Skip to content

Configure Renovate #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .python-version
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
3.11.6
12 changes: 11 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1 +1,11 @@
# parse-csv-sample
# Lab Bank CSVエクスポートデータ活用サンプル

本リポジトリは[Lab Bank](https://labbank.jp/)で出力されたCSVエクスポートデータを活用するための、サンプルコードを格納しております。

```
.
├── README.md ... 本ドキュメント
├── export ... サンプルコード向けのダミーのエクスポートデータ
├── libs ... pandasを簡単に扱うための関数
└── sample.ipynb ... サンプルコード
```
5 changes: 5 additions & 0 deletions export/project.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
project.__id,project.__record_name,project.client_name,project.deadline,project.purpose,project.memo
プロジェクト.ID,プロジェクト.プロジェクト名,プロジェクト.顧客名,プロジェクト.期限,プロジェクト.目的,プロジェクト.メモ
text,text,text,date,text,text
df9d5402-218b-4d0d-87f0-c486340896ea,test,test,2024/5/29,aaaaa,
cfd451e2-8e25-4632-9890-33695f583ac6,test2,test2,2024/5/22,test2,test2
6 changes: 6 additions & 0 deletions export/theme_b_breaking_evaluation_conditions.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
theme_b_breaking_evaluation_conditions.__id,theme_b_breaking_evaluation_conditions.speed,theme_b_breaking_evaluation_conditions.wet_road,theme_b_breaking_evaluation_conditions.vehicle
制動性能評価.条件ID,制動性能評価.開始速度,制動性能評価.ウェット路面,制動性能評価.試験車両
text,number,boolean,text
43dcdd39-f9ed-456c-b1bc-17918e866061,60,true,10daf7c0-941a-42e9-8913-07cb65ad6e81
e187d3b1-e610-49b3-9879-fd070b792ed3,80,true,10daf7c0-941a-42e9-8913-07cb65ad6e81
35960a3e-5d72-482b-82ae-f8b068a65a4d,100,true,10daf7c0-941a-42e9-8913-07cb65ad6e81
33 changes: 33 additions & 0 deletions export/theme_b_breaking_evaluation_results.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
theme_b_breaking_evaluation_results.__id,theme_b_breaking_evaluation_results.condition_id,make_form.__id,theme_b_breaking_evaluation_results.distance,theme_b_breaking_evaluation_results.duration,theme_b_breaking_evaluation_results.uneven_wear,theme_b_breaking_evaluation_results.squeal_sound,theme_b_breaking_evaluation_results.date,theme_b_breaking_evaluation_results.image
制動性能評価.結果ID,制動性能評価.条件ID,成形.ID,制動性能評価.制動距離,制動性能評価.制動時間,制動性能評価.偏摩耗,制動性能評価.スキール音,制動性能評価.実施日,制動性能評価.参考画像
text,text,text,number,number,boolean,number,date,number
293936ec-8ff5-45be-92ff-72fe55863827,43dcdd39-f9ed-456c-b1bc-17918e866061,3277d707-df85-4444-b3ef-10b988e005a6,11.3,9.8,false,10,2024/5/12,
f9a570f4-ff37-45de-9ae3-732812c1bb39,43dcdd39-f9ed-456c-b1bc-17918e866061,82a44f81-0f9e-43ed-8b42-3b774a5a3124,12.45,10.5,false,11,2024/5/13,
0bba79e4-5061-4833-83a6-08af83fb89ee,43dcdd39-f9ed-456c-b1bc-17918e866061,b51ad19f-34dd-4e2d-971e-31494e5b0b7f,11.98,10.7,false,12,2024/5/14,
4aacfc15-2a8e-4b5a-ae8c-111ec02bde94,43dcdd39-f9ed-456c-b1bc-17918e866061,193a304b-2e7b-4b01-8bb2-6aff8ff7df5f,11.22,11.2,false,13,2024/5/15,
7623f093-5087-4123-b5ce-ce2023e23174,43dcdd39-f9ed-456c-b1bc-17918e866061,0542caed-ebe0-47c2-8a9e-ec9dc137853c,10.8,9.6,false,11,2024/5/16,
af1b1a19-5933-4c20-9ec5-c092814854ef,e187d3b1-e610-49b3-9879-fd070b792ed3,3277d707-df85-4444-b3ef-10b988e005a6,12.56,11.8,false,15,2024/5/17,
794ee15d-ddbc-427a-9063-1e4be7349e4e,e187d3b1-e610-49b3-9879-fd070b792ed3,82a44f81-0f9e-43ed-8b42-3b774a5a3124,13.45,12.5,false,18,2024/5/18,
96ce3777-7b4e-4ccf-a754-d312c2e45322,e187d3b1-e610-49b3-9879-fd070b792ed3,b51ad19f-34dd-4e2d-971e-31494e5b0b7f,14.22,14.5,false,14,2024/5/19,
82caf155-af9b-4df3-adc9-e8641a6e0e6f,e187d3b1-e610-49b3-9879-fd070b792ed3,193a304b-2e7b-4b01-8bb2-6aff8ff7df5f,13.15,12.8,false,12,2024/5/20,
bab92498-1a40-4544-9ad7-79a0b1f97966,e187d3b1-e610-49b3-9879-fd070b792ed3,0542caed-ebe0-47c2-8a9e-ec9dc137853c,14.5,12.9,false,11,2024/5/21,
f8f3955f-e371-4cbe-9934-d77ce51dc425,35960a3e-5d72-482b-82ae-f8b068a65a4d,3277d707-df85-4444-b3ef-10b988e005a6,20.5,19.5,false,18,2024/5/22,
4b49cf8c-6b17-47b4-affa-4948128e0633,35960a3e-5d72-482b-82ae-f8b068a65a4d,82a44f81-0f9e-43ed-8b42-3b774a5a3124,19.81,16.3,false,19,2024/5/23,
8f448e34-ba9a-4225-8259-77745eea9314,35960a3e-5d72-482b-82ae-f8b068a65a4d,b51ad19f-34dd-4e2d-971e-31494e5b0b7f,21.45,18.5,true,24,2024/5/24,
ee3286eb-3ec8-4ff6-8702-45d72502feaf,35960a3e-5d72-482b-82ae-f8b068a65a4d,193a304b-2e7b-4b01-8bb2-6aff8ff7df5f,24.5,20.1,true,26,2024/5/25,
7a08f765-d6f9-491b-8866-085f1e72cfbf,35960a3e-5d72-482b-82ae-f8b068a65a4d,0542caed-ebe0-47c2-8a9e-ec9dc137853c,25.6,19.5,true,28,2024/5/26,
2e23a4c8-46be-4d6a-b3af-493f23503aa5,43dcdd39-f9ed-456c-b1bc-17918e866061,229d1635-2af7-4bab-9c14-c610a7cc9aaf,9.98,8.55,false,9.8,2024/5/27,
776d1d18-6f39-4862-9045-3aac78645bdb,43dcdd39-f9ed-456c-b1bc-17918e866061,5a1e704e-c53e-4b91-b7f4-74782f9bf153,10.12,9.3,false,9.6,2024/5/28,
23da5cd4-c04d-486b-a554-9793cec77439,43dcdd39-f9ed-456c-b1bc-17918e866061,d9a8b647-4591-46f5-a6d5-a8d10b74c81b,10.88,8.9,false,10.34,2024/5/29,
4ee66c1b-9fc3-4e19-b4c6-4a9ade04f655,43dcdd39-f9ed-456c-b1bc-17918e866061,39109815-1f26-41d3-ad70-50201cc2c674,9.99,8.56,false,12.5,2024/5/30,
c79d22c4-988a-4354-b2d6-e2ce624d7a8b,43dcdd39-f9ed-456c-b1bc-17918e866061,0542caed-ebe0-47c2-8a9e-ec9dc137853c,10.54,9.5,false,11.5,2024/5/31,
007f85cd-9576-4ac8-ba9b-cf492185521c,e187d3b1-e610-49b3-9879-fd070b792ed3,229d1635-2af7-4bab-9c14-c610a7cc9aaf,11.9,10,false,15,2024/6/1,
e875854a-15f2-4a4c-954b-f0478859669f,e187d3b1-e610-49b3-9879-fd070b792ed3,5a1e704e-c53e-4b91-b7f4-74782f9bf153,12.86,11.5,false,16,2024/6/2,
93a4c21b-db3b-44e7-97f8-c027171f2605,e187d3b1-e610-49b3-9879-fd070b792ed3,d9a8b647-4591-46f5-a6d5-a8d10b74c81b,13.33,12.4,false,17,2024/6/3,
13e6d8a7-5836-4de1-b5e6-b75f8426be92,e187d3b1-e610-49b3-9879-fd070b792ed3,39109815-1f26-41d3-ad70-50201cc2c674,12.55,11,false,14,2024/6/4,
868e3362-276f-4bd1-8549-154e11c4f672,e187d3b1-e610-49b3-9879-fd070b792ed3,0542caed-ebe0-47c2-8a9e-ec9dc137853c,13.8,12.5,false,15,2024/6/5,
9d762953-2710-4c07-ac94-69093bcc76d4,35960a3e-5d72-482b-82ae-f8b068a65a4d,229d1635-2af7-4bab-9c14-c610a7cc9aaf,19.55,18.5,false,14,2024/6/6,
5ea3c8fd-f025-44b9-ae34-57b3a2a3a78d,35960a3e-5d72-482b-82ae-f8b068a65a4d,5a1e704e-c53e-4b91-b7f4-74782f9bf153,19,18.2,false,14,2024/6/7,
fa8a4676-b181-4036-9932-6a424bf1a912,35960a3e-5d72-482b-82ae-f8b068a65a4d,d9a8b647-4591-46f5-a6d5-a8d10b74c81b,20.53,19.2,true,26,2024/6/8,
626d1544-0e48-4da9-aecb-517a83b36e73,35960a3e-5d72-482b-82ae-f8b068a65a4d,39109815-1f26-41d3-ad70-50201cc2c674,23.22,20.1,true,33,2024/6/9,
5895591c-2123-4762-9bc7-07d7555a8552,35960a3e-5d72-482b-82ae-f8b068a65a4d,0542caed-ebe0-47c2-8a9e-ec9dc137853c,24.5,22.5,true,32,2024/6/10,
8 changes: 8 additions & 0 deletions export/theme_b_carbon_black.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
theme_b_carbon_black.__id,theme_b_carbon_black.name,theme_b_carbon_black.param1,theme_b_carbon_black.param2,theme_b_carbon_black.maker
カーボンブラック.ID,カーボンブラック.名前,カーボンブラック.物性1,カーボンブラック.物性2,カーボンブラック.製造元
text,text,number,number,text
1c9acec0-fe04-4c11-960e-ef1c50edb503,carbon_black1,100,38,ef47e88b-c316-4503-9e62-1597778a72c0
b29bd7a2-a6d5-4c0a-b0a0-24c6e878d681,carbon_black2,120,40,1ac9039b-ac81-4b9c-8f22-3c285adcb508
1be837e0-a159-4e95-9cfb-f06ada79e8cc,carbon_black3,98,42,838ec269-6d25-4f14-81bd-b09e14da4ade
c9b28d45-c80c-4bdc-b8d2-ad75fb67c403,carbon_black4,121,39,24cbf099-108a-4ce1-a6c9-4f96e636734d
38dbf93a-5ae1-4a70-a671-ec6533a1b2a5,carbon_black5,94.5,36,eacb7a51-9eb4-45e1-932c-72711fea02c1
13 changes: 13 additions & 0 deletions export/theme_b_make_form.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
theme_b_make_form.__id,dependencyDevStep.__id,theme_b_make_form.tread_width,theme_b_make_form.carcass_length
成形.ID,前工程.ID,成形.トレッド幅,成形.カーカス長
text,text,number,number
3277d707-df85-4444-b3ef-10b988e005a6,2ed6f86e-9e23-4baa-ae57-33ef1817e160,225,450
82a44f81-0f9e-43ed-8b42-3b774a5a3124,e51ee3f1-2ef9-4685-9bb1-717dedecd32a,225,450
b51ad19f-34dd-4e2d-971e-31494e5b0b7f,7ffb28c8-ad14-42f2-938b-c83bc2c2eae9,225,450
193a304b-2e7b-4b01-8bb2-6aff8ff7df5f,f56206b8-1766-4d3e-85f9-3eea07661c45,225,450
0542caed-ebe0-47c2-8a9e-ec9dc137853c,66c2148c-df73-4896-b4b0-5e83aedb3f7a,225,450
229d1635-2af7-4bab-9c14-c610a7cc9aaf,2ed6f86e-9e23-4baa-ae57-33ef1817e160,230,450
5a1e704e-c53e-4b91-b7f4-74782f9bf153,e51ee3f1-2ef9-4685-9bb1-717dedecd32a,230,450
d9a8b647-4591-46f5-a6d5-a8d10b74c81b,7ffb28c8-ad14-42f2-938b-c83bc2c2eae9,230,450
39109815-1f26-41d3-ad70-50201cc2c674,f56206b8-1766-4d3e-85f9-3eea07661c45,230,450
1dd85480-95d5-4383-b998-0709e6eaf020,66c2148c-df73-4896-b4b0-5e83aedb3f7a,230,450
8 changes: 8 additions & 0 deletions export/theme_b_maker.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
theme_b_maker.__id,theme_b_maker.name
製造元.ID,製造元.社名
text,text
ef47e88b-c316-4503-9e62-1597778a72c0,Aidemy
1ac9039b-ac81-4b9c-8f22-3c285adcb508,Bidemy
838ec269-6d25-4f14-81bd-b09e14da4ade,Cidemy
24cbf099-108a-4ce1-a6c9-4f96e636734d,Didemy
eacb7a51-9eb4-45e1-932c-72711fea02c1,Eidemy
22 changes: 22 additions & 0 deletions export/theme_b_recipe_material_amounts.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
theme_b_recipe_material_amounts.__id,theme_b_recipe_material_amounts.__sub_recipe_id,theme_b_recipe_material_amounts.__master_name,theme_b_recipe_material_amounts.__master_id,theme_b_recipe_material_amounts.amount
レシピ.ID,レシピ.サブレシピID,レシピ.材料マスタ,レシピ.材料マスタID,レシピ.分量
text,text,text,text,text
137bb1d9-4132-4044-9e30-1463f5967079,b12cd3a9-2b87-4aea-964a-4e64f4bdf0cc,theme_b_rubber,aa610527-eb34-4430-bbc0-fb1bbfb3f27d,100
e770e3ca-6721-4b13-af09-7fc991c99110,b12cd3a9-2b87-4aea-964a-4e64f4bdf0cc,theme_b_carbon_black,c9b28d45-c80c-4bdc-b8d2-ad75fb67c403,50
f0a33669-3b15-41e4-9783-9294c33fdd1f,45c3aafd-d8ed-418f-8ac4-60a6bacc4e06,theme_b_rubber,aa610527-eb34-4430-bbc0-fb1bbfb3f27d,80
be83a8c0-5999-4362-b8de-828ab10491d6,45c3aafd-d8ed-418f-8ac4-60a6bacc4e06,theme_b_carbon_black,c9b28d45-c80c-4bdc-b8d2-ad75fb67c403,70
3113a3ab-8c50-416f-9131-bbbc5feb3887,07c6f1a1-2032-40dc-9f3e-b8102915a981,theme_b_rubber,aa610527-eb34-4430-bbc0-fb1bbfb3f27d,70
67ea7357-874d-4d5f-af35-d3311773ae68,07c6f1a1-2032-40dc-9f3e-b8102915a981,theme_b_carbon_black,c9b28d45-c80c-4bdc-b8d2-ad75fb67c403,40
62551a2c-c73d-411f-8b47-cfd559cff1c5,07c6f1a1-2032-40dc-9f3e-b8102915a981,theme_b_carbon_black,1be837e0-a159-4e95-9cfb-f06ada79e8cc,40
7846d7de-588d-4f6b-8aa5-9c4e14fe36d7,f0c69b4b-235b-446b-ba8d-13a210cfd19d,theme_b_rubber,aa610527-eb34-4430-bbc0-fb1bbfb3f27d,50
9f2f5325-8702-4f28-8c6a-aadabd35c6b5,f0c69b4b-235b-446b-ba8d-13a210cfd19d,theme_b_carbon_black,c9b28d45-c80c-4bdc-b8d2-ad75fb67c403,20
94521e16-662b-492f-bae3-d4ca0280a471,f0c69b4b-235b-446b-ba8d-13a210cfd19d,theme_b_carbon_black,1be837e0-a159-4e95-9cfb-f06ada79e8cc,30
3f8d58c5-3b99-48b6-90f3-f3189d90da98,f0c69b4b-235b-446b-ba8d-13a210cfd19d,theme_b_rubber,df2225e3-67d4-4670-9dcb-5bfd0e42bc7b,50
51e1fd6b-20ff-4413-857e-1af5eb0fe1e8,f5047c36-d953-459f-b681-464fd43b2c1d,theme_b_carbon_black,c9b28d45-c80c-4bdc-b8d2-ad75fb67c403,50
a0defa20-c751-4510-b879-99343c9a8d98,f5047c36-d953-459f-b681-464fd43b2c1d,theme_b_rubber,df2225e3-67d4-4670-9dcb-5bfd0e42bc7b,100
72ae2e2f-3b3f-4138-b0b9-6524daed796f,71cf5a34-ecf5-4481-828d-ab48b00ec23d,theme_b_rubber,df2225e3-67d4-4670-9dcb-5bfd0e42bc7b,30
6acef913-c0b8-4872-8a5f-8f8bdb0d05d3,71cf5a34-ecf5-4481-828d-ab48b00ec23d,theme_b_carbon_black,b29bd7a2-a6d5-4c0a-b0a0-24c6e878d681,10
0d0d1771-d0b8-47ac-989e-87ffa52147fa,09687ba8-6c96-4d74-a83d-bd875bbc73d5,theme_b_rubber,df2225e3-67d4-4670-9dcb-5bfd0e42bc7b,30
41a65d10-350f-4b28-ad50-48357e691db7,09687ba8-6c96-4d74-a83d-bd875bbc73d5,theme_b_carbon_black,1c9acec0-fe04-4c11-960e-ef1c50edb503,10
6d4a71bb-52d7-4c6e-bec7-d92bf071bfc1,ca89ec11-ef1f-4141-8826-9fef6ab8739d,theme_b_rubber,df2225e3-67d4-4670-9dcb-5bfd0e42bc7b,20
671affa3-666f-4dd0-a24e-c8bd607710fb,ca89ec11-ef1f-4141-8826-9fef6ab8739d,theme_b_carbon_black,1c9acec0-fe04-4c11-960e-ef1c50edb503,15
8 changes: 8 additions & 0 deletions export/theme_b_recipe_recipes.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
theme_b_recipe_recipes.__id,theme_b_recipe_recipes.__recipe_name,project.__id,theme_b_recipe_recipes.temp,theme_b_recipe_recipes.additive
レシピ.ID,レシピ.レシピ名,プロジェクト.ID,レシピ.温度,レシピ.添加剤
text,text,text,number,boolean
2ed6f86e-9e23-4baa-ae57-33ef1817e160,レシピ1,df9d5402-218b-4d0d-87f0-c486340896ea,150,true
e51ee3f1-2ef9-4685-9bb1-717dedecd32a,レシピ2,df9d5402-218b-4d0d-87f0-c486340896ea,150,false
7ffb28c8-ad14-42f2-938b-c83bc2c2eae9,レシピ3,df9d5402-218b-4d0d-87f0-c486340896ea,200,true
f56206b8-1766-4d3e-85f9-3eea07661c45,レシピ4,df9d5402-218b-4d0d-87f0-c486340896ea,200,false
66c2148c-df73-4896-b4b0-5e83aedb3f7a,レシピ5,df9d5402-218b-4d0d-87f0-c486340896ea,120,true
13 changes: 13 additions & 0 deletions export/theme_b_recipe_sub_recipes.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
theme_b_recipe_sub_recipes.__id,theme_b_recipe_recipes.__id,theme_b_recipe_sub_recipes.__name,theme_b_recipe_sub_recipes.additive
レシピ.サブレシピID,レシピ.レシピID,レシピ.サブレシピ名,レシピ.添加剤
text,text,text,boolean
b12cd3a9-2b87-4aea-964a-4e64f4bdf0cc,2ed6f86e-9e23-4baa-ae57-33ef1817e160,配合ステップ1,false
45c3aafd-d8ed-418f-8ac4-60a6bacc4e06,e51ee3f1-2ef9-4685-9bb1-717dedecd32a,配合ステップ1,false
07c6f1a1-2032-40dc-9f3e-b8102915a981,7ffb28c8-ad14-42f2-938b-c83bc2c2eae9,配合ステップ1,true
f0c69b4b-235b-446b-ba8d-13a210cfd19d,f56206b8-1766-4d3e-85f9-3eea07661c45,配合ステップ1,true
f5047c36-d953-459f-b681-464fd43b2c1d,66c2148c-df73-4896-b4b0-5e83aedb3f7a,配合ステップ1,false
71cf5a34-ecf5-4481-828d-ab48b00ec23d,2ed6f86e-9e23-4baa-ae57-33ef1817e160,配合ステップ2,true
a0a85502-aca2-4efa-bdac-4631b9366b35,e51ee3f1-2ef9-4685-9bb1-717dedecd32a,配合ステップ2,false
09687ba8-6c96-4d74-a83d-bd875bbc73d5,7ffb28c8-ad14-42f2-938b-c83bc2c2eae9,配合ステップ2,true
200a639c-4973-4f4a-ac13-b4d90870232e,f56206b8-1766-4d3e-85f9-3eea07661c45,配合ステップ2,false
ca89ec11-ef1f-4141-8826-9fef6ab8739d,66c2148c-df73-4896-b4b0-5e83aedb3f7a,配合ステップ2,true
8 changes: 8 additions & 0 deletions export/theme_b_rubber.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
theme_b_rubber.__id,theme_b_rubber.name,theme_b_rubber.param1,theme_b_rubber.param2,theme_b_rubber.maker
ゴム.ID,ゴム.名前,ゴム.物性1,ゴム.物性2,ゴム.製造元
text,text,number,number,text
aa610527-eb34-4430-bbc0-fb1bbfb3f27d,rubber1,50,12,ef47e88b-c316-4503-9e62-1597778a72c0
df2225e3-67d4-4670-9dcb-5bfd0e42bc7b,rubber2,80,11.5,1ac9039b-ac81-4b9c-8f22-3c285adcb508
00c40efd-3a6b-46fd-9d9b-89c3af0b277c,rubber3,88,22.1,838ec269-6d25-4f14-81bd-b09e14da4ade
5c7bcbc8-9dd6-4757-b29d-c3643c07612a,rubber4,90,18.6,24cbf099-108a-4ce1-a6c9-4f96e636734d
4f581462-34b2-40b5-9488-0de1b17ec7de,rubber5,56.3,11,eacb7a51-9eb4-45e1-932c-72711fea02c1
5 changes: 5 additions & 0 deletions export/theme_b_vehicle.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
theme_b_vehicle.__id,theme_b_vehicle.name,theme_b_vehicle.weight
試験車両.ID,試験車両.車体番号,試験車両.車体重量
text,text,number
b63d5516-89ad-4f19-b98d-da67d1de5d97,001,1200
10daf7c0-941a-42e9-8913-07cb65ad6e81,002,1480
33 changes: 33 additions & 0 deletions libs/combine.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
import pandas as pd


def merge_columns_df(df: pd.DataFrame, target_keys: list[str], merged_key: str) -> pd.DataFrame:
"""
target_keysで指定された列を結合し、新しくmerged_keyで指定された列を作成する。
同じ行の中でNaNではない値が存在する場合はそれを採用する、そのため欠損値がNaN以外の場合は動作しない。
複数の列でNaN以外が存在する場合は、target_keysのインデックスが小さい値が優先される。
また関数が実行されると、引数で渡されたdfの元の変数も書き換わる。

ex.
--- code ---
df = pd.DataFrame({
'a': [1, 2, 3],
'b': [4, NaN, 6],
'c': [NaN, 8, NaN]
})
merge_columns_df(df, ['b', 'c'], 'd')
print(df)

--- output ---
0 a d
1 1 4
2 2 8
3 3 6
"""

def merge_value(row: pd.Series) -> str:
return list(filter(lambda v: not pd.isna(v), [row[k] for k in target_keys]))[0]

df[merged_key] = df.apply(merge_value, axis=1)
df.drop(target_keys, axis=1, inplace=True)
return df
39 changes: 39 additions & 0 deletions libs/read_csv.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
import pandas as pd


def csv_to_df(path: str):
"""
CSVデータを読み込んでpandasのDataFrameに変換する
"""

# CSVは3行のヘッダがある
# 英語カラム名: CSVの中で一意、操作やクエリの実行は英語カラム名を指定
# 日本語カラム名: CSVの中で一意ではないため操作やクエリには使わない、表示などに使用する
# 型: text, number, dateなどそれぞれの値をどういった型として扱うべきかを示す

# CSVの型表記とpandasのdtype表記の対応
to_dtype = {
"number": "float",
"boolean": "bool",
"text": "object",
"date": "object",
"datetime": "object",
}
type_df = (pd.read_csv(path, header=0, na_filter=True))[1:2]
dtypes = {k: to_dtype[type_df[k][1]] for k in type_df.columns}

# データフレームのヘッダとして扱うのは0=1行目、以降2行(日本語カラム名、型)を読み飛ばし
data = pd.read_csv(path, header=0, na_filter=True).drop([0, 1])
return data.astype(dtypes)


def key_to_display_name(paths: list[str]):
"""
DataFrameのヘッダと表示用の日本語表記の対応を辞書型で返す
"""
res = dict()
for p in paths:
df = pd.read_csv(p, header=0, na_filter=True)[0:1]
for k in df.columns:
res[k] = df[k][0]
return res
6 changes: 6 additions & 0 deletions renovate.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
{
"$schema": "https://docs.renovatebot.com/renovate-schema.json",
"extends": [
"config:recommended"
]
}
612 changes: 612 additions & 0 deletions sample.ipynb

Large diffs are not rendered by default.