Add more industry data #211

danielelerede-oet · 2025-04-15T16:55:20Z

Changes proposed in this Pull Request

Added BF-BOF steelmaking technology
Separated "direct iron reduction furnace" and "hydrogen direct iron reduction furnace" steelmaking technologies (the previous "direct iron reduction furnace" used hydrogen as input commodity but that's not the standard). This shouldn't imply changes to PyPSA-Eur / PyPSA-Earth as steelmaking is currently not modelled in an explicit way
Add cement production route (cement dry clinker + cement finishing)
Add 2 ethanol production routes (ethanol from starch crop for US- and EUR-based production, ethanol from sugar crop for Brazilian-based production)

Checklist

Code changes are sufficiently documented; i.e. new functions contain docstrings and further explanations may be given in doc.
Data source for new technologies is clearly stated.
Newly introduced dependencies are added to environment.yaml (if applicable).
A note for the release notes doc/release_notes.rst of the upcoming release is included.
I consent to the release of this PR's code under the GPLv3 license.

…crops

danielelerede-oet · 2025-05-07T16:29:59Z

Latest updates envisage:

Fixed unit of measurement for VOM (from %/year to EUR/MWh)
Fixed steel data (iron ore/scrap input for BF-BOF)
Changed all investment cost units to EUR/capacity/h for steel, clinker, cement and ethanol
Added bioethanol crops CO2 intensity
Removed electricity input for traditional DRI as electricity-input for DRI-EAF - electricity-input for EAF = (almost) 0 in the source

cc @yerbol-akhmetov

euronion

I tried to cross-check a few numbers with limited success. Could you help me and future us locate them?

We also need to avoid breaking changes from changing value e.g. for DRI HBI demand.

Could you also please merge with master and rerun snakemake, since there have been a few changes since the branch was created?

Thanks!

inputs/manual_input.csv

euronion · 2025-05-14T07:59:03Z

inputs/manual_input.csv

@@ -371,6 +377,7 @@ bioethanol crops,fuel,2020,54.6434100368518,EUR/MWhth,2010,"JRC ENSPRESO ca avg
 bioethanol crops,fuel,2030,72.477665790641,EUR/MWhth,2010,"JRC ENSPRESO ca avg for MINBIOCRP11 (Bioethanol barley, wheat, grain maize, oats, other cereals and rye), ENS_BaU_GFTM",
 bioethanol crops,fuel,2040,75.7178710725453,EUR/MWhth,2010,"JRC ENSPRESO ca avg for MINBIOCRP11 (Bioethanol barley, wheat, grain maize, oats, other cereals and rye), ENS_BaU_GFTM",
 bioethanol crops,fuel,2050,78.995541440487,EUR/MWhth,2010,"JRC ENSPRESO ca avg for MINBIOCRP11 (Bioethanol barley, wheat, grain maize, oats, other cereals and rye), ENS_BaU_GFTM",
+bioethanol crops,CO2 intensity,2020,0.25704,tCO2/MWh_th,,"JRC, 01_JRC-EU-TIMES Full model, https://zenodo.org/records/3544900, file `Scen_EmisCO2.xls`). Original value 71.4 g CO2/MJ",


This value is based on the Well-to-Wheel numbers from the Excel, is that what you really wanted? Maybe add some more description what this means to avoid misinterpretation. E.g. It could also be the CO2 intensity of only the agricultural activity for bioethanol crops (not used for transport fuels).

add the sheet name from where you got the number, so the next person doesn't have to search through the Excel file sheet by sheet ;)

Suggested change

bioethanol crops,CO2 intensity,2020,0.25704,tCO2/MWh_th,,"JRC, 01_JRC-EU-TIMES Full model, https://zenodo.org/records/3544900, file `Scen_EmisCO2.xls`). Original value 71.4 g CO2/MJ",

bioethanol crops,CO2 intensity,2020,0.25704,tCO2/MWh_th,,"JRC, 01_JRC-EU-TIMES Full model, https://zenodo.org/records/3544900, file `Scen_EmisCO2.xls`. Original value 71.4 g CO2/MJ",

Surplus bracket ;)

Thanks for the observation, @euronion ! Definitely an update is required here. I'm currently using the value obtained from the stoichiometric CO2 yield of ethanol fermentation, based on a lower heating value (LHV) of 26.7 MJ/kg to obtain the theoretically capturable biogenic CO2.

Shouldn't it be negative in that case? Since the bioethanol crops is absorbing the carbon, not emitting? Emissions happens where the energy service is provided.

Sure, in the implementation in PyPSA-Earth this CO2 intensity value is used to obtain the value of CO2_stored obtained from a CCS-equipped ethanol production plant (thus providing actual "negative" emissions), but it should be ok if it's positive here, as it is for all other carriers reporting a CO2 intensity.

inputs/manual_input.csv

… of natural gas direct iron reduction furnace

euronion

One more round. Information is ok-ish, I'm not sure on some entries. Let's blame the
the Excel files from TIMES are not nice to navigate :/

inputs/manual_input.csv

euronion · 2025-05-14T15:52:52Z

inputs/manual_input.csv

@@ -371,6 +377,7 @@ bioethanol crops,fuel,2020,54.6434100368518,EUR/MWhth,2010,"JRC ENSPRESO ca avg
 bioethanol crops,fuel,2030,72.477665790641,EUR/MWhth,2010,"JRC ENSPRESO ca avg for MINBIOCRP11 (Bioethanol barley, wheat, grain maize, oats, other cereals and rye), ENS_BaU_GFTM",
 bioethanol crops,fuel,2040,75.7178710725453,EUR/MWhth,2010,"JRC ENSPRESO ca avg for MINBIOCRP11 (Bioethanol barley, wheat, grain maize, oats, other cereals and rye), ENS_BaU_GFTM",
 bioethanol crops,fuel,2050,78.995541440487,EUR/MWhth,2010,"JRC ENSPRESO ca avg for MINBIOCRP11 (Bioethanol barley, wheat, grain maize, oats, other cereals and rye), ENS_BaU_GFTM",
+bioethanol crops,CO2 intensity,2020,0.25704,tCO2/MWh_th,,"JRC, 01_JRC-EU-TIMES Full model, https://zenodo.org/records/3544900, file `Scen_EmisCO2.xls`). Original value 71.4 g CO2/MJ",


Shouldn't it be negative in that case? Since the bioethanol crops is absorbing the carbon, not emitting? Emissions happens where the energy service is provided.

inputs/manual_input.csv

euronion · 2025-05-14T16:04:31Z

inputs/manual_input.csv

+cement dry clinker,gas-input,2020,1.9,MWh_NG/t_clinker,2020,"JRC, 01_JRC-EU-TIMES Full model, https://zenodo.org/records/3544900, file `SubRES_15_TECHS_CHP_SUP_IND.xlsx`, Sheet `IND` (ICMDRYPRD01, ICM.Dry Process Production.01)",
+cement dry clinker,electricity-input,2020,30,MWh_el/t_clinker,2020,"JRC, 01_JRC-EU-TIMES Full model, https://zenodo.org/records/3544900, file `SubRES_15_TECHS_CHP_SUP_IND.xlsx`, Sheet `IND` (ICMDRYPRD01, ICM.Dry Process Production.01)",


I'm trying to understand the units for INDGAS and INDELC.
Also what does ICMPRC and INDCOK indicate?

INDGAS and INDELC input should be in PJ/Mt (because all INDGAS and INDELC are in PJ and the output commodity MCMCLK in Mt). You can retrieve the information regarding all the units related to all the commodities and technologies in the tables at the bottom of the same sheet where data are listed (let's blame again the Excel files from TIMES that are definitely not nice to navigate)

ICMPRC is the Process cement heat and INDCOK is coke (but that's zero for dry clinker).

However, I'm having strong doubts now because I see the values in PJ/Mt don't match the values I put in the manual_input file. I need further checks. Also, I'm missing the process heat input, and I don't really understand/remember the reason why

@euronion I checked again and made a few changes. My suspect is that there were some mistakes in fetching the right values from the Excel file but now everything should be fine. I also added heat input for dry clinker production, which was not taken into account before. For cement finishing, the source now is the Trans file as it's mentioned as the used input source for values in the JRC model.

inputs/manual_input.csv

Co-authored-by: Johannes HAMPP <[email protected]>

euronion

Thanks a lot @danielelerede-oet .

We're slowly getting there! :)

inputs/manual_input.csv

Co-authored-by: Johannes HAMPP <[email protected]>

inputs/manual_input.csv

euronion · 2025-05-15T16:19:37Z

outputs/costs_2020.csv

+Suited for Brazilian production, original value 501.0876  MEUR/GW INVCOST~2020; and
+Suited for Brazilian production, original value 454.9348 MEUR/GW INVCOST~2025; and
+Suited for Brazilian production, original value 421.9685 MEUR/GW INVCOST~2030",2015.0
+ethanol from sugar crops,lifetime,20.0,years,"JRC, 01_JRC-EU-TIMES Full model, https://zenodo.org/records/3544900, file `SubRES_10_TECHS_CHP_SUP_IND.xlsx` and `SubRES_10_TECHS_CHP_SUP_IND_Trans.xlsx` (BCRPETH201, Ethanol production from sugar crops ) and currency year from file `SysSettings.xls`, sheet `Constants`, Attribute `G_Dyear` = 2015.",Suited for Brazilian production,2015.0


There is some weirdness going on when the output files are created - this information should be in one line, not in dedicated lines.

This should be the last thing to fix (I hope)

euronion · 2025-05-15T16:21:23Z

@danielelerede-oet I've directly added and committed some info that I think we should also add for traceability, please check the latest commit.

Also there is something wrong in the output csv files, that needs to be fixed.

Else looking good - as soon as my changes are deemed ok or adjusted and the csv outputs are fixed, this is RTM.

danielelerede-oet · 2025-05-16T09:26:42Z

Hi @euronion ! The bug in the output .csv files is due to line 2702 in compile_cost_assumptions.py. I tried to avoid the concatenation of rows in further description, but that solves the issues on ethanol production technologies while causing issues with other entries. Therefore, for the moment I preferred getting around the obstacle removing a few details you added, while trying to preserve a good quality in the description of original data.

euronion · 2025-05-19T09:56:33Z

Thanks @danielelerede-oet . I've removed the weird newline in the processing script, but I'll keep your shortened descriptions. Thanks for updating them!

Looking good, proceeding to merge. Thanks a lot for this contribution! :)

danielelerede-oet added 5 commits April 15, 2025 15:28

separate traditional DRI and hydrogen-based DRI

bb80783

add BF-BOF technology

4d298eb

restore decimal digits for iron-air batter

22e8a30

add ethanol and cement production technologies

e04375c

update release notes

9ebfdfa

danielelerede-oet marked this pull request as ready for review April 16, 2025 13:16

danielelerede-oet mentioned this pull request Apr 16, 2025

Industrial CCS retrofits data #212

Merged

5 tasks

danielelerede-oet added 4 commits April 17, 2025 11:40

add scrap input for EAF

dda18d7

fix steel data, change unit for VOM and add CO2 intensity bioethanol …

61e84e9

…crops

fix MWh capital letters

981daf1

uniform investment values for industry to EUR/capacity/h

40017c3

danielelerede-oet added 2 commits May 7, 2025 18:32

run compile_cost_assumptions

3c4fc4b

correct data and units for ethanol

79c13bf

euronion self-requested a review May 12, 2025 15:30

euronion requested changes May 14, 2025

View reviewed changes

danielelerede-oet added 5 commits May 14, 2025 11:57

merge changes in master branch

a305160

add explanation on direct iron reduction name changes and modify name…

0dd484f

… of natural gas direct iron reduction furnace

review CO2 intensity bioethanol crops

b9c8f37

review steel data

aa0815a

review source of ethanol and cement data

ba7434e

euronion requested changes May 14, 2025

View reviewed changes

danielelerede-oet and others added 5 commits May 14, 2025 19:04

Update inputs/manual_input.csv

8f4d076

Co-authored-by: Johannes HAMPP <[email protected]>

Update JRC file name

cc9ee07

Co-authored-by: Johannes HAMPP <[email protected]>

corrections

244aa45

update reference year for new technologies

923c110

corrections on energy inputs for cement and clinker

49c3b1d

euronion requested changes May 15, 2025

View reviewed changes

inputs/manual_input.csv Outdated Show resolved Hide resolved

inputs/manual_input.csv Outdated Show resolved Hide resolved

inputs/manual_input.csv Outdated Show resolved Hide resolved

inputs/manual_input.csv Outdated Show resolved Hide resolved

danielelerede-oet and others added 2 commits May 15, 2025 14:12

Update details on cement finishing inputs

6d0ece0

Co-authored-by: Johannes HAMPP <[email protected]>

Update dry clinker reference year, investment and source details

6a25fd5

Co-authored-by: Johannes HAMPP <[email protected]>

danielelerede-oet and others added 5 commits May 15, 2025 14:35

update fixom for ethanol production

53d093c

Co-authored-by: Johannes HAMPP <[email protected]>

update cost values ethanol and details on sources

b3885b1

update cement inputs

2bbc94f

update cement finishing slag input

c7cfb7c

Merge branch 'master' into add_more_industry_data

5a1ce51

euronion reviewed May 15, 2025

View reviewed changes

inputs/manual_input.csv Outdated Show resolved Hide resolved

danielelerede-oet and others added 2 commits May 15, 2025 16:42

update ethanol costs and currency year for JRC

1b62349

Add source information on details (stochimetry, currency year)

d3f6850

euronion reviewed May 15, 2025

View reviewed changes

fix further description bug on ethanol production technologies

e650d7b

correct name electric arc furnace with hbi and scrap

bc30c18

euronion mentioned this pull request May 19, 2025

No newline in concatenated further description #219

Merged

3 tasks

euronion merged commit ea6c7c6 into PyPSA:master May 19, 2025
3 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add more industry data #211

Add more industry data #211

danielelerede-oet commented Apr 15, 2025 •

edited

Loading

danielelerede-oet commented May 7, 2025 •

edited

Loading

euronion left a comment •

edited

Loading

euronion May 14, 2025

euronion May 14, 2025

danielelerede-oet May 14, 2025

euronion May 14, 2025

danielelerede-oet May 14, 2025

euronion left a comment

euronion May 14, 2025

euronion May 14, 2025

danielelerede-oet May 14, 2025 •

edited

Loading

danielelerede-oet May 14, 2025 •

edited

Loading

euronion left a comment

euronion May 15, 2025

euronion commented May 15, 2025

danielelerede-oet commented May 16, 2025 •

edited

Loading

euronion commented May 19, 2025

	bioethanol crops,CO2 intensity,2020,0.25704,tCO2/MWh_th,,"JRC, 01_JRC-EU-TIMES Full model, https://zenodo.org/records/3544900, file `Scen_EmisCO2.xls`). Original value 71.4 g CO2/MJ",
	bioethanol crops,CO2 intensity,2020,0.25704,tCO2/MWh_th,,"JRC, 01_JRC-EU-TIMES Full model, https://zenodo.org/records/3544900, file `Scen_EmisCO2.xls`. Original value 71.4 g CO2/MJ",

		cement dry clinker,gas-input,2020,1.9,MWh_NG/t_clinker,2020,"JRC, 01_JRC-EU-TIMES Full model, https://zenodo.org/records/3544900, file `SubRES_15_TECHS_CHP_SUP_IND.xlsx`, Sheet `IND` (ICMDRYPRD01, ICM.Dry Process Production.01)",
		cement dry clinker,electricity-input,2020,30,MWh_el/t_clinker,2020,"JRC, 01_JRC-EU-TIMES Full model, https://zenodo.org/records/3544900, file `SubRES_15_TECHS_CHP_SUP_IND.xlsx`, Sheet `IND` (ICMDRYPRD01, ICM.Dry Process Production.01)",

Add more industry data #211

Add more industry data #211

Conversation

danielelerede-oet commented Apr 15, 2025 • edited Loading

Changes proposed in this Pull Request

Checklist

danielelerede-oet commented May 7, 2025 • edited Loading

euronion left a comment • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

euronion left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

danielelerede-oet May 14, 2025 • edited Loading

Choose a reason for hiding this comment

danielelerede-oet May 14, 2025 • edited Loading

Choose a reason for hiding this comment

euronion left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

euronion commented May 15, 2025

danielelerede-oet commented May 16, 2025 • edited Loading

euronion commented May 19, 2025

danielelerede-oet commented Apr 15, 2025 •

edited

Loading

danielelerede-oet commented May 7, 2025 •

edited

Loading

euronion left a comment •

edited

Loading

danielelerede-oet May 14, 2025 •

edited

Loading

danielelerede-oet May 14, 2025 •

edited

Loading

danielelerede-oet commented May 16, 2025 •

edited

Loading