Feature Proposal: Example notebook combining UKV and Sheffield Solar data

[Shohail-Ismail]

Context

As discussed with @peterdudfield, I suggest a small showcase/example that combines Met Office UKV data with Sheffield Solar's generation dataset. This idea came about as a result of my work at the Met Office and conversations with colleagues from the University of Sheffield.

A worked example showing them together could be useful for:

• onboarding new contributors
• demonstrating how weather forecasts and generation data can be paired in practice
• providing content for the UKV dataset card on HuggingFace

Proposal

1. pulls UKV irradiance data for a given period
2. matches it against Sheffield Solar half-hourly (or 5 min) generation data
3. visualises both together, with some basic analysis

This creates a reusable, beginner-friendly notebook that can be turned into a link in the Hugging Face dataset card, and has the potential to be presented as a case study at Quartz Solar sessions, etc. It also complements ongoing work in open_data_pvnet by focusing on introductory EDA and onboarding resources.

Feedback

Feedback would be welcome on:

• which UKV variables should be highlighted
• if the analysis would be better off as simple visualisation or more quantitative metrics
• suggestions on maximising value for contributors and external users

Edit

17/08: Changed simple clerical error to match intended dataset (ENTSOE instead of Sheffield Solar)

---

Happy to draft the first version after feedback, thanks!

[peterdudfield]

I think UKV is just for the UK, so you might want to consider a different NWP if you want to focus on Germany
Analysis and plotting is always useful

A worked example is always useful. @siddharth7113 is working on for the UK in open_data_pvnet

[Shohail-Ismail]

Thanks for flagging that Peter - I had ENTSOE in mind because of my earlier contributions in this repo!

For this notebook, what I meant to say was to focus on the Sheffield Solar dataset (https://huggingface.co/datasets/openclimatefix/uk_pv), and have edited the issue to reflect this. This was discussed when talking with a colleague from the university of sheffield, and we thought this idea would make a good example notebook.

I think this will be complementary to to Siddharth's work, and so I'll start the draft now if all else is fine.

[siddharth7113]

Hi @Shohail-Ismail ,
This seems like a great plan but I think the right place to work with it on it would be on Open-data-PVNet , we have already have few notebooks created for GFS data.

[Shohail-Ismail]

Thanks @siddharth7113, I can see there are existing GFS and Met Office data notebooks and will add the new UKV + Sheffield Solar example in the same directory. If that's all good with you, I’ll open a PR here for review once the first draft is ready.