I've only seen this happen with GEFS, but occasionally (maybe 1-2% of downloads) I end up with missing idx and grib files but no errors. After converting the output to an xarray dataset there are simply missing timesteps.
I typically loop through each of the 30 members one at a time, and I'm retrieving one to 10 days of valid times, so 240-2400 total grib+index files in one attempt, and it looks like it's usually on the order of 2-10 sets of files missing, and usually all within a single member (so a single instance of FH.download). And then maybe just 2% of the time does this issue occur. All to say, it seems pretty rare.
I'm working on a fix for my use-case based on williamhobbs/hefty#36. Curious if anyone else has had this issue come up.
This is somewhat similar to #535, but a different problem.
I've only seen this happen with GEFS, but occasionally (maybe 1-2% of downloads) I end up with missing idx and grib files but no errors. After converting the output to an xarray dataset there are simply missing timesteps.
I typically loop through each of the 30 members one at a time, and I'm retrieving one to 10 days of valid times, so 240-2400 total grib+index files in one attempt, and it looks like it's usually on the order of 2-10 sets of files missing, and usually all within a single member (so a single instance of
FH.download). And then maybe just 2% of the time does this issue occur. All to say, it seems pretty rare.I'm working on a fix for my use-case based on williamhobbs/hefty#36. Curious if anyone else has had this issue come up.
This is somewhat similar to #535, but a different problem.