Skip to content

Exception in NodeFileEditor - "Time (...) does not exist in input data fileset" #84

@tonyrafter

Description

@tonyrafter

Hello! I'm looking for some help/ideas to track down the cause of a strange exception produced when running NodeFileEditor.

I am using NodeFileEditor to calculate TC energetics (ACE, PDI etc.) following tracking and stitching with DetectNodes/StitchNodes. This has worked for quite a few simulations so far, so I am reasonably confident the workflow is okay.

However, for one model run I am getting an error when trying to produce ACE.

The input commands are (with some filenames replaced):

Arguments:
  --in_nodefile <string> [(StitchNodes output file with tracks)] 
  --in_nodefile_type <string> ["SN"] [DN|SN]
  --in_data <string> [""] 
  --in_data_list <string> [(file with lists of model outputs, one month per line)] 
  --in_connect <string> [""] 
  --diag_connect <bool> [false] 
  --regional <bool> [true] 
  --in_fmt <string> ["lon,lat,mslp,wind,zs,sst2deg_min,sst2deg_avg,sst2deg_max"] 
  --out_fmt <string> ["lon,lat,mslp,wind,ACE,PDI,IKE,rsize,rprof"] 
  --out_nodefile <string> [(output file containing energetics alongside each track)] 
  --out_nodefile_format <string> ["csv"] [gfdl|csv|csvnohead]
  --timefilter <string> [""] 
  --colfilter <string> [""] [col,op,value;...]
  --calculate <string> ["ACE=eval_ace(uas,vas,5);PDI=eval_pdi(uas,vas,5);IKE=eval_ike(uas,vas,5);rprof=radial_wind_profile(uas,vas,159,0.125);rsize=lastwhere(rprof,>,8)"] 
  --apply_time_delta <string> [""] 
  --lonname <string> ["lon"] 
  --latname <string> ["lat"] 

...and the error produced looks like this:

..Calculating "ACE=eval_ace(uas,vas,5)"
....EXCEPTION (/[path_to_installation]/tempestextremes/src/nodes/NodeFileEditor.cpp, Line 1687) Time (2020-12-06 12:00:00) does not exist in input data fileset

...which I see in the output once for each CPU used in the call to NodeFileEditor.

This exception sounds like it's telling me the input files (from the model) are missing a timestep or the like, however:

  • The program seems to have run okay to this point, including the tracking.
  • I have run several checks on the input files (uas and vas) in the eval_ace call, and I can't see any issues with the data or metadata.
  • The other model fields also look normal at the problematic time step (as well as before and after that).
  • Other netCDF tools have no issues working with the data.
  • The output of StitchNodes looks normal, in both csv and gfdl formats, and has a row/track starting at the above time (2020-12-06 12:00:00).

Do you have any idea what might be causing this error? Happy to supply any other info if needed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions