[Bug] Possibly incorrect output dump ? (The actual data appears to be fine)

[thameem-abbas]

cat fp8_fp8_tp2.json | jq '.benchmarks[] | .args.profile.measured_rates'
[
  0.020927754394140415,
  1.277633358306354,
  0.16187661325946062,
  0.3006715892920996,
  0.42809462336187576,
  0.5790540149106302,
  0.706221702530327,
  0.8352987384060198,
  0.9707840531576964,
  1.0963631997951027
]
[
  0.020927754394140415,
  1.277633358306354,
  0.16187661325946062,
  0.3006715892920996,
  0.42809462336187576,
  0.5790540149106302,
  0.706221702530327,
  0.8352987384060198,
  0.9707840531576964,
  1.0963631997951027
]
[
  0.020927754394140415,
  1.277633358306354,
  0.16187661325946062,
  0.3006715892920996,
  0.42809462336187576,
  0.5790540149106302,
  0.706221702530327,
  0.8352987384060198,
  0.9707840531576964,
  1.0963631997951027
]
[
  0.020927754394140415,
  1.277633358306354,
  0.16187661325946062,
  0.3006715892920996,
  0.42809462336187576,
  0.5790540149106302,
  0.706221702530327,
  0.8352987384060198,
  0.9707840531576964,
  1.0963631997951027
]
....
....

--

cat fp8_fp8_tp2.json | jq '.benchmarks[] | .metrics.requests_per_second.successful.mean'

0.020927754394140415
1.277633358306354
0.16187661325946062
0.3006715892920996
0.42809462336187576
0.5790540149106302
0.706221702530327
0.8352987384060198
0.9707840531576964
1.0963631997951027

Looks like an unintentional referencing of the same object between benchmark runs ?

[rgreenberg1]

Action Item:
Strip this out from the output file.