Backtest results vary with different chunk_size values — potential inconsistency in synthesized bar data #3303
Unanswered
ReCodeLife
asked this question in
Q&A
Replies: 1 comment
-
|
Hi @cjdsellers I’d really appreciate it if you could take a look at this issue when you have time. The inconsistency in bar synthesis across different |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello,
I'm encountering a potentially significant issue while running backtests using this library and would appreciate your insight.
Issue Description
I'm performing backtesting using quote/tick data that is aggregated into minute-level bars. Due to the large volume of raw data, I enabled the
chunk_sizeparameter to process the data in chunks. However, I've observed that the final backtest PnL (or cumulative returns) differs depending on the value ofchunk_size.Upon closer inspection, it appears that the synthesized minute bars themselves are not identical across different
chunk_sizesettings—for example, slight discrepancies exist in OHLC values or volume for certain bars. Since my strategy logic depends on these bars, even minor differences can lead to divergent trade signals and performance outcomes.Questions
chunk_sizemight affect data aggregation and backtest reproducibility?Thank you very much for your excellent work on this project! I’d be grateful for any clarification or guidance.
Beta Was this translation helpful? Give feedback.
All reactions