feat: add possibility to have multiple input payloads with headers #441
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
We can now pass an entire folder as input data This will also read headers along with the actual data. This also includes a simple script to generator a set of payloads with some variability in content Signed-off-by: Charly Molter <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation
We're testing a Kafka gateway so it is useful for us to vary and control the payloads sent with openMessaging benchmark.
We also needed the ability to send headers.
Implementation
FilePayloadReaderwithPayloadReaderwhich will behave the same with a single file as input but will load all files with extension.payload.yamlin the folder passed.[]byteto the generator pass aPayloadobject so we can send headers as well.bin/generate_payloads.sha sample script to generate a folder with data with some entropyAll this still respect the requirement to preload everything to minimize perf impact.
Signed-off-by: Charly Molter [email protected]