Open
Description
I am trying the chunk a bunch of markdown files. I want to set the max_characters=1000
to the config. But my result looks like it follows the default of max_characters=500
. I do the following:
if __name__ == "__main__":
Pipeline.from_configs(
...
chunker_config=ChunkerConfig(chunking_strategy="basic", max_characters=1000),
...
).run()
when i check the results in my elements table, i see that the max_characters is 500. It looks like the ChunkerConfig doesn't respect the kwargs passed.
Metadata
Metadata
Assignees
Labels
No labels