You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am trying the chunk a bunch of markdown files. I want to set the max_characters=1000 to the config. But my result looks like it follows the default of max_characters=500. I do the following:
if __name__ == "__main__":
Pipeline.from_configs(
...
chunker_config=ChunkerConfig(chunking_strategy="basic", max_characters=1000),
...
).run()
when i check the results in my elements table, i see that the max_characters is 500. It looks like the ChunkerConfig doesn't respect the kwargs passed.