Skip to content

ChunckerConfig doesn't respect the args passed #409

Open
@krish-adi

Description

@krish-adi

I am trying the chunk a bunch of markdown files. I want to set the max_characters=1000 to the config. But my result looks like it follows the default of max_characters=500. I do the following:

if __name__ == "__main__":
    Pipeline.from_configs(
        ...                   
        chunker_config=ChunkerConfig(chunking_strategy="basic", max_characters=1000),
        ...
    ).run()

when i check the results in my elements table, i see that the max_characters is 500. It looks like the ChunkerConfig doesn't respect the kwargs passed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions