Taking a lot of time for the sample pdf

[SouravaBehera]

I am using a 16 core cpu for the same document using a local model same as in the github repo.

How to get the output faster?

[Dicklesworthstone]

It just works much much better using the API. Highly recommend doing that considering the cost is totally negligible. With the API, each chunk is submitted in parallel in an async way, so it’s incredibly faster.

[SouravaBehera]

can you suggest any such free API Models.

[Dicklesworthstone]

They aren’t free but the cost is extremely low for OpenAI using the model the code is already configured for. We are talking a few cents tops for a document.