Add progress bar for document loading

[adarshh347]

Add progress bar for document loading

• Added tqdm progress bar to MergedDataLoader
• Shows loading progress during document ingestion
• Updated requirements.txt with new dependency

Testing

• Verified progress bar appears during both web and RTD doc loading
  

Next Step for Progress Bar

• Progress tracking for text splitting & Embedding generation & VectorDB storage status

LFX Mentorship Interest

As an applicant for LFX Mentorship, I'm particularly interested in:

• Improving pipeline observability (starting with this progress bar)
• Enhancing RAG efficiency (crawling/retrieval optimization)
• Contributing to under-documented components

Would appreciate maintainers' guidance on where these skills could be most valuable!

[RAWx18]

I think there lot to do before adding loading bar to documents as it's major use would be through website (UI). As agentic system need a lot more upgrade first.

[adarshh347]

yeah true, as i saw your pull request, you have recarved the whole agentic pipeline. I have been totally invested in going through the codebase. I feel it's better to understand & commit in your branch. Are there points of changes where I can contribute? It would be great if you help there as well. If you're up, I'm dming you on twitter, please do respond

[RAWx18]

yeah true, as i saw your pull request, you have recarved the whole agentic pipeline. I have been totally invested in going through the codebase. I feel it's better to understand & commit in your branch. Are there points of changes where I can contribute? It would be great if you help there as well. If you're up, I'm dming you on twitter, please do respond

Ya u can surely contribute to the PR made. My twitter id is https://x.com/RAWx18_dev

[RAWx18]

My PR is available on https://github.com/RAWx18/aifaq/tree/agents

[adarshh347]

messaged on your twitter's comment section as dm is disabled

[adarshh347]

please do respond fast there as I have queries regarding application submission of lfx(i guess it's last date today)

[RAWx18]

messaged on your twitter's comment section as dm is disabled

Yes sure bro I replied to you there.