🐛 Bug Report: Headers are Ignored and Data is Truncated/Jumbled in Table Parsers

[JeevaRamanathan]

📜 Description

When parsing CSV or XML files in the application, headers are not being considered, and only the values are processed. Additionally, data sources are either jumbled or truncated for each chat, resulting in incomplete data handling. This behavior prevents effective interaction with the full file content.

👟 Reproduction steps

1. Upload a CSV file with headers (e.g., "Country," "Demographic Pressures," etc.).
2. Parse the file using the application.
3. Interact with the data by asking questions referencing the headers.
   • Headers are not included.
   • Data rows are truncated or shuffled for each chat in logs (source), leading to incomplete or incorrect results.

👍 Expected behavior

• Headers should be properly included and accessible.
• All data rows should be retained or should be able to interact with all the data in case of large file.

👎 Actual Behavior with Screenshots

• Headers are ignored.
• Data rows are either jumbled or truncated, preventing access to the complete file content. The source file has more rows.
  In the same chat, interactions were made, and below are the screenshots of the sources where the data appears truncated.
  

💻 Operating system

Windows

What browsers are you seeing the problem on?

Chrome

🤖 What development environment are you experiencing this bug on?

Docker

🔒 Did you set the correct environment variables in the right path? List the environment variable names (not values please!)

📃 Provide any additional context for the Bug.

No response

📖 Relevant log output

No response

👀 Have you spent some time to check if this bug has been raised before?

• I checked and didn't find similar issue

🔗 Are you willing to submit PR?

None

🧑‍⚖️ Code of Conduct

• I agree to follow this project's Code of Conduct