Create Chatbots for Delta and DeltaAI

[rohan-uiuc]

• Create new chatbots at https://uiuc.chat/new
• Webscrape Delta and DeltaAI documentation
• See https://docs.uiuc.chat/ for docs

[abodeuis]

I have now created a chatbot for the Delta Documentation using the UIUC chat interface. The share link for it is https://uiuc.chat/Delta-Documentation

Creating the bot required a bit of tinkering with how to ingest the documentation website. This might be due to how read the docs documentation website is structured, with multiple NCSA compute systems in the same domain of https://docs.ncsa.illinois.edu.

The UIUC chat interface provides 4 options for ingesting a website directly from a weblink, this is what I initially tried:

• Equal and Below : This from what I can tell only ingests the single page you provide it and doesn't properly crawl the full docs.
• Same Subdomain : This option does crawl some of the documentation website but ends up pulling other systems documentation in and doesn't even get all of deltas documentation pages.
• Entire Domain : I didn't try the entire domain option as it will likely have the same problem of pulling in other systems documentation that the "same subdomain" option had.
• ALL : Same as above.

So instead of ingesting the website I tried ingesting the GitHub repo, This had some mixed results. The bot performed better on questions when compared to ingesting the website, but was still outright missing useful information what nodes were available on delta.

So I then tried scraping the documentation website links myself and adding them individually using the "Equal and Below" option. There are 30 page links so this was not too big of a deal but would need to be automated somehow in future.

This provided very good results and in my quick testing I didn't have any questions that the bot missed, using both the Qwen and Deepseek models. So this is the method I think we should use.

I'm going to go ahead and create a bot for the DeltaAI Documentation now, using the same method.

[abodeuis]

DeltaAI bot created and available here https://uiuc.chat/DeltaAI-Documentation

[abodeuis]

Added Taiga and slurm documentation to both chatbots