Llama Index

Llama Index creates hierarchical data structures over private datasets & runs optimized queries over them. This will help overcome the limitation of the number of tokens we can pass to the LLMs.

Reading list:

• Documentation: https://gpt-index.readthedocs.io/en/latest/index.html
• Blog Posts: https://medium.com/llamaindex-blog
• Podcast, Jerry Liu CEO of LlamaIndex - https://www.youtube.com/watch?v=Wmj6GUd_lGg

We can consider using LlamaIndex to improve the LLM results for Issue 1: https://github.com/developmentseed/issue-one-llm/blob/main/how-to.md