How to create an LLM that cites sentence level documentation

[jdkent]

other projects:

• https://developers.llamaindex.ai/python/examples/workflow/citation_query_engine/
• https://docs.vectara.com/docs/learn/mockingbird-llm and https://www.vectara.com/blog/a-reference-architecture-for-grounded-generation
• https://docs.cloud.google.com/generative-ai-app-builder/docs/grounded-gen and https://www.kaggle.com/code/markishere/day-4-google-search-grounding
• https://zilliz.com/blog/retrieval-augmented-generation-with-citations
• https://www.tensorlake.ai/blog/rag-citations
• https://medium.com/%40darrenoberst/using-llmware-for-rag-evidence-verification-8611abf2dbeb
• https://medium.com/%40yotamabraham/in-text-citing-with-langchain-question-answering-e19a24d81e39
• https://medium.com/pal4ai/retriever-augmented-generation-rag-with-llms-3-9e803e68ae34
• https://medium.com/data-science-collective/multi-modal-rag-with-visual-answer-grounding-e8875a486c88
• https://neo4j.com/blog/genai/advanced-rag-techniques/?utm_source=chatgpt.com
• https://iaee.substack.com/p/ai-generated-in-text-citations-intuitively

publications:

• https://aclanthology.org/2025.acl-long.1456
• https://arxiv.org/abs/2510.11394
• https://dl.acm.org/doi/10.1145/3731120.3744592
• https://arxiv.org/html/2409.02897v2
• https://www.arxiv.org/pdf/2508.02872
• https://aclanthology.org/2025.findings-naacl.55.pdf
• https://arxiv.org/abs/2501.01303
• https://arxiv.org/pdf/2412.18004

notebookLM: https://notebooklm.google.com/notebook/eddb6447-ba3f-4eb0-9208-1404cadfad1b

[jdkent]

use this to verify whether a sentence is supportive to the claim output by the large language model:
https://huggingface.co/MoritzLaurer/DeBERTa-v3-large-mnli-fever-anli-ling-wanli

i can use this to select sentences from the document: https://huggingface.co/cross-encoder/ms-marco-MiniLM-L12-v2