You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Update documentation for RAG systems with improved layout and promotional content
- Added a 20% discount code for the RAG Playbook course in the index and emphasized its availability.
- Enhanced the structure of the office hours index by organizing chapters and sessions for better navigation.
- Removed unnecessary sections to streamline content and improve clarity.
- Updated chapter summaries to reflect recent changes and maintain consistency across the documentation.
Copy file name to clipboardExpand all lines: docs/index.md
+38-97Lines changed: 38 additions & 97 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,74 +16,59 @@ Most RAG implementations struggle in production because teams focus on model sel
16
16
17
17
This guide presents frameworks developed through real-world experience with companies like HubSpot, Zapier, and others to help you build RAG systems that become more valuable over time.
18
18
19
-
# Trusted by Professionals from Leading Organizations:
19
+
👉 If you want to learn more about RAG systems, check out our RAG Playbook course. Here is a 20% discount code for readers. 👈
20
20
21
-
These are the companies that took our masterclass.
21
+
[RAG Playbook - 20% off for readers](https://maven.com/applied-llms/rag-playbook?promoCode=EBOOK){ .md-button .md-button--primary }
22
+
23
+
## Trusted by Leading Organizations
24
+
25
+
This methodology has been battle-tested by professionals at:
This methodology has been used by engineers and data scientists at companies including Zapier, Adobe, Red Hat, and others to build production RAG systems with measurable improvements in user satisfaction and business outcomes.
68
54
69
55
## The Problem: Why Most RAG Systems Fail
70
56
71
57
!!! quote "Real Patterns from the Field"
72
-
After working with dozens of companies, the failure pattern is predictable:
58
+
After working with dozens of companies, the failure pattern is predictable:
73
59
74
60
**Week 1-2:** "Our RAG demo is amazing!"
61
+
75
62
**Week 3-4:** "Why are users getting irrelevant results?"
63
+
76
64
**Week 5-6:** "Let's try a different model..."
65
+
77
66
**Week 7-8:** "Maybe we need better prompts..."
67
+
78
68
**Week 9+:** "Our users have stopped using it."
79
69
80
70
Sound familiar? You're not alone. The issue isn't your technology—it's your approach.
81
71
82
-
!!! info "Get Updates"
83
-
Subscribe for updates on new content and frameworks:
84
-
85
-
[Enroll in the Free 6-Day Email Course](https://improvingrag.com/){ .md-button .md-button--primary }
86
-
87
72
## The Solution: The RAG Improvement Flywheel
88
73
89
74
### [Introduction: The Product Mindset Shift](workshops/chapter0.md)
@@ -177,7 +162,7 @@ Models change. Principles endure. Take away the core insights that will guide yo
177
162
## Learn from Industry Leaders: 20+ Expert Talks
178
163
179
164
!!! info "Featured Lightning Lessons"
180
-
Companies like Zapier, ChromaDB, LanceDB, Glean, and Sourcegraph share their battle-tested strategies
165
+
Companies like Zapier, ChromaDB, LanceDB, Glean, and Sourcegraph share their battle-tested strategies
181
166
182
167
### Featured Talks
183
168
@@ -198,7 +183,8 @@ _"Jason helped us set you on the right path... emphasis on looking at your data
198
183
## For Product Leaders, Engineers, and Data Scientists
199
184
200
185
!!! info "What You'll Learn"
201
-
**For Product Leaders**
186
+
187
+
**For Product Leaders**
202
188
203
189
- How to establish metrics that align with business outcomes
204
190
- Frameworks for prioritizing AI product improvements
@@ -219,58 +205,13 @@ _"Jason helped us set you on the right path... emphasis on looking at your data
219
205
- Frameworks for measuring retrieval effectiveness
220
206
- Approaches to continuous learning from user interactions
221
207
222
-
## Quick Improvements
223
-
224
-
Common improvements that can be implemented quickly:
225
-
226
-
**1. Improve Feedback Collection**
227
-
228
-
- Replace "How did we do?" with "Did we answer your question?"
229
-
- More specific questions get better response rates
230
-
231
-
**2. Better Data Formatting**
232
-
233
-
- Format structured data as markdown tables instead of JSON/CSV
234
-
- Use XML for complex tables
235
-
- Improves lookup accuracy for structured information
236
-
237
-
**3. Show Progress to Users**
238
-
239
-
- Display "Searching... Analyzing... Generating..." with progress indicators
240
-
- Stream responses as they're generated
241
-
- Reduces perceived latency
242
-
243
-
**4. Page-Level Chunking**
244
-
245
-
- For documentation, chunk by page boundaries rather than arbitrary text length
246
-
- Pages often contain semantically coherent units
247
-
248
-
**Medium-Term Improvements (2-4 weeks)**
249
-
250
-
-**Fine-tune embeddings**: Cost-effective way to improve domain-specific performance
251
-
-**Add re-ranker**: Secondary ranking step that improves retrieval relevance
252
-
-**Build specialized tools**: Domain-specific retrievers for documents, code, or structured data
253
-
-**Implement contextual retrieval**: Better understanding of query context
254
-
-**Create Slack feedback integration**: Collect feedback directly in enterprise workflows
255
-
256
-
!!! info "Learn from the Experts"
257
-
258
-
Before implementing, learn from these practical talks:
259
-
- [**RAG Anti-patterns in the Wild**](talks/rag-antipatterns-skylar-payne.md)
260
-
- [**Document Ingestion Best Practices**](talks/reducto-docs-adit.md)
261
-
262
208
## About the Author
263
209
264
210
Jason Liu is a machine learning engineer with experience at Facebook and Stitch Fix, and has consulted for companies like HubSpot and Zapier on RAG implementations. His background includes computer vision, recommendation systems, and retrieval applications across various domains.
265
211
266
-
## Getting Started
267
212
268
-
Begin your journey by reading the [Introduction](workshops/chapter0.md) or jump directly to [Chapter 1](workshops/chapter1.md) to start building your evaluation framework and data foundation.
213
+
## Stay Updated
269
214
270
-
---
271
-
272
-
--8<--
273
-
"snippets/enrollment-button.md"
274
-
--8<--
215
+
👉 If you want to learn more about RAG systems, check out our RAG Playbook course. Here is a 20% discount code for readers. 👈
275
216
276
-
---
217
+
[RAG Playbook - 20% off for readers](https://maven.com/applied-llms/rag-playbook?promoCode=EBOOK){ .md-button .md-button--primary }
0 commit comments