Skip to content

Commit c500abe

Browse files
committed
improved readability in readme and final discussion
1 parent 40743a4 commit c500abe

2 files changed

Lines changed: 47 additions & 22 deletions

File tree

README.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -129,6 +129,20 @@ flowchart TD
129129
H --> I([LLM · Llama-3-8B\nGrounded recommendation])
130130
```
131131

132+
### Additional Feature
133+
134+
We implemented a quantitative evaluation feature to evaluate the performance of our final product (The app) using precision and recall metrics.
135+
The final document can be located at `../results/final_discussion.md`
136+
137+
138+
### Example
139+
140+
Using the RAG Tab;
141+
142+
**QUERY**: 'highly rated hair product that works for both men and women'
143+
144+
**Expected response:** Based on the provided information, the highly rated hair product that works for both men and women is the Curl Defining Cream Activator
145+
for Soft Beautiful Curls by Osensia. It is rated 5.0 and is described as suitable for curly hair, which can apply to both men and women.
132146

133147

134148
---

results/final_discussion.md

Lines changed: 33 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -34,15 +34,17 @@ model good for chat/Q&A style tasks.
3434
#### Results and discussions
3535

3636
We evaluated both performances using 5 queries and the same prompt template:
37-
- queries = [
38-
'gentle cleanser for sensitive scalp',
39-
'natural scent that is not overpowering',
40-
'best leave-in conditioner for thick curly hair under $20',
41-
'what do people say about this product causing hair loss',
42-
'highly rated hair product that works for both men and women'
43-
]
44-
- Prompt used:
45-
PROMPT_TEMPLATE = """
37+
##### queries:
38+
39+
- 'gentle cleanser for sensitive scalp',
40+
- 'natural scent that is not overpowering',
41+
- 'best leave-in conditioner for thick curly hair under $20',
42+
- 'what do people say about this product causing hair loss',
43+
- 'highly rated hair product that works for both men and women'
44+
45+
##### Prompt used:
46+
47+
PROMPT_TEMPLATE = """
4648
You are a helpful product recommendation assistant.
4749
Use ONLY the product information provided below to answer the user's question.
4850
If the products do not match the query well, say so honestly.
@@ -55,30 +57,34 @@ User Question: {question}
5557
Your Answer:
5658
"""
5759

58-
- Results:
60+
##### Results:
5961

60-
Using the meta-llama/Meta-Llama-3-8B-Instruct we obtained the following responses:
62+
**Using the meta-llama/Meta-Llama-3-8B-Instruct we obtained the following responses:**
6163

6264
=== RAG Query Results using meta-llama/Meta-Llama-3-8B-Instruct ===
6365

6466
Based on the products provided, I don't see any direct match for a gentle cleanser for a sensitive scalp. The products listed include hair accessories, skin care sets, synthetic braids, lip care, and a tanning lotion, but none of them are specifically a gentle cleanser.
65-
6667
However, if you're looking for a gentle skin care product that might also be suitable for a sensitive scalp, the Drunk Elephant Rise + Glow Duo could be a possibility, as it's a gentle skin care set that includes a vitamin C serum and a hydrating gel.
67-
==================================================
68+
69+
---
6870

6971
Based on the provided products, I couldn't find any information related to a product with a "natural scent that is not overpowering". The products listed include a digital timer, plastic pump bottles, hair accessories, and hair care tools, but none of them mention scent or fragrance. If you're looking for a product with a natural scent, I recommend searching for products specifically labeled as "natural fragrances" or "unscented" to find products that match your query.
70-
==================================================
72+
73+
---
7174

7275
Based on the provided products, I couldn't find a suitable match for the best leave-in conditioner for thick curly hair under $20. The products listed don't have information about hair care products, including leave-in conditioners, so I couldn't make a recommendation.
7376

7477
If you're looking for a hair care product, I'd be happy to help you find one if you provide more information or context.
75-
==================================================
78+
79+
---
7680

7781
I don't have any information about the product(s) in the provided list causing hair loss. The reviews focus on the quality, performance, and other aspects of the products but do not mention hair loss. If you have a specific product you're inquiring about, I'd need more information about the product in question.
78-
==================================================
82+
83+
---
7984

8085
Based on the provided information, the highly rated hair product that works for both men and women is the Curl Defining Cream Activator for Soft Beautiful Curls by Osensia. It is rated 5.0 and is described as suitable for curly hair, which can apply to both men and women.
81-
==================================================
86+
87+
---
8288

8389
Using the mistralai/Mistral-7B-Instruct-v0.2 we obtained the following responses:
8490

@@ -91,7 +97,8 @@ I hope this helps answer your question, and I apologize for the lengthy response
9197
If you have any further questions or need more clarification on any of the points I've made, please don't hesitate to ask. I'm always here to help answer your questions and provide you with accurate and useful information, no matter how complicated or technical the subject matter might be.
9298

9399
I hope this information is helpful to you in your search for a gentle cleanser for a sensitive scalp. I wish you all the best in your quest for healthy and beautiful
94-
==================================================
100+
101+
---
95102

96103
Based on the product information provided in the retrieved reviews, the following product, "Joband Fashion hairband women hair headband Teeth Comb Hair Hoop Hair band Soft Comfy Non-slip Hair Accessories for Women/Girl," may fit the user's query for a natural scent that is not overpowering.
97104

@@ -100,7 +107,8 @@ The user's query does not explicitly mention what type of product they are looki
100107
In this case, the user's query mentions the desirable qualities of a natural scent that is not overpowering. Based on the reviews provided for the retrieved products, the "Joband Fashion hairband women hair headband Teeth Comb Hair Hoop Hair band Soft Comfy Non-slip Hair Accessories for Women/Girl" product review mentioned that the hairbands have a subtle and natural scent that is not overpowering. Therefore, this product may be a suitable match for the user's query.
101108

102109
It is important to note that while the product information provided in the retrieved reviews suggest that the "Joband Fashion hairband women hair headband Teeth Comb Hair Hoop Hair band Soft Comfy Non-slip Hair Accessories for Women/Girl" product may be a suitable match for the user's query, it is
103-
==================================================
110+
111+
---
104112

105113
Based on the products provided in the context, none of them matches the query exactly for a leave-in conditioner specifically for thick curly hair under $20.
106114

@@ -113,13 +121,16 @@ Here are some suggested products that might meet the query's criteria:
113121
1. SheaMoisture Jamaican Black Castor Oil Strengthen & Restore Leave-In Treatment for Damaged Hair, 8 oz
114122
2. Cantu Shea Butter Leave-In Conditioning Repair Cream, 16 oz
115123
3. Aussie 3 Minute Miracle Deep Conditioning Treatment, 13.5
116-
==================================================
124+
125+
---
117126

118127
Based on the provided reviews, there is no mention or indication of hair loss caused by any of the products.
119-
==================================================
128+
129+
---
120130

121131
Based on the information provided, I would recommend the Curl Defining Cream Activator by Osensia. This product has a high rating, and it is suitable for both men and women with dry, frizzy, or color-treated hair.
122-
==================================================
132+
133+
---
123134

124135

125136
The first thing we notice is that the Mistral model returns very lengthy/verbose response compared to the meta-llama model. The most important thing of note however is the response quality differential for both models.

0 commit comments

Comments
 (0)