You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# If no proper parsing worked, fallback to demo data
84
87
ifnotresults:
85
-
results= [
86
-
{
87
-
"title": "Large Language Models Still Cannot Plan: A Benchmark Study",
88
-
"excerpt": "Despite recent advances, our comprehensive evaluation shows that current LLMs exhibit significant limitations in multi-step reasoning and planning tasks, contradicting claims about their reasoning capabilities."
89
-
},
90
-
{
91
-
"title": "On the Reasoning Abilities of Large Language Models: A Critical Analysis",
92
-
"excerpt": "We demonstrate through systematic testing that LLMs primarily rely on pattern matching rather than genuine logical reasoning, revealing fundamental gaps in their cognitive abilities."
93
-
},
94
-
{
95
-
"title": "Emergent Abilities of Large Language Models Are Not What They Seem",
96
-
"excerpt": "Our analysis suggests that apparent reasoning capabilities in LLMs are largely artifacts of training data memorization rather than true emergent reasoning abilities."
97
-
}
98
-
]
88
+
print(f"⚠️ Could not parse contradictions from response: {content[:500]}...")
99
89
100
-
returnresults
90
+
# Remove duplicates based on title
91
+
unique_results= []
92
+
seen_titles=set()
93
+
forpaperinresults:
94
+
title_lower=paper['title'].lower().strip()
95
+
iftitle_lowernotinseen_titles:
96
+
seen_titles.add(title_lower)
97
+
unique_results.append(paper)
98
+
99
+
returnunique_results
101
100
102
101
exceptExceptionase:
103
102
print(f"Error in detect_contradictions: {str(e)}")
104
-
# Return demo data for demonstration purposes
105
-
return [
106
-
{
107
-
"title": "Large Language Models Still Cannot Plan: A Benchmark Study",
108
-
"excerpt": "Despite recent advances, our comprehensive evaluation shows that current LLMs exhibit significant limitations in multi-step reasoning and planning tasks, contradicting claims about their reasoning capabilities."
109
-
},
110
-
{
111
-
"title": "On the Reasoning Abilities of Large Language Models: A Critical Analysis",
112
-
"excerpt": "We demonstrate through systematic testing that LLMs primarily rely on pattern matching rather than genuine logical reasoning, revealing fundamental gaps in their cognitive abilities."
113
-
},
114
-
{
115
-
"title": "Emergent Abilities of Large Language Models Are Not What They Seem",
116
-
"excerpt": "Our analysis suggests that apparent reasoning capabilities in LLMs are largely artifacts of training data memorization rather than true emergent reasoning abilities."
return"""Based on these contradictory findings, there are several research directions to consider:
104
-
105
-
• **Experimental Validation**: Design controlled experiments to test the specific claims made in your research against the contradictory evidence found
106
-
107
-
• **Methodological Comparison**: Compare your methodology with the approaches used in the contradictory papers to identify key differences
108
-
109
-
• **Gap Analysis**: Focus on the specific gaps or limitations highlighted by the contradictory research to refine your approach
110
-
111
-
Good luck!"""
102
+
return"Unable to generate research strategy. Please try again."
0 commit comments