Skip to content

OpenSourceAGI/qwksearch-research-agent

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

429 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation


Join Discord GitHub Stars Next.js
GitHub Discussions GitHub last commit
PRs Welcome

πŸ§ πŸ’» Reimagine the Internet as Self-Organizing Mind Map

Critical times call for critical thinkers to create a crowdsourced argument reasoning dataset, for AI models to recommend research quotes, to evolve crowdsourced chain-of-thought reasoning, to unlock faster ways to read long articles, to monitor developments by topic modeling a knowledge base graph, and to provide a public service of answers to research.

Language Models can distill the essence of collective thought into a vector space where every point has a weighted value representing its contribution to the overall decision-making process. AI will show its reasoning based on what sentences and cites it used from the collective research, so that people can see it is aligned with our interests. Research Agents recommend articles for human researchers working alongside AI to develop a summarized topic outline as a public service. The agents monitor for any related articles via web searches for keywords associated with that Topic Model. Imagine uploading a research paper, then the app extracts full text of reference cites and creates topic model and keyword summaries, then monitors that literature base and stores highlights. People will make personal knowledge bases of what influences them to create AI assistants cloning their mind-uploaded perspective and interests in a self-organizing mind map.

# Download Source
bun x git0 vtempest/qwksearch-research-agent
# Import Self-Hosted API
bun i ai-research-agent
# Import API Client
bun i qwksearch-api-client

image

πŸ€–πŸ”Ž STREAM: Search with Top Result Extraction & Answer Model

Reimagine The Web as Self-Organizing Mind Map

  • πŸ” Web Search - 100+ popular sites search across 10 categories: Web Search, Academic, Videos, Images, Files, News, etc
  • πŸ“ Article Preview - Extract, format with APA cite, and summarize articles, PDFs, Youtube, and URLs before reading them
  • πŸ€– Choice of Language Model - Claude, GPT, Gemini, Grok, Llama, Chinese LLMs, etc
  • πŸ“„ File Upload Support - Ask questions about PDFs, URLs, DOCX, Google Docs, and Youtube
  • πŸ“š Search History - All searches saved with memories, except for privacy mode
  • ❓ Follow-up Questions - Generate follow-up questions to ask language models

REASON Writing Agent

Research Editor for Annotated Summaries in Outline Notation

  • πŸ“ Complex Rich Text Editor: full featured alternative to Google Docs based on Meta's Lexical with easy minimalist UI
  • πŸ“‚ Nested Document Tree: organize research notes with a nested document organizer with drag-and-drop, tabs, and custom storage sources
  • πŸ–±οΈ Context Menu: right-click to access quick actions for seamless document management
  • πŸ” Full-Text Search: instantly find documents by title or content with full-text search
  • ✨ AI Rewriting: leverage AI to rewrite and improve your text directly within the editor
  • πŸ‘₯ Team Management: collaborate with team members and manage access rights
  • πŸ”„ View Modes: switch between Formatted, parsing HTML, and Markdown views for versatile editing
  • πŸ› οΈ Find & Replace: powerful search and replace functionality with match highlighting
  • πŸ“₯ Google Docs Integration: seamless export, import, and sharing capabilities
  • πŸ’Ύ Persistent Storage: reliable SQLite storage ensures your data is safe and accessible
  • ⌨️ Keyboard Navigation: efficient keyboard shortcuts for power users
  • πŸ’¬ Research Quotes: capture and organize key quotes and insights from your research
  • πŸ—οΈ Built with: Claude Code, Lexical Editor, shadcn/ui, Cloudflare, Next.js, Google Docs API

πŸšœπŸ“œ Tractor the Text Extractor

  1. Main Content Detection: Extract the main content from a URL by combining Mozilla Readability and Postlight Mercury algorithms, utilizing over 100 custom adapters for major sites for article, author, date HTML classes.
  2. YouTube Transcript Processing: When a YouTube video URL is detected, retrieve the complete video transcript including both manual captions and auto-generated subtitles, maintaining proper timestamp synchronization.
  3. PDF to HTML: Extracts formatted text from PDF with parsing of linebreaks , page headers, footnotes, and section headings. Supports fonts, links, bold, italics, lists, headings, headers, footnotes, and Table of Contents, Quotes, and Code Blocks. Removes repeated headers, links footnote anchors to the footnote, and preserves number of the PDF page with invisible I element. This function uses pdfjs-serverless to work in more environments than PDF.js-based tools: Cloudflare workers, serverless, node.js, and front-end only.
  4. Basic HTML Standardization: Transform complex HTML into a simplified reading-mode format of basic HTML, making it ideal for research note archival and focused reading, with headings, images and links.
  5. Cite: Identify and extract citation metadata including author names, publication dates, sources, and titles using HTML meta tags and common class name patterns. The system validates author names against a comprehensive database of 90,000 first and last names, distinguishing between personal and organizational authors to properly format citations.

πŸ–₯️ Desktop App

QwkSearch Desktop β€” Built with Tauri. Select any text on screen, press ` to instantly search the web without leaving your workflow.

🧩 Browser Extension

QwkSearch Tab Manager AI β€” AI-powered tab manager that organizes, searches, and manages browser tabs intelligently.

Further Research

🌟 Star this repo so it will grow new features!

PRs Welcome

About

πŸ€–πŸ”Ž STREAM: Search with Top Result Extraction & Answer Model πŸ“ˆπŸ“ REASON Docs Writing Agent πŸšœπŸ“œ Tractor the Text Extractor πŸ”€πŸ“Š SEEKTOPIC

Topics

Resources

License

Stars

73 stars

Watchers

1 watching

Forks

Sponsor this project

 

Packages

 
 
 

Contributors