Pocket LLM

An LLM wrapper for popular services using ByteDance's Lynx mobile app framework.

Planned Features

• Branching Discussion Functionality:
  • Editing
  • Re-prompting
• Changing models within a service
• Streaming Text
• Ollama support
• Save user data (needs to be done through Native Modules)
  • Chats
  • API Keys
• Dark mode

As this framework is still very early, there are many bugs and issues currently in this project that are difficult to fix. Feel free to open issues, but be aware Lynx is still does not have all of the mature development features of most other frameworks, which makes it difficult to implement some things.

Contributing

Contributions are welcome! We do not implement any custom native modules yet, so the default Lynx Explorer app will work to run the app.

If you have not developed with Lynx before see Quick Start With Lynx.

There are multiple ways to test apps in Lynx. I personally use Expo Orbit, which provides easy management for Android Studio emulators. I have only tested on the Pixel 9 Pro. Also, pnpm is used for package management.

To get started:

pnpm install
pnpm run dev

Then copy the URL into the emulator to start the app.