Skip to content

Suryansh-Dey/llms-client

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

157 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Gemini

Installation

cargo add gemini-client-api

view at crate.io

Overview

A Rust library to use Google's Gemini API with macro super powers! It is extremely flexible and modular to integrate with any framework.
For example, since Actix supports stream of Result<Bytes, Error> for response streaming, you can get it directly instead of making a wrapper stream around a response stream of futures, which is a pain.

Features

  • Automatic context management
  • Automatic function calling. Trust me!
  • Automatic JSON schema generation
  • Inbuilt markdown to parts parser enables AI to see markdown images or files, even if they are from your device storage!
  • Vision to see images
  • Code execution by Gemini
  • File reading like PDF or any document, even audio files like MP3
  • Function call support
  • Thinking and Safety setting
  • Context Caching
  • Supports Session management in WASM environment with default-features = false

TODO

  1. Do the same for OpenAI

About

Rust library for Gemini, chatGPT, etc. with automatic context management

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages