Skip to content

๐Ÿ Hand-picked awesome Python libraries and frameworks, organised by category

License

Notifications You must be signed in to change notification settings

dylanhogg/awesome-python

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

Awesome Python

Awesome Last commit License: MIT

Hand-picked awesome Python libraries and frameworks, organised by category ๐Ÿ

Interactive version: www.awesomepython.org

Updated 12 Aug 2024

Categories

  • Newly Created Repositories - Awesome Python is regularly updated, and this category lists the most recently created GitHub repositories from all the other repositories here (10 repos)
  • Code Quality - Code quality tooling: linters, formatters, pre-commit hooks, unused code removal (17 repos)
  • Crypto and Blockchain - Cryptocurrency and blockchain libraries: trading bots, API integration, Ethereum virtual machine, solidity (13 repos)
  • Data - General data libraries: data processing, serialisation, formats, databases, SQL, connectors, web crawlers, data generation/augmentation/checks (101 repos)
  • Debugging - Debugging and tracing tools (9 repos)
  • Diffusion Text to Image - Text-to-image diffusion model libraries, tools and apps for generating images from natural language (42 repos)
  • Finance - Financial and quantitative libraries: investment research tools, market data, algorithmic trading, backtesting, financial derivatives (31 repos)
  • Game Development - Game development tools, engines and libraries (6 repos)
  • GIS - Geospatial libraries: raster and vector data formats, interactive mapping and visualisation, computing frameworks for processing images, projections (29 repos)
  • Graph - Graphs and network libraries: network analysis, graph machine learning, visualisation (6 repos)
  • GUI - Graphical user interface libraries and toolkits (8 repos)
  • Jupyter - Jupyter and JupyterLab and Notebook tools, libraries and plugins (24 repos)
  • LLMs and ChatGPT - Large language model and GPT libraries and frameworks: auto-gpt, agents, QnA, chain-of-thought workflows, API integations. Also see the Natural Language Processing category for crossover (259 repos)
  • Math and Science - Mathematical, numerical and scientific libraries (23 repos)
  • Machine Learning - General - General and classical machine learning libraries. See below for other sections covering specialised ML areas (157 repos)
  • Machine Learning - Deep Learning - Machine learning libraries that cross over with deep learning in some way (76 repos)
  • Machine Learning - Interpretability - Machine learning interpretability libraries. Covers explainability, prediction explainations, dashboards, understanding knowledge development in training (20 repos)
  • Machine Learning - Ops - MLOps tools, frameworks and libraries: intersection of machine learning, data engineering and DevOps; deployment, health, diagnostics and governance of ML models (44 repos)
  • Machine Learning - Reinforcement - Machine learning libraries and toolkits that cross over with reinforcement learning in some way: agent reinforcement learning, agent environemnts, RLHF (22 repos)
  • Machine Learning - Time Series - Machine learning and classical timeseries libraries: forecasting, seasonality, anomaly detection, econometrics (19 repos)
  • Natural Language Processing - Natural language processing libraries and toolkits: text processing, topic modelling, tokenisers, chatbots. Also see the LLMs and ChatGPT category for crossover (82 repos)
  • Packaging - Python packaging, dependency management and bundling (28 repos)
  • Pandas - Pandas and dataframe libraries: data analysis, statistical reporting, pandas GUIs, pandas performance optimisations (24 repos)
  • Performance - Performance, parallelisation and low level libraries (28 repos)
  • Profiling - Memory and CPU/GPU profiling tools and libraries (11 repos)
  • Security - Security related libraries: vulnerability discovery, SQL injection, environment auditing (14 repos)
  • Simulation - Simulation libraries: robotics, economic, agent-based, traffic, physics, astronomy, chemistry, quantum simulation. Also see the Maths and Science category for crossover (28 repos)
  • Study - Miscellaneous study resources: algorithms, general resources, system design, code repos for textbooks, best practices, tutorials (55 repos)
  • Template - Template tools and libraries: cookiecutter repos, generators, quick-starts (9 repos)
  • Terminal - Terminal and console tools and libraries: CLI tools, terminal based formatters, progress bars (15 repos)
  • Testing - Testing libraries: unit testing, load testing, acceptance testing, code coverage, browser automation, plugins (24 repos)
  • Typing - Typing libraries: static and run-time type checking, annotations (12 repos)
  • Utility - General utility libraries: miscellaneous tools, linters, code formatters, version management, package tools, documentation tools (197 repos)
  • Vizualisation - Vizualisation tools and libraries. Application frameworks, 2D/3D plotting, dashboards, WebGL (33 repos)
  • Web - Web related frameworks and libraries: webapp servers, WSGI, ASGI, asyncio, HTTP, REST, user management (58 repos)

Newly Created Repositories

Awesome Python is regularly updated, and this category lists the most recently created GitHub repositories from all the other repositories here.

  1. naklecha/llama3-from-scratch โญ 11,767
    llama3 implementation one matrix multiplication at a time

  2. codium-ai/cover-agent โญ 4,101
    CodiumAI Cover-Agent: An AI-Powered Tool for Automated Test Generation and Code Coverage Enhancement! ๐Ÿ’ป๐Ÿค–๐Ÿงช๐Ÿž
    ๐Ÿ”— www.codium.ai

  3. blealtan/efficient-kan โญ 3,720
    An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).

  4. meta-llama/llama-agentic-system โญ 2,909
    Agentic components of the Llama Stack APIs

  5. lm-sys/RouteLLM โญ 2,675
    A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

  6. mistralai/mistral-finetune โญ 2,606
    A light-weight codebase that enables memory-efficient and performant finetuning of Mistral's models. It is based on LoRA.

  7. thudm/CogVLM2 โญ 1,738
    GPT4V-level open-source multi-modal model based on Llama3-8B

  8. facebookresearch/chameleon โญ 1,668
    Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.
    ๐Ÿ”— arxiv.org/abs/2405.09818

  9. mlfoundations/dclm โญ 1,024
    DataComp for Language Models

  10. likejazz/llama3.np โญ 943
    llama3.np is a pure NumPy implementation for Llama 3 model.

Code Quality

Code quality tooling: linters, formatters, pre-commit hooks, unused code removal.

  1. psf/black โญ 38,144
    The uncompromising Python code formatter
    ๐Ÿ”— black.readthedocs.io/en/stable

  2. astral-sh/ruff โญ 29,753
    An extremely fast Python linter and code formatter, written in Rust.
    ๐Ÿ”— docs.astral.sh/ruff

  3. google/yapf โญ 13,708
    A formatter for Python files

  4. pre-commit/pre-commit โญ 12,555
    A framework for managing and maintaining multi-language pre-commit hooks.
    ๐Ÿ”— pre-commit.com

  5. sqlfluff/sqlfluff โญ 7,492
    A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
    ๐Ÿ”— www.sqlfluff.com

  6. pycqa/isort โญ 6,418
    A Python utility / library to sort imports.
    ๐Ÿ”— pycqa.github.io/isort

  7. davidhalter/jedi โญ 5,740
    Awesome autocompletion, static analysis and refactoring library for python
    ๐Ÿ”— jedi.readthedocs.io

  8. pycqa/pylint โญ 5,222
    It's not just a linter that annoys you!
    ๐Ÿ”— pylint.readthedocs.io/en/latest

  9. asottile/pyupgrade โญ 3,447
    A tool (and pre-commit hook) to automatically upgrade syntax for newer versions of the language.

  10. pycqa/flake8 โญ 3,377
    flake8 is a python tool that glues together pycodestyle, pyflakes, mccabe, and third-party plugins to check the style and quality of some python code.
    ๐Ÿ”— flake8.pycqa.org

  11. jendrikseipp/vulture โญ 3,357
    Find dead Python code

  12. wemake-services/wemake-python-styleguide โญ 2,481
    The strictest and most opinionated python linter ever!
    ๐Ÿ”— wemake-python-styleguide.rtfd.io

  13. codespell-project/codespell โญ 1,830
    check code for common misspellings

  14. python-lsp/python-lsp-server โญ 1,812
    Fork of the python-language-server project, maintained by the Spyder IDE team and the community

  15. sourcery-ai/sourcery โญ 1,513
    Instant AI code reviews
    ๐Ÿ”— sourcery.ai

  16. akaihola/darker โญ 629
    Apply black reformatting to Python files only in regions changed since a given commit. For a practical usage example, see the blog post at https://dev.to/akaihola/improving-python-code-incrementally-3f7a
    ๐Ÿ”— pypi.org/project/darker

  17. tconbeer/sqlfmt โญ 382
    sqlfmt formats your dbt SQL files so you don't have to
    ๐Ÿ”— sqlfmt.com

Crypto and Blockchain

Cryptocurrency and blockchain libraries: trading bots, API integration, Ethereum virtual machine, solidity.

  1. ccxt/ccxt โญ 32,194
    A JavaScript / TypeScript / Python / C# / PHP cryptocurrency trading API with support for more than 100 bitcoin/altcoin exchanges
    ๐Ÿ”— docs.ccxt.com

  2. freqtrade/freqtrade โญ 27,405
    Free, open source crypto trading bot
    ๐Ÿ”— www.freqtrade.io

  3. crytic/slither โญ 5,187
    Static Analyzer for Solidity and Vyper
    ๐Ÿ”— blog.trailofbits.com/2018/10/19/slither-a-solidity-static-analysis-framework

  4. ethereum/web3.py โญ 4,918
    A python interface for interacting with the Ethereum blockchain and ecosystem.
    ๐Ÿ”— web3py.readthedocs.io

  5. ethereum/consensus-specs โญ 3,507
    Ethereum Proof-of-Stake Consensus Specifications

  6. cyberpunkmetalhead/Binance-volatility-trading-bot โญ 3,387
    This is a fully functioning Binance trading bot that measures the volatility of every coin on Binance and places trades with the highest gaining coins If you like this project consider donating though the Brave browser to allow me to continuously improve the script.

  7. ethereum/py-evm โญ 2,237
    A Python implementation of the Ethereum Virtual Machine
    ๐Ÿ”— py-evm.readthedocs.io/en/latest

  8. bmoscon/cryptofeed โญ 2,167
    Cryptocurrency Exchange Websocket Data Feed Handler

  9. binance/binance-public-data โญ 1,431
    Details on how to get Binance public data

  10. ofek/bit โญ 1,237
    Bitcoin made easy.
    ๐Ÿ”— ofek.dev/bit

  11. man-c/pycoingecko โญ 1,038
    Python wrapper for the CoinGecko API

  12. palkeo/panoramix โญ 790
    Ethereum decompiler

  13. dylanhogg/awesome-crypto โญ 66
    A list of awesome crypto and blockchain projects
    ๐Ÿ”— www.awesomecrypto.xyz

Data

General data libraries: data processing, serialisation, formats, databases, SQL, connectors, web crawlers, data generation/augmentation/checks.

  1. scrapy/scrapy โญ 51,973
    Scrapy, a fast high-level web crawling & scraping framework for Python.
    ๐Ÿ”— scrapy.org

  2. apache/spark โญ 39,092
    Apache Spark - A unified analytics engine for large-scale data processing
    ๐Ÿ”— spark.apache.org

  3. mindsdb/mindsdb โญ 25,976
    The platform for building AI from enterprise data
    ๐Ÿ”— mindsdb.com

  4. getredash/redash โญ 25,759
    Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
    ๐Ÿ”— redash.io

  5. jaidedai/EasyOCR โญ 23,183
    Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
    ๐Ÿ”— www.jaided.ai

  6. qdrant/qdrant โญ 19,410
    Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
    ๐Ÿ”— qdrant.tech

  7. humansignal/label-studio โญ 17,813
    Label Studio is an open source data labeling tool. It lets you label data types like audio, text, images, videos, and time series with a simple and straightforward UI and export to various model formats.
    ๐Ÿ”— labelstud.io

  8. joke2k/faker โญ 17,463
    Faker is a Python package that generates fake data for you.
    ๐Ÿ”— faker.readthedocs.io

  9. binux/pyspider โญ 16,437
    A Powerful Spider(Web Crawler) System in Python.
    ๐Ÿ”— docs.pyspider.org

  10. twintproject/twint โญ 15,677
    An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.

  11. airbytehq/airbyte โญ 15,089
    The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
    ๐Ÿ”— airbyte.com

  12. chroma-core/chroma โญ 14,048
    the AI-native open-source embedding database
    ๐Ÿ”— www.trychroma.com

  13. apache/arrow โญ 14,047
    Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
    ๐Ÿ”— arrow.apache.org

  14. tiangolo/sqlmodel โญ 13,782
    SQL databases in Python, designed for simplicity, compatibility, and robustness.
    ๐Ÿ”— sqlmodel.tiangolo.com

  15. redis/redis-py โญ 12,467
    Redis Python client

  16. coleifer/peewee โญ 11,012
    a small, expressive orm -- supports postgresql, mysql, sqlite and cockroachdb
    ๐Ÿ”— docs.peewee-orm.com

  17. s0md3v/Photon โญ 10,766
    Incredibly fast crawler designed for OSINT.

  18. avaiga/taipy โญ 10,597
    Turns Data and AI algorithms into production-ready web applications in no time.
    ๐Ÿ”— www.taipy.io

  19. sqlalchemy/sqlalchemy โญ 9,265
    The Database Toolkit for Python
    ๐Ÿ”— www.sqlalchemy.org

  20. simonw/datasette โญ 9,167
    An open source multi-tool for exploring and publishing data
    ๐Ÿ”— datasette.io

  21. bigscience-workshop/petals โญ 9,007
    ๐ŸŒธ Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
    ๐Ÿ”— petals.dev

  22. yzhao062/pyod โญ 8,359
    A Python Library for Outlier and Anomaly Detection, Integrating Classical and Deep Learning Techniques
    ๐Ÿ”— pyod.readthedocs.io

  23. voxel51/fiftyone โญ 7,983
    The open-source tool for building high-quality datasets and computer vision models
    ๐Ÿ”— fiftyone.ai

  24. gristlabs/grist-core โญ 6,758
    Grist is the evolution of spreadsheets.
    ๐Ÿ”— www.getgrist.com

  25. tobymao/sqlglot โญ 6,190
    Python SQL Parser and Transpiler
    ๐Ÿ”— sqlglot.com

  26. alirezamika/autoscraper โญ 6,109
    A Smart, Automatic, Fast and Lightweight Web Scraper for Python

  27. kaggle/kaggle-api โญ 6,075
    Official Kaggle API

  28. madmaze/pytesseract โญ 5,712
    A Python wrapper for Google Tesseract

  29. vi3k6i5/flashtext โญ 5,570
    Extract Keywords from sentence or Replace keywords in sentences.

  30. airbnb/knowledge-repo โญ 5,462
    A next-generation curated knowledge sharing platform for data scientists and other technical professions.

  31. facebookresearch/AugLy โญ 4,928
    A data augmentations library for audio, image, text, and video.
    ๐Ÿ”— ai.facebook.com/blog/augly-a-new-data-augmentation-library-to-help-build-more-robust-ai-models

  32. ibis-project/ibis โญ 4,752
    Ibis is a Python library that provides a lightweight, universal interface for data wrangling. It helps Python users explore and transform data of any size, stored anywhere.
    ๐Ÿ”— ibis-project.org

  33. superduperdb/superduper โญ 4,596
    Superduper: Bring AI to your database! Integrate AI models and workflows with your database to implement custom AI applications, without moving your data. Including streaming inference, scalable model hosting, training and vector search.
    ๐Ÿ”— superduper.io

  34. jazzband/tablib โญ 4,582
    Python Module for Tabular Datasets in XLS, CSV, JSON, YAML, &c.
    ๐Ÿ”— tablib.readthedocs.io

  35. lk-geimfari/mimesis โญ 4,377
    Mimesis is a robust data generator for Python that can produce a wide range of fake data in multiple languages.
    ๐Ÿ”— mimesis.name

  36. amundsen-io/amundsen โญ 4,361
    Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.
    ๐Ÿ”— www.amundsen.io/amundsen

  37. mongodb/mongo-python-driver โญ 4,099
    PyMongo - the Official MongoDB Python driver
    ๐Ÿ”— pymongo.readthedocs.io

  38. lancedb/lancedb โญ 3,842
    Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!
    ๐Ÿ”— lancedb.github.io/lancedb

  39. giskard-ai/giskard โญ 3,839
    ๐Ÿข Open-Source Evaluation & Testing for LLMs and ML models
    ๐Ÿ”— docs.giskard.ai

  40. andialbrecht/sqlparse โญ 3,671
    A non-validating SQL parser module for Python

  41. jmcnamara/XlsxWriter โญ 3,576
    A Python module for creating Excel XLSX files.
    ๐Ÿ”— xlsxwriter.readthedocs.io

  42. deepchecks/deepchecks โญ 3,520
    Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
    ๐Ÿ”— docs.deepchecks.com/stable

  43. rom1504/img2dataset โญ 3,515
    Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

  44. run-llama/llama-hub โญ 3,434
    A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
    ๐Ÿ”— llamahub.ai

  45. praw-dev/praw โญ 3,425
    PRAW, an acronym for "Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.
    ๐Ÿ”— praw.readthedocs.io

  46. pyeve/cerberus โญ 3,134
    Lightweight, extensible data validation library for Python
    ๐Ÿ”— python-cerberus.org

  47. datafold/data-diff โญ 2,928
    Compare tables within or across databases
    ๐Ÿ”— docs.datafold.com

  48. zoomeranalytics/xlwings โญ 2,921
    xlwings is a Python library that makes it easy to call Python from Excel and vice versa. It works with Excel on Windows and macOS as well as with Google Sheets and Excel on the web.
    ๐Ÿ”— www.xlwings.org

  49. pathwaycom/pathway โญ 2,890
    Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
    ๐Ÿ”— pathway.com

  50. docarray/docarray โญ 2,881
    Represent, send, store and search multimodal data
    ๐Ÿ”— docs.docarray.org

  51. pallets/itsdangerous โญ 2,875
    Safely pass trusted data to untrusted environments and back.
    ๐Ÿ”— itsdangerous.palletsprojects.com

  52. goldsmith/Wikipedia โญ 2,859
    A Pythonic wrapper for the Wikipedia API
    ๐Ÿ”— wikipedia.readthedocs.org

  53. awslabs/amazon-redshift-utils โญ 2,739
    Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment

  54. sqlalchemy/alembic โญ 2,656
    A database migrations tool for SQLAlchemy.

  55. rapidai/RapidOCR โญ 2,612
    Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVION and PaddlePaddle. ๏ผˆๅฐ†PaddleOCRๆจกๅž‹ๅšไบ†่ฝฌๆข๏ผŒ้‡‡็”จONNXRuntimeๆŽจ็†๏ผŒ้€Ÿๅบฆๅพˆๅฟซ๏ผ‰
    ๐Ÿ”— rapidai.github.io/rapidocrdocs

  56. kayak/pypika โญ 2,453
    PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.
    ๐Ÿ”— pypika.readthedocs.io/en/latest

  57. pynamodb/PynamoDB โญ 2,413
    A pythonic interface to Amazon's DynamoDB
    ๐Ÿ”— pynamodb.readthedocs.io

  58. emirozer/fake2db โญ 2,276
    Generate fake but valid data filled databases for test purposes using most popular patterns(AFAIK). Current support is sqlite, mysql, postgresql, mongodb, redis, couchdb.

  59. sdv-dev/SDV โญ 2,253
    Synthetic data generation for tabular data
    ๐Ÿ”— docs.sdv.dev/sdv

  60. uqfoundation/dill โญ 2,227
    serialize all of Python
    ๐Ÿ”— dill.rtfd.io

  61. accenture/AmpliGraph โญ 2,127
    Python library for Representation Learning on Knowledge Graphs https://docs.ampligraph.org

  62. dlt-hub/dlt โญ 2,123
    data load tool (dlt) is an open source Python library that makes data loading easy ๐Ÿ› ๏ธ
    ๐Ÿ”— dlthub.com/docs

  63. graphistry/pygraphistry โญ 2,106
    PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer

  64. samuelcolvin/arq โญ 2,059
    Fast job queuing and RPC in python with asyncio and redis.
    ๐Ÿ”— arq-docs.helpmanual.io

  65. sfu-db/connector-x โญ 1,906
    Fastest library to load data from DB to DataFrames in Rust and Python
    ๐Ÿ”— sfu-db.github.io/connector-x

  66. huggingface/datatrove โญ 1,838
    Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

  67. agronholm/sqlacodegen โญ 1,821
    Automatic model code generator for SQLAlchemy

  68. uber/petastorm โญ 1,773
    Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

  69. milvus-io/bootcamp โญ 1,761
    Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
    ๐Ÿ”— milvus.io

  70. aminalaee/sqladmin โญ 1,745
    SQLAlchemy Admin for FastAPI and Starlette
    ๐Ÿ”— aminalaee.dev/sqladmin

  71. aio-libs/aiomysql โญ 1,734
    aiomysql is a library for accessing a MySQL database from the asyncio
    ๐Ÿ”— aiomysql.rtfd.io

  72. simple-salesforce/simple-salesforce โญ 1,638
    A very simple Salesforce.com REST API client for Python

  73. collerek/ormar โญ 1,630
    python async orm with fastapi in mind and pydantic validation
    ๐Ÿ”— collerek.github.io/ormar

  74. simonw/sqlite-utils โญ 1,602
    Python CLI utility and library for manipulating SQLite databases
    ๐Ÿ”— sqlite-utils.datasette.io

  75. eleutherai/the-pile โญ 1,451
    The Pile is a large, diverse, open source language modelling data set that consists of many smaller datasets combined together.

  76. sdispater/orator โญ 1,429
    The Orator ORM provides a simple yet beautiful ActiveRecord implementation.
    ๐Ÿ”— orator-orm.com

  77. zarr-developers/zarr-python โญ 1,425
    An implementation of chunked, compressed, N-dimensional arrays for Python.
    ๐Ÿ”— zarr.readthedocs.io

  78. mchong6/JoJoGAN โญ 1,416
    Official PyTorch repo for JoJoGAN: One Shot Face Stylization

  79. ydataai/ydata-synthetic โญ 1,396
    Synthetic data generators for tabular and time-series data
    ๐Ÿ”— docs.synthetic.ydata.ai

  80. aio-libs/aiopg โญ 1,387
    aiopg is a library for accessing a PostgreSQL database from the asyncio
    ๐Ÿ”— aiopg.readthedocs.io

  81. google/tensorstore โญ 1,328
    Library for reading and writing large multi-dimensional arrays.
    ๐Ÿ”— google.github.io/tensorstore

  82. scholarly-python-package/scholarly โญ 1,314
    Retrieve author and publication information from Google Scholar in a friendly, Pythonic way without having to worry about CAPTCHAs!
    ๐Ÿ”— scholarly.readthedocs.io

  83. eliasdabbas/advertools โญ 1,109
    advertools - online marketing productivity and analysis tools
    ๐Ÿ”— advertools.readthedocs.io

  84. pytorch/data โญ 1,104
    A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.

  85. aio-libs/aiocache โญ 1,082
    Asyncio cache manager for redis, memcached and memory
    ๐Ÿ”— aiocache.readthedocs.io

  86. brettkromkamp/contextualise โญ 1,043
    Contextualise is an effective tool particularly suited for organising information-heavy projects and activities consisting of unstructured and widely diverse data and information resources
    ๐Ÿ”— contextualise.dev

  87. uber/fiber โญ 1,039
    Distributed Computing for AI Made Simple
    ๐Ÿ”— uber.github.io/fiber

  88. intake/intake โญ 998
    Intake is a lightweight package for finding, investigating, loading and disseminating data.
    ๐Ÿ”— intake.readthedocs.io

  89. duckdb/dbt-duckdb โญ 828
    dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)

  90. scikit-hep/awkward โญ 816
    Manipulate JSON-like data with NumPy-like idioms.
    ๐Ÿ”— awkward-array.org

  91. koaning/human-learn โญ 791
    Natural Intelligence is still a pretty good idea.
    ๐Ÿ”— koaning.github.io/human-learn

  92. goccy/bigquery-emulator โญ 779
    BigQuery emulator provides a way to launch a BigQuery server on your local machine for testing and development.

  93. macbre/sql-metadata โญ 773
    Uses tokenized query returned by python-sqlparse and generates query metadata
    ๐Ÿ”— pypi.python.org/pypi/sql-metadata

  94. hyperqueryhq/whale โญ 724
    ๐Ÿณ The stupidly simple CLI workspace for your data warehouse.
    ๐Ÿ”— rsyi.gitbook.io/whale

  95. googleapis/python-bigquery โญ 723
    Python Client for Google BigQuery

  96. dgarnitz/vectorflow โญ 660
    VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.
    ๐Ÿ”— www.getvectorflow.com

  97. kagisearch/vectordb โญ 604
    A minimal Python package for storing and retrieving text using chunking, embeddings, and vector search.
    ๐Ÿ”— vectordb.com

  98. igorbenav/fastcrud โญ 592
    FastCRUD is a Python package for FastAPI, offering robust async CRUD operations and flexible endpoint creation utilities.

  99. jina-ai/vectordb โญ 517
    A Python vector database you just need - no more, no less.

  100. koaning/doubtlab โญ 503
    Doubt your data, find bad labels.
    ๐Ÿ”— koaning.github.io/doubtlab

  101. koaning/bulk โญ 485
    Bulk is a quick UI developer tool to apply some bulk labels.

Debugging

Debugging and tracing tools.

  1. cool-rr/PySnooper โญ 16,310
    Never use print for debugging again

  2. gruns/icecream โญ 8,799
    ๐Ÿฆ Never use print() to debug again.

  3. shobrook/rebound โญ 4,095
    Command-line tool that instantly fetches Stack Overflow results when an exception is thrown

  4. inducer/pudb โญ 2,931
    Full-screen console debugger for Python
    ๐Ÿ”— documen.tician.de/pudb

  5. gotcha/ipdb โญ 1,842
    Integration of IPython pdb

  6. alexmojaki/heartrate โญ 1,750
    Simple real time visualisation of the execution of a Python program.

  7. alexmojaki/birdseye โญ 1,646
    Graphical Python debugger which lets you easily view the values of all evaluated expressions
    ๐Ÿ”— birdseye.readthedocs.io

  8. alexmojaki/snoop โญ 1,243
    A powerful set of Python debugging tools, based on PySnooper

  9. samuelcolvin/python-devtools โญ 969
    Dev tools for python
    ๐Ÿ”— python-devtools.helpmanual.io

Diffusion Text to Image

Text-to-image diffusion model libraries, tools and apps for generating images from natural language.

  1. automatic1111/stable-diffusion-webui โญ 137,638
    Stable Diffusion web UI

  2. compvis/stable-diffusion โญ 67,039
    A latent text-to-image diffusion model
    ๐Ÿ”— ommer-lab.com/research/latent-diffusion-models

  3. comfyanonymous/ComfyUI โญ 45,565
    The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
    ๐Ÿ”— www.comfy.org

  4. stability-ai/stablediffusion โญ 37,984
    High-Resolution Image Synthesis with Latent Diffusion Models

  5. lllyasviel/ControlNet โญ 29,344
    Let us control diffusion models!

  6. huggingface/diffusers โญ 24,540
    ๐Ÿค— Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
    ๐Ÿ”— huggingface.co/docs/diffusers

  7. invoke-ai/InvokeAI โญ 22,522
    InvokeAI is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, supports terminal use through a CLI, and serves as the foundation for multi...
    ๐Ÿ”— invoke-ai.github.io/invokeai

  8. apple/ml-stable-diffusion โญ 16,575
    Stable Diffusion with Core ML on Apple Silicon

  9. borisdayma/dalle-mini โญ 14,717
    DALLยทE Mini - Generate images from a text prompt
    ๐Ÿ”— www.craiyon.com

  10. divamgupta/diffusionbee-stable-diffusion-ui โญ 12,209
    Diffusion Bee is the easiest way to run Stable Diffusion locally on your M1 Mac. Comes with a one-click installer. No dependencies or technical knowledge needed.
    ๐Ÿ”— diffusionbee.com

  11. compvis/latent-diffusion โญ 11,289
    High-Resolution Image Synthesis with Latent Diffusion Models

  12. lucidrains/DALLE2-pytorch โญ 11,003
    Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

  13. instantid/InstantID โญ 10,672
    InstantID : Zero-shot Identity-Preserving Generation in Seconds ๐Ÿ”ฅ
    ๐Ÿ”— instantid.github.io

  14. openbmb/MiniCPM-V โญ 9,897
    MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

  15. facebookresearch/dinov2 โญ 8,573
    PyTorch code and models for the DINOv2 self-supervised learning method.

  16. ashawkey/stable-dreamfusion โญ 8,083
    Text-to-3D & Image-to-3D & Mesh Exportation with NeRF + Diffusion.

  17. carson-katri/dream-textures โญ 7,733
    Stable Diffusion built-in to Blender

  18. xavierxiao/Dreambooth-Stable-Diffusion โญ 7,545
    Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion

  19. timothybrooks/instruct-pix2pix โญ 6,180
    PyTorch implementation of InstructPix2Pix, an instruction-based image editing model, based on the original CompVis/stable_diffusion repo.

  20. openai/consistency_models โญ 6,046
    Official repo for consistency models.

  21. idea-research/GroundingDINO โญ 5,942
    [ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
    ๐Ÿ”— arxiv.org/abs/2303.05499

  22. opengvlab/InternVL โญ 4,898
    [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. ๆŽฅ่ฟ‘GPT-4o่กจ็Žฐ็š„ๅฏๅ•†็”จๅผ€ๆบๅคšๆจกๆ€ๅฏน่ฏๆจกๅž‹
    ๐Ÿ”— internvl.readthedocs.io/en/latest

  23. salesforce/BLIP โญ 4,543
    PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

  24. nateraw/stable-diffusion-videos โญ 4,377
    Create ๐Ÿ”ฅ videos with Stable Diffusion by exploring the latent space and morphing between text prompts

  25. lkwq007/stablediffusion-infinity โญ 3,840
    Outpainting with Stable Diffusion on an infinite canvas

  26. jina-ai/discoart โญ 3,837
    ๐Ÿชฉ Create Disco Diffusion artworks in one line

  27. mlc-ai/web-stable-diffusion โญ 3,522
    Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
    ๐Ÿ”— mlc.ai/web-stable-diffusion

  28. openai/glide-text2im โญ 3,515
    GLIDE: a diffusion-based text-conditional image synthesis model

  29. openai/improved-diffusion โญ 3,086
    Release for Improved Denoising Diffusion Probabilistic Models

  30. saharmor/dalle-playground โญ 2,764
    A playground to generate images from any text prompt using Stable Diffusion (past: using DALL-E Mini)

  31. stability-ai/stability-sdk โญ 2,416
    SDK for interacting with stability.ai APIs (e.g. stable diffusion inference)
    ๐Ÿ”— platform.stability.ai

  32. google-research/big_vision โญ 2,098
    Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.

  33. thudm/CogVLM2 โญ 1,738
    GPT4V-level open-source multi-modal model based on Llama3-8B

  34. coyote-a/ultimate-upscale-for-automatic1111 โญ 1,581
    Ultimate SD Upscale extension for AUTOMATIC1111 Stable Diffusion web UI

  35. divamgupta/stable-diffusion-tensorflow โญ 1,576
    Stable Diffusion in TensorFlow / Keras

  36. nvlabs/prismer โญ 1,291
    The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
    ๐Ÿ”— shikun.io/projects/prismer

  37. chenyangqiqi/FateZero โญ 1,083
    [ICCV 2023 Oral] "FateZero: Fusing Attentions for Zero-shot Text-based Video Editing"
    ๐Ÿ”— fate-zero-edit.github.io

  38. open-compass/VLMEvalKit โญ 836
    Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 30+ benchmarks
    ๐Ÿ”— huggingface.co/spaces/opencompass/open_vlm_leaderboard

  39. thereforegames/unprompted โญ 770
    Templating language written for Stable Diffusion workflows. Available as an extension for the Automatic1111 WebUI.

  40. sharonzhou/long_stable_diffusion โญ 680
    Long-form text-to-images generation, using a pipeline of deep generative models (GPT-3 and Stable Diffusion)

  41. tanelp/tiny-diffusion โญ 596
    A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.

  42. laion-ai/dalle2-laion โญ 500
    Pretrained Dalle2 from laion

Finance

Financial and quantitative libraries: investment research tools, market data, algorithmic trading, backtesting, financial derivatives.

  1. openbb-finance/OpenBB โญ 26,908
    Investment Research for Everyone, Everywhere.
    ๐Ÿ”— openbb.co

  2. quantopian/zipline โญ 17,388
    Zipline, a Pythonic Algorithmic Trading Library
    ๐Ÿ”— www.zipline.io

  3. microsoft/qlib โญ 14,989
    Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions. Qlib supports diverse machine learning modeling paradigms. including supervised learning, ...
    ๐Ÿ”— qlib.readthedocs.io/en/latest

  4. mementum/backtrader โญ 13,741
    Python Backtesting library for trading strategies
    ๐Ÿ”— www.backtrader.com

  5. ai4finance-foundation/FinGPT โญ 12,846
    FinGPT: Open-Source Financial Large Language Models! Revolutionize ๐Ÿ”ฅ We release the trained model on HuggingFace.
    ๐Ÿ”— ai4finance.org

  6. ranaroussi/yfinance โญ 12,714
    Download market data from Yahoo! Finance's API
    ๐Ÿ”— aroussi.com/post/python-yahoo-finance

  7. ai4finance-foundation/FinRL โญ 9,520
    FinRL: Financial Reinforcement Learning. ๐Ÿ”ฅ
    ๐Ÿ”— ai4finance.org

  8. ta-lib/ta-lib-python โญ 9,354
    Python wrapper for TA-Lib (http://ta-lib.org/).
    ๐Ÿ”— ta-lib.github.io/ta-lib-python

  9. quantconnect/Lean โญ 9,260
    Lean Algorithmic Trading Engine by QuantConnect (Python, C#)
    ๐Ÿ”— lean.io

  10. goldmansachs/gs-quant โญ 7,375
    Python toolkit for quantitative finance
    ๐Ÿ”— developer.gs.com/discover/products/gs-quant

  11. quantopian/pyfolio โญ 5,569
    Portfolio and risk analytics in Python
    ๐Ÿ”— quantopian.github.io/pyfolio

  12. kernc/backtesting.py โญ 5,201
    ๐Ÿ”Ž ๐Ÿ“ˆ ๐Ÿ ๐Ÿ’ฐ Backtest trading strategies in Python.
    ๐Ÿ”— kernc.github.io/backtesting.py

  13. twopirllc/pandas-ta โญ 5,108
    Technical Analysis Indicators - Pandas TA is an easy to use Python 3 Pandas Extension with 150+ Indicators
    ๐Ÿ”— twopirllc.github.io/pandas-ta

  14. ranaroussi/quantstats โญ 4,639
    Portfolio analytics for quants, written in Python

  15. google/tf-quant-finance โญ 4,408
    High-performance TensorFlow library for quantitative finance.

  16. gbeced/pyalgotrade โญ 4,358
    Python Algorithmic Trading Library
    ๐Ÿ”— gbeced.github.io/pyalgotrade

  17. polakowo/vectorbt โญ 4,067
    Find your trading edge, using the fastest engine for backtesting, algorithmic trading, and research.
    ๐Ÿ”— vectorbt.dev

  18. borisbanushev/stockpredictionai โญ 4,040
    In this noteboook I will create a complete process for predicting stock price movements. Follow along and we will achieve some pretty good results. For that purpose we will use a Generative Adversarial Network (GAN) with LSTM, a type of Recurrent Neural Network, as generator, and a Convolutional Neural Networ...

  19. matplotlib/mplfinance โญ 3,544
    Financial Markets Data Visualization using Matplotlib
    ๐Ÿ”— pypi.org/project/mplfinance

  20. cuemacro/finmarketpy โญ 3,403
    Python library for backtesting trading strategies & analyzing financial markets (formerly pythalesians)
    ๐Ÿ”— www.cuemacro.com

  21. quantopian/alphalens โญ 3,220
    Performance analysis of predictive (alpha) stock factors
    ๐Ÿ”— quantopian.github.io/alphalens

  22. zvtvz/zvt โญ 3,099
    modular quant framework.
    ๐Ÿ”— zvt.readthedocs.io/en/latest

  23. robcarver17/pysystemtrade โญ 2,525
    Systematic Trading in python

  24. quantopian/research_public โญ 2,375
    Quantitative research and educational materials
    ๐Ÿ”— www.quantopian.com/lectures

  25. pmorissette/bt โญ 2,137
    bt - flexible backtesting for Python
    ๐Ÿ”— pmorissette.github.io/bt

  26. blankly-finance/blankly โญ 2,052
    ๐Ÿš€ ๐Ÿ’ธ Easily build, backtest and deploy your algo in just a few lines of code. Trade stocks, cryptos, and forex across exchanges w/ one package.
    ๐Ÿ”— package.blankly.finance

  27. domokane/FinancePy โญ 2,024
    A Python Finance Library that focuses on the pricing and risk-management of Financial Derivatives, including fixed-income, equity, FX and credit derivatives.

  28. pmorissette/ffn โญ 1,878
    ffn - a financial function library for Python
    ๐Ÿ”— pmorissette.github.io/ffn

  29. cuemacro/findatapy โญ 1,630
    Python library to download market data via Bloomberg, Eikon, Quandl, Yahoo etc.

  30. quantopian/empyrical โญ 1,262
    Common financial risk and performance metrics. Used by zipline and pyfolio.
    ๐Ÿ”— quantopian.github.io/empyrical

  31. idanya/algo-trader โญ 765
    Trading bot with support for realtime trading, backtesting, custom strategies and much more.

Game Development

Game development tools, engines and libraries.

  1. kitao/pyxel โญ 14,387
    A retro game engine for Python

  2. pygame/pygame โญ 7,235
    ๐Ÿ๐ŸŽฎ pygame (the library) is a Free and Open Source python programming language library for making multimedia applications like games built on top of the excellent SDL library. C, Python, Native, OpenGL.
    ๐Ÿ”— www.pygame.org

  3. panda3d/panda3d โญ 4,405
    Powerful, mature open-source cross-platform game engine for Python and C++, developed by Disney and CMU
    ๐Ÿ”— www.panda3d.org

  4. pokepetter/ursina โญ 2,155
    A game engine powered by python and panda3d.
    ๐Ÿ”— pokepetter.github.io/ursina

  5. pyglet/pyglet โญ 1,830
    pyglet is a cross-platform windowing and multimedia library for Python, for developing games and other visually rich applications.
    ๐Ÿ”— pyglet.org

  6. pythonarcade/arcade โญ 1,669
    Easy to use Python library for creating 2D arcade games.
    ๐Ÿ”— arcade.academy

GIS

Geospatial libraries: raster and vector data formats, interactive mapping and visualisation, computing frameworks for processing images, projections.

  1. domlysz/BlenderGIS โญ 7,539
    Blender addons to make the bridge between Blender and geographic data

  2. python-visualization/folium โญ 6,803
    Python Data. Leaflet.js Maps.
    ๐Ÿ”— python-visualization.github.io/folium

  3. gboeing/osmnx โญ 4,783
    OSMnx is a Python package to easily download, model, analyze, and visualize street networks and other geospatial features from OpenStreetMap.
    ๐Ÿ”— osmnx.readthedocs.io

  4. osgeo/gdal โญ 4,714
    GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats.
    ๐Ÿ”— gdal.org

  5. geopandas/geopandas โญ 4,392
    Python tools for geographic data
    ๐Ÿ”— geopandas.org

  6. shapely/shapely โญ 3,788
    Manipulation and analysis of geometric objects
    ๐Ÿ”— shapely.readthedocs.io/en/stable

  7. giswqs/geemap โญ 3,352
    A Python package for interactive geospatial analysis and visualization with Google Earth Engine.
    ๐Ÿ”— geemap.org

  8. holoviz/datashader โญ 3,283
    Quickly and accurately render even the largest data.
    ๐Ÿ”— datashader.org

  9. opengeos/leafmap โญ 3,120
    A Python package for interactive mapping and geospatial analysis with minimal coding in a Jupyter environment
    ๐Ÿ”— leafmap.org

  10. opengeos/segment-geospatial โญ 2,804
    A Python package for segmenting geospatial data with the Segment Anything Model (SAM)
    ๐Ÿ”— samgeo.gishub.org

  11. google/earthengine-api โญ 2,610
    Python and JavaScript bindings for calling the Earth Engine API.

  12. microsoft/torchgeo โญ 2,387
    TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data
    ๐Ÿ”— www.osgeo.org/projects/torchgeo

  13. rasterio/rasterio โญ 2,197
    Rasterio reads and writes geospatial raster datasets
    ๐Ÿ”— rasterio.readthedocs.io

  14. mcordts/cityscapesScripts โญ 2,132
    README and scripts for the Cityscapes Dataset

  15. azavea/raster-vision โญ 2,032
    An open source library and framework for deep learning on satellite and aerial imagery.
    ๐Ÿ”— docs.rastervision.io

  16. apache/sedona โญ 1,839
    A cluster computing framework for processing large-scale geospatial data
    ๐Ÿ”— sedona.apache.org

  17. plant99/felicette โญ 1,819
    Satellite imagery for dummies.

  18. gboeing/osmnx-examples โญ 1,523
    Gallery of OSMnx tutorials, usage examples, and feature demonstations.
    ๐Ÿ”— osmnx.readthedocs.io

  19. jupyter-widgets/ipyleaflet โญ 1,476
    A Jupyter - Leaflet.js bridge
    ๐Ÿ”— ipyleaflet.readthedocs.io

  20. microsoft/GlobalMLBuildingFootprints โญ 1,342
    Worldwide building footprints derived from satellite imagery

  21. pysal/pysal โญ 1,300
    PySAL: Python Spatial Analysis Library Meta-Package
    ๐Ÿ”— pysal.org/pysal

  22. anitagraser/movingpandas โญ 1,183
    Movement trajectory classes and functions built on top of GeoPandas
    ๐Ÿ”— movingpandas.org

  23. residentmario/geoplot โญ 1,141
    High-level geospatial data visualization library for Python.
    ๐Ÿ”— residentmario.github.io/geoplot/index.html

  24. sentinel-hub/eo-learn โญ 1,103
    Earth observation processing framework for machine learning in Python
    ๐Ÿ”— eo-learn.readthedocs.io/en/latest

  25. opengeos/streamlit-geospatial โญ 845
    A multi-page streamlit app for geospatial
    ๐Ÿ”— huggingface.co/spaces/giswqs/streamlit

  26. osgeo/grass โญ 810
    GRASS GIS - free and open-source geospatial processing engine
    ๐Ÿ”— grass.osgeo.org

  27. makepath/xarray-spatial โญ 808
    Raster-based Spatial Analytics for Python
    ๐Ÿ”— xarray-spatial.readthedocs.io

  28. developmentseed/titiler โญ 745
    Build your own Raster dynamic map tile services
    ๐Ÿ”— developmentseed.org/titiler

  29. scikit-mobility/scikit-mobility โญ 703
    scikit-mobility: mobility analysis in Python
    ๐Ÿ”— scikit-mobility.github.io/scikit-mobility

Graph

Graphs and network libraries: network analysis, graph machine learning, visualisation.

  1. networkx/networkx โญ 14,575
    Network Analysis in Python
    ๐Ÿ”— networkx.org

  2. stellargraph/stellargraph โญ 2,925
    StellarGraph - Machine Learning on Graphs
    ๐Ÿ”— stellargraph.readthedocs.io

  3. westhealth/pyvis โญ 960
    Python package for creating and visualizing interactive network graphs.
    ๐Ÿ”— pyvis.readthedocs.io/en/latest

  4. microsoft/graspologic โญ 737
    graspologic is a package for graph statistical algorithms
    ๐Ÿ”— graspologic-org.github.io/graspologic

  5. rampasek/GraphGPS โญ 636
    Recipe for a General, Powerful, Scalable Graph Transformer

  6. dylanhogg/llmgraph โญ 256
    Create knowledge graphs with LLMs

GUI

Graphical user interface libraries and toolkits.

  1. pysimplegui/PySimpleGUI โญ 13,304
    Python GUIs for Humans! PySimpleGUI is the top-rated Python application development environment. Launched in 2018 and actively developed, maintained, and supported in 2024. Transforms tkinter, Qt, WxPython, and Remi into a simple, intuitive, and fun experience for both hobbyists and expert users.
    ๐Ÿ”— www.pysimplegui.com

  2. hoffstadt/DearPyGui โญ 12,795
    Dear PyGui: A fast and powerful Graphical User Interface Toolkit for Python with minimal dependencies
    ๐Ÿ”— dearpygui.readthedocs.io/en/latest

  3. parthjadhav/Tkinter-Designer โญ 8,785
    An easy and fast way to create a Python GUI ๐Ÿ

  4. samuelcolvin/FastUI โญ 7,960
    FastUI is a new way to build web application user interfaces defined by declarative Python code.
    ๐Ÿ”— fastui-demo.onrender.com

  5. r0x0r/pywebview โญ 4,556
    Build GUI for your Python program with JavaScript, HTML, and CSS
    ๐Ÿ”— pywebview.flowrl.com

  6. beeware/toga โญ 4,243
    A Python native, OS native GUI toolkit.
    ๐Ÿ”— toga.readthedocs.io/en/latest

  7. dddomodossola/remi โญ 3,489
    Python REMote Interface library. Platform independent. In about 100 Kbytes, perfect for your diet.

  8. wxwidgets/Phoenix โญ 2,266
    wxPython's Project Phoenix. A new implementation of wxPython, better, stronger, faster than he was before.
    ๐Ÿ”— wxpython.org

Jupyter

Jupyter and JupyterLab and Notebook tools, libraries and plugins.

  1. jupyterlab/jupyterlab โญ 14,006
    JupyterLab computational environment.
    ๐Ÿ”— jupyterlab.readthedocs.io

  2. jupyter/notebook โญ 11,472
    Jupyter Interactive Notebook
    ๐Ÿ”— jupyter-notebook.readthedocs.io

  3. mwouts/jupytext โญ 6,544
    Jupyter Notebooks as Markdown Documents, Julia, Python or R scripts
    ๐Ÿ”— jupytext.readthedocs.io

  4. nteract/papermill โญ 5,743
    ๐Ÿ“š Parameterize, execute, and analyze notebooks
    ๐Ÿ”— papermill.readthedocs.io/en/latest

  5. connorferster/handcalcs โญ 5,383
    Python library for converting Python calculations into rendered latex.

  6. voila-dashboards/voila โญ 5,351
    Voilร  turns Jupyter notebooks into standalone web applications
    ๐Ÿ”— voila.readthedocs.io

  7. executablebooks/jupyter-book โญ 3,792
    Create beautiful, publication-quality books and documents from computational content.
    ๐Ÿ”— jupyterbook.org

  8. jupyterlite/jupyterlite โญ 3,769
    Wasm powered Jupyter running in the browser ๐Ÿ’ก
    ๐Ÿ”— jupyterlite.rtfd.io/en/stable/try/lab

  9. jupyterlab/jupyterlab-desktop โญ 3,585
    JupyterLab desktop application, based on Electron.

  10. jupyter-widgets/ipywidgets โญ 3,116
    Interactive Widgets for the Jupyter Notebook
    ๐Ÿ”— ipywidgets.readthedocs.io

  11. jupyterlab/jupyter-ai โญ 3,052
    A generative AI extension for JupyterLab
    ๐Ÿ”— jupyter-ai.readthedocs.io

  12. quantopian/qgrid โญ 3,034
    An interactive grid for sorting, filtering, and editing DataFrames in Jupyter notebooks

  13. jupyter/nbdime โญ 2,640
    Tools for diffing and merging of Jupyter notebooks.
    ๐Ÿ”— nbdime.readthedocs.io

  14. mito-ds/mito โญ 2,266
    The mitosheet package, trymito.io, and other public Mito code.
    ๐Ÿ”— trymito.io

  15. jupyter/nbviewer โญ 2,196
    nbconvert as a web service: Render Jupyter Notebooks as static web pages
    ๐Ÿ”— nbviewer.jupyter.org

  16. maartenbreddels/ipyvolume โญ 1,928
    3d plotting for Python in the Jupyter notebook based on IPython widgets using WebGL

  17. jupyter-lsp/jupyterlab-lsp โญ 1,773
    Coding assistance for JupyterLab (code navigation + hover suggestions + linters + autocompletion + rename) using Language Server Protocol
    ๐Ÿ”— jupyterlab-lsp.readthedocs.io

  18. jupyter/nbconvert โญ 1,703
    Jupyter Notebook Conversion
    ๐Ÿ”— nbconvert.readthedocs.io

  19. nbqa-dev/nbQA โญ 1,009
    Run ruff, isort, pyupgrade, mypy, pylint, flake8, and more on Jupyter Notebooks
    ๐Ÿ”— nbqa.readthedocs.io/en/latest/index.html

  20. vizzuhq/ipyvizzu โญ 941
    Build animated charts in Jupyter Notebook and similar environments with a simple Python syntax.
    ๐Ÿ”— ipyvizzu.vizzuhq.com

  21. koaning/drawdata โญ 749
    Draw datasets from within Jupyter.
    ๐Ÿ”— calmcode.io/labs/drawdata.html

  22. aws/graph-notebook โญ 705
    Library extending Jupyter notebooks to integrate with Apache TinkerPop, openCypher, and RDF SPARQL.
    ๐Ÿ”— github.com/aws/graph-notebook

  23. linealabs/lineapy โญ 664
    Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two lines of code.
    ๐Ÿ”— lineapy.org

  24. xiaohk/stickyland โญ 509
    Break the linear presentation of Jupyter Notebooks with sticky cells!
    ๐Ÿ”— xiaohk.github.io/stickyland

LLMs and ChatGPT

Large language model and GPT libraries and frameworks: auto-gpt, agents, QnA, chain-of-thought workflows, API integations. Also see the Natural Language Processing category for crossover.

  1. significant-gravitas/AutoGPT โญ 165,614
    AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
    ๐Ÿ”— agpt.co

  2. hwchase17/langchain โญ 90,483
    ๐Ÿฆœ๐Ÿ”— Build context-aware reasoning applications
    ๐Ÿ”— python.langchain.com

  3. nomic-ai/gpt4all โญ 68,427
    GPT4All: Chat with Local LLMs on Any Device
    ๐Ÿ”— nomic.ai/gpt4all

  4. ggerganov/llama.cpp โญ 63,308
    LLM inference in C/C++

  5. xtekky/gpt4free โญ 59,588
    The official gpt4free repository | various collection of powerful language models
    ๐Ÿ”— g4f.ai

  6. facebookresearch/llama โญ 54,977
    Inference code for Llama models

  7. imartinez/private-gpt โญ 53,239
    Interact with your documents using the power of GPT, 100% privately, no data leaks
    ๐Ÿ”— docs.privategpt.dev

  8. gpt-engineer-org/gpt-engineer โญ 51,581
    Specify what you want it to build, the AI asks for clarification, and then builds it. Completely separate team and codebase from the AI Web App builder https://gptengineer.app

  9. killianlucas/open-interpreter โญ 51,412
    A natural language interface for computers
    ๐Ÿ”— openinterpreter.com

  10. xai-org/grok-1 โญ 49,250
    This repository contains JAX example code for loading and running the Grok-1 open-weights model.

  11. geekan/MetaGPT โญ 42,242
    ๐ŸŒŸ The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
    ๐Ÿ”— deepwisdom.ai

  12. thudm/ChatGLM-6B โญ 40,217
    ChatGLM-6B: An Open Bilingual Dialogue Language Model | ๅผ€ๆบๅŒ่ฏญๅฏน่ฏ่ฏญ่จ€ๆจกๅž‹

  13. oobabooga/text-generation-webui โญ 38,906
    A Gradio web UI for Large Language Models.

  14. hpcaitech/ColossalAI โญ 38,474
    Making large AI models cheaper, faster and more accessible
    ๐Ÿ”— www.colossalai.org

  15. laion-ai/Open-Assistant โญ 36,889
    OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
    ๐Ÿ”— open-assistant.io

  16. lm-sys/FastChat โญ 36,085
    An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  17. karpathy/nanoGPT โญ 35,504
    The simplest, fastest repository for training/finetuning medium-sized GPTs.

  18. moymix/TaskMatrix โญ 34,532
    Connects ChatGPT and a series of Visual Foundation Models to enable sending and receiving images during chatting.

  19. quivrhq/quivr โญ 34,528
    Open-source RAG Framework for building GenAI Second Brains ๐Ÿง  Build productivity assistant (RAG) โšก๏ธ๐Ÿค– Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, Groq that you can share with users ! Efficient retrieval augmented generation framework
    ๐Ÿ”— quivr.com

  20. jerryjliu/llama_index โญ 34,335
    LlamaIndex is a data framework for your LLM applications
    ๐Ÿ”— docs.llamaindex.ai

  21. microsoft/autogen โญ 29,377
    A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
    ๐Ÿ”— microsoft.github.io/autogen

  22. pythagora-io/gpt-pilot โญ 29,284
    The first real AI developer

  23. tatsu-lab/stanford_alpaca โญ 29,252
    Code and documentation to train Stanford's Alpaca models, and generate the data.
    ๐Ÿ”— crfm.stanford.edu/2023/03/13/alpaca.html

  24. hiyouga/LLaMA-Factory โญ 28,756
    A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
    ๐Ÿ”— arxiv.org/abs/2403.13372

  25. meta-llama/llama3 โญ 25,401
    The official Meta Llama 3 GitHub site

  26. vision-cair/MiniGPT-4 โญ 25,215
    Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
    ๐Ÿ”— minigpt-4.github.io

  27. vllm-project/vllm โญ 24,549
    A high-throughput and memory-efficient inference and serving engine for LLMs
    ๐Ÿ”— docs.vllm.ai

  28. logspace-ai/langflow โญ 23,973
    โ›“๏ธ Langflow is a visual framework for building multi-agent and RAG applications. It's open-source, Python-powered, fully customizable, model and vector store agnostic.
    ๐Ÿ”— www.langflow.org

  29. microsoft/JARVIS โญ 23,457
    JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

  30. karpathy/llm.c โญ 22,562
    LLM training in simple, pure C/CUDA. There is no need for 245MB of PyTorch or 107MB of cPython

  31. openai/gpt-2 โญ 22,097
    Code for the paper "Language Models are Unsupervised Multitask Learners"
    ๐Ÿ”— openai.com/blog/better-language-models

  32. openai/chatgpt-retrieval-plugin โญ 20,994
    The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.

  33. microsoft/semantic-kernel โญ 20,975
    Integrate cutting-edge LLM technology quickly and easily into your apps
    ๐Ÿ”— aka.ms/semantic-kernel

  34. danielmiessler/fabric โญ 20,228
    fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.
    ๐Ÿ”— danielmiessler.com/p/fabric-origin-story

  35. yoheinakajima/babyagi โญ 19,806
    GPT-4 powered task-driven autonomous agent

  36. karpathy/minGPT โญ 19,633
    A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

  37. embedchain/mem0 โญ 19,322
    The memory layer for Personalized AI
    ๐Ÿ”— mem0.ai

  38. haotian-liu/LLaVA โญ 18,643
    [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
    ๐Ÿ”— llava.hliu.cc

  39. tloen/alpaca-lora โญ 18,475
    Instruct-tune LLaMA on consumer hardware

  40. rasahq/rasa โญ 18,441
    ๐Ÿ’ฌ Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
    ๐Ÿ”— rasa.com/docs/rasa

  41. guidance-ai/guidance โญ 18,437
    A guidance language for controlling large language models.

  42. mlc-ai/mlc-llm โญ 18,321
    Universal LLM Deployment Engine with ML Compilation
    ๐Ÿ”— llm.mlc.ai

  43. joaomdmoura/crewAI โญ 18,134
    Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
    ๐Ÿ”— crewai.com

  44. stitionai/devika โญ 18,092
    Devika is an advanced AI software engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective.

  45. karpathy/llama2.c โญ 16,997
    Inference Llama 2 in one file of pure C

  46. facebookresearch/codellama โญ 15,754
    Inference code for CodeLlama models

  47. thudm/ChatGLM2-6B โญ 15,668
    ChatGLM2-6B: An Open Bilingual Chat LLM | ๅผ€ๆบๅŒ่ฏญๅฏน่ฏ่ฏญ่จ€ๆจกๅž‹

  48. huggingface/peft โญ 15,409
    ๐Ÿค— PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
    ๐Ÿ”— huggingface.co/docs/peft

  49. stanfordnlp/dspy โญ 15,391
    DSPy: The framework for programmingโ€”not promptingโ€”foundation models
    ๐Ÿ”— dspy-docs.vercel.app

  50. transformeroptimus/SuperAGI โญ 15,108
    <โšก๏ธ> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
    ๐Ÿ”— superagi.com

  51. deepset-ai/haystack โญ 15,085
    ๐Ÿ” LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conv...
    ๐Ÿ”— haystack.deepset.ai

  52. mayooear/gpt4-pdf-chatbot-langchain โญ 14,801
    GPT4 & LangChain Chatbot for large PDF docs
    ๐Ÿ”— www.youtube.com/watch?v=ih9pbgvvoo4

  53. openai/evals โญ 14,513
    Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

  54. microsoft/graphrag โญ 14,488
    A modular graph-based Retrieval-Augmented Generation (RAG) system
    ๐Ÿ”— microsoft.github.io/graphrag

  55. fauxpilot/fauxpilot โญ 14,478
    FauxPilot - an open-source alternative to GitHub Copilot server

  56. idea-research/Grounded-Segment-Anything โญ 14,474
    Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything
    ๐Ÿ”— arxiv.org/abs/2401.14159

  57. unslothai/unsloth โญ 14,043
    Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
    ๐Ÿ”— unsloth.ai

  58. infiniflow/ragflow โญ 13,868
    RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
    ๐Ÿ”— ragflow.io

  59. assafelovic/gpt-researcher โญ 13,533
    GPT based autonomous agent that does online comprehensive research on any given topic
    ๐Ÿ”— gptr.dev

  60. qwenlm/Qwen โญ 12,961
    The official repo of Qwen (้€šไน‰ๅƒ้—ฎ) chat & pretrained large language model proposed by Alibaba Cloud.

  61. dao-ailab/flash-attention โญ 12,854
    Fast and memory-efficient exact attention

  62. blinkdl/RWKV-LM โญ 12,101
    RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

  63. mlc-ai/web-llm โญ 11,984
    High-performance In-browser LLM Inference Engine
    ๐Ÿ”— webllm.mlc.ai

  64. openlmlab/MOSS โญ 11,896
    An open-source tool-augmented conversational language model from Fudan University
    ๐Ÿ”— txsun1997.github.io/blogs/moss.html

  65. paddlepaddle/PaddleNLP โญ 11,836
    ๐Ÿ‘‘ Easy-to-use and powerful NLP and LLM library with ๐Ÿค— Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including ๐Ÿ—‚Text Classification, ๐Ÿ” Neural Search, โ“ Question Answering, โ„น๏ธ Information Extraction, ๐Ÿ“„ Document Intelligence, ๐Ÿ’Œ Sentiment Analysis etc.
    ๐Ÿ”— paddlenlp.readthedocs.io

  66. smol-ai/developer โญ 11,768
    the first library to let you embed a developer agent in your own app!
    ๐Ÿ”— twitter.com/smolmodels

  67. facebookresearch/llama-recipes โญ 11,245
    Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta ...

  68. berriai/litellm โญ 11,123
    LLM Proxy to call 100+ LLM APIs using the OpenAI format - Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq
    ๐Ÿ”— docs.litellm.ai/docs

  69. h2oai/h2ogpt โญ 11,112
    Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/
    ๐Ÿ”— h2o.ai

  70. shishirpatil/gorilla โญ 11,026
    Enables LLMs to use tools by invoking APIs. Given a query, Gorilla comes up with the semantically and syntactically correct API.
    ๐Ÿ”— gorilla.cs.berkeley.edu

  71. phidatahq/phidata โญ 10,923
    Phidata is a toolkit for building AI Assistants using function calling.
    ๐Ÿ”— docs.phidata.com

  72. databrickslabs/dolly โญ 10,808
    Databricksโ€™ Dolly, a large language model trained on the Databricks Machine Learning Platform
    ๐Ÿ”— www.databricks.com/blog/2023/03/24/hello-dolly-democratizing-magic-chatgpt-open-models.html

  73. vanna-ai/vanna โญ 10,277
    ๐Ÿค– Chat with your SQL database ๐Ÿ“Š. Accurate Text-to-SQL Generation via LLMs using RAG ๐Ÿ”„.
    ๐Ÿ”— vanna.ai/docs

  74. microsoft/LoRA โญ 10,033
    Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
    ๐Ÿ”— arxiv.org/abs/2106.09685

  75. google-research/vision_transformer โญ 9,884
    Vision Transformer and MLP-Mixer Architectures

  76. artidoro/qlora โญ 9,798
    QLoRA: Efficient Finetuning of Quantized LLMs
    ๐Ÿ”— arxiv.org/abs/2305.14314

  77. nvidia/Megatron-LM โญ 9,643
    Ongoing research training transformer models at scale
    ๐Ÿ”— docs.nvidia.com/megatron-core/developer-guide/latest/user-guide/index.html#quick-start

  78. mistralai/mistral-inference โญ 9,407
    Official inference library for Mistral models
    ๐Ÿ”— mistral.ai

  79. blinkdl/ChatRWKV โญ 9,351
    ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

  80. lightning-ai/litgpt โญ 9,325
    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
    ๐Ÿ”— lightning.ai

  81. lightning-ai/litgpt โญ 9,313
    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
    ๐Ÿ”— lightning.ai

  82. mshumer/gpt-prompt-engineer โญ 9,221
    Simply input a description of your task and some test cases, and the system will generate, test, and rank a multitude of prompts to find the ones that perform the best.

  83. microsoft/promptflow โญ 9,002
    Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
    ๐Ÿ”— microsoft.github.io/promptflow

  84. lvwerra/trl โญ 8,964
    Train transformer language models with reinforcement learning.
    ๐Ÿ”— hf.co/docs/trl

  85. karpathy/minbpe โญ 8,858
    Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

  86. apple/ml-ferret โญ 8,259
    Ferret: Refer and Ground Anything Anywhere at Any Granularity

  87. eleutherai/gpt-neo โญ 8,189
    An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
    ๐Ÿ”— www.eleuther.ai

  88. optimalscale/LMFlow โญ 8,169
    An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
    ๐Ÿ”— optimalscale.github.io/lmflow

  89. thudm/CodeGeeX โญ 8,049
    CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
    ๐Ÿ”— codegeex.cn

  90. outlines-dev/outlines โญ 7,793
    Structured Text Generation from LLMs
    ๐Ÿ”— outlines-dev.github.io/outlines

  91. lianjiatech/BELLE โญ 7,765
    BELLE: Be Everyone's Large Language model Engine๏ผˆๅผ€ๆบไธญๆ–‡ๅฏน่ฏๅคงๆจกๅž‹๏ผ‰

  92. sjtu-ipads/PowerInfer โญ 7,764
    High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

  93. thudm/GLM-130B โญ 7,650
    GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

  94. plachtaa/VALL-E-X โญ 7,487
    An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io

  95. jzhang38/TinyLlama โญ 7,478
    The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

  96. abetlen/llama-cpp-python โญ 7,433
    Simple Python bindings for @ggerganov's llama.cpp library.
    ๐Ÿ”— llama-cpp-python.readthedocs.io

  97. sweepai/sweep โญ 7,354
    Sweep: open-source AI-powered Software Developer for small features and bug fixes.
    ๐Ÿ”— sweep.dev

  98. openlm-research/open_llama โญ 7,322
    OpenLLaMA: An Open Reproduction of LLaMA

  99. bigcode-project/starcoder โญ 7,227
    Home of StarCoder: fine-tuning & inference!

  100. vaibhavs10/insanely-fast-whisper โญ 7,104
    An opinionated CLI to transcribe Audio files w/ Whisper on-device! Powered by ๐Ÿค— Transformers, Optimum & flash-attn

  101. jxnl/instructor โญ 7,069
    Instructor is a Python library that makes it a breeze to work with structured outputs from large language models (LLMs). Built on top of Pydantic, it provides a simple, transparent, and user-friendly API to manage validation, retries, and streaming responses.
    ๐Ÿ”— python.useinstructor.com

  102. zilliztech/GPTCache โญ 6,992
    Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
    ๐Ÿ”— gptcache.readthedocs.io

  103. apple/corenet โญ 6,874
    CoreNet is a deep neural network toolkit that allows researchers and engineers to train standard and novel small and large-scale models for variety of tasks, including foundation models (e.g., CLIP and LLM), object classification, object detection, and semantic segmentation.

  104. bhaskatripathi/pdfGPT โญ 6,867
    PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The most effective open source solution to turn your pdf files in a chatbot!
    ๐Ÿ”— huggingface.co/spaces/bhaskartripathi/pdfgpt_turbo

  105. eleutherai/gpt-neox โญ 6,746
    An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
    ๐Ÿ”— www.eleuther.ai

  106. chainlit/chainlit โญ 6,480
    Build Conversational AI in minutes โšก๏ธ
    ๐Ÿ”— docs.chainlit.io

  107. mit-han-lab/streaming-llm โญ 6,413
    [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
    ๐Ÿ”— arxiv.org/abs/2309.17453

  108. skypilot-org/skypilot โญ 6,380
    SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
    ๐Ÿ”— skypilot.readthedocs.io

  109. langchain-ai/opengpts โญ 6,375
    An open source effort to create a similar experience to OpenAI's GPTs and Assistants API.

  110. nat/openplayground โญ 6,187
    An LLM playground you can run on your laptop

  111. run-llama/rags โญ 6,139
    Build ChatGPT over your data, all with natural language

  112. eleutherai/lm-evaluation-harness โญ 6,107
    A framework for few-shot evaluation of language models.
    ๐Ÿ”— www.eleuther.ai

  113. explodinggradients/ragas โญ 6,085
    Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
    ๐Ÿ”— docs.ragas.io

  114. internlm/InternLM โญ 6,010
    Official release of InternLM2.5 base and chat models. 1M context support
    ๐Ÿ”— internlm.intern-ai.org.cn

  115. lightning-ai/lit-llama โญ 5,917
    Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

  116. skyvern-ai/skyvern โญ 5,599
    Skyvern automates browser-based workflows using LLMs and computer vision. It provides a simple API endpoint to fully automate manual workflows, replacing brittle or unreliable automation solutions.
    ๐Ÿ”— www.skyvern.com

  117. pytorch-labs/gpt-fast โญ 5,439
    Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

  118. minedojo/Voyager โญ 5,423
    An Open-Ended Embodied Agent with Large Language Models
    ๐Ÿ”— voyager.minedojo.org

  119. weaviate/Verba โญ 5,414
    Retrieval Augmented Generation (RAG) chatbot powered by Weaviate

  120. dsdanielpark/Bard-API โญ 5,348
    The unofficial python package that returns response of Google Bard through cookie value.
    ๐Ÿ”— pypi.org/project/bardapi

  121. microsoft/promptbase โญ 5,295
    promptbase is an evolving collection of resources, best practices, and example scripts for eliciting the best performance from foundation models.

  122. langchain-ai/chat-langchain โญ 5,057
    Locally hosted chatbot specifically focused on question answering over the LangChain documentation
    ๐Ÿ”— chat.langchain.com

  123. langchain-ai/langgraph โญ 5,022
    LangGraph is a library for building stateful, multi-actor applications with LLMs, built on top of (and intended to be used with) LangChain.
    ๐Ÿ”— langchain-ai.github.io/langgraph

  124. mnotgod96/AppAgent โญ 4,768
    AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.
    ๐Ÿ”— appagent-official.github.io

  125. vikhyat/moondream โญ 4,723
    A tiny open-source computer-vision language model designed to run efficiently on edge devices
    ๐Ÿ”— moondream.ai

  126. openbmb/ToolBench โญ 4,667
    [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
    ๐Ÿ”— openbmb.github.io/toolbench

  127. togethercomputer/RedPajama-Data โญ 4,482
    The RedPajama-Data repository contains code for preparing large datasets for training large language models.

  128. llmware-ai/llmware โญ 4,342
    Unified framework for building enterprise RAG pipelines with small, specialized models
    ๐Ÿ”— llmware-ai.github.io/llmware

  129. microsoft/LLMLingua โญ 4,321
    To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
    ๐Ÿ”— llmlingua.com

  130. arcee-ai/mergekit โญ 4,296
    Tools for merging pretrained large language models.

  131. cg123/mergekit โญ 4,294
    Tools for merging pretrained large language models.

  132. allenai/OLMo โญ 4,284
    OLMo is a repository for training and using AI2's state-of-the-art open language models. It is built by scientists, for scientists.
    ๐Ÿ”— allenai.org/olmo

  133. microsoft/BioGPT โญ 4,273
    Implementation of BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining

  134. 1rgs/jsonformer โญ 4,235
    A Bulletproof Way to Generate Structured JSON from Language Models

  135. kyegomez/tree-of-thoughts โญ 4,207
    Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
    ๐Ÿ”— discord.gg/qutxnk2nmf

  136. instruction-tuning-with-gpt-4/GPT-4-LLM โญ 4,140
    Instruction Tuning with GPT-4
    ๐Ÿ”— instruction-tuning-with-gpt-4.github.io

  137. sgl-project/sglang โญ 4,033
    SGLang is yet another fast serving framework for large language models and vision language models.

  138. yizhongw/self-instruct โญ 4,005
    Aligning pretrained language models with instruction data generated by themselves.

  139. mshumer/gpt-llm-trainer โญ 3,894
    Input a description of your task, and the system will generate a dataset, parse it, and fine-tune a LLaMA 2 model for you

  140. nvidia/NeMo-Guardrails โญ 3,872
    NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

  141. promptfoo/promptfoo โญ 3,854
    Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
    ๐Ÿ”— www.promptfoo.dev

  142. ravenscroftj/turbopilot โญ 3,832
    Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU

  143. h2oai/h2o-llmstudio โญ 3,831
    H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
    ๐Ÿ”— gpt-gm.h2o.ai

  144. whitead/paper-qa โญ 3,815
    LLM Chain for answering questions from documents with citations

  145. guardrails-ai/guardrails โญ 3,738
    Open-source Python package for specifying structure and type, validating and correcting the outputs of large language models (LLMs)
    ๐Ÿ”— www.guardrailsai.com/docs

  146. simonw/llm โญ 3,648
    Access large language models from the command-line
    ๐Ÿ”— llm.datasette.io

  147. mmabrouk/llm-workflow-engine โญ 3,631
    Power CLI and Workflow manager for LLMs (core package)

  148. eth-sri/lmql โญ 3,551
    A language for constraint-guided and efficient LLM programming.
    ๐Ÿ”— lmql.ai

  149. luodian/Otter โญ 3,537
    ๐Ÿฆฆ Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
    ๐Ÿ”— otter-ntu.github.io

  150. open-compass/opencompass โญ 3,524
    OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
    ๐Ÿ”— opencompass.org.cn

  151. microsoft/LMOps โญ 3,486
    General technology for enabling AI capabilities w/ LLMs and MLLMs
    ๐Ÿ”— aka.ms/generalai

  152. minimaxir/simpleaichat โญ 3,456
    Python package for easily interfacing with chat apps, with robust features and minimal code complexity.

  153. pathwaycom/llm-app โญ 3,419
    Dynamic RAG for enterprise. Ready to run with Docker,โšกin sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.
    ๐Ÿ”— pathway.com/developers/templates

  154. minimaxir/gpt-2-simple โญ 3,402
    Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts

  155. turboderp/exllamav2 โญ 3,348
    A fast inference library for running LLMs locally on modern consumer-class GPUs

  156. deep-diver/LLM-As-Chatbot โญ 3,270
    LLM as a Chatbot Service

  157. defog-ai/sqlcoder โญ 3,200
    SoTA LLM for converting natural language questions to SQL queries

  158. jaymody/picoGPT โญ 3,141
    An unnecessarily tiny implementation of GPT-2 in NumPy.

  159. next-gpt/NExT-GPT โญ 3,138
    Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model
    ๐Ÿ”— next-gpt.github.io

  160. agiresearch/AIOS โญ 3,116
    AIOS, a Large Language Model (LLM) Agent operating system, embeds large language model into Operating Systems (OS) as the brain of the OS, enabling an operating system "with soul" -- an important step towards AGI.
    ๐Ÿ”— aios.foundation

  161. truefoundry/cognita โญ 3,076
    RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
    ๐Ÿ”— cognita.truefoundry.com

  162. iryna-kondr/scikit-llm โญ 3,019
    Seamlessly integrate LLMs into scikit-learn.
    ๐Ÿ”— beastbyte.ai

  163. microsoft/torchscale โญ 2,986
    Foundation Architecture for (M)LLMs
    ๐Ÿ”— aka.ms/generalai

  164. baichuan-inc/Baichuan-13B โญ 2,973
    A 13B large language model developed by Baichuan Intelligent Technology
    ๐Ÿ”— huggingface.co/baichuan-inc/baichuan-13b-chat

  165. meta-llama/llama-agentic-system โญ 2,909
    Agentic components of the Llama Stack APIs

  166. freedomintelligence/LLMZoo โญ 2,909
    โšกLLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.โšก

  167. li-plus/chatglm.cpp โญ 2,862
    C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4

  168. modelscope/ms-swift โญ 2,810
    Use PEFT or Full-parameter to finetune 300+ LLMs or 60+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3.1, Llava-Video, Internvl2, MiniCPM-V-2.6, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)
    ๐Ÿ”— swift.readthedocs.io/zh-cn/latest/llm/index.html

  169. juncongmoo/pyllama โญ 2,800
    LLaMA: Open and Efficient Foundation Language Models

  170. lm-sys/RouteLLM โญ 2,675
    A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

  171. pipecat-ai/pipecat โญ 2,674
    Open Source framework for voice and multimodal conversational AI

  172. paperswithcode/galai โญ 2,673
    Model API for GALACTICA

  173. alpha-vllm/LLaMA2-Accessory โญ 2,656
    An Open-source Toolkit for LLM Development
    ๐Ÿ”— llama2-accessory.readthedocs.io

  174. cohere-ai/cohere-toolkit โญ 2,651
    Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.

  175. mistralai/mistral-finetune โญ 2,606
    A light-weight codebase that enables memory-efficient and performant finetuning of Mistral's models. It is based on LoRA.

  176. bclavie/RAGatouille โญ 2,592
    Bridging the gap between state-of-the-art research and alchemical RAG pipeline practices.

  177. hegelai/prompttools โญ 2,584
    Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
    ๐Ÿ”— prompttools.readthedocs.io

  178. databricks/dbrx โญ 2,488
    Code examples and resources for DBRX, a large language model developed by Databricks
    ๐Ÿ”— www.databricks.com

  179. huggingface/text-embeddings-inference โญ 2,400
    A blazing fast inference solution for text embeddings models
    ๐Ÿ”— huggingface.co/docs/text-embeddings-inference/quick_tour

  180. ofa-sys/OFA โญ 2,379
    Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

  181. young-geng/EasyLM โญ 2,344
    Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

  182. civitai/sd_civitai_extension โญ 2,307
    All of the Civitai models inside Automatic 1111 Stable Diffusion Web UI

  183. noahshinn/reflexion โญ 2,212
    [NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning

  184. cheshire-cat-ai/core โญ 2,200
    Production ready AI agent framework
    ๐Ÿ”— cheshirecat.ai

  185. openai/finetune-transformer-lm โญ 2,127
    Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
    ๐Ÿ”— s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf

  186. langroid/langroid โญ 2,121
    Harness LLMs with Multi-Agent Programming
    ๐Ÿ”— langroid.github.io/langroid

  187. intel/neural-compressor โญ 2,108
    SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
    ๐Ÿ”— intel.github.io/neural-compressor

  188. tairov/llama2.mojo โญ 2,087
    Inference Llama 2 in one file of pure ๐Ÿ”ฅ
    ๐Ÿ”— www.modular.com/blog/community-spotlight-how-i-built-llama2-by-aydyn-tairov

  189. openai/image-gpt โญ 2,025
    Archived. Code and models from the paper "Generative Pretraining from Pixels"

  190. spcl/graph-of-thoughts โญ 2,021
    Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
    ๐Ÿ”— arxiv.org/pdf/2308.09687.pdf

  191. predibase/lorax โญ 1,989
    Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
    ๐Ÿ”— loraexchange.ai

  192. lucidrains/toolformer-pytorch โญ 1,933
    Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

  193. neulab/prompt2model โญ 1,932
    prompt2model - Generate Deployable Models from Natural Language Instructions

  194. truera/trulens โญ 1,923
    Evaluation and Tracking for LLM Experiments
    ๐Ÿ”— www.trulens.org

  195. openai/gpt-2-output-dataset โญ 1,921
    Dataset of GPT-2 outputs for research in detection, biases, and more

  196. minimaxir/aitextgen โญ 1,833
    A robust Python tool for text-based AI training and generation using GPT-2.
    ๐Ÿ”— docs.aitextgen.io

  197. ist-daslab/gptq โญ 1,829
    Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
    ๐Ÿ”— arxiv.org/abs/2210.17323

  198. epfllm/meditron โญ 1,797
    Meditron is a suite of open-source medical Large Language Models (LLMs).
    ๐Ÿ”— huggingface.co/epfl-llm

  199. microsoft/Megatron-DeepSpeed โญ 1,789
    Ongoing research training transformer language models at scale, including: BERT & GPT-2

  200. openai/gpt-discord-bot โญ 1,747
    Example Discord bot written in Python that uses the completions API to have conversations with the text-davinci-003 model, and the moderations API to filter the messages.

  201. akariasai/self-rag โญ 1,676
    This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.
    ๐Ÿ”— selfrag.github.io

  202. facebookresearch/chameleon โญ 1,668
    Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.
    ๐Ÿ”— arxiv.org/abs/2405.09818

  203. ray-project/llm-applications โญ 1,645
    A comprehensive guide to building RAG-based LLM applications for production.

  204. casper-hansen/AutoAWQ โญ 1,542
    AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
    ๐Ÿ”— casper-hansen.github.io/autoawq

  205. jina-ai/thinkgpt โญ 1,513
    Agent techniques to augment your LLM and push it beyong its limits

  206. openai/simple-evals โญ 1,449
    Lightweight library for evaluating language models

  207. cstankonrad/long_llama โญ 1,444
    LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method.

  208. azure-samples/graphrag-accelerator โญ 1,430
    One-click deploy of a Knowledge Graph powered RAG (GraphRAG) in Azure
    ๐Ÿ”— github.com/microsoft/graphrag

  209. farizrahman4u/loopgpt โญ 1,424
    Re-implementation of Auto-GPT as a python package, written with modularity and extensibility in mind.

  210. run-llama/llama-lab โญ 1,374
    Llama Lab is a repo dedicated to building cutting-edge projects using LlamaIndex

  211. agentops-ai/tokencost โญ 1,334
    Easy token price estimates for 400+ LLMs. TokenOps.
    ๐Ÿ”— agentops.ai

  212. explosion/spacy-transformers โญ 1,331
    ๐Ÿ›ธ Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
    ๐Ÿ”— spacy.io/usage/embeddings-transformers

  213. chatarena/chatarena โญ 1,310
    ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.

  214. bigscience-workshop/Megatron-DeepSpeed โญ 1,296
    Ongoing research training transformer language models at scale, including: BERT & GPT-2

  215. meetkai/functionary โญ 1,279
    Chat language model that can use tools and interpret the results

  216. ray-project/ray-llm โญ 1,213
    RayLLM - LLMs on Ray
    ๐Ÿ”— aviary.anyscale.com

  217. evolvinglmms-lab/lmms-eval โญ 1,199
    Accelerating the development of large multimodal models (LMMs) with lmms-eval
    ๐Ÿ”— lmms-lab.github.io

  218. srush/MiniChain โญ 1,198
    A tiny library for coding with large language models.
    ๐Ÿ”— srush-minichain.hf.space

  219. linksoul-ai/AutoAgents โญ 1,126
    [IJCAI 2024] Generate different roles for GPTs to form a collaborative entity for complex tasks.
    ๐Ÿ”— huggingface.co/spaces/linksoul/autoagents

  220. ibm/Dromedary โญ 1,104
    Dromedary: towards helpful, ethical and reliable LLMs.

  221. agenta-ai/agenta โญ 1,090
    The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
    ๐Ÿ”— www.agenta.ai

  222. keirp/automatic_prompt_engineer โญ 1,078
    Large Language Models Are Human-Level Prompt Engineers

  223. hao-ai-lab/LookaheadDecoding โญ 1,065
    Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

  224. lupantech/chameleon-llm โญ 1,051
    Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".
    ๐Ÿ”— chameleon-llm.github.io

  225. explosion/spacy-llm โญ 1,041
    ๐Ÿฆ™ Integrating LLMs into structured NLP pipelines
    ๐Ÿ”— spacy.io/usage/large-language-models

  226. rlancemartin/auto-evaluator โญ 1,040
    Evaluation tool for LLM QA chains
    ๐Ÿ”— autoevaluator.langchain.com

  227. nomic-ai/pygpt4all โญ 1,026
    Official supported Python bindings for llama.cpp + gpt4all
    ๐Ÿ”— nomic-ai.github.io/pygpt4all

  228. mlfoundations/dclm โญ 1,024
    DataComp for Language Models

  229. huggingface/nanotron โญ 1,021
    Minimalistic large language model 3D-parallelism training

  230. ctlllll/LLM-ToolMaker โญ 1,013
    Large Language Models as Tool Makers

  231. microsoft/Llama-2-Onnx โญ 1,003
    A Microsoft optimized version of the Llama 2 model, available from Meta

  232. ajndkr/lanarky โญ 965
    The web framework for building LLM microservices
    ๐Ÿ”— lanarky.ajndkr.com

  233. likejazz/llama3.np โญ 943
    llama3.np is a pure NumPy implementation for Llama 3 model.

  234. pinecone-io/canopy โญ 934
    Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone
    ๐Ÿ”— www.pinecone.io

  235. cerebras/modelzoo โญ 872
    Examples of common deep learning models that can be trained on Cerebras hardware

  236. muennighoff/sgpt โญ 830
    SGPT: GPT Sentence Embeddings for Semantic Search
    ๐Ÿ”— arxiv.org/abs/2202.08904

  237. topoteretes/cognee โญ 786
    Deterministic LLMs Outputs for AI Applications and AI Agents
    ๐Ÿ”— www.cognee.ai

  238. oliveirabruno01/babyagi-asi โญ 773
    BabyAGI: an Autonomous and Self-Improving agent, or BASI

  239. datadreamer-dev/DataDreamer โญ 760
    DataDreamer is a powerful open-source Python library for prompting, synthetic data generation, and training workflows. It is designed to be simple, extremely efficient, and research-grade.
    ๐Ÿ”— datadreamer.dev

  240. opengenerativeai/GenossGPT โญ 748
    One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) ๐ŸŒˆ๐Ÿ‚ Replace OpenAI GPT with any LLMs in your app with one line.
    ๐Ÿ”— genoss.ai

  241. langchain-ai/langsmith-cookbook โญ 726
    LangSmith is a platform for building production-grade LLM applications.
    ๐Ÿ”— langsmith-cookbook.vercel.app

  242. prometheus-eval/prometheus-eval โญ 719
    Evaluate your LLM's response with Prometheus and GPT4 ๐Ÿ’ฏ

  243. salesforce/xgen โญ 713
    Salesforce open-source LLMs with 8k sequence length.

  244. junruxiong/IncarnaMind โญ 707
    Connect and chat with your multiple documents (pdf and txt) through GPT 3.5, GPT-4 Turbo, Claude and Local Open-Source LLMs
    ๐Ÿ”— www.incarnamind.com

  245. opengvlab/OmniQuant โญ 643
    [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

  246. wandb/weave โญ 630
    Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.
    ๐Ÿ”— wandb.me/weave

  247. squeezeailab/SqueezeLLM โญ 619
    [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
    ๐Ÿ”— arxiv.org/abs/2306.07629

  248. lupantech/ScienceQA โญ 580
    Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".

  249. zhudotexe/kani โญ 543
    kani (ใ‚ซใƒ‹) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)
    ๐Ÿ”— kani.readthedocs.io

  250. hazyresearch/ama_prompting โญ 535
    Ask Me Anything language model prompting

  251. vahe1994/SpQR โญ 517
    Quantization algorithm and the model evaluation code for SpQR method for LLM compression

  252. huggingface/lighteval โญ 516
    LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

  253. continuum-llms/chatgpt-memory โญ 511
    Allows to scale the ChatGPT API to multiple simultaneous sessions with infinite contextual and adaptive memory powered by GPT and Redis datastore.

  254. tsinghuadatabasegroup/DB-GPT โญ 507
    LLM As Database Administrator
    ๐Ÿ”— dbgpt.dbmind.cn

  255. hazyresearch/H3 โญ 506
    Language Modeling with the H3 State Space Model

  256. modal-labs/llm-finetuning โญ 505
    Guide for fine-tuning Llama/Mistral/CodeLlama models and more

  257. nousresearch/Hermes-Function-Calling โญ 504
    Code for the Hermes Pro Large Language Model to perform function calling based on the provided schema. It allows users to query the model and retrieve information related to stock prices, company fundamentals, financial statements

  258. judahpaul16/gpt-home โญ 383
    ChatGPT at home! Basically a better Google Nest Hub or Amazon Alexa home assistant. Built on the Raspberry Pi using the OpenAI API.
    ๐Ÿ”— hub.docker.com/r/judahpaul/gpt-home

  259. stanford-oval/suql โญ 178
    SUQL: Conversational Search over Structured and Unstructured Data with LLMs
    ๐Ÿ”— arxiv.org/abs/2311.09818

Math and Science

Mathematical, numerical and scientific libraries.

  1. numpy/numpy โญ 27,305
    The fundamental package for scientific computing with Python.
    ๐Ÿ”— numpy.org

  2. taichi-dev/taichi โญ 25,179
    Productive, portable, and performant GPU programming in Python: Taichi Lang is an open-source, imperative, parallel programming language for high-performance numerical computation.
    ๐Ÿ”— taichi-lang.org

  3. scipy/scipy โญ 12,806
    SciPy library main repository
    ๐Ÿ”— scipy.org

  4. sympy/sympy โญ 12,680
    A computer algebra system written in pure Python
    ๐Ÿ”— sympy.org

  5. google/or-tools โญ 10,882
    Google Optimization Tools (a.k.a., OR-Tools) is an open-source, fast and portable software suite for solving combinatorial optimization problems.
    ๐Ÿ”— developers.google.com/optimization

  6. z3prover/z3 โญ 10,052
    Z3 is a theorem prover from Microsoft Research with a Python language binding.

  7. cupy/cupy โญ 8,037
    NumPy & SciPy for GPU
    ๐Ÿ”— cupy.dev

  8. google-deepmind/alphageometry โญ 3,970
    Solving Olympiad Geometry without Human Demonstrations

  9. mikedh/trimesh โญ 2,895
    Python library for loading and using triangular meshes.
    ๐Ÿ”— trimesh.org

  10. mckinsey/causalnex โญ 2,202
    A Python library that helps data scientists to infer causation rather than observing correlation.
    ๐Ÿ”— causalnex.readthedocs.io

  11. pyomo/pyomo โญ 1,939
    An object-oriented algebraic modeling language in Python for structured optimization problems.
    ๐Ÿ”— www.pyomo.org

  12. facebookresearch/theseus โญ 1,690
    A library for differentiable nonlinear optimization

  13. google-research/torchsde โญ 1,539
    Differentiable SDE solvers with GPU support and efficient sensitivity analysis.

  14. dynamicslab/pysindy โญ 1,383
    A package for the sparse identification of nonlinear dynamical systems from data
    ๐Ÿ”— pysindy.readthedocs.io/en/latest

  15. geomstats/geomstats โญ 1,187
    Computations and statistics on manifolds with geometric structures.
    ๐Ÿ”— geomstats.ai

  16. cma-es/pycma โญ 1,064
    pycma is a Python implementation of CMA-ES and a few related numerical optimization tools.

  17. sj001/AI-Feynman โญ 616
    Implementation of AI Feynman: a Physics-Inspired Method for Symbolic Regression

  18. willianfuks/tfcausalimpact โญ 600
    Python Causal Impact Implementation Based on Google's R Package. Built using TensorFlow Probability.

  19. lean-dojo/LeanDojo โญ 530
    Tool for data extraction and interacting with Lean programmatically.
    ๐Ÿ”— leandojo.org

  20. brandondube/prysm โญ 249
    Prysm is an open-source library for physical and first-order modeling of optical systems and analysis of related data: numerical and physical optics, integrated modeling, phase retrieval, segmented systems, polynomials and fitting, sequential raytracing.
    ๐Ÿ”— prysm.readthedocs.io/en/stable

  21. lean-dojo/ReProver โญ 201
    Retrieval-Augmented Theorem Provers for Lean
    ๐Ÿ”— leandojo.org

  22. albahnsen/pycircular โญ 92
    pycircular is a Python module for circular data analysis

  23. gbillotey/Fractalshades โญ 27
    Arbitrary-precision fractal explorer - Python package

Machine Learning - General

General and classical machine learning libraries. See below for other sections covering specialised ML areas.

  1. scikit-learn/scikit-learn โญ 59,148
    scikit-learn: machine learning in Python
    ๐Ÿ”— scikit-learn.org

  2. openai/openai-cookbook โญ 58,036
    Examples and guides for using the OpenAI API
    ๐Ÿ”— cookbook.openai.com

  3. tencentarc/GFPGAN โญ 35,263
    GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration.

  4. suno-ai/bark โญ 34,153
    ๐Ÿ”Š Text-Prompted Generative Audio Model

  5. google-research/google-research โญ 33,588
    This repository contains code released by Google Research
    ๐Ÿ”— research.google

  6. facebookresearch/faiss โญ 29,909
    A library for efficient similarity search and clustering of dense vectors.
    ๐Ÿ”— faiss.ai

  7. google/jax โญ 29,440
    Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
    ๐Ÿ”— jax.readthedocs.io

  8. open-mmlab/mmdetection โญ 28,801
    OpenMMLab Detection Toolbox and Benchmark
    ๐Ÿ”— mmdetection.readthedocs.io

  9. ageron/handson-ml2 โญ 27,516
    A series of Jupyter notebooks that walk you through the fundamentals of Machine Learning and Deep Learning in Python using Scikit-Learn, Keras and TensorFlow 2.

  10. lutzroeder/netron โญ 27,115
    Visualizer for neural network, deep learning and machine learning models
    ๐Ÿ”— netron.app

  11. google/mediapipe โญ 26,467
    Cross-platform, customizable ML solutions for live and streaming media.
    ๐Ÿ”— mediapipe.dev

  12. dmlc/xgboost โญ 25,951
    Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
    ๐Ÿ”— xgboost.readthedocs.io/en/stable

  13. harisiqbal88/PlotNeuralNet โญ 21,692
    Latex code for making neural networks diagrams

  14. jina-ai/jina โญ 20,737
    โ˜๏ธ Build multimodal AI applications with cloud-native stack
    ๐Ÿ”— docs.jina.ai

  15. roboflow/supervision โญ 18,298
    We write your reusable computer vision tools. ๐Ÿ’œ
    ๐Ÿ”— supervision.roboflow.com

  16. onnx/onnx โญ 17,422
    Open standard for machine learning interoperability
    ๐Ÿ”— onnx.ai

  17. microsoft/LightGBM โญ 16,449
    A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
    ๐Ÿ”— lightgbm.readthedocs.io/en/latest

  18. ml-explore/mlx โญ 16,118
    MLX is an array framework for machine learning on Apple silicon, brought to you by Apple machine learning research.
    ๐Ÿ”— ml-explore.github.io/mlx

  19. tensorflow/tensor2tensor โญ 15,230
    Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

  20. ddbourgin/numpy-ml โญ 15,129
    Machine learning, in numpy
    ๐Ÿ”— numpy-ml.readthedocs.io

  21. aleju/imgaug โญ 14,301
    Image augmentation for machine learning experiments.
    ๐Ÿ”— imgaug.readthedocs.io

  22. microsoft/nni โญ 13,929
    An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
    ๐Ÿ”— nni.readthedocs.io

  23. microsoft/onnxruntime โญ 13,821
    ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
    ๐Ÿ”— onnxruntime.ai

  24. jindongwang/transferlearning โญ 13,165
    Transfer learning / domain adaptation / domain generalization / multi-task learning etc. Papers, codes, datasets, applications, tutorials.-่ฟ็งปๅญฆไน 
    ๐Ÿ”— transferlearning.xyz

  25. deepmind/deepmind-research โญ 13,006
    This repository contains implementations and illustrative code to accompany DeepMind publications

  26. spotify/annoy โญ 13,005
    Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

  27. neonbjb/tortoise-tts โญ 12,648
    A multi-voice TTS system trained with an emphasis on quality

  28. deepmind/alphafold โญ 12,192
    Implementation of the inference pipeline of AlphaFold v2

  29. ggerganov/ggml โญ 10,525
    Tensor library for machine learning

  30. facebookresearch/AnimatedDrawings โญ 10,404
    Code to accompany "A Method for Animating Children's Drawings of the Human Figure"

  31. optuna/optuna โญ 10,337
    A hyperparameter optimization framework
    ๐Ÿ”— optuna.org

  32. twitter/the-algorithm-ml โญ 9,990
    Source code for Twitter's Recommendation Algorithm
    ๐Ÿ”— blog.twitter.com/engineering/en_us/topics/open-source/2023/twitter-recommendation-algorithm

  33. statsmodels/statsmodels โญ 9,884
    Statsmodels: statistical modeling and econometrics in Python
    ๐Ÿ”— www.statsmodels.org/devel

  34. epistasislab/tpot โญ 9,626
    A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.
    ๐Ÿ”— epistasislab.github.io/tpot

  35. megvii-basedetection/YOLOX โญ 9,232
    YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/

  36. cleanlab/cleanlab โญ 9,229
    The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
    ๐Ÿ”— cleanlab.ai

  37. wandb/wandb โญ 8,745
    ๐Ÿ”ฅ A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
    ๐Ÿ”— wandb.ai

  38. pycaret/pycaret โญ 8,733
    An open-source, low-code machine learning library in Python
    ๐Ÿ”— www.pycaret.org

  39. pymc-devs/pymc โญ 8,551
    Bayesian Modeling and Probabilistic Programming in Python
    ๐Ÿ”— docs.pymc.io

  40. uberi/speech_recognition โญ 8,238
    Speech recognition module for Python, supporting several engines and APIs, online and offline.
    ๐Ÿ”— pypi.python.org/pypi/speechrecognition

  41. facebookresearch/xformers โญ 8,177
    Hackable and optimized Transformers building blocks, supporting a composable construction.
    ๐Ÿ”— facebookresearch.github.io/xformers

  42. catboost/catboost โญ 7,952
    A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
    ๐Ÿ”— catboost.ai

  43. open-mmlab/mmsegmentation โญ 7,849
    OpenMMLab Semantic Segmentation Toolbox and Benchmark.
    ๐Ÿ”— mmsegmentation.readthedocs.io/en/main

  44. awslabs/autogluon โญ 7,517
    Fast and Accurate ML in 3 Lines of Code
    ๐Ÿ”— auto.gluon.ai

  45. automl/auto-sklearn โญ 7,512
    Automated Machine Learning with scikit-learn
    ๐Ÿ”— automl.github.io/auto-sklearn

  46. huggingface/accelerate โญ 7,486
    ๐Ÿš€ A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
    ๐Ÿ”— huggingface.co/docs/accelerate

  47. lmcinnes/umap โญ 7,282
    Uniform Manifold Approximation and Projection

  48. hyperopt/hyperopt โญ 7,175
    Distributed Asynchronous Hyperparameter Optimization in Python
    ๐Ÿ”— hyperopt.github.io/hyperopt

  49. featurelabs/featuretools โญ 7,152
    An open source python library for automated feature engineering
    ๐Ÿ”— www.featuretools.com

  50. py-why/dowhy โญ 6,945
    DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.
    ๐Ÿ”— www.pywhy.org/dowhy

  51. hips/autograd โญ 6,888
    Efficiently computes derivatives of numpy code.

  52. open-mmlab/mmagic โญ 6,795
    OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic ๐Ÿช„: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image generation, image/video restoration/enhancement, etc.
    ๐Ÿ”— mmagic.readthedocs.io/en/latest

  53. scikit-learn-contrib/imbalanced-learn โญ 6,772
    A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning
    ๐Ÿ”— imbalanced-learn.org

  54. probml/pyprobml โญ 6,402
    Python code for "Probabilistic Machine learning" book by Kevin Murphy

  55. nicolashug/Surprise โญ 6,301
    A Python scikit for building and analyzing recommender systems
    ๐Ÿ”— surpriselib.com

  56. google/automl โญ 6,197
    Google Brain AutoML

  57. cleverhans-lab/cleverhans โญ 6,137
    An adversarial example library for constructing attacks, building defenses, and benchmarking both

  58. kevinmusgrave/pytorch-metric-learning โญ 5,908
    The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.
    ๐Ÿ”— kevinmusgrave.github.io/pytorch-metric-learning

  59. open-mmlab/mmcv โญ 5,783
    OpenMMLab Computer Vision Foundation
    ๐Ÿ”— mmcv.readthedocs.io/en/latest

  60. ml-explore/mlx-examples โญ 5,662
    Examples in the MLX framework

  61. project-monai/MONAI โญ 5,592
    AI Toolkit for Healthcare Imaging
    ๐Ÿ”— monai.io

  62. thudm/CogVideo โญ 5,294
    Text-to-video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

  63. mdbloice/Augmentor โญ 5,049
    Image augmentation library in Python for machine learning.
    ๐Ÿ”— augmentor.readthedocs.io/en/stable

  64. online-ml/river โญ 4,927
    ๐ŸŒŠ Online machine learning in Python
    ๐Ÿ”— riverml.xyz

  65. uber/causalml โญ 4,926
    Uplift modeling and causal inference with machine learning algorithms

  66. rasbt/mlxtend โญ 4,843
    A library of extension and helper modules for Python's data analysis and machine learning libraries.
    ๐Ÿ”— rasbt.github.io/mlxtend

  67. google-gemini/cookbook โญ 4,483
    A collection of guides and examples for the Gemini API, including quickstart tutorials for writing prompts.
    ๐Ÿ”— ai.google.dev/gemini-api/docs

  68. google-deepmind/graphcast โญ 4,462
    GraphCast: Learning skillful medium-range global weather forecasting

  69. marqo-ai/marqo โญ 4,393
    Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
    ๐Ÿ”— www.marqo.ai

  70. lucidrains/deep-daze โญ 4,376
    Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

  71. skvark/opencv-python โญ 4,372
    Automated CI toolchain to produce precompiled opencv-python, opencv-python-headless, opencv-contrib-python and opencv-contrib-python-headless packages.
    ๐Ÿ”— pypi.org/project/opencv-python

  72. sanchit-gandhi/whisper-jax โญ 4,300
    JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.

  73. apple/coremltools โญ 4,277
    Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.
    ๐Ÿ”— coremltools.readme.io

  74. districtdatalabs/yellowbrick โญ 4,253
    Visual analysis and diagnostic tools to facilitate machine learning model selection.
    ๐Ÿ”— www.scikit-yb.org

  75. nmslib/hnswlib โญ 4,203
    Header-only C++/python library for fast approximate nearest neighbors
    ๐Ÿ”— github.com/nmslib/hnswlib

  76. nv-tlabs/GET3D โญ 4,169
    Generative Model of High Quality 3D Textured Shapes Learned from Images

  77. cmusphinx/pocketsphinx โญ 3,863
    A small speech recognizer

  78. microsoft/FLAML โญ 3,802
    A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.
    ๐Ÿ”— microsoft.github.io/flaml

  79. ourownstory/neural_prophet โญ 3,770
    NeuralProphet: A simple forecasting package
    ๐Ÿ”— neuralprophet.com

  80. py-why/EconML โญ 3,700
    ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to brin...
    ๐Ÿ”— www.microsoft.com/en-us/research/project/alice

  81. huggingface/autotrain-advanced โญ 3,695
    AutoTrain Advanced: faster and easier training and deployments of state-of-the-art machine learning models
    ๐Ÿ”— huggingface.co/autotrain

  82. huggingface/notebooks โญ 3,503
    Notebooks using the Hugging Face libraries ๐Ÿค—

  83. zjunlp/DeepKE โญ 3,306
    [EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction
    ๐Ÿ”— deepke.zjukg.cn

  84. rucaibox/RecBole โญ 3,297
    A unified, comprehensive and efficient recommendation library
    ๐Ÿ”— recbole.io

  85. yoheinakajima/instagraph โญ 3,262
    Converts text input or URL into knowledge graph and displays

  86. facebookresearch/vissl โญ 3,244
    VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.
    ๐Ÿ”— vissl.ai

  87. pytorch/glow โญ 3,193
    Compiler for Neural Network hardware accelerators

  88. lucidrains/musiclm-pytorch โญ 3,111
    Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

  89. hrnet/HRNet-Semantic-Segmentation โญ 3,107
    The OCR approach is rephrased as Segmentation Transformer: https://arxiv.org/abs/1909.11065. This is an official implementation of semantic segmentation for HRNet. https://arxiv.org/abs/1908.07919

  90. mljar/mljar-supervised โญ 2,986
    Python package for AutoML on Tabular Data with Feature Engineering, Hyper-Parameters Tuning, Explanations and Automatic Documentation
    ๐Ÿ”— mljar.com

  91. lightly-ai/lightly โญ 2,877
    A python library for self-supervised learning on images.
    ๐Ÿ”— docs.lightly.ai/self-supervised-learning

  92. shankarpandala/lazypredict โญ 2,819
    Lazy Predict help build a lot of basic models without much code and helps understand which models works better without any parameter tuning

  93. scikit-learn-contrib/hdbscan โญ 2,741
    A high performance implementation of HDBSCAN clustering.
    ๐Ÿ”— hdbscan.readthedocs.io/en/latest

  94. scikit-optimize/scikit-optimize โญ 2,737
    Sequential model-based optimization with a scipy.optimize interface
    ๐Ÿ”— scikit-optimize.github.io

  95. huggingface/safetensors โญ 2,679
    Implements a new simple format for storing tensors safely (as opposed to pickle) and that is still fast (zero-copy).
    ๐Ÿ”— huggingface.co/docs/safetensors

  96. google-research/t5x โญ 2,602
    T5X is a modular, composable, research-friendly framework for high-performance, configurable, self-service training, evaluation, and inference of sequence models (starting with language) at many scales.

  97. apple/ml-ane-transformers โญ 2,530
    Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)

  98. freedmand/semantra โญ 2,456
    Semantra is a multipurpose tool for semantically searching documents. Query by meaning rather than just by matching text.

  99. scikit-learn-contrib/category_encoders โญ 2,392
    A library of sklearn compatible categorical variable encoders
    ๐Ÿ”— contrib.scikit-learn.org/category_encoders

  100. huggingface/optimum โญ 2,377
    ๐Ÿš€ Accelerate training and inference of ๐Ÿค— Transformers and ๐Ÿค— Diffusers with easy to use hardware optimization tools
    ๐Ÿ”— huggingface.co/docs/optimum/main

  101. rom1504/clip-retrieval โญ 2,305
    Easily compute clip embeddings and build a clip retrieval system with them
    ๐Ÿ”— rom1504.github.io/clip-retrieval

  102. aws/sagemaker-python-sdk โญ 2,082
    A library for training and deploying machine learning models on Amazon SageMaker
    ๐Ÿ”— sagemaker.readthedocs.io

  103. eric-mitchell/direct-preference-optimization โญ 1,940
    Reference implementation for DPO (Direct Preference Optimization)

  104. huggingface/evaluate โญ 1,925
    ๐Ÿค— Evaluate: A library for easily evaluating machine learning models and datasets.
    ๐Ÿ”— huggingface.co/docs/evaluate

  105. huggingface/huggingface_hub โญ 1,903
    The official Python client for the Huggingface Hub.
    ๐Ÿ”— huggingface.co/docs/huggingface_hub

  106. rentruewang/koila โญ 1,816
    Prevent PyTorch's CUDA error: out of memory in just 1 line of code.
    ๐Ÿ”— rentruewang.com/koila

  107. contextlab/hypertools โญ 1,812
    A Python toolbox for gaining geometric insights into high-dimensional data
    ๐Ÿ”— hypertools.readthedocs.io/en/latest

  108. linkedin/greykite โญ 1,804
    A flexible, intuitive and fast forecasting library

  109. bmabey/pyLDAvis โญ 1,801
    Python library for interactive topic model visualization. Port of the R LDAvis package.

  110. scikit-learn-contrib/lightning โญ 1,719
    Large-scale linear classification, regression and ranking in Python
    ๐Ÿ”— contrib.scikit-learn.org/lightning

  111. tensorflow/addons โญ 1,688
    Useful extra functionality for TensorFlow 2.x maintained by SIG-addons

  112. microsoft/i-Code โญ 1,658
    The ambition of the i-Code project is to build integrative and composable multimodal AI. The "i" stands for integrative multimodal learning.

  113. castorini/pyserini โญ 1,587
    Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
    ๐Ÿ”— pyserini.io

  114. googlecloudplatform/vertex-ai-samples โญ 1,579
    Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.
    ๐Ÿ”— cloud.google.com/vertex-ai

  115. visual-layer/fastdup โญ 1,547
    fastdup is a powerful free tool designed to rapidly extract valuable insights from your image & video datasets. Assisting you to increase your dataset images & labels quality and reduce your data operations costs at an unparalleled scale.

  116. laekov/fastmoe โญ 1,498
    A fast MoE impl for PyTorch
    ๐Ÿ”— fastmoe.ai

  117. microsoft/Olive โญ 1,476
    Olive is an easy-to-use hardware-aware model optimization tool that composes industry-leading techniques across model compression, optimization, and compilation.
    ๐Ÿ”— microsoft.github.io/olive

  118. kubeflow/katib โญ 1,472
    Automated Machine Learning on Kubernetes
    ๐Ÿ”— www.kubeflow.org/docs/components/katib

  119. jina-ai/finetuner โญ 1,455
    ๐ŸŽฏ Task-oriented embedding tuning for BERT, CLIP, etc.
    ๐Ÿ”— finetuner.jina.ai

  120. csinva/imodels โญ 1,351
    Interpretable ML package ๐Ÿ” for concise, transparent, and accurate predictive modeling (sklearn-compatible).
    ๐Ÿ”— csinva.io/imodels

  121. microsoft/Semi-supervised-learning โญ 1,287
    A Unified Semi-Supervised Learning Codebase (NeurIPS'22)
    ๐Ÿ”— usb.readthedocs.io

  122. borealisai/advertorch โญ 1,285
    A Toolbox for Adversarial Robustness Research

  123. patchy631/machine-learning โญ 1,267
    Machine Learning Tutorials Repository

  124. spotify/voyager โญ 1,249
    ๐Ÿ›ฐ๏ธ An approximate nearest-neighbor search library for Python and Java with a focus on ease of use, simplicity, and deployability.
    ๐Ÿ”— spotify.github.io/voyager

  125. awslabs/dgl-ke โญ 1,249
    High performance, easy-to-use, and scalable package for learning large-scale knowledge graph embeddings.
    ๐Ÿ”— dglke.dgl.ai/doc

  126. qdrant/fastembed โญ 1,240
    Fast, Accurate, Lightweight Python library to make State of the Art Embedding
    ๐Ÿ”— qdrant.github.io/fastembed

  127. koaning/scikit-lego โญ 1,228
    Extra blocks for scikit-learn pipelines.
    ๐Ÿ”— koaning.github.io/scikit-lego

  128. google/vizier โญ 1,201
    Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.
    ๐Ÿ”— oss-vizier.readthedocs.io

  129. automl/TabPFN โญ 1,153
    Official implementation of the TabPFN paper (https://arxiv.org/abs/2207.01848) and the tabpfn package.
    ๐Ÿ”— priorlabs.ai

  130. pytorch/FBGEMM โญ 1,146
    FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/

  131. lightning-ai/lightning-thunder โญ 1,104
    Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

  132. google-research/deeplab2 โญ 992
    DeepLab2 is a TensorFlow library for deep labeling, aiming to provide a unified and state-of-the-art TensorFlow codebase for dense pixel labeling tasks.

  133. davidmrau/mixture-of-experts โญ 918
    PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

  134. lmcinnes/pynndescent โญ 875
    A Python nearest neighbor descent for approximate nearest neighbors

  135. hazyresearch/safari โญ 858
    Convolutions for Sequence Modeling

  136. oml-team/open-metric-learning โญ 843
    OML is a PyTorch-based framework to train and validate the models producing high-quality embeddings.
    ๐Ÿ”— open-metric-learning.readthedocs.io/en/latest/index.html

  137. opentensor/bittensor โญ 842
    Internet-scale Neural Networks
    ๐Ÿ”— www.bittensor.com

  138. nvidia/cuda-python โญ 838
    CUDA Python Low-level Bindings
    ๐Ÿ”— nvidia.github.io/cuda-python

  139. criteo/autofaiss โญ 783
    Automatically create Faiss knn indices with the most optimal similarity search parameters.
    ๐Ÿ”— criteo.github.io/autofaiss

  140. huggingface/optimum-quanto โญ 713
    A pytorch quantization backend for optimum

  141. replicate/replicate-python โญ 705
    Python client for Replicate
    ๐Ÿ”— replicate.com

  142. awslabs/python-deequ โญ 685
    Python API for Deequ, a library built on Spark for defining "unit tests for data", which measure data quality in large datasets

  143. facebookresearch/balance โญ 678
    The balance python package offers a simple workflow and methods for dealing with biased data samples when looking to infer from them to some target population of interest.
    ๐Ÿ”— import-balance.org

  144. nicolas-hbt/pygraft โญ 659
    Configurable Generation of Synthetic Schemas and Knowledge Graphs at Your Fingertips
    ๐Ÿ”— pygraft.readthedocs.io/en/latest

  145. qdrant/quaterion โญ 630
    Blazing fast framework for fine-tuning similarity learning models
    ๐Ÿ”— quaterion.qdrant.tech

  146. hpcaitech/EnergonAI โญ 629
    Large-scale model inference.

  147. pymc-labs/pymc-marketing โญ 622
    Bayesian marketing toolbox in PyMC. Media Mix (MMM), customer lifetime value (CLV), buy-till-you-die (BTYD) models and more.
    ๐Ÿ”— www.pymc-marketing.io

  148. googleapis/python-aiplatform โญ 598
    A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.

  149. huggingface/exporters โญ 595
    Export Hugging Face models to Core ML and TensorFlow Lite

  150. microsoft/Focal-Transformer โญ 543
    [NeurIPS 2021 Spotlight] Official code for "Focal Self-attention for Local-Global Interactions in Vision Transformers"

  151. cvxgrp/pymde โญ 531
    Minimum-distortion embedding with PyTorch
    ๐Ÿ”— pymde.org

  152. nevronai/MetisFL โญ 530
    The first open Federated Learning framework implemented in C++ and Python.
    ๐Ÿ”— metisfl.org

  153. mrdbourke/m1-machine-learning-test โญ 516
    Code for testing various M1 Chip benchmarks with TensorFlow.

  154. linkedin/FastTreeSHAP โญ 504
    Fast SHAP value computation for interpreting tree-based models

  155. intellabs/bayesian-torch โญ 503
    A library for Bayesian neural network layers and uncertainty estimation in Deep Learning extending the core of PyTorch

  156. lightning-ai/litdata โญ 281
    Transform datasets at scale. Optimize datasets for fast AI model training.

  157. dylanhogg/gptauthor โญ 54
    GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt.

Machine Learning - Deep Learning

Machine learning libraries that cross over with deep learning in some way.

  1. tensorflow/tensorflow โญ 184,632
    An Open Source Machine Learning Framework for Everyone
    ๐Ÿ”— tensorflow.org

  2. pytorch/pytorch โญ 81,182
    Tensors and Dynamic neural networks in Python with strong GPU acceleration
    ๐Ÿ”— pytorch.org

  3. openai/whisper โญ 65,802
    Robust Speech Recognition via Large-Scale Weak Supervision

  4. keras-team/keras โญ 61,447
    Deep Learning for humans
    ๐Ÿ”— keras.io

  5. deepfakes/faceswap โญ 50,041
    Deepfakes Software For All
    ๐Ÿ”— www.faceswap.dev

  6. iperov/DeepFaceLab โญ 46,547
    DeepFaceLab is the leading software for creating deepfakes.

  7. facebookresearch/segment-anything โญ 46,137
    The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

  8. microsoft/DeepSpeed โญ 34,254
    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
    ๐Ÿ”— www.deepspeed.ai

  9. rwightman/pytorch-image-models โญ 31,059
    The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
    ๐Ÿ”— huggingface.co/docs/timm

  10. facebookresearch/detectron2 โญ 29,682
    Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
    ๐Ÿ”— detectron2.readthedocs.io/en/latest

  11. lightning-ai/pytorch-lightning โญ 27,709
    The deep learning framework to pretrain, finetune and deploy AI models. PyTorch Lightning is just organized PyTorch - Lightning disentangles PyTorch code to decouple the science from the engineering.
    ๐Ÿ”— lightning.ai

  12. xinntao/Real-ESRGAN โญ 27,295
    Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.

  13. facebookresearch/Detectron โญ 26,227
    FAIR's research platform for object detection research, implementing popular algorithms like Mask R-CNN and RetinaNet.

  14. google-research/tuning_playbook โญ 26,112
    A playbook for systematically maximizing the performance of deep learning models.

  15. matterport/Mask_RCNN โญ 24,464
    Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow

  16. openai/CLIP โญ 24,117
    CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

  17. paddlepaddle/Paddle โญ 21,963
    PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice ๏ผˆใ€Ž้ฃžๆกจใ€ๆ ธๅฟƒๆก†ๆžถ๏ผŒๆทฑๅบฆๅญฆไน &ๆœบๅ™จๅญฆไน ้ซ˜ๆ€ง่ƒฝๅ•ๆœบใ€ๅˆ†ๅธƒๅผ่ฎญ็ปƒๅ’Œ่ทจๅนณๅฐ้ƒจ็ฝฒ๏ผ‰
    ๐Ÿ”— www.paddlepaddle.org

  18. pyg-team/pytorch_geometric โญ 20,760
    Graph Neural Network Library for PyTorch
    ๐Ÿ”— pyg.org

  19. apache/mxnet โญ 20,740
    Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
    ๐Ÿ”— mxnet.apache.org

  20. lucidrains/vit-pytorch โญ 19,239
    Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

  21. sanster/IOPaint โญ 18,447
    Image inpainting tool powered by SOTA AI Model. Remove any unwanted object, defect, people from your pictures or erase and replace(powered by stable diffusion) any thing on your pictures.
    ๐Ÿ”— www.iopaint.com

  22. rasbt/deeplearning-models โญ 16,511
    A collection of various deep learning architectures, models, and tips

  23. danielgatis/rembg โญ 15,796
    Rembg is a tool to remove images background

  24. albumentations-team/albumentations โญ 13,872
    Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125
    ๐Ÿ”— albumentations.ai

  25. microsoft/Swin-Transformer โญ 13,443
    This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".
    ๐Ÿ”— arxiv.org/abs/2103.14030

  26. dmlc/dgl โญ 13,283
    Python package built to ease deep learning on graph, on top of existing DL frameworks.
    ๐Ÿ”— dgl.ai

  27. facebookresearch/detr โญ 13,229
    End-to-End Object Detection with Transformers

  28. nvidia/DeepLearningExamples โญ 13,101
    State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

  29. kornia/kornia โญ 9,692
    Geometric Computer Vision Library for Spatial AI
    ๐Ÿ”— kornia.readthedocs.io

  30. mlfoundations/open_clip โญ 9,491
    An open source implementation of OpenAI's CLIP (Contrastive Language-Image Pre-training)

  31. keras-team/autokeras โญ 9,103
    AutoML library for deep learning
    ๐Ÿ”— autokeras.com

  32. modelscope/facechain โญ 8,799
    FaceChain is a deep-learning toolchain for generating your Digital-Twin.

  33. facebookresearch/pytorch3d โญ 8,570
    PyTorch3D is FAIR's library of reusable components for deep learning with 3D data
    ๐Ÿ”— pytorch3d.org

  34. pyro-ppl/pyro โญ 8,465
    Deep universal probabilistic programming with Python and PyTorch
    ๐Ÿ”— pyro.ai

  35. arogozhnikov/einops โญ 8,263
    Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
    ๐Ÿ”— einops.rocks

  36. nvidia/apex โญ 8,238
    A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

  37. facebookresearch/ImageBind โญ 8,146
    ImageBind One Embedding Space to Bind Them All

  38. google/trax โญ 8,024
    Trax โ€” Deep Learning with Clear Code and Speed

  39. lucidrains/imagen-pytorch โญ 7,937
    Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

  40. xpixelgroup/BasicSR โญ 6,584
    Open Source Image and Video Restoration Toolbox for Super-resolution, Denoise, Deblurring, etc. Currently, it includes EDSR, RCAN, SRResNet, SRGAN, ESRGAN, EDVR, BasicVSR, SwinIR, ECBSR, etc. Also support StyleGAN2, DFDNet.
    ๐Ÿ”— basicsr.readthedocs.io/en/latest

  41. google/flax โญ 5,871
    Flax is a neural network library for JAX that is designed for flexibility.
    ๐Ÿ”— flax.readthedocs.io

  42. skorch-dev/skorch โญ 5,725
    A scikit-learn compatible neural network library that wraps PyTorch

  43. facebookresearch/mmf โญ 5,464
    A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
    ๐Ÿ”— mmf.sh

  44. mosaicml/composer โญ 5,096
    Supercharge Your Model Training
    ๐Ÿ”— docs.mosaicml.com

  45. facebookincubator/AITemplate โญ 4,507
    AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

  46. pytorch/ignite โญ 4,505
    High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
    ๐Ÿ”— pytorch-ignite.ai

  47. deci-ai/super-gradients โญ 4,488
    Easily train or fine-tune SOTA computer vision models with one open source training library. The home of Yolo-NAS.
    ๐Ÿ”— www.supergradients.com

  48. nvidiagameworks/kaolin โญ 4,374
    A PyTorch Library for Accelerating 3D Deep Learning Research

  49. williamyang1991/VToonify โญ 3,520
    [SIGGRAPH Asia 2022] VToonify: Controllable High-Resolution Portrait Video Style Transfer

  50. facebookresearch/PyTorch-BigGraph โญ 3,362
    Generate embeddings from large-scale graph-structured data.
    ๐Ÿ”— torchbiggraph.readthedocs.io

  51. cvg/LightGlue โญ 3,224
    LightGlue: Local Feature Matching at Light Speed (ICCV 2023)

  52. google-research/scenic โญ 3,189
    Scenic: A Jax Library for Computer Vision Research and Beyond

  53. alpa-projects/alpa โญ 3,034
    Training and serving large-scale neural networks with auto parallelization.
    ๐Ÿ”— alpa.ai

  54. pytorch/botorch โญ 3,028
    Bayesian optimization in PyTorch
    ๐Ÿ”— botorch.org

  55. deepmind/dm-haiku โญ 2,850
    JAX-based neural network library
    ๐Ÿ”— dm-haiku.readthedocs.io

  56. explosion/thinc โญ 2,811
    ๐Ÿ”ฎ A refreshing functional take on deep learning, compatible with your favorite libraries
    ๐Ÿ”— thinc.ai

  57. nerdyrodent/VQGAN-CLIP โญ 2,596
    Just playing with getting VQGAN+CLIP running locally, rather than having to use colab.

  58. danielegrattarola/spektral โญ 2,357
    Graph Neural Networks with Keras and Tensorflow 2.
    ๐Ÿ”— graphneural.network

  59. google-research/electra โญ 2,317
    ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

  60. neuralmagic/sparseml โญ 2,026
    Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

  61. fepegar/torchio โญ 2,026
    Medical imaging toolkit for deep learning
    ๐Ÿ”— www.torchio.org

  62. pytorch/torchrec โญ 1,835
    Pytorch domain library for recommendation systems

  63. tensorflow/mesh โญ 1,573
    Mesh TensorFlow: Model Parallelism Made Easier

  64. vt-vl-lab/FGVC โญ 1,549
    [ECCV 2020] Flow-edge Guided Video Completion

  65. tensorly/tensorly โญ 1,528
    TensorLy: Tensor Learning in Python.
    ๐Ÿ”— tensorly.org

  66. calculatedcontent/WeightWatcher โญ 1,424
    The WeightWatcher tool for predicting the accuracy of Deep Neural Networks

  67. hysts/pytorch_image_classification โญ 1,338
    PyTorch implementation of image classification models for CIFAR-10/CIFAR-100/MNIST/FashionMNIST/Kuzushiji-MNIST/ImageNet

  68. jeshraghian/snntorch โญ 1,214
    Deep and online learning with spiking neural networks in Python
    ๐Ÿ”— snntorch.readthedocs.io/en/latest

  69. xl0/lovely-tensors โญ 1,080
    Tensors, for human consumption
    ๐Ÿ”— xl0.github.io/lovely-tensors

  70. tensorflow/similarity โญ 1,007
    TensorFlow Similarity is a python package focused on making similarity learning quick and easy.

  71. keras-team/keras-cv โญ 987
    Industry-strength Computer Vision workflows with Keras

  72. deepmind/android_env โญ 983
    RL research on Android devices.

  73. deepmind/chex โญ 752
    Chex is a library of utilities for helping to write reliable JAX code
    ๐Ÿ”— chex.readthedocs.io

  74. kakaobrain/rq-vae-transformer โญ 741
    The official implementation of Autoregressive Image Generation using Residual Quantization (CVPR '22)

  75. mlfoundations/datacomp โญ 626
    DataComp: In search of the next generation of multimodal datasets
    ๐Ÿ”— datacomp.ai

  76. whitead/dmol-book โญ 602
    Deep learning for molecules and materials book
    ๐Ÿ”— dmol.pub

Machine Learning - Interpretability

Machine learning interpretability libraries. Covers explainability, prediction explainations, dashboards, understanding knowledge development in training.

  1. slundberg/shap โญ 22,280
    A game theoretic approach to explain the output of any machine learning model.
    ๐Ÿ”— shap.readthedocs.io

  2. marcotcr/lime โญ 11,451
    Lime: Explaining the predictions of any machine learning classifier

  3. interpretml/interpret โญ 6,162
    Fit interpretable models. Explain blackbox machine learning.
    ๐Ÿ”— interpret.ml/docs

  4. pytorch/captum โญ 4,748
    Model interpretability and understanding for PyTorch
    ๐Ÿ”— captum.ai

  5. tensorflow/lucid โญ 4,640
    A collection of infrastructure and tools for research in neural network interpretability.

  6. pair-code/lit โญ 3,447
    The Learning Interpretability Tool: Interactively analyze ML models to understand their behavior in an extensible and framework agnostic interface.
    ๐Ÿ”— pair-code.github.io/lit

  7. arize-ai/phoenix โญ 3,242
    AI Observability & Evaluation
    ๐Ÿ”— docs.arize.com/phoenix

  8. teamhg-memex/eli5 โญ 2,750
    A library for debugging/inspecting machine learning classifiers and explaining their predictions
    ๐Ÿ”— eli5.readthedocs.io

  9. maif/shapash โญ 2,701
    ๐Ÿ”… Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models
    ๐Ÿ”— maif.github.io/shapash

  10. seldonio/alibi โญ 2,356
    Algorithms for explaining machine learning models
    ๐Ÿ”— docs.seldon.io/projects/alibi/en/stable

  11. oegedijk/explainerdashboard โญ 2,276
    Quickly build Explainable AI dashboards that show the inner workings of so-called "blackbox" machine learning models.
    ๐Ÿ”— explainerdashboard.readthedocs.io

  12. eleutherai/pythia โญ 2,173
    Interpretability analysis and scaling laws to understand how knowledge develops and evolves during training in autoregressive transformers

  13. jalammar/ecco โญ 1,948
    Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
    ๐Ÿ”— ecco.readthedocs.io

  14. google-deepmind/penzai โญ 1,601
    A JAX library for writing models as legible, functional pytree data structures, along with tools for visualizing, modifying, and analyzing them. Penzai focuses on making it easy to do stuff with models after they have been trained
    ๐Ÿ”— penzai.readthedocs.io

  15. trusted-ai/AIX360 โญ 1,579
    Interpretability and explainability of data and machine learning models
    ๐Ÿ”— aix360.res.ibm.com

  16. cdpierse/transformers-interpret โญ 1,242
    Model explainability that works seamlessly with ๐Ÿค— transformers. Explain your transformers model in just 2 lines of code.

  17. ethicalml/xai โญ 1,088
    XAI is a Machine Learning library that is designed with AI explainability in its core. XAI contains various tools that enable for analysis and evaluation of data and models
    ๐Ÿ”— ethical.institute/principles.html#commitment-3

  18. selfexplainml/PiML-Toolbox โญ 916
    PiML (Python Interpretable Machine Learning) toolbox for model development & diagnostics
    ๐Ÿ”— selfexplainml.github.io/piml-toolbox

  19. salesforce/OmniXAI โญ 853
    OmniXAI: A Library for eXplainable AI

  20. andyzoujm/representation-engineering โญ 668
    Representation Engineering: A Top-Down Approach to AI Transparency
    ๐Ÿ”— www.ai-transparency.org

Machine Learning - Ops

MLOps tools, frameworks and libraries: intersection of machine learning, data engineering and DevOps; deployment, health, diagnostics and governance of ML models.

  1. apache/airflow โญ 35,799
    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
    ๐Ÿ”— airflow.apache.org

  2. ray-project/ray โญ 32,591
    Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
    ๐Ÿ”— ray.io

  3. mlflow/mlflow โญ 18,118
    Open source platform for the machine learning lifecycle
    ๐Ÿ”— mlflow.org

  4. spotify/luigi โญ 17,604
    Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

  5. prefecthq/prefect โญ 15,590
    Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
    ๐Ÿ”— prefect.io

  6. horovod/horovod โญ 14,095
    Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
    ๐Ÿ”— horovod.ai

  7. iterative/dvc โญ 13,496
    ๐Ÿฆ‰ ML Experiments and Data Management with Git
    ๐Ÿ”— dvc.org

  8. ludwig-ai/ludwig โญ 11,035
    Low-code framework for building custom LLMs, neural networks, and other AI models
    ๐Ÿ”— ludwig.ai

  9. dagster-io/dagster โญ 10,942
    An orchestration platform for the development, production, and observation of data assets.
    ๐Ÿ”— dagster.io

  10. great-expectations/great_expectations โญ 9,739
    Always know what to expect from your data.
    ๐Ÿ”— docs.greatexpectations.io

  11. kedro-org/kedro โญ 9,582
    Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
    ๐Ÿ”— kedro.org

  12. bentoml/OpenLLM โญ 9,548
    Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
    ๐Ÿ”— bentoml.com

  13. dbt-labs/dbt-core โญ 9,438
    dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
    ๐Ÿ”— getdbt.com

  14. huggingface/text-generation-inference โญ 8,558
    A Rust, Python and gRPC server for text generation inference. Used in production at HuggingFace to power Hugging Chat, the Inference API and Inference Endpoint.
    ๐Ÿ”— hf.co/docs/text-generation-inference

  15. activeloopai/deeplake โญ 7,968
    Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
    ๐Ÿ”— activeloop.ai

  16. netflix/metaflow โญ 7,923
    ๐Ÿš€ Build and manage real-life ML, AI, and data science projects with ease!
    ๐Ÿ”— metaflow.org

  17. mage-ai/mage-ai โญ 7,570
    ๐Ÿง™ Build, run, and manage data pipelines for integrating and transforming data.
    ๐Ÿ”— www.mage.ai

  18. kestra-io/kestra โญ 7,321
    Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
    ๐Ÿ”— kestra.io

  19. bentoml/BentoML โญ 6,886
    The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!
    ๐Ÿ”— bentoml.com

  20. allegroai/clearml โญ 5,504
    ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
    ๐Ÿ”— clear.ml/docs

  21. feast-dev/feast โญ 5,423
    The Open Source Feature Store for Machine Learning
    ๐Ÿ”— feast.dev

  22. flyteorg/flyte โญ 5,322
    Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
    ๐Ÿ”— flyte.org

  23. langfuse/langfuse โญ 5,126
    ๐Ÿชข Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. ๐ŸŠYC W23
    ๐Ÿ”— langfuse.com/docs

  24. aimhubio/aim โญ 5,069
    Aim ๐Ÿ’ซ โ€” An easy-to-use & supercharged open-source experiment tracker.
    ๐Ÿ”— aimstack.io

  25. evidentlyai/evidently โญ 4,980
    Evidently is โ€‹โ€‹an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
    ๐Ÿ”— www.evidentlyai.com/evidently-oss

  26. adap/flower โญ 4,699
    Flower: A Friendly Federated Learning Framework
    ๐Ÿ”— flower.ai

  27. orchest/orchest โญ 4,037
    Build data pipelines, the easy way ๐Ÿ› ๏ธ
    ๐Ÿ”— orchest.readthedocs.io/en/stable

  28. zenml-io/zenml โญ 3,875
    ZenML ๐Ÿ™: The bridge between ML and Ops. https://zenml.io.
    ๐Ÿ”— zenml.io

  29. internlm/lmdeploy โญ 3,805
    LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
    ๐Ÿ”— lmdeploy.readthedocs.io/en/latest

  30. internlm/xtuner โญ 3,545
    An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
    ๐Ÿ”— xtuner.readthedocs.io/zh-cn/latest

  31. polyaxon/polyaxon โญ 3,533
    MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
    ๐Ÿ”— polyaxon.com

  32. kubeflow/pipelines โญ 3,530
    Machine Learning Pipelines for Kubeflow
    ๐Ÿ”— www.kubeflow.org/docs/components/pipelines

  33. ploomber/ploomber โญ 3,458
    The fastest โšก๏ธ way to build data pipelines. Develop iteratively, deploy anywhere. โ˜๏ธ
    ๐Ÿ”— docs.ploomber.io

  34. towhee-io/towhee โญ 3,112
    Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
    ๐Ÿ”— towhee.io

  35. determined-ai/determined โญ 2,958
    Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
    ๐Ÿ”— determined.ai

  36. leptonai/leptonai โญ 2,608
    A Pythonic framework to simplify AI service building
    ๐Ÿ”— lepton.ai

  37. meltano/meltano โญ 1,736
    Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
    ๐Ÿ”— meltano.com

  38. dagworks-inc/hamilton โญ 1,655
    Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
    ๐Ÿ”— hamilton.dagworks.io/en/latest

  39. azure/PyRIT โญ 1,626
    The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and ML engineers to red team foundation models and their applications.

  40. hi-primus/optimus โญ 1,466
    ๐Ÿšš Agile Data Preparation Workflows madeย easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
    ๐Ÿ”— hi-optimus.com

  41. kubeflow/examples โญ 1,389
    A repository to host extended examples and tutorials

  42. dstackai/dstack โญ 1,265
    A lightweight alternative to Kubernetes for AI, simplifying container orchestration on any cloud or on-premises and accelerating AI development, training, and deployment.
    ๐Ÿ”— dstack.ai/docs

  43. dagworks-inc/burr โญ 1,010
    Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.
    ๐Ÿ”— burr.dagworks.io

  44. nccr-itmo/FEDOT โญ 627
    Automated modeling and machine learning framework FEDOT
    ๐Ÿ”— fedot.readthedocs.io

Machine Learning - Reinforcement

Machine learning libraries and toolkits that cross over with reinforcement learning in some way: agent reinforcement learning, agent environemnts, RLHF

  1. openai/gym โญ 34,357
    A toolkit for developing and comparing reinforcement learning algorithms.
    ๐Ÿ”— www.gymlibrary.dev

  2. unity-technologies/ml-agents โญ 16,750
    The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.
    ๐Ÿ”— unity.com/products/machine-learning-agents

  3. openai/baselines โญ 15,564
    OpenAI Baselines: high-quality implementations of reinforcement learning algorithms

  4. google/dopamine โญ 10,429
    Dopamine is a research framework for fast prototyping of reinforcement learning algorithms.
    ๐Ÿ”— github.com/google/dopamine

  5. deepmind/pysc2 โญ 7,984
    StarCraft II Learning Environment

  6. thu-ml/tianshou โญ 7,683
    An elegant PyTorch deep reinforcement learning library.
    ๐Ÿ”— tianshou.org

  7. lucidrains/PaLM-rlhf-pytorch โญ 7,662
    Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

  8. tensorlayer/TensorLayer โญ 7,312
    Deep Learning and Reinforcement Learning Library for Scientists and Engineers
    ๐Ÿ”— tensorlayerx.com

  9. farama-foundation/Gymnasium โญ 6,506
    An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)
    ๐Ÿ”— gymnasium.farama.org

  10. keras-rl/keras-rl โญ 5,507
    Deep Reinforcement Learning for Keras.
    ๐Ÿ”— keras-rl.readthedocs.io

  11. deepmind/dm_control โญ 3,680
    Google DeepMind's software stack for physics-based simulation and Reinforcement Learning environments, using MuJoCo.

  12. ai4finance-foundation/ElegantRL โญ 3,590
    Massively Parallel Deep Reinforcement Learning. ๐Ÿ”ฅ
    ๐Ÿ”— ai4finance.org

  13. facebookresearch/ReAgent โญ 3,547
    A platform for Reasoning systems (Reinforcement Learning, Contextual Bandits, etc.)
    ๐Ÿ”— reagent.ai

  14. deepmind/acme โญ 3,449
    A library of reinforcement learning components and agents

  15. eureka-research/Eureka โญ 2,756
    Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models" (ICLR 2024)
    ๐Ÿ”— eureka-research.github.io

  16. pettingzoo-team/PettingZoo โญ 2,499
    An API standard for multi-agent reinforcement learning environments, with popular reference environments and related utilities
    ๐Ÿ”— pettingzoo.farama.org

  17. kzl/decision-transformer โญ 2,294
    Official codebase for Decision Transformer: Reinforcement Learning via Sequence Modeling.

  18. pytorch/rl โญ 2,123
    A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
    ๐Ÿ”— pytorch.org/rl

  19. anthropics/hh-rlhf โญ 1,533
    Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
    ๐Ÿ”— arxiv.org/abs/2204.05862

  20. humancompatibleai/imitation โญ 1,235
    Clean PyTorch implementations of imitation and reward learning algorithms
    ๐Ÿ”— imitation.readthedocs.io

  21. arise-initiative/robosuite โญ 1,198
    robosuite: A Modular Simulation Framework and Benchmark for Robot Learning
    ๐Ÿ”— robosuite.ai

  22. denys88/rl_games โญ 826
    RL Games: High performance RL library

Natural Language Processing

Natural language processing libraries and toolkits: text processing, topic modelling, tokenisers, chatbots. Also see the LLMs and ChatGPT category for crossover.

  1. huggingface/transformers โญ 130,399
    ๐Ÿค— Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
    ๐Ÿ”— huggingface.co/transformers

  2. pytorch/fairseq โญ 29,976
    Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

  3. explosion/spaCy โญ 29,462
    ๐Ÿ’ซ Industrial-strength Natural Language Processing (NLP) in Python
    ๐Ÿ”— spacy.io

  4. myshell-ai/OpenVoice โญ 27,880
    Instant voice cloning by MyShell.
    ๐Ÿ”— research.myshell.ai/open-voice

  5. microsoft/unilm โญ 19,343
    Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
    ๐Ÿ”— aka.ms/generalai

  6. huggingface/datasets โญ 18,856
    ๐Ÿค— The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
    ๐Ÿ”— huggingface.co/docs/datasets

  7. rare-technologies/gensim โญ 15,502
    Topic Modelling for Humans
    ๐Ÿ”— radimrehurek.com/gensim

  8. vikparuchuri/marker โญ 15,331
    Marker converts PDF, EPUB, and MOBI to markdown. It's 10x faster than nougat, more accurate on most documents, and has low hallucination risk.
    ๐Ÿ”— www.datalab.to

  9. ukplab/sentence-transformers โญ 14,624
    Multilingual Sentence & Image Embeddings with BERT
    ๐Ÿ”— www.sbert.net

  10. gunthercox/ChatterBot โญ 13,985
    ChatterBot is a machine learning, conversational dialog engine for creating chat bots
    ๐Ÿ”— chatterbot.readthedocs.io

  11. flairnlp/flair โญ 13,775
    A very simple framework for state-of-the-art Natural Language Processing (NLP)
    ๐Ÿ”— flairnlp.github.io/flair

  12. nltk/nltk โญ 13,331
    NLTK Source
    ๐Ÿ”— www.nltk.org

  13. jina-ai/clip-as-service โญ 12,326
    ๐Ÿ„ Scalable embedding, reasoning, ranking for images and sentences with CLIP
    ๐Ÿ”— clip-as-service.jina.ai

  14. allenai/allennlp โญ 11,727
    An open-source NLP research library, built on PyTorch.
    ๐Ÿ”— www.allennlp.org

  15. openai/tiktoken โญ 11,450
    tiktoken is a fast BPE tokeniser for use with OpenAI's models.

  16. nvidia/NeMo โญ 11,201
    A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
    ๐Ÿ”— docs.nvidia.com/nemo-framework/user-guide/latest/overview.html

  17. facebookresearch/seamless_communication โญ 10,647
    Foundational Models for State-of-the-Art Speech and Text Translation

  18. facebookresearch/ParlAI โญ 10,457
    A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
    ๐Ÿ”— parl.ai

  19. m-bain/whisperX โญ 10,430
    WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

  20. google/sentencepiece โญ 9,940
    Unsupervised text tokenizer for Neural Network-based text generation.

  21. vikparuchuri/surya โญ 9,448
    OCR, layout analysis, reading order, line detection in 90+ languages
    ๐Ÿ”— www.datalab.to

  22. doccano/doccano โญ 9,310
    Open source annotation tool for machine learning practitioners.

  23. sloria/TextBlob โญ 9,058
    Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
    ๐Ÿ”— textblob.readthedocs.io

  24. togethercomputer/OpenChatKit โญ 9,011
    OpenChatKit provides a powerful, open-source base to create both specialized and general purpose chatbots

  25. clips/pattern โญ 8,718
    Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
    ๐Ÿ”— github.com/clips/pattern/wiki

  26. facebookresearch/nougat โญ 8,595
    Implementation of Nougat Neural Optical Understanding for Academic Documents
    ๐Ÿ”— facebookresearch.github.io/nougat

  27. neuml/txtai โญ 8,447
    ๐Ÿ’ก All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
    ๐Ÿ”— neuml.github.io/txtai

  28. speechbrain/speechbrain โญ 8,374
    A PyTorch-based Speech Toolkit
    ๐Ÿ”— speechbrain.github.io

  29. espnet/espnet โญ 8,195
    End-to-End Speech Processing Toolkit
    ๐Ÿ”— espnet.github.io/espnet

  30. deeppavlov/DeepPavlov โญ 6,634
    An open source library for deep learning end-to-end dialog systems and chatbots.
    ๐Ÿ”— deeppavlov.ai

  31. facebookresearch/metaseq โญ 6,446
    A codebase for working with Open Pre-trained Transformers, originally forked from fairseq.

  32. kingoflolz/mesh-transformer-jax โญ 6,255
    Model parallel transformers in JAX and Haiku

  33. maartengr/BERTopic โญ 5,902
    Leveraging BERT and c-TF-IDF to create easily interpretable topics.
    ๐Ÿ”— maartengr.github.io/bertopic

  34. prefecthq/marvin โญ 5,075
    โœจ Build AI interfaces that spark joy
    ๐Ÿ”— askmarvin.ai

  35. aiwaves-cn/agents โญ 5,064
    An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents

  36. minimaxir/textgenrnn โญ 4,944
    Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.

  37. salesforce/CodeGen โญ 4,861
    CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

  38. layout-parser/layout-parser โญ 4,709
    A Unified Toolkit for Deep Learning Based Document Image Analysis
    ๐Ÿ”— layout-parser.github.io

  39. facebookresearch/DrQA โญ 4,470
    Reading Wikipedia to Answer Open-Domain Questions

  40. makcedward/nlpaug โญ 4,378
    Data augmentation for NLP
    ๐Ÿ”— makcedward.github.io

  41. thilinarajapakse/simpletransformers โญ 4,049
    Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
    ๐Ÿ”— simpletransformers.ai

  42. argilla-io/argilla โญ 3,719
    Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
    ๐Ÿ”— docs.argilla.io

  43. maartengr/KeyBERT โญ 3,379
    Minimal keyword extraction with BERT
    ๐Ÿ”— maartengr.github.io/keybert

  44. life4/textdistance โญ 3,344
    ๐Ÿ“ Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.

  45. jsvine/markovify โญ 3,290
    A simple, extensible Markov chain generator.

  46. promptslab/Promptify โญ 3,166
    Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
    ๐Ÿ”— discord.gg/m88xfymbk6

  47. bytedance/lightseq โญ 3,149
    LightSeq: A High Performance Library for Sequence Processing and Generation

  48. errbotio/errbot โญ 3,103
    Errbot is a chatbot, a daemon that connects to your favorite chat service and bring your tools and some fun into the conversation.
    ๐Ÿ”— errbot.io

  49. huawei-noah/Pretrained-Language-Model โญ 2,997
    Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

  50. neuralmagic/deepsparse โญ 2,952
    Sparsity-aware deep learning inference runtime for CPUs
    ๐Ÿ”— neuralmagic.com/deepsparse

  51. ddangelov/Top2Vec โญ 2,906
    Top2Vec learns jointly embedded topic, document and word vectors.

  52. jbesomi/texthero โญ 2,880
    Text preprocessing, representation and visualization from zero to hero.
    ๐Ÿ”— texthero.org

  53. huggingface/neuralcoref โญ 2,842
    โœจFast Coreference Resolution in spaCy with Neural Networks
    ๐Ÿ”— huggingface.co/coref

  54. salesforce/CodeT5 โญ 2,680
    Home of CodeT5: Open Code LLMs for Code Understanding and Generation
    ๐Ÿ”— arxiv.org/abs/2305.07922

  55. bigscience-workshop/promptsource โญ 2,618
    Toolkit for creating, sharing and using natural language prompts.

  56. huggingface/setfit โญ 2,107
    SetFit is an efficient and prompt-free framework for few-shot fine-tuning of Sentence Transformers.
    ๐Ÿ”— hf.co/docs/setfit

  57. jamesturk/jellyfish โญ 2,027
    ๐Ÿชผ a python library for doing approximate and phonetic matching of strings.
    ๐Ÿ”— jamesturk.github.io/jellyfish

  58. alibaba/EasyNLP โญ 2,013
    EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

  59. thudm/P-tuning-v2 โญ 1,953
    An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks

  60. featureform/featureform โญ 1,778
    The Virtual Feature Store. Turn your existing data infrastructure into a feature store.
    ๐Ÿ”— www.featureform.com

  61. marella/ctransformers โญ 1,768
    Python bindings for the Transformer models implemented in C/C++ using GGML library.

  62. deepset-ai/FARM โญ 1,735
    ๐Ÿก Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
    ๐Ÿ”— farm.deepset.ai

  63. franck-dernoncourt/NeuroNER โญ 1,689
    Named-entity recognition using neural networks. Easy-to-use and state-of-the-art results.
    ๐Ÿ”— neuroner.com

  64. plasticityai/magnitude โญ 1,620
    A fast, efficient universal vector embedding utility package.

  65. arxiv-vanity/arxiv-vanity โญ 1,599
    Renders papers from arXiv as responsive web pages so you don't have to squint at a PDF.
    ๐Ÿ”— www.arxiv-vanity.com

  66. google-research/language โญ 1,589
    Shared repository for open-sourced projects from the Google AI Language team.
    ๐Ÿ”— ai.google/research/teams/language

  67. explosion/spacy-models โญ 1,577
    ๐Ÿ’ซ Models for the spaCy Natural Language Processing (NLP) library
    ๐Ÿ”— spacy.io

  68. chrismattmann/tika-python โญ 1,467
    Tika-Python is a Python binding to the Apache Tikaโ„ข REST services allowing Tika to be called natively in the Python community.

  69. dmmiller612/bert-extractive-summarizer โญ 1,374
    Easy to use extractive text summarization with BERT

  70. gunthercox/chatterbot-corpus โญ 1,357
    A multilingual dialog corpus
    ๐Ÿ”— chatterbot-corpus.readthedocs.io

  71. jonasgeiping/cramming โญ 1,276
    Cramming the training of a (BERT-type) language model into limited compute.

  72. intellabs/fastRAG โญ 1,187
    Efficient Retrieval Augmentation and Generation Framework

  73. nomic-ai/nomic โญ 1,187
    Interact, analyze and structure massive text, image, embedding, audio and video datasets
    ๐Ÿ”— atlas.nomic.ai

  74. urchade/GLiNER โญ 1,115
    Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
    ๐Ÿ”— arxiv.org/abs/2311.08526

  75. pemistahl/lingua-py โญ 1,065
    The most accurate natural language detection library for Python, suitable for short text and mixed-language text

  76. abertsch72/unlimiformer โญ 1,047
    Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"

  77. openai/grade-school-math โญ 966
    GSM8K, a dataset of 8.5K high quality linguistically diverse grade school math word problems

  78. norskregnesentral/skweak โญ 915
    skweak: A software toolkit for weak supervision applied to NLP tasks

  79. explosion/spacy-streamlit โญ 782
    ๐Ÿ‘‘ spaCy building blocks and visualizers for Streamlit apps
    ๐Ÿ”— share.streamlit.io/ines/spacy-streamlit-demo/master/app.py

  80. paddlepaddle/RocketQA โญ 761
    ๐Ÿš€ RocketQA, dense retrieval for information retrieval and question answering, including both Chinese and English state-of-the-art models.

  81. keras-team/keras-nlp โญ 748
    Modular Natural Language Processing workflows with Keras

  82. explosion/spacy-stanza โญ 722
    ๐Ÿ’ฅ Use the latest Stanza (StanfordNLP) research models directly in spaCy

Packaging

Python packaging, dependency management and bundling.

  1. pyenv/pyenv โญ 38,177
    pyenv lets you easily switch between multiple versions of Python.

  2. python-poetry/poetry โญ 30,755
    Python packaging and dependency management made easy
    ๐Ÿ”— python-poetry.org

  3. pypa/pipenv โญ 24,762
    A virtualenv management tool that supports a multitude of systems and nicely bridges the gaps between pip, python and virtualenv.
    ๐Ÿ”— pipenv.pypa.io

  4. astral-sh/uv โญ 15,817
    An extremely fast Python package installer and resolver, written in Rust. Designed as a drop-in replacement for pip and pip-compile.
    ๐Ÿ”— astral.sh

  5. mitsuhiko/rye โญ 13,078
    a Hassle-Free Python Experience
    ๐Ÿ”— rye.astral.sh

  6. pyinstaller/pyinstaller โญ 11,601
    Freeze (package) Python programs into stand-alone executables
    ๐Ÿ”— www.pyinstaller.org

  7. pypa/pipx โญ 9,800
    Install and Run Python Applications in Isolated Environments
    ๐Ÿ”— pipx.pypa.io

  8. pdm-project/pdm โญ 7,678
    A modern Python package and dependency manager supporting the latest PEP standards
    ๐Ÿ”— pdm-project.org

  9. jazzband/pip-tools โญ 7,653
    A set of tools to keep your pinned Python dependencies fresh (pip-compile + pip-sync)
    ๐Ÿ”— pip-tools.rtfd.io

  10. mamba-org/mamba โญ 6,633
    The Fast Cross-Platform Package Manager: mamba is a reimplementation of the conda package manager in C++
    ๐Ÿ”— mamba.readthedocs.io

  11. conda/conda โญ 6,298
    A system-level, binary package and environment manager running on all major operating systems and platforms.
    ๐Ÿ”— docs.conda.io/projects/conda

  12. conda-forge/miniforge โญ 5,945
    A conda-forge distribution.
    ๐Ÿ”— conda-forge.org/miniforge

  13. pypa/hatch โญ 5,782
    Modern, extensible Python project management
    ๐Ÿ”— hatch.pypa.io/latest

  14. indygreg/PyOxidizer โญ 5,348
    A modern Python application packaging and distribution tool

  15. pypa/virtualenv โญ 4,775
    A tool to create isolated Python environments. Since Python 3.3, a subset of it has been integrated into the standard lib venv module.
    ๐Ÿ”— virtualenv.pypa.io

  16. spack/spack โญ 4,153
    A flexible package manager that supports multiple versions, configurations, platforms, and compilers.
    ๐Ÿ”— spack.io

  17. prefix-dev/pixi โญ 2,629
    pixi is a cross-platform, multi-language package manager and workflow tool built on the foundation of the conda ecosystem.
    ๐Ÿ”— pixi.sh

  18. beeware/briefcase โญ 2,546
    Tools to support converting a Python project into a standalone native application.
    ๐Ÿ”— briefcase.readthedocs.io

  19. pantsbuild/pex โญ 2,501
    A tool for generating .pex (Python EXecutable) files, lock files and venvs.
    ๐Ÿ”— docs.pex-tool.org

  20. pypa/flit โญ 2,144
    Simplified packaging of Python modules
    ๐Ÿ”— flit.pypa.io

  21. linkedin/shiv โญ 1,716
    shiv is a command line utility for building fully self contained Python zipapps as outlined in PEP 441, but with all their dependencies included.

  22. marcelotduarte/cx_Freeze โญ 1,299
    cx_Freeze creates standalone executables from Python scripts, with the same performance, is cross-platform and should work on any platform that Python itself works on.
    ๐Ÿ”— marcelotduarte.github.io/cx_freeze

  23. ofek/pyapp โญ 1,130
    Runtime installer for Python applications
    ๐Ÿ”— ofek.dev/pyapp

  24. pypa/gh-action-pypi-publish โญ 881
    The blessed :octocat: GitHub Action, for publishing your ๐Ÿ“ฆ distribution files to PyPI: https://github.com/marketplace/actions/pypi-publish
    ๐Ÿ”— packaging.python.org/guides/publishing-package-distribution-releases-using-github-actions-ci-cd-workflows

  25. py2exe/py2exe โญ 813
    Create standalone Windows programs from Python code
    ๐Ÿ”— www.py2exe.org

  26. prefix-dev/rip โญ 640
    RIP is a library that allows the resolving and installing of Python PyPI packages from Rust into a virtual environment. It's based on our experience with building Rattler and aims to provide the same experience but for PyPI instead of Conda.
    ๐Ÿ”— prefix.dev

  27. snok/install-poetry โญ 565
    Github action for installing and configuring Poetry

  28. python-poetry/install.python-poetry.org โญ 192
    The official Poetry installation script
    ๐Ÿ”— install.python-poetry.org

Pandas

Pandas and dataframe libraries: data analysis, statistical reporting, pandas GUIs, pandas performance optimisations.

  1. pandas-dev/pandas โญ 42,948
    Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
    ๐Ÿ”— pandas.pydata.org

  2. pola-rs/polars โญ 28,538
    Dataframes powered by a multithreaded, vectorized query engine, written in Rust
    ๐Ÿ”— docs.pola.rs

  3. duckdb/duckdb โญ 21,590
    DuckDB is an analytical in-process SQL database management system
    ๐Ÿ”— www.duckdb.org

  4. gventuri/pandas-ai โญ 12,307
    Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
    ๐Ÿ”— pandas-ai.com

  5. ydataai/ydata-profiling โญ 12,304
    1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
    ๐Ÿ”— docs.profiling.ydata.ai

  6. kanaries/pygwalker โญ 10,897
    PyGWalker: Turn your pandas dataframe into an interactive UI for visual analysis
    ๐Ÿ”— kanaries.net/pygwalker

  7. rapidsai/cudf โญ 8,133
    cuDF is a GPU DataFrame library for loading joining, aggregating, filtering, and otherwise manipulating data
    ๐Ÿ”— docs.rapids.ai/api/cudf/stable

  8. aws/aws-sdk-pandas โญ 3,862
    pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
    ๐Ÿ”— aws-sdk-pandas.readthedocs.io

  9. nalepae/pandarallel โญ 3,611
    A simple and efficient tool to parallelize Pandas operations on all availableย CPUs
    ๐Ÿ”— nalepae.github.io/pandarallel

  10. unionai-oss/pandera โญ 3,184
    A light-weight, flexible, and expressive statistical data testing library
    ๐Ÿ”— www.union.ai/pandera

  11. blaze/blaze โญ 3,181
    NumPy and Pandas interface to Big Data
    ๐Ÿ”— blaze.pydata.org

  12. adamerose/PandasGUI โญ 3,161
    A GUI for Pandas DataFrames

  13. pydata/pandas-datareader โญ 2,893
    Extract data from a wide range of Internet sources into a pandas DataFrame.
    ๐Ÿ”— pydata.github.io/pandas-datareader/stable/index.html

  14. scikit-learn-contrib/sklearn-pandas โญ 2,798
    Pandas integration with sklearn

  15. jmcarpenter2/swifter โญ 2,500
    A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

  16. delta-io/delta-rs โญ 2,049
    A native Rust library for Delta Lake, with bindings into Python
    ๐Ÿ”— delta-io.github.io/delta-rs

  17. eventual-inc/Daft โญ 1,963
    Distributed DataFrame for Python designed for the cloud, powered by Rust
    ๐Ÿ”— getdaft.io

  18. fugue-project/fugue โญ 1,940
    A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
    ๐Ÿ”— fugue-tutorials.readthedocs.io

  19. pyjanitor-devs/pyjanitor โญ 1,335
    Clean APIs for data cleaning. Python implementation of R package Janitor
    ๐Ÿ”— pyjanitor-devs.github.io/pyjanitor

  20. machow/siuba โญ 1,138
    Python library for using dplyr like syntax with pandas and SQL
    ๐Ÿ”— siuba.org

  21. renumics/spotlight โญ 1,084
    Interactively explore unstructured datasets from your dataframe.
    ๐Ÿ”— renumics.com

  22. holoviz/hvplot โญ 1,046
    A high-level plotting API for pandas, dask, xarray, and networkx built on HoloViews
    ๐Ÿ”— hvplot.holoviz.org

  23. tkrabel/bamboolib โญ 935
    bamboolib - a GUI for pandas DataFrames
    ๐Ÿ”— bamboolib.com

  24. mwouts/itables โญ 745
    This packages changes how Pandas and Polars DataFrames are rendered in Jupyter Notebooks. With itables you can display your tables as interactive DataTables that you can sort, paginate, scroll or filter.
    ๐Ÿ”— mwouts.github.io/itables

Performance

Performance, parallelisation and low level libraries.

  1. celery/celery โญ 24,216
    Distributed Task Queue (development branch)
    ๐Ÿ”— docs.celeryq.dev

  2. google/flatbuffers โญ 22,687
    FlatBuffers: Memory Efficient Serialization Library
    ๐Ÿ”— flatbuffers.dev

  3. pybind/pybind11 โญ 15,296
    Seamless operability between C++11 and Python
    ๐Ÿ”— pybind11.readthedocs.io

  4. exaloop/codon โญ 14,021
    A high-performance, zero-overhead, extensible Python compiler using LLVM
    ๐Ÿ”— docs.exaloop.io/codon

  5. dask/dask โญ 12,310
    Parallel computing with task scheduling
    ๐Ÿ”— dask.org

  6. numba/numba โญ 9,701
    NumPy aware dynamic Python compiler using LLVM
    ๐Ÿ”— numba.pydata.org

  7. modin-project/modin โญ 9,652
    Modin: Scale your Pandas workflows by changing a single line of code
    ๐Ÿ”— modin.readthedocs.io

  8. nebuly-ai/optimate โญ 8,366
    A collection of libraries to optimise AI model performances
    ๐Ÿ”— www.nebuly.com

  9. vaexio/vaex โญ 8,243
    Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second ๐Ÿš€
    ๐Ÿ”— vaex.io

  10. mher/flower โญ 6,336
    Real-time monitor and web admin for Celery distributed task queue
    ๐Ÿ”— flower.readthedocs.io

  11. python-trio/trio โญ 6,027
    Trio โ€“ a friendly Python library for async concurrency and I/O
    ๐Ÿ”— trio.readthedocs.io

  12. ultrajson/ultrajson โญ 4,294
    Ultra fast JSON decoder and encoder written in C with Python bindings
    ๐Ÿ”— pypi.org/project/ujson

  13. facebookincubator/cinder โญ 3,446
    Cinder is Meta's internal performance-oriented production version of CPython.
    ๐Ÿ”— trycinder.com

  14. tlkh/asitop โญ 3,251
    Perf monitoring CLI tool for Apple Silicon
    ๐Ÿ”— tlkh.github.io/asitop

  15. ipython/ipyparallel โญ 2,570
    IPython Parallel: Interactive Parallel Computing in Python
    ๐Ÿ”— ipyparallel.readthedocs.io

  16. airtai/faststream โญ 2,267
    FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.
    ๐Ÿ”— faststream.airt.ai/latest

  17. intel/intel-extension-for-transformers โญ 2,085
    โšก Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platformsโšก

  18. h5py/h5py โญ 2,062
    HDF5 for Python -- The h5py package is a Pythonic interface to the HDF5 binary data format.
    ๐Ÿ”— www.h5py.org

  19. agronholm/anyio โญ 1,708
    High level asynchronous concurrency and networking framework that works on top of either trio or asyncio

  20. faster-cpython/ideas โญ 1,668
    Discussion and work tracker for Faster CPython project.

  21. dask/distributed โญ 1,561
    A distributed task scheduler for Dask
    ๐Ÿ”— distributed.dask.org

  22. tiangolo/asyncer โญ 1,531
    Asyncer, async and await, focused on developer experience.
    ๐Ÿ”— asyncer.tiangolo.com

  23. intel/intel-extension-for-pytorch โญ 1,510
    A Python package for extending the official PyTorch that can easily obtain performance on Intel platform

  24. nschloe/perfplot โญ 1,330
    ๐Ÿ“ˆ Performance analysis for Python snippets

  25. intel/scikit-learn-intelex โญ 1,199
    Intel(R) Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
    ๐Ÿ”— intel.github.io/scikit-learn-intelex

  26. markshannon/faster-cpython โญ 938
    How to make CPython faster.

  27. zerointensity/pointers.py โญ 913
    Bringing the hell of pointers to Python.
    ๐Ÿ”— pointers.zintensity.dev

  28. brandtbucher/specialist โญ 621
    Visualize CPython's specializing, adaptive interpreter. ๐Ÿ”ฅ

Profiling

Memory and CPU/GPU profiling tools and libraries.

  1. bloomberg/memray โญ 12,981
    Memray is a memory profiler for Python
    ๐Ÿ”— bloomberg.github.io/memray

  2. benfred/py-spy โญ 12,302
    Sampling profiler for Python programs

  3. plasma-umass/scalene โญ 11,477
    Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals

  4. joerick/pyinstrument โญ 6,374
    ๐Ÿšดย Call stack profiler for Python. Shows you why your code is slow!
    ๐Ÿ”— pyinstrument.readthedocs.io

  5. gaogaotiantian/viztracer โญ 4,750
    VizTracer is a low-overhead logging/debugging/profiling tool that can trace and visualize your python code execution.
    ๐Ÿ”— viztracer.readthedocs.io

  6. pythonprofilers/memory_profiler โญ 4,294
    Monitor Memory usage of Python code
    ๐Ÿ”— pypi.python.org/pypi/memory_profiler

  7. reloadware/reloadium โญ 2,765
    Hot Reloading and Profiling for Python
    ๐Ÿ”— reloadium.io

  8. pyutils/line_profiler โญ 2,612
    Line-by-line profiling for Python

  9. jiffyclub/snakeviz โญ 2,302
    An in-browser Python profile viewer
    ๐Ÿ”— jiffyclub.github.io/snakeviz

  10. p403n1x87/austin โญ 1,418
    Python frame stack sampler for CPython
    ๐Ÿ”— pypi.org/project/austin-dist

  11. pythonspeed/filprofiler โญ 825
    A Python memory profiler for data processing and scientific computing applications
    ๐Ÿ”— pythonspeed.com/products/filmemoryprofiler

Security

Security related libraries: vulnerability discovery, SQL injection, environment auditing.

  1. swisskyrepo/PayloadsAllTheThings โญ 59,026
    A list of useful payloads and bypass for Web Application Security and Pentest/CTF
    ๐Ÿ”— swisskyrepo.github.io/payloadsallthethings

  2. sqlmapproject/sqlmap โญ 31,594
    Automatic SQL injection and database takeover tool
    ๐Ÿ”— sqlmap.org

  3. certbot/certbot โญ 31,205
    Certbot is EFF's tool to obtain certs from Let's Encrypt and (optionally) auto-enable HTTPS on your server. It can also act as a client for any other CA that uses the ACME protocol.

  4. aquasecurity/trivy โญ 22,488
    Find vulnerabilities, misconfigurations, secrets, SBOM in containers, Kubernetes, code repositories, clouds and more
    ๐Ÿ”— aquasecurity.github.io/trivy

  5. bridgecrewio/checkov โญ 6,806
    Checkov is a static code analysis tool for infrastructure as code (IaC) and also a software composition analysis (SCA) tool for images and open source packages.
    ๐Ÿ”— www.checkov.io

  6. nccgroup/ScoutSuite โญ 6,396
    Multi-Cloud Security Auditing Tool

  7. pycqa/bandit โญ 6,213
    Bandit is a tool designed to find common security issues in Python code.
    ๐Ÿ”— bandit.readthedocs.io

  8. stamparm/maltrail โญ 6,200
    Malicious traffic detection system

  9. rhinosecuritylabs/pacu โญ 4,242
    The AWS exploitation framework, designed for testing the security of Amazon Web Services environments.
    ๐Ÿ”— rhinosecuritylabs.com/aws/pacu-open-source-aws-exploitation-framework

  10. dashingsoft/pyarmor โญ 3,163
    A tool used to obfuscate python scripts, bind obfuscated scripts to fixed machine or expire obfuscated scripts.
    ๐Ÿ”— pyarmor.dashingsoft.com

  11. luijait/DarkGPT โญ 1,925
    DarkGPT is an OSINT assistant based on GPT-4-200K (recommended use) designed to perform queries on leaked databases, thus providing an artificial intelligence assistant that can be useful in your traditional OSINT processes.

  12. pyupio/safety โญ 1,675
    Safety checks Python dependencies for known security vulnerabilities and suggests the proper remediations for vulnerabilities detected.
    ๐Ÿ”— safetycli.com/product/safety-cli

  13. trailofbits/pip-audit โญ 952
    Audits Python environments, requirements files and dependency trees for known security vulnerabilities, and can automatically fix them
    ๐Ÿ”— pypi.org/project/pip-audit

  14. fadi002/de4py โญ 832
    toolkit for python reverse engineering
    ๐Ÿ”— de4py.000.pe

Simulation

Simulation libraries: robotics, economic, agent-based, traffic, physics, astronomy, chemistry, quantum simulation. Also see the Maths and Science category for crossover.

  1. atsushisakai/PythonRobotics โญ 22,489
    Python sample codes for robotics algorithms.
    ๐Ÿ”— atsushisakai.github.io/pythonrobotics

  2. bulletphysics/bullet3 โญ 12,313
    Bullet Physics SDK: real-time collision detection and multi-physics simulation for VR, games, visual effects, robotics, machine learning etc.
    ๐Ÿ”— bulletphysics.org

  3. isl-org/Open3D โญ 10,976
    Open3D: A Modern Library for 3D Data Processing
    ๐Ÿ”— www.open3d.org

  4. qiskit/qiskit โญ 4,945
    Qiskit is an open-source SDK for working with quantum computers at the level of extended quantum circuits, operators, and primitives.
    ๐Ÿ”— www.ibm.com/quantum/qiskit

  5. astropy/astropy โญ 4,335
    Astronomy and astrophysics core library
    ๐Ÿ”— www.astropy.org

  6. quantumlib/Cirq โญ 4,206
    A python framework for creating, editing, and invoking Noisy Intermediate Scale Quantum (NISQ) circuits.

  7. nvidia/warp โญ 3,972
    A Python framework for high performance GPU simulation and graphics
    ๐Ÿ”— nvidia.github.io/warp

  8. openai/mujoco-py โญ 2,810
    MuJoCo is a physics engine for detailed, efficient rigid body simulations with contacts. mujoco-py allows using MuJoCo from Python 3.

  9. rdkit/rdkit โญ 2,556
    The official sources for the RDKit library

  10. taichi-dev/difftaichi โญ 2,438
    10 differentiable physical simulators built with Taichi differentiable programming (DiffTaichi, ICLR 2020)

  11. projectmesa/mesa โญ 2,338
    Mesa is an open-source Python library for agent-based modeling, ideal for simulating complex systems and exploring emergent behaviors.
    ๐Ÿ”— mesa.readthedocs.io

  12. google/brax โญ 2,180
    Massively parallel rigidbody physics simulation on accelerator hardware.

  13. quantecon/QuantEcon.py โญ 1,908
    A community based Python library for quantitative economics
    ๐Ÿ”— quantecon.org/quantecon-py

  14. facebookresearch/habitat-lab โญ 1,859
    A modular high-level library to train embodied AI agents across a variety of tasks and environments.
    ๐Ÿ”— aihabitat.org

  15. nvidia-omniverse/IsaacGymEnvs โญ 1,836
    Example RL environments for the NVIDIA Isaac Gym high performance environments

  16. microsoft/PromptCraft-Robotics โญ 1,812
    Community for applying LLMs to robotics and a robot simulator with ChatGPT integration
    ๐Ÿ”— aka.ms/chatgpt-robotics

  17. nvidia-omniverse/IsaacLab โญ 1,726
    Unified framework for robot learning built on NVIDIA Isaac Sim
    ๐Ÿ”— isaac-sim.github.io/isaaclab

  18. deepmodeling/deepmd-kit โญ 1,426
    A deep learning package for many-body potential energy representation and molecular dynamics
    ๐Ÿ”— docs.deepmodeling.com/projects/deepmd

  19. sail-sg/envpool โญ 1,057
    C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
    ๐Ÿ”— envpool.readthedocs.io

  20. a-r-j/graphein โญ 1,012
    Protein Graph Library
    ๐Ÿ”— graphein.ai

  21. bowang-lab/scGPT โญ 958
    scGPT: Towards Building a Foundation Model for Single-Cell Multi-omics Using Generative AI
    ๐Ÿ”— scgpt.readthedocs.io/en/latest

  22. hardmaru/estool โญ 927
    Evolution Strategies Tool

  23. viblo/pymunk โญ 909
    Pymunk is a easy-to-use pythonic 2d physics library that can be used whenever you need 2d rigid body physics from Python
    ๐Ÿ”— www.pymunk.org

  24. google-deepmind/materials_discovery โญ 853
    Graph Networks for Materials Science (GNoME) is a project centered around scaling machine learning methods to tackle materials science.

  25. facebookresearch/fairo โญ 842
    A modular embodied agent architecture and platform for building embodied agents

  26. google/evojax โญ 818
    EvoJAX is a scalable, general purpose, hardware-accelerated neuroevolution toolkit built on the JAX library

  27. nvidia-omniverse/OmniIsaacGymEnvs โญ 797
    Reinforcement Learning Environments for Omniverse Isaac Gym

  28. eureka-research/DrEureka โญ 767
    Official Repository for "DrEureka: Language Model Guided Sim-To-Real Transfer" (RSS 2024)
    ๐Ÿ”— eureka-research.github.io/dr-eureka

Study

Miscellaneous study resources: algorithms, general resources, system design, code repos for textbooks, best practices, tutorials.

  1. thealgorithms/Python โญ 183,083
    All Algorithms implemented in Python
    ๐Ÿ”— the-algorithms.com

  2. microsoft/generative-ai-for-beginners โญ 58,095
    18 Lessons, Get Started Building with Generative AI ๐Ÿ”— https://microsoft.github.io/generative-ai-for-beginners/
    ๐Ÿ”— microsoft.github.io/generative-ai-for-beginners

  3. jakevdp/PythonDataScienceHandbook โญ 42,426
    Python Data Science Handbook: full text in Jupyter Notebooks
    ๐Ÿ”— jakevdp.github.io/pythondatasciencehandbook

  4. mlabonne/llm-course โญ 35,660
    Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
    ๐Ÿ”— mlabonne.github.io/blog

  5. realpython/python-guide โญ 28,069
    Python best practices guidebook, written for humans.
    ๐Ÿ”— docs.python-guide.org

  6. rasbt/LLMs-from-scratch โญ 24,602
    Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step
    ๐Ÿ”— www.manning.com/books/build-a-large-language-model-from-scratch

  7. christoschristofidis/awesome-deep-learning โญ 23,425
    A curated list of awesome Deep Learning tutorials, projects and communities.

  8. d2l-ai/d2l-en โญ 22,812
    Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.
    ๐Ÿ”— d2l.ai

  9. wesm/pydata-book โญ 21,837
    Materials and IPython notebooks for "Python for Data Analysis" by Wes McKinney, published by O'Reilly Media

  10. microsoft/recommenders โญ 18,596
    Best Practices on Recommendation Systems
    ๐Ÿ”— recommenders-team.github.io/recommenders/intro.html

  11. fchollet/deep-learning-with-python-notebooks โญ 18,018
    Jupyter notebooks for the code samples of the book "Deep Learning with Python"

  12. hannibal046/Awesome-LLM โญ 16,650
    Awesome-LLM: a curated list of Large Language Model

  13. graykode/nlp-tutorial โญ 13,977
    Natural Language Processing Tutorial for Deep Learning Researchers
    ๐Ÿ”— www.reddit.com/r/machinelearning/comments/amfinl/project_nlptutoral_repository_who_is_studying

  14. shangtongzhang/reinforcement-learning-an-introduction โญ 13,393
    Python Implementation of Reinforcement Learning: An Introduction

  15. naklecha/llama3-from-scratch โญ 11,767
    llama3 implementation one matrix multiplication at a time

  16. karpathy/nn-zero-to-hero โญ 11,281
    Neural Networks: Zero to Hero

  17. eugeneyan/open-llms โญ 10,759
    ๐Ÿ“‹ A list of open LLMs available for commercial use.

  18. openai/spinningup โญ 9,886
    An educational resource to help anyone learn deep reinforcement learning.
    ๐Ÿ”— spinningup.openai.com

  19. rucaibox/LLMSurvey โญ 9,770
    The official GitHub page for the survey paper "A Survey of Large Language Models".
    ๐Ÿ”— arxiv.org/abs/2303.18223

  20. karpathy/micrograd โญ 9,760
    A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

  21. mrdbourke/pytorch-deep-learning โญ 9,750
    Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.
    ๐Ÿ”— learnpytorch.io

  22. mooler0410/LLMsPracticalGuide โญ 9,139
    A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)
    ๐Ÿ”— arxiv.org/abs/2304.13712v2

  23. nielsrogge/Transformers-Tutorials โญ 8,776
    This repository contains demos I made with the Transformers library by HuggingFace.

  24. zhanymkanov/fastapi-best-practices โญ 8,162
    FastAPI Best Practices and Conventions we used at our startup

  25. firmai/industry-machine-learning โญ 7,171
    A curated list of applied machine learning and data science notebooks and libraries across different industries (by @firmai)
    ๐Ÿ”— www.linkedin.com/company/firmai

  26. gkamradt/langchain-tutorials โญ 6,577
    Overview and tutorial of the LangChain Library

  27. udlbook/udlbook โญ 5,851
    Understanding Deep Learning - Simon J.D. Prince

  28. srush/GPU-Puzzles โญ 5,498
    Teaching beginner GPU programming in a completely interactive fashion

  29. neetcode-gh/leetcode โญ 5,414
    Leetcode solutions for NeetCode.io

  30. udacity/deep-learning-v2-pytorch โญ 5,250
    Projects and exercises for the latest Deep Learning ND program https://www.udacity.com/course/deep-learning-nanodegree--nd101

  31. mrdbourke/tensorflow-deep-learning โญ 5,090
    All course materials for the Zero to Mastery Deep Learning with TensorFlow course.
    ๐Ÿ”— dbourke.link/ztmtfcourse

  32. roboflow/notebooks โญ 4,968
    Examples and tutorials on using SOTA computer vision models and techniques. Learn everything from old-school ResNet, through YOLO and object-detection transformers like DETR, to the latest models like Grounding DINO and SAM.
    ๐Ÿ”— roboflow.com/models

  33. timofurrer/awesome-asyncio โญ 4,520
    A curated list of awesome Python asyncio frameworks, libraries, software and resources

  34. zotroneneis/machine_learning_basics โญ 4,257
    Plain python implementations of basic machine learning algorithms

  35. alirezadir/Machine-Learning-Interviews โญ 4,082
    This repo is meant to serve as a guide for Machine Learning/AI technical interviews.

  36. huggingface/deep-rl-class โญ 3,766
    This repo contains the syllabus of the Hugging Face Deep Reinforcement Learning Course.

  37. promptslab/Awesome-Prompt-Engineering โญ 3,619
    This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
    ๐Ÿ”— discord.gg/m88xfymbk6

  38. huggingface/diffusion-models-class โญ 3,465
    Materials for the Hugging Face Diffusion Models Course

  39. cosmicpython/book โญ 3,332
    A Book about Pythonic Application Architecture Patterns for Managing Complexity. Cosmos is the Opposite of Chaos you see. O'R. wouldn't actually let us call it "Cosmic Python" tho.
    ๐Ÿ”— www.cosmicpython.com

  40. rasbt/machine-learning-book โญ 3,204
    Code Repository for Machine Learning with PyTorch and Scikit-Learn
    ๐Ÿ”— sebastianraschka.com/books/#machine-learning-with-pytorch-and-scikit-learn

  41. fluentpython/example-code-2e โญ 3,120
    Example code for Fluent Python, 2nd edition (O'Reilly 2022)
    ๐Ÿ”— amzn.to/3j48u2j

  42. amanchadha/coursera-deep-learning-specialization โญ 2,943
    Notes, programming assignments and quizzes from all courses within the Coursera Deep Learning specialization offered by deeplearning.ai: (i) Neural Networks and Deep Learning; (ii) Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization; (iii) Structuring Machine Learning Projects; (iv...

  43. mrdbourke/zero-to-mastery-ml โญ 2,795
    All course materials for the Zero to Mastery Machine Learning and Data Science course.
    ๐Ÿ”— dbourke.link/ztmmlcourse

  44. krzjoa/awesome-python-data-science โญ 2,466
    Probably the best curated list of data science software in Python.
    ๐Ÿ”— krzjoa.github.io/awesome-python-data-science

  45. cgpotts/cs224u โญ 2,087
    Code for CS224u: Natural Language Understanding

  46. cerlymarco/MEDIUM_NoteBook โญ 2,060
    Repository containing notebooks of my posts on Medium

  47. gerdm/prml โญ 2,035
    Repository of notes, code and notebooks in Python for the book Pattern Recognition and Machine Learning by Christopher Bishop

  48. trananhkma/fucking-awesome-python โญ 1,982
    awesome-python with :octocat: โญ and ๐Ÿด

  49. huggingface/cookbook โญ 1,553
    Community-driven practical examples of building AI applications and solving various tasks with AI using open-source tools and models.
    ๐Ÿ”— huggingface.co/learn/cookbook

  50. chandlerbang/awesome-self-supervised-gnn โญ 1,527
    Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

  51. atcold/NYU-DLSP21 โญ 1,518
    NYU Deep Learning Spring 2021
    ๐Ÿ”— atcold.github.io/nyu-dlsp21

  52. patrickloeber/MLfromscratch โญ 1,235
    Machine Learning algorithm implementations from scratch.

  53. davidadsp/Generative_Deep_Learning_2nd_Edition โญ 1,000
    The official code repository for the second edition of the O'Reilly book Generative Deep Learning: Teaching Machines to Paint, Write, Compose and Play.
    ๐Ÿ”— www.oreilly.com/library/view/generative-deep-learning/9781098134174

  54. jackhidary/quantumcomputingbook โญ 782
    Companion site for the textbook Quantum Computing: An Applied Approach

  55. dylanhogg/awesome-python โญ 285
    ๐Ÿ Hand-picked awesome Python libraries and frameworks, organised by category
    ๐Ÿ”— www.awesomepython.org

Template

Template tools and libraries: cookiecutter repos, generators, quick-starts.

  1. tiangolo/full-stack-fastapi-template โญ 25,264
    Full stack, modern web application template. Using FastAPI, React, SQLModel, PostgreSQL, Docker, GitHub Actions, automatic HTTPS and more.

  2. cookiecutter/cookiecutter โญ 22,137
    A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C projects.
    ๐Ÿ”— pypi.org/project/cookiecutter

  3. drivendata/cookiecutter-data-science โญ 8,084
    A logical, reasonably standardized, but flexible project structure for doing and sharing data science work.
    ๐Ÿ”— cookiecutter-data-science.drivendata.org

  4. buuntu/fastapi-react โญ 2,158
    ๐Ÿš€ Cookiecutter Template for FastAPI + React Projects. Using PostgreSQL, SQLAlchemy, and Docker

  5. pyscaffold/pyscaffold โญ 2,062
    ๐Ÿ›  Python project template generator with batteries included
    ๐Ÿ”— pyscaffold.org

  6. cjolowicz/cookiecutter-hypermodern-python โญ 1,774
    Cookiecutter template for a Python package based on the Hypermodern Python article series.
    ๐Ÿ”— cookiecutter-hypermodern-python.readthedocs.io

  7. tezromach/python-package-template โญ 1,087
    ๐Ÿš€ Your next Python package needs a bleeding-edge project structure.

  8. martinheinz/python-project-blueprint โญ 951
    Blueprint/Boilerplate For Python Projects

  9. fmind/mlops-python-package โญ 595
    Kickstart your MLOps initiative with a flexible, robust, and productive Python package.
    ๐Ÿ”— fmind.github.io/mlops-python-package

Terminal

Terminal and console tools and libraries: CLI tools, terminal based formatters, progress bars.

  1. willmcgugan/rich โญ 48,563
    Rich is a Python library for rich text and beautiful formatting in the terminal.
    ๐Ÿ”— rich.readthedocs.io/en/latest

  2. tqdm/tqdm โญ 28,119
    โšก A Fast, Extensible Progress Bar for Python and CLI
    ๐Ÿ”— tqdm.github.io

  3. google/python-fire โญ 26,732
    Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.

  4. willmcgugan/textual โญ 24,547
    The lean application framework for Python. Build sophisticated user interfaces with a simple Python API. Run your apps in the terminal and a web browser.
    ๐Ÿ”— textual.textualize.io

  5. pallets/click โญ 15,394
    Python composable command line interface toolkit
    ๐Ÿ”— click.palletsprojects.com

  6. tiangolo/typer โญ 15,124
    Typer, build great CLIs. Easy to code. Based on Python type hints.
    ๐Ÿ”— typer.tiangolo.com

  7. saulpw/visidata โญ 7,729
    A terminal spreadsheet multitool for discovering and arranging data
    ๐Ÿ”— visidata.org

  8. tconbeer/harlequin โญ 3,441
    The SQL IDE for Your Terminal.
    ๐Ÿ”— harlequin.sh

  9. manrajgrover/halo โญ 2,873
    ๐Ÿ’ซ Beautiful spinners for terminal, IPython and Jupyter

  10. urwid/urwid โญ 2,775
    Console user interface library for Python (official repo)
    ๐Ÿ”— urwid.org

  11. textualize/trogon โญ 2,419
    Easily turn your Click CLI into a powerful terminal application

  12. darrenburns/elia โญ 1,681
    A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

  13. tmbo/questionary โญ 1,499
    Python library to build pretty command line user prompts โœจEasy to use multi-select lists, confirmations, free text prompts ...

  14. jazzband/prettytable โญ 1,327
    Display tabular data in a visually appealing ASCII table format
    ๐Ÿ”— pypi.org/project/prettytable

  15. 1j01/textual-paint โญ 930
    ๐ŸŽจ MS Paint in your terminal.
    ๐Ÿ”— pypi.org/project/textual-paint

Testing

Testing libraries: unit testing, load testing, acceptance testing, code coverage, browser automation, plugins.

  1. mitmproxy/mitmproxy โญ 35,534
    An interactive TLS-capable intercepting HTTP proxy for penetration testers and software developers.
    ๐Ÿ”— mitmproxy.org

  2. locustio/locust โญ 24,372
    Write scalable load tests in plain Python ๐Ÿš—๐Ÿ’จ

  3. pytest-dev/pytest โญ 11,756
    The pytest framework makes it easy to write small tests, yet scales to support complex functional testing
    ๐Ÿ”— pytest.org

  4. microsoft/playwright-python โญ 11,327
    Python version of the Playwright testing and automation library.
    ๐Ÿ”— playwright.dev/python

  5. robotframework/robotframework โญ 9,513
    Generic automation framework for acceptance testing and RPA
    ๐Ÿ”— robotframework.org

  6. getmoto/moto โญ 7,536
    A library that allows you to easily mock out tests based on AWS infrastructure.
    ๐Ÿ”— docs.getmoto.org/en/latest

  7. hypothesisworks/hypothesis โญ 7,447
    Hypothesis is a powerful, flexible, and easy to use library for property-based testing.
    ๐Ÿ”— hypothesis.works

  8. newsapps/beeswithmachineguns โญ 6,430
    A utility for arming (creating) many bees (micro EC2 instances) to attack (load test) targets (web applications).
    ๐Ÿ”— apps.chicagotribune.com

  9. seleniumbase/SeleniumBase โญ 4,606
    ๐Ÿ“Š Python's all-in-one framework for web crawling, scraping, testing, and reporting. Supports pytest. UC Mode provides stealth. Includes many tools.
    ๐Ÿ”— seleniumbase.io

  10. getsentry/responses โญ 4,105
    A utility for mocking out the Python Requests library.

  11. spulec/freezegun โญ 4,105
    Let your Python tests travel through time

  12. codium-ai/cover-agent โญ 4,101
    CodiumAI Cover-Agent: An AI-Powered Tool for Automated Test Generation and Code Coverage Enhancement! ๐Ÿ’ป๐Ÿค–๐Ÿงช๐Ÿž
    ๐Ÿ”— www.codium.ai

  13. tox-dev/tox โญ 3,601
    Command line driven CI frontend and development task automation tool.
    ๐Ÿ”— tox.wiki

  14. behave/behave โญ 3,117
    BDD, Python style.
    ๐Ÿ”— behave.readthedocs.io/en/latest

  15. nedbat/coveragepy โญ 2,935
    The code coverage tool for Python
    ๐Ÿ”— coverage.readthedocs.io

  16. cobrateam/splinter โญ 2,708
    splinter - python test framework for web applications
    ๐Ÿ”— splinter.readthedocs.org/en/stable/index.html

  17. kevin1024/vcrpy โญ 2,665
    Automatically mock your HTTP interactions to simplify and speed up testing

  18. confident-ai/deepeval โญ 2,659
    The LLM Evaluation Framework
    ๐Ÿ”— docs.confident-ai.com

  19. pytest-dev/pytest-testinfra โญ 2,357
    With Testinfra you can write unit tests in Python to test actual state of your servers configured by management tools like Salt, Ansible, Puppet, Chef and so on.
    ๐Ÿ”— testinfra.readthedocs.io

  20. pytest-dev/pytest-mock โญ 1,805
    Thin-wrapper around the mock package for easier use with pytest
    ๐Ÿ”— pytest-mock.readthedocs.io/en/latest

  21. pytest-dev/pytest-cov โญ 1,711
    Coverage plugin for pytest.

  22. pytest-dev/pytest-xdist โญ 1,422
    pytest plugin for distributed testing and loop-on-failures testing modes.
    ๐Ÿ”— pytest-xdist.readthedocs.io

  23. pytest-dev/pytest-asyncio โญ 1,379
    Asyncio support for pytest
    ๐Ÿ”— pytest-asyncio.readthedocs.io

  24. taverntesting/tavern โญ 1,013
    A command-line tool and Python library and Pytest plugin for automated testing of RESTful APIs, with a simple, concise and flexible YAML-based syntax
    ๐Ÿ”— taverntesting.github.io

Machine Learning - Time Series

Machine learning and classical timeseries libraries: forecasting, seasonality, anomaly detection, econometrics.

  1. facebook/prophet โญ 18,155
    Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.
    ๐Ÿ”— facebook.github.io/prophet

  2. blue-yonder/tsfresh โญ 8,264
    Automatic extraction of relevant features from time series:
    ๐Ÿ”— tsfresh.readthedocs.io

  3. unit8co/darts โญ 7,798
    A python library for user-friendly forecasting and anomaly detection on time series.
    ๐Ÿ”— unit8co.github.io/darts

  4. sktime/sktime โญ 7,668
    A unified framework for machine learning with time series
    ๐Ÿ”— www.sktime.net

  5. facebookresearch/Kats โญ 4,858
    Kats, a kit to analyze time series data, a lightweight, easy-to-use, generalizable, and extendable framework to perform time series analysis, from understanding the key statistics and characteristics, detecting change points and anomalies, to forecasting future trends.

  6. awslabs/gluonts โญ 4,495
    Probabilistic time series modeling in Python
    ๐Ÿ”— ts.gluon.ai

  7. nixtla/statsforecast โญ 3,798
    Lightning โšก๏ธ fast forecasting with statistical and econometric models.
    ๐Ÿ”— nixtlaverse.nixtla.io/statsforecast

  8. tdameritrade/stumpy โญ 3,553
    STUMPY is a powerful and scalable Python library for modern time series analysis
    ๐Ÿ”— stumpy.readthedocs.io/en/latest

  9. google-research/timesfm โญ 3,371
    TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.
    ๐Ÿ”— research.google/blog/a-decoder-only-foundation-model-for-time-series-forecasting

  10. salesforce/Merlion โญ 3,322
    Merlion: A Machine Learning Framework for Time Series Intelligence

  11. amazon-science/chronos-forecasting โญ 2,205
    Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting
    ๐Ÿ”— arxiv.org/abs/2403.07815

  12. rjt1990/pyflux โญ 2,103
    Open source time series library for Python

  13. aistream-peelout/flow-forecast โญ 1,984
    Deep learning PyTorch library for time series forecasting, classification, and anomaly detection (originally for flood forecasting).
    ๐Ÿ”— flow-forecast.atlassian.net/wiki/spaces/ff/overview

  14. uber/orbit โญ 1,843
    A Python package for Bayesian forecasting with object-oriented design and probabilistic models under the hood.
    ๐Ÿ”— orbit-ml.readthedocs.io/en/stable

  15. alkaline-ml/pmdarima โญ 1,560
    A statistical library designed to fill the void in Python's time series analysis capabilities, including the equivalent of R's auto.arima function.
    ๐Ÿ”— www.alkaline-ml.com/pmdarima

  16. time-series-foundation-models/lag-llama โญ 1,149
    Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

  17. winedarksea/AutoTS โญ 1,083
    Automated Time Series Forecasting

  18. autoviml/Auto_TS โญ 713
    Automatically build ARIMA, SARIMAX, VAR, FB Prophet and XGBoost Models on Time Series data sets with a Single Line of Code. Created by Ram Seshadri. Collaborators welcome.

  19. google/temporian โญ 658
    Temporian is an open-source Python library for preprocessing โšก and feature engineering ๐Ÿ›  temporal data ๐Ÿ“ˆ for machine learning applications ๐Ÿค–
    ๐Ÿ”— temporian.readthedocs.io

Typing

Typing libraries: static and run-time type checking, annotations.

  1. python/mypy โญ 18,045
    Optional static typing for Python
    ๐Ÿ”— www.mypy-lang.org

  2. microsoft/pyright โญ 12,819
    Static Type Checker for Python

  3. facebook/pyre-check โญ 6,779
    Performant type-checking for python.
    ๐Ÿ”— pyre-check.org

  4. python-attrs/attrs โญ 5,183
    Python Classes Without Boilerplate
    ๐Ÿ”— www.attrs.org

  5. instagram/MonkeyType โญ 4,700
    A Python library that generates static type annotations by collecting runtime types

  6. google/pytype โญ 4,692
    A static type analyzer for Python code
    ๐Ÿ”— google.github.io/pytype

  7. python/typeshed โญ 4,210
    Collection of library stubs for Python, with static types

  8. mtshiba/pylyzer โญ 2,242
    A fast static code analyzer & language server for Python
    ๐Ÿ”— mtshiba.github.io/pylyzer

  9. microsoft/pylance-release โญ 1,691
    Fast, feature-rich language support for Python. Documentation and issues for Pylance.

  10. agronholm/typeguard โญ 1,484
    Run-time type checker for Python

  11. patrick-kidger/torchtyping โญ 1,369
    Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.

  12. robertcraigie/pyright-python โญ 156
    Python command line wrapper for pyright, a static type checker
    ๐Ÿ”— pypi.org/project/pyright

Utility

General utility libraries: miscellaneous tools, linters, code formatters, version management, package tools, documentation tools.

  1. yt-dlp/yt-dlp โญ 79,494
    A feature-rich command-line audio/video downloader
    ๐Ÿ”— discord.gg/h5mncfw63r

  2. home-assistant/core โญ 70,322
    ๐Ÿก Open source home automation that puts local control and privacy first.
    ๐Ÿ”— www.home-assistant.io

  3. python/cpython โญ 61,703
    The Python programming language
    ๐Ÿ”— www.python.org

  4. localstack/localstack โญ 53,304
    ๐Ÿ’ป A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline
    ๐Ÿ”— localstack.cloud

  5. faif/python-patterns โญ 40,010
    A collection of design patterns/idioms in Python

  6. mingrammer/diagrams โญ 36,470
    ๐ŸŽจ Diagram as Code for prototyping cloud system architectures
    ๐Ÿ”— diagrams.mingrammer.com

  7. ggerganov/whisper.cpp โญ 33,626
    Port of OpenAI's Whisper model in C/C++

  8. keon/algorithms โญ 23,853
    Minimal examples of data structures and algorithms in Python

  9. norvig/pytudes โญ 22,556
    Python programs, usually short, of considerable difficulty, to perfect particular skills.

  10. modularml/mojo โญ 22,543
    The Mojo Programming Language
    ๐Ÿ”— docs.modular.com/mojo/manual

  11. openai/openai-python โญ 21,559
    The official Python library for the OpenAI API
    ๐Ÿ”— pypi.org/project/openai

  12. chriskiehl/Gooey โญ 20,525
    Turn (almost) any Python command line program into a full GUI application with one line

  13. facebookresearch/audiocraft โญ 20,393
    Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

  14. pydantic/pydantic โญ 20,041
    Data validation using Python type hints
    ๐Ÿ”— docs.pydantic.dev

  15. squidfunk/mkdocs-material โญ 19,562
    Documentation that simply works
    ๐Ÿ”— squidfunk.github.io/mkdocs-material

  16. delgan/loguru โญ 19,140
    Python logging made (stupidly) simple

  17. micropython/micropython โญ 18,897
    MicroPython - a lean and efficient Python implementation for microcontrollers and constrained systems
    ๐Ÿ”— micropython.org

  18. mkdocs/mkdocs โญ 18,864
    Project documentation with Markdown.
    ๐Ÿ”— www.mkdocs.org

  19. rustpython/RustPython โญ 18,494
    A Python Interpreter written in Rust
    ๐Ÿ”— rustpython.github.io

  20. kivy/kivy โญ 17,401
    Open source UI framework written in Python, running on Windows, Linux, macOS, Android and iOS
    ๐Ÿ”— kivy.org

  21. higherorderco/Bend โญ 17,017
    A massively parallel, high-level programming language
    ๐Ÿ”— higherorderco.com

  22. blakeblackshear/frigate โญ 16,816
    NVR with realtime local object detection for IP cameras
    ๐Ÿ”— frigate.video

  23. ipython/ipython โญ 16,215
    Official repository for IPython itself. Other repos in the IPython organization contain things like the website, documentation builds, etc.
    ๐Ÿ”— ipython.readthedocs.org

  24. alievk/avatarify-python โญ 16,200
    Avatars for Zoom, Skype and other video-conferencing apps.

  25. paul-gauthier/aider โญ 15,759
    Aider is a command line tool that lets you pair program with LLMs, to edit code stored in your local git repository
    ๐Ÿ”— aider.chat

  26. zulko/moviepy โญ 12,233
    Video editing with Python
    ๐Ÿ”— zulko.github.io/moviepy

  27. openai/triton โญ 12,204
    Development repository for the Triton language and compiler
    ๐Ÿ”— triton-lang.org

  28. python-pillow/Pillow โญ 11,992
    The Python Imaging Library adds image processing capabilities to Python (Pillow is the friendly PIL fork)
    ๐Ÿ”— python-pillow.org

  29. pytube/pytube โญ 11,853
    A lightweight, dependency-free Python library (and command-line utility) for downloading YouTube Videos.
    ๐Ÿ”— pytube.io

  30. pyodide/pyodide โญ 11,824
    Pyodide is a Python distribution for the browser and Node.js based on WebAssembly
    ๐Ÿ”— pyodide.org/en/stable

  31. pyo3/pyo3 โญ 11,719
    Rust bindings for the Python interpreter
    ๐Ÿ”— pyo3.rs

  32. dbader/schedule โญ 11,672
    Python job scheduling for humans.
    ๐Ÿ”— schedule.readthedocs.io

  33. nuitka/Nuitka โญ 11,568
    Nuitka is a Python compiler written in Python. It's fully compatible with Python 2.6, 2.7, 3.4-3.12. You feed it your Python app, it does a lot of clever things, and spits out an executable or extension module.
    ๐Ÿ”— nuitka.net

  34. caronc/apprise โญ 11,154
    Apprise - Push Notifications that work with just about every platform!
    ๐Ÿ”— hub.docker.com/r/caronc/apprise

  35. ninja-build/ninja โญ 10,903
    Ninja is a small build system with a focus on speed.
    ๐Ÿ”— ninja-build.org

  36. secdev/scapy โญ 10,441
    Scapy: the Python-based interactive packet manipulation program & library.
    ๐Ÿ”— scapy.net

  37. magicstack/uvloop โญ 10,203
    Ultra fast asyncio event loop.

  38. pallets/jinja โญ 10,176
    A very fast and expressive template engine.
    ๐Ÿ”— jinja.palletsprojects.com

  39. asweigart/pyautogui โญ 10,022
    A cross-platform GUI automation Python module for human beings. Used to programmatically control the mouse & keyboard.

  40. aristocratos/bpytop โญ 9,994
    Linux/OSX/FreeBSD resource monitor

  41. aws/serverless-application-model โญ 9,306
    The AWS Serverless Application Model (AWS SAM) transform is a AWS CloudFormation macro that transforms SAM templates into CloudFormation templates.
    ๐Ÿ”— aws.amazon.com/serverless/sam

  42. cython/cython โญ 9,231
    The most widely used Python to C compiler
    ๐Ÿ”— cython.org

  43. paramiko/paramiko โญ 8,984
    The leading native Python SSHv2 protocol library.
    ๐Ÿ”— paramiko.org

  44. boto/boto3 โญ 8,890
    AWS SDK for Python
    ๐Ÿ”— aws.amazon.com/sdk-for-python

  45. arrow-py/arrow โญ 8,651
    ๐Ÿน Better dates & times for Python
    ๐Ÿ”— arrow.readthedocs.io

  46. facebookresearch/hydra โญ 8,508
    Hydra is a framework for elegantly configuring complex applications
    ๐Ÿ”— hydra.cc

  47. xonsh/xonsh โญ 8,240
    ๐Ÿš Python-powered shell. Full-featured and cross-platform.
    ๐Ÿ”— xon.sh

  48. eternnoir/pyTelegramBotAPI โญ 7,953
    Python Telegram bot api.

  49. py-pdf/pypdf โญ 7,913
    A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files
    ๐Ÿ”— pypdf.readthedocs.io/en/latest

  50. kellyjonbrazil/jc โญ 7,753
    CLI tool and python library that converts the output of popular command-line tools, file-types, and common strings to JSON, YAML, or Dictionaries. This allows piping of output to tools like jq and simplifying automation scripts.

  51. googleapis/google-api-python-client โญ 7,610
    ๐Ÿ The official Python client library for Google's discovery based APIs.
    ๐Ÿ”— googleapis.github.io/google-api-python-client/docs

  52. theskumar/python-dotenv โญ 7,390
    Reads key-value pairs from a .env file and can set them as environment variables. It helps in developing applications following the 12-factor principles.
    ๐Ÿ”— saurabh-kumar.com/python-dotenv

  53. jasonppy/VoiceCraft โญ 7,310
    Zero-Shot Speech Editing and Text-to-Speech in the Wild

  54. googlecloudplatform/python-docs-samples โญ 7,124
    Code samples used on cloud.google.com

  55. google/latexify_py โญ 7,122
    A library to generate LaTeX expression from Python code.

  56. marshmallow-code/marshmallow โญ 6,959
    A lightweight library for converting complex objects to and from simple Python datatypes.
    ๐Ÿ”— marshmallow.readthedocs.io

  57. hugapi/hug โญ 6,857
    Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.

  58. pygithub/PyGithub โญ 6,855
    Typed interactions with the GitHub API v3
    ๐Ÿ”— pygithub.readthedocs.io

  59. pyca/cryptography โญ 6,471
    cryptography is a package designed to expose cryptographic primitives and recipes to Python developers.
    ๐Ÿ”— cryptography.io

  60. openai/point-e โญ 6,440
    Point cloud diffusion for 3D model synthesis

  61. gorakhargosh/watchdog โญ 6,435
    Python library and shell utilities to monitor filesystem events.
    ๐Ÿ”— packages.python.org/watchdog

  62. icloud-photos-downloader/icloud_photos_downloader โญ 6,422
    A command-line tool to download photos from iCloud

  63. jd/tenacity โญ 6,412
    Retrying library for Python
    ๐Ÿ”— tenacity.readthedocs.io

  64. sphinx-doc/sphinx โญ 6,311
    The Sphinx documentation generator
    ๐Ÿ”— www.sphinx-doc.org

  65. sdispater/pendulum โญ 6,145
    Python datetimes made easy
    ๐Ÿ”— pendulum.eustace.io

  66. agronholm/apscheduler โญ 6,041
    Task scheduling library for Python

  67. bndr/pipreqs โญ 6,035
    pipreqs - Generate pip requirements.txt file based on imports of any project. Looking for maintainers to move this project forward.

  68. scikit-image/scikit-image โญ 5,995
    Image processing in Python
    ๐Ÿ”— scikit-image.org

  69. ijl/orjson โญ 5,954
    Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy

  70. wireservice/csvkit โญ 5,926
    A suite of utilities for converting to and working with CSV, the king of tabular file formats.
    ๐Ÿ”— csvkit.readthedocs.io

  71. timdettmers/bitsandbytes โญ 5,869
    Accessible large language models via k-bit quantization for PyTorch.
    ๐Ÿ”— huggingface.co/docs/bitsandbytes/main/en/index

  72. pdfminer/pdfminer.six โญ 5,723
    Community maintained fork of pdfminer - we fathom PDF
    ๐Ÿ”— pdfminersix.readthedocs.io

  73. pytransitions/transitions โญ 5,562
    A lightweight, object-oriented finite state machine implementation in Python with many extensions

  74. rsalmei/alive-progress โญ 5,311
    A new kind of Progress Bar, with real-time throughput, ETA, and very cool animations!

  75. buildbot/buildbot โญ 5,210
    Python-based continuous integration testing framework; your pull requests are more than welcome!
    ๐Ÿ”— www.buildbot.net

  76. prompt-toolkit/ptpython โญ 5,152
    A better Python REPL

  77. spotify/pedalboard โญ 5,056
    ๐ŸŽ› ๐Ÿ”Š A Python library for audio.
    ๐Ÿ”— spotify.github.io/pedalboard

  78. pycqa/pycodestyle โญ 5,006
    Simple Python style checker in one Python file
    ๐Ÿ”— pycodestyle.pycqa.org

  79. pywinauto/pywinauto โญ 4,826
    Windows GUI Automation with Python (based on text properties)
    ๐Ÿ”— pywinauto.github.io

  80. jorgebastida/awslogs โญ 4,817
    AWS CloudWatch logs for Humansโ„ข

  81. tebelorg/RPA-Python โญ 4,773
    Python package for doing RPA

  82. pytoolz/toolz โญ 4,619
    A functional standard library for Python.
    ๐Ÿ”— toolz.readthedocs.org

  83. hhatto/autopep8 โญ 4,553
    A tool that automatically formats Python code to conform to the PEP 8 style guide.
    ๐Ÿ”— pypi.org/project/autopep8

  84. pyinvoke/invoke โญ 4,340
    Pythonic task management & command execution.
    ๐Ÿ”— pyinvoke.org

  85. bogdanp/dramatiq โญ 4,191
    A fast and reliable background task processing library for Python 3.
    ๐Ÿ”— dramatiq.io

  86. evhub/coconut โญ 4,022
    Coconut (coconut-lang.org) is a variant of Python that adds on top of Python syntax new features for simple, elegant, Pythonic functional programming.
    ๐Ÿ”— coconut-lang.org

  87. adafruit/circuitpython โญ 3,984
    CircuitPython - a Python implementation for teaching coding with microcontrollers
    ๐Ÿ”— circuitpython.org

  88. ashleve/lightning-hydra-template โญ 3,955
    PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. โšก๐Ÿ”ฅโšก

  89. miguelgrinberg/python-socketio โญ 3,897
    Python Socket.IO server and client

  90. joblib/joblib โญ 3,788
    Computing with Python functions.
    ๐Ÿ”— joblib.readthedocs.org

  91. pyinfra-dev/pyinfra โญ 3,769
    pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fast and scales from one server to thousands.
    ๐Ÿ”— pyinfra.com

  92. ets-labs/python-dependency-injector โญ 3,751
    Dependency injection framework for Python
    ๐Ÿ”— python-dependency-injector.ets-labs.org

  93. rspeer/python-ftfy โญ 3,743
    Fixes mojibake and other glitches in Unicode text, after the fact.
    ๐Ÿ”— ftfy.readthedocs.org

  94. blealtan/efficient-kan โญ 3,720
    An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).

  95. python-markdown/markdown โญ 3,692
    A Python implementation of John Gruberโ€™s Markdown with Extension support.
    ๐Ÿ”— python-markdown.github.io

  96. more-itertools/more-itertools โญ 3,642
    More routines for operating on iterables, beyond itertools
    ๐Ÿ”— more-itertools.rtfd.io

  97. zeromq/pyzmq โญ 3,638
    PyZMQ: Python bindings for zeromq
    ๐Ÿ”— zguide.zeromq.org/py:all

  98. pyo3/maturin โญ 3,589
    Build and publish crates with pyo3, cffi and uniffi bindings as well as rust binaries as python packages
    ๐Ÿ”— maturin.rs

  99. pydata/xarray โญ 3,530
    N-D labeled arrays and datasets in Python
    ๐Ÿ”— xarray.dev

  100. pypi/warehouse โญ 3,529
    The Python Package Index
    ๐Ÿ”— pypi.org

  101. tartley/colorama โญ 3,491
    Simple cross-platform colored terminal text in Python

  102. osohq/oso โญ 3,462
    Oso is a batteries-included framework for building authorization in your application.
    ๐Ÿ”— docs.osohq.com

  103. jorisschellekens/borb โญ 3,346
    borb is a library for reading, creating and manipulating PDF files in python.
    ๐Ÿ”— borbpdf.com

  104. suor/funcy โญ 3,333
    A fancy and practical functional tools

  105. spotify/basic-pitch โญ 3,199
    A lightweight yet powerful audio-to-MIDI converter with pitch bend detection
    ๐Ÿ”— basicpitch.io

  106. pyserial/pyserial โญ 3,171
    Python serial port access library

  107. camelot-dev/camelot โญ 2,865
    A Python library to extract tabular data from PDFs
    ๐Ÿ”— camelot-py.readthedocs.io

  108. legrandin/pycryptodome โญ 2,767
    A self-contained cryptographic library for Python
    ๐Ÿ”— www.pycryptodome.org

  109. tox-dev/pipdeptree โญ 2,747
    A command line utility to display dependency tree of the installed Python packages
    ๐Ÿ”— pypi.python.org/pypi/pipdeptree

  110. lxml/lxml โญ 2,635
    The lxml XML toolkit for Python
    ๐Ÿ”— lxml.de

  111. liiight/notifiers โญ 2,633
    The easy way to send notifications
    ๐Ÿ”— notifiers.readthedocs.io

  112. whylabs/whylogs โญ 2,606
    An open-source data logging library for machine learning models and data pipelines. ๐Ÿ“š Provides visibility into data quality & model performance over time. ๐Ÿ›ก๏ธ Supports privacy-preserving data collection, ensuring safety & robustness. ๐Ÿ“ˆ
    ๐Ÿ”— whylogs.readthedocs.io

  113. pexpect/pexpect โญ 2,573
    A Python module for controlling interactive programs in a pseudo-terminal
    ๐Ÿ”— pexpect.readthedocs.io

  114. litl/backoff โญ 2,556
    Python library providing function decorators for configurable backoff and retry

  115. scrapinghub/dateparser โญ 2,511
    python parser for human readable dates

  116. pyston/pyston โญ 2,503
    A faster and highly-compatible implementation of the Python programming language.
    ๐Ÿ”— www.pyston.org

  117. yaml/pyyaml โญ 2,497
    Canonical source repository for PyYAML

  118. dosisod/refurb โญ 2,472
    A tool for refurbishing and modernizing Python codebases

  119. cdgriffith/Box โญ 2,424
    Python dictionaries with advanced dot notation access
    ๐Ÿ”— github.com/cdgriffith/box/wiki

  120. pypa/setuptools โญ 2,420
    Official project repository for the Setuptools build system
    ๐Ÿ”— pypi.org/project/setuptools

  121. nschloe/tikzplotlib โญ 2,365
    ๐Ÿ“Š Save matplotlib figures as TikZ/PGFplots for smooth integration into LaTeX.

  122. hgrecco/pint โญ 2,342
    Operate and manipulate physical quantities in Python
    ๐Ÿ”— pint.readthedocs.org

  123. dateutil/dateutil โญ 2,296
    Useful extensions to the standard Python datetime features

  124. grantjenks/python-diskcache โญ 2,287
    Python disk-backed cache (Django-compatible). Faster than Redis and Memcached. Pure-Python.
    ๐Ÿ”— www.grantjenks.com/docs/diskcache

  125. pndurette/gTTS โญ 2,223
    Python library and CLI tool to interface with Google Translate's text-to-speech API
    ๐Ÿ”— gtts.readthedocs.org

  126. kiminewt/pyshark โญ 2,188
    Python wrapper for tshark, allowing python packet parsing using wireshark dissectors

  127. jcrist/msgspec โญ 2,167
    A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML
    ๐Ÿ”— jcristharif.com/msgspec

  128. pyparsing/pyparsing โญ 2,164
    Python library for creating PEG parsers

  129. ianmiell/shutit โญ 2,150
    Automation framework for programmers
    ๐Ÿ”— ianmiell.github.io/shutit

  130. libaudioflux/audioFlux โญ 2,115
    A library for audio and music analysis, feature extraction.
    ๐Ÿ”— audioflux.top

  131. astanin/python-tabulate โญ 2,074
    Pretty-print tabular data in Python, a library and a command-line utility. Repository migrated from bitbucket.org/astanin/python-tabulate.
    ๐Ÿ”— pypi.org/project/tabulate

  132. nateshmbhat/pyttsx3 โญ 2,034
    Offline Text To Speech synthesis for python

  133. google/gin-config โญ 2,024
    Gin provides a lightweight configuration framework for Python

  134. grahamdumpleton/wrapt โญ 2,021
    A Python module for decorators, wrappers and monkey patching.

  135. pyfilesystem/pyfilesystem2 โญ 1,973
    Python's Filesystem abstraction layer
    ๐Ÿ”— www.pyfilesystem.org

  136. landscapeio/prospector โญ 1,927
    Inspects Python source files and provides information about type and location of classes, methods etc

  137. rhettbull/osxphotos โญ 1,913
    Python app to work with pictures and associated metadata from Apple Photos on macOS. Also includes a package to provide programmatic access to the Photos library, pictures, and metadata.

  138. omry/omegaconf โญ 1,907
    Flexible Python configuration system. The last one you will ever need.

  139. julienpalard/Pipe โญ 1,907
    A Python library to use infix notation in Python

  140. python-rope/rope โญ 1,901
    a python refactoring library

  141. mitmproxy/pdoc โญ 1,898
    API Documentation for Python Projects
    ๐Ÿ”— pdoc.dev

  142. numba/llvmlite โญ 1,879
    A lightweight LLVM python binding for writing JIT compilers
    ๐Ÿ”— llvmlite.pydata.org

  143. chaostoolkit/chaostoolkit โญ 1,868
    Chaos Engineering Toolkit & Orchestration for Developers
    ๐Ÿ”— chaostoolkit.org

  144. carpedm20/emoji โญ 1,864
    emoji terminal output for Python

  145. pydoit/doit โญ 1,825
    task management & automation tool
    ๐Ÿ”— pydoit.org

  146. joowani/binarytree โญ 1,810
    Python Library for Studying Binary Trees
    ๐Ÿ”— binarytree.readthedocs.io

  147. pydantic/logfire โญ 1,803
    Uncomplicated Observability for Python and beyond! ๐Ÿชต๐Ÿ”ฅ
    ๐Ÿ”— docs.pydantic.dev/logfire

  148. pygments/pygments โญ 1,771
    Pygments is a generic syntax highlighter written in Python
    ๐Ÿ”— pygments.org

  149. kalliope-project/kalliope โญ 1,714
    Kalliope is a framework that will help you to create your own personal assistant.
    ๐Ÿ”— kalliope-project.github.io

  150. konradhalas/dacite โญ 1,708
    Simple creation of data classes from dictionaries.

  151. samuelcolvin/watchfiles โญ 1,701
    Simple, modern and fast file watching and code reload in python.
    ๐Ÿ”— watchfiles.helpmanual.io

  152. p0dalirius/Coercer โญ 1,699
    A python script to automatically coerce a Windows server to authenticate on an arbitrary machine through 12 methods.
    ๐Ÿ”— podalirius.net

  153. home-assistant/supervisor โญ 1,696
    ๐Ÿก Home Assistant Supervisor
    ๐Ÿ”— home-assistant.io/hassio

  154. open-telemetry/opentelemetry-python โญ 1,692
    OpenTelemetry Python API and SDK
    ๐Ÿ”— opentelemetry.io

  155. rubik/radon โญ 1,692
    Various code metrics for Python code
    ๐Ÿ”— radon.readthedocs.org

  156. hbldh/bleak โญ 1,674
    A cross platform Bluetooth Low Energy Client for Python using asyncio

  157. mkdocstrings/mkdocstrings โญ 1,648
    ๐Ÿ“˜ Automatic documentation from sources, for MkDocs.
    ๐Ÿ”— mkdocstrings.github.io

  158. facebookincubator/Bowler โญ 1,532
    Safe code refactoring for modern Python.
    ๐Ÿ”— pybowler.io

  159. quodlibet/mutagen โญ 1,502
    Python module for handling audio metadata
    ๐Ÿ”— mutagen.readthedocs.io

  160. nficano/python-lambda โญ 1,493
    A toolkit for developing and deploying serverless Python code in AWS Lambda.

  161. instagram/LibCST โญ 1,490
    A concrete syntax tree parser and serializer library for Python that preserves many aspects of Python's abstract syntax tree
    ๐Ÿ”— libcst.readthedocs.io

  162. lcompilers/lpython โญ 1,489
    Python compiler
    ๐Ÿ”— lpython.org

  163. fabiocaccamo/python-benedict โญ 1,474
    ๐Ÿ“˜ dict subclass with keylist/keypath support, built-in I/O operations (base64, csv, html, ini, json, pickle, plist, query-string, toml, xls, xml, yaml), s3 support and many utilities.

  164. aws-samples/aws-glue-samples โญ 1,414
    AWS Glue code samples

  165. pycqa/pyflakes โญ 1,355
    A simple program which checks Python source files for errors
    ๐Ÿ”— pypi.org/project/pyflakes

  166. lidatong/dataclasses-json โญ 1,349
    Easily serialize Data Classes to and from JSON

  167. ossf/criticality_score โญ 1,307
    Gives criticality score for an open source project

  168. brandon-rhodes/python-patterns โญ 1,300
    Source code behind the python-patterns.guide site by Brandon Rhodes

  169. aio-libs/yarl โญ 1,275
    Yet another URL library
    ๐Ÿ”— yarl.aio-libs.org

  170. anthropics/anthropic-sdk-python โญ 1,238
    SDK providing access to Anthropic's safety-first language model APIs

  171. oracle/graalpython โญ 1,187
    A Python 3 implementation built on GraalVM

  172. pdoc3/pdoc โญ 1,119
    ๐Ÿ โžก๏ธ ๐Ÿ“œ Auto-generate API documentation for Python projects
    ๐Ÿ”— pdoc3.github.io/pdoc

  173. pyo3/rust-numpy โญ 1,080
    PyO3-based Rust bindings of the NumPy C-API

  174. c4urself/bump2version โญ 1,052
    Version-bump your software with a single command
    ๐Ÿ”— pypi.python.org/pypi/bump2version

  175. metachris/logzero โญ 1,028
    Robust and effective logging for Python 2 and 3.
    ๐Ÿ”— logzero.readthedocs.io

  176. pyfpdf/fpdf2 โญ 1,025
    Simple PDF generation for Python
    ๐Ÿ”— py-pdf.github.io/fpdf2

  177. fsspec/filesystem_spec โญ 980
    A specification that python filesystems should adhere to.

  178. milvus-io/pymilvus โญ 959
    Python SDK for Milvus.

  179. fastai/fastcore โญ 930
    Python supercharged for the fastai library
    ๐Ÿ”— fastcore.fast.ai

  180. lastmile-ai/aiconfig โญ 915
    AIConfig saves prompts, models and model parameters as source control friendly configs. This allows you to iterate on prompts and model parameters separately from your application code.
    ๐Ÿ”— aiconfig.lastmileai.dev

  181. pypy/pypy โญ 881
    PyPy is a very fast and compliant implementation of the Python language.
    ๐Ÿ”— pypy.org

  182. alex-sherman/unsync โญ 876
    Unsynchronize asyncio

  183. barracuda-fsh/pyobd โญ 794
    An OBD-II compliant car diagnostic tool

  184. samuelcolvin/dirty-equals โญ 788
    Doing dirty (but extremely useful) things with equals.
    ๐Ÿ”— dirty-equals.helpmanual.io

  185. ariebovenberg/whenever โญ 774
    โฐ Modern datetime library for Python, available in Rust or pure Python
    ๐Ÿ”— whenever.rtfd.io

  186. pypa/build โญ 710
    A simple, correct Python build frontend
    ๐Ÿ”— build.pypa.io

  187. qdrant/qdrant-client โญ 706
    Python client for Qdrant vector search engine
    ๐Ÿ”— qdrant.tech

  188. open-telemetry/opentelemetry-python-contrib โญ 677
    OpenTelemetry instrumentation for Python modules
    ๐Ÿ”— opentelemetry.io

  189. modal-labs/modal-examples โญ 668
    Examples of programs built using Modal
    ๐Ÿ”— modal.com/docs

  190. instagram/Fixit โญ 663
    Advanced Python linting framework with auto-fixes and hierarchical configuration that makes it easy to write custom in-repo lint rules.
    ๐Ÿ”— fixit.rtfd.io/en/latest

  191. gefyrahq/gefyra โญ 662
    Blazingly-fast ๐Ÿš€, rock-solid, local application development โžก๏ธ with Kubernetes.
    ๐Ÿ”— gefyra.dev

  192. methexis-inc/terminal-copilot โญ 569
    A smart terminal assistant that helps you find the right command.

  193. platformdirs/platformdirs โญ 549
    A small Python module for determining appropriate platform-specific dirs, e.g. a "user data dir".
    ๐Ÿ”— platformdirs.readthedocs.io

  194. argoproj-labs/hera โญ 538
    Hera is an Argo Python SDK. Hera aims to make construction and submission of various Argo Project resources easy and accessible to everyone! Hera abstracts away low-level setup details while still maintaining a consistent vocabulary with Argo. โญ๏ธ Remember to star!
    ๐Ÿ”— hera.rtfd.io

  195. fastai/ghapi โญ 529
    A delightful and complete interface to GitHub's amazing API
    ๐Ÿ”— ghapi.fast.ai

  196. steamship-core/steamship-langchain โญ 510
    steamship-langchain

  197. google/pyglove โญ 323
    Manipulating Python Programs

Vizualisation

Vizualisation tools and libraries. Application frameworks, 2D/3D plotting, dashboards, WebGL.

  1. apache/superset โญ 61,072
    Apache Superset is a Data Visualization and Data Exploration Platform
    ๐Ÿ”— superset.apache.org

  2. streamlit/streamlit โญ 33,921
    Streamlit โ€” A faster way to build and share data apps.
    ๐Ÿ”— streamlit.io

  3. gradio-app/gradio โญ 31,492
    Build and share delightful machine learning apps, all in Python. ๐ŸŒŸ Star to support our work!
    ๐Ÿ”— www.gradio.app

  4. plotly/dash โญ 21,031
    Data Apps & Dashboards for Python. No JavaScript Required.
    ๐Ÿ”— plotly.com/dash

  5. matplotlib/matplotlib โญ 19,794
    matplotlib: plotting with Python
    ๐Ÿ”— matplotlib.org/stable

  6. bokeh/bokeh โญ 19,138
    Interactive Data Visualization in the browser, from Python
    ๐Ÿ”— bokeh.org

  7. plotly/plotly.py โญ 15,850
    The interactive graphing library for Python โœจ This project now includes Plotly Express!
    ๐Ÿ”— plotly.com/python

  8. mwaskom/seaborn โญ 12,288
    Statistical data visualization in Python
    ๐Ÿ”— seaborn.pydata.org

  9. visgl/deck.gl โญ 11,984
    WebGL2 powered visualization framework
    ๐Ÿ”— deck.gl

  10. marceloprates/prettymaps โญ 11,068
    A small set of Python functions to draw pretty maps from OpenStreetMap data. Based on osmnx, matplotlib and shapely libraries.

  11. altair-viz/altair โญ 9,132
    Declarative statistical visualization library for Python
    ๐Ÿ”— altair-viz.github.io

  12. nvidia/TensorRT-LLM โญ 7,872
    TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT...
    ๐Ÿ”— nvidia.github.io/tensorrt-llm

  13. lux-org/lux โญ 5,104
    Automatically visualize your pandas dataframe via a single print! ๐Ÿ“Š ๐Ÿ’ก

  14. renpy/renpy โญ 4,818
    The Ren'Py Visual Novel Engine
    ๐Ÿ”— www.renpy.org

  15. man-group/dtale โญ 4,654
    Visualizer for pandas data structures
    ๐Ÿ”— alphatechadmin.pythonanywhere.com

  16. holoviz/panel โญ 4,539
    Panel: The powerful data exploration & web app framework for Python
    ๐Ÿ”— panel.holoviz.org

  17. has2k1/plotnine โญ 3,931
    A Grammar of Graphics for Python
    ๐Ÿ”— plotnine.org

  18. residentmario/missingno โญ 3,875
    missingno provides a small toolset of flexible and easy-to-use missing data visualizations and utilities that allows you to get a quick visual summary of the completeness (or lack thereof) of your dataset.

  19. pyqtgraph/pyqtgraph โญ 3,814
    Fast data visualization and GUI tools for scientific / engineering applications
    ๐Ÿ”— www.pyqtgraph.org

  20. vispy/vispy โญ 3,276
    Main repository for Vispy
    ๐Ÿ”— vispy.org

  21. ml-tooling/opyrator โญ 3,054
    ๐Ÿช„ Turns your machine learning code into microservices with web API, interactive GUI, and more.
    ๐Ÿ”— opyrator-playground.mltooling.org

  22. netflix/flamescope โญ 2,995
    FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.

  23. facebookresearch/hiplot โญ 2,731
    HiPlot makes understanding high dimensional data easy
    ๐Ÿ”— facebookresearch.github.io/hiplot

  24. holoviz/holoviews โญ 2,676
    With Holoviews, your data visualizes itself.
    ๐Ÿ”— holoviews.org

  25. kozea/pygal โญ 2,629
    pygal is a dynamic SVG charting library written in python.
    ๐Ÿ”— www.pygal.org

  26. mckinsey/vizro โญ 2,586
    Vizro is a toolkit for creating modular data visualization applications.
    ๐Ÿ”— vizro.readthedocs.io/en/stable

  27. pyvista/pyvista โญ 2,533
    3D plotting and mesh analysis through a streamlined interface for the Visualization Toolkit (VTK)
    ๐Ÿ”— docs.pyvista.org

  28. marcomusy/vedo โญ 1,997
    A python module for scientific analysis of 3D data based on VTK and Numpy
    ๐Ÿ”— vedo.embl.es

  29. datapane/datapane โญ 1,363
    Build and share data reports in 100% Python
    ๐Ÿ”— datapane.com

  30. facultyai/dash-bootstrap-components โญ 1,094
    Bootstrap components for Plotly Dash
    ๐Ÿ”— dash-bootstrap-components.opensource.faculty.ai

  31. nomic-ai/deepscatter โญ 1,007
    Zoomable, animated scatterplots in the browser that scales over a billion points

  32. holoviz/holoviz โญ 827
    High-level tools to simplify visualization in Python.
    ๐Ÿ”— holoviz.org

  33. hazyresearch/meerkat โญ 820
    Creative interactive views of any dataset.

Web

Web related frameworks and libraries: webapp servers, WSGI, ASGI, asyncio, HTTP, REST, user management.

  1. django/django โญ 78,410
    The Web framework for perfectionists with deadlines.
    ๐Ÿ”— www.djangoproject.com

  2. tiangolo/fastapi โญ 74,488
    FastAPI framework, high performance, easy to learn, fast to code, ready for production
    ๐Ÿ”— fastapi.tiangolo.com

  3. pallets/flask โญ 67,280
    The Python micro framework for building web applications.
    ๐Ÿ”— flask.palletsprojects.com

  4. sherlock-project/sherlock โญ 53,273
    Hunt down social media accounts by username across social networks
    ๐Ÿ”— sherlockproject.xyz

  5. psf/requests โญ 51,854
    A simple, yet elegant, HTTP library.
    ๐Ÿ”— requests.readthedocs.io/en/latest

  6. tornadoweb/tornado โญ 21,641
    Tornado is a Python web framework and asynchronous networking library, originally developed at FriendFeed.
    ๐Ÿ”— www.tornadoweb.org

  7. reflex-dev/reflex โญ 18,547
    ๐Ÿ•ธ๏ธ Web apps in pure Python ๐Ÿ
    ๐Ÿ”— reflex.dev

  8. huge-success/sanic โญ 17,945
    Accelerate your web app development | Build fast. Run fast.
    ๐Ÿ”— sanic.dev

  9. wagtail/wagtail โญ 17,713
    A Django content management system focused on flexibility and user experience
    ๐Ÿ”— wagtail.org

  10. pyscript/pyscript โญ 17,581
    A framework that allows users to create rich Python applications in the browser using HTML's interface and the power of Pyodide, WASM, and modern web technologies.
    ๐Ÿ”— pyscript.net

  11. aio-libs/aiohttp โญ 14,854
    Asynchronous HTTP client/server framework for asyncio and Python
    ๐Ÿ”— docs.aiohttp.org

  12. vincigit00/Scrapegraph-ai โญ 13,769
    ScrapeGraphAI is a web scraping python library that uses LLM and direct graph logic to create scraping pipelines for websites and local documents
    ๐Ÿ”— scrapegraphai.com

  13. encode/httpx โญ 12,835
    A next generation HTTP client for Python. ๐Ÿฆ‹
    ๐Ÿ”— www.python-httpx.org

  14. getpelican/pelican โญ 12,450
    Static site generator that supports Markdown and reST syntax. Powered by Python.
    ๐Ÿ”— getpelican.com

  15. aws/chalice โญ 10,564
    Python Serverless Microframework for AWS

  16. flet-dev/flet โญ 10,534
    Flet enables developers to easily build realtime web, mobile and desktop apps in Python. No frontend experience required.
    ๐Ÿ”— flet.dev

  17. encode/starlette โญ 9,895
    The little ASGI framework that shines. ๐ŸŒŸ
    ๐Ÿ”— www.starlette.io

  18. benoitc/gunicorn โญ 9,673
    gunicorn 'Green Unicorn' is a WSGI HTTP Server for UNIX, fast clients and sleepy applications.
    ๐Ÿ”— www.gunicorn.org

  19. falconry/falcon โญ 9,469
    The no-magic web data plane API and microservices framework for Python developers, with a focus on reliability, correctness, and performance at scale.
    ๐Ÿ”— falcon.readthedocs.io/en/stable

  20. zauberzeug/nicegui โญ 8,509
    Create web-based user interfaces with Python. The nice way.
    ๐Ÿ”— nicegui.io

  21. bottlepy/bottle โญ 8,356
    bottle.py is a fast and simple micro-framework for python web-applications.
    ๐Ÿ”— bottlepy.org

  22. encode/uvicorn โญ 8,231
    An ASGI web server, for Python. ๐Ÿฆ„
    ๐Ÿ”— www.uvicorn.org

  23. graphql-python/graphene โญ 8,038
    GraphQL framework for Python
    ๐Ÿ”— graphene-python.org

  24. reactive-python/reactpy โญ 7,791
    ReactPy is a library for building user interfaces in Python without Javascript
    ๐Ÿ”— reactpy.dev

  25. vitalik/django-ninja โญ 6,781
    ๐Ÿ’จ Fast, Async-ready, Openapi, type hints based framework for building APIs
    ๐Ÿ”— django-ninja.dev

  26. pyeve/eve โญ 6,678
    REST API framework designed for human beings
    ๐Ÿ”— python-eve.org

  27. pallets/werkzeug โญ 6,609
    The comprehensive WSGI web application library.
    ๐Ÿ”— werkzeug.palletsprojects.com

  28. webpy/webpy โญ 5,884
    web.py is a web framework for python that is as simple as it is powerful.
    ๐Ÿ”— webpy.org

  29. starlite-api/litestar โญ 5,247
    Production-ready, Light, Flexible and Extensible ASGI API framework | Effortlessly Build Performant APIs
    ๐Ÿ”— litestar.dev

  30. stephenmcd/mezzanine โญ 4,749
    CMS framework for Django
    ๐Ÿ”— mezzanine.jupo.org

  31. nameko/nameko โญ 4,688
    A microservices framework for Python that lets service developers concentrate on application logic and encourages testability.
    ๐Ÿ”— www.nameko.io

  32. pywebio/PyWebIO โญ 4,459
    Write interactive web app in script way.
    ๐Ÿ”— pywebio.readthedocs.io

  33. fastapi-users/fastapi-users โญ 4,418
    Ready-to-use and customizable users management for FastAPI
    ๐Ÿ”— fastapi-users.github.io/fastapi-users

  34. pylons/pyramid โญ 3,929
    Pyramid - A Python web framework
    ๐Ÿ”— trypyramid.com

  35. h2oai/wave โญ 3,913
    H2O Wave is a software stack for building beautiful, low-latency, realtime, browser-based applications and dashboards entirely in Python/R without using HTML, Javascript, or CSS.
    ๐Ÿ”— wave.h2o.ai

  36. strawberry-graphql/strawberry โญ 3,882
    A GraphQL library for Python that leverages type annotations ๐Ÿ“
    ๐Ÿ”— strawberry.rocks

  37. websocket-client/websocket-client โญ 3,540
    WebSocket client for Python
    ๐Ÿ”— github.com/websocket-client/websocket-client

  38. unbit/uwsgi โญ 3,441
    uWSGI application server container
    ๐Ÿ”— projects.unbit.it/uwsgi

  39. pallets/quart โญ 2,834
    An async Python micro framework for building web applications.
    ๐Ÿ”— quart.palletsprojects.com

  40. fastapi-admin/fastapi-admin โญ 2,758
    A fast admin dashboard based on FastAPI and TortoiseORM with tabler ui, inspired by Django admin
    ๐Ÿ”— fastapi-admin-docs.long2ice.io

  41. flipkart-incubator/Astra โญ 2,475
    Automated Security Testing For REST API's

  42. masoniteframework/masonite โญ 2,174
    The Modern And Developer Centric Python Web Framework. Be sure to read the documentation and join the Discord channel for questions: https://discord.gg/TwKeFahmPZ
    ๐Ÿ”— docs.masoniteproject.com

  43. dot-agent/nextpy โญ 2,171
    ๐Ÿค–Self-Modifying Framework from the Future ๐Ÿ”ฎ World's First AMS
    ๐Ÿ”— dotagent.ai

  44. python-restx/flask-restx โญ 2,123
    Fork of Flask-RESTPlus: Fully featured framework for fast, easy and documented API development with Flask
    ๐Ÿ”— flask-restx.readthedocs.io/en/latest

  45. s3rius/FastAPI-template โญ 1,859
    Feature rich robust FastAPI template.

  46. dmontagu/fastapi-utils โญ 1,852
    Reusable utilities for FastAPI: a number of utilities to help reduce boilerplate and reuse common functionality across projects

  47. neoteroi/BlackSheep โญ 1,822
    Fast ASGI web framework for Python
    ๐Ÿ”— www.neoteroi.dev/blacksheep

  48. cherrypy/cherrypy โญ 1,818
    CherryPy is a pythonic, object-oriented HTTP framework. https://cherrypy.dev
    ๐Ÿ”— docs.cherrypy.dev

  49. indico/indico โญ 1,709
    Indico - A feature-rich event management system, made @ CERN, the place where the Web was born.
    ๐Ÿ”— getindico.io

  50. jordaneremieff/mangum โญ 1,662
    AWS Lambda support for ASGI applications
    ๐Ÿ”— mangum.io

  51. wtforms/wtforms โญ 1,497
    A flexible forms validation and rendering library for Python.
    ๐Ÿ”— wtforms.readthedocs.io

  52. awtkns/fastapi-crudrouter โญ 1,352
    A dynamic FastAPI router that automatically creates CRUD routes for your models
    ๐Ÿ”— fastapi-crudrouter.awtkns.com

  53. long2ice/fastapi-cache โญ 1,230
    fastapi-cache is a tool to cache fastapi response and function result, with backends support redis and memcached.
    ๐Ÿ”— github.com/long2ice/fastapi-cache

  54. magicstack/httptools โญ 1,187
    Fast HTTP parser

  55. rstudio/py-shiny โญ 1,169
    Shiny for Python
    ๐Ÿ”— shiny.posit.co/py

  56. whitphx/stlite โญ 1,114
    A port of Streamlit to WebAssembly, powered by Pyodide.
    ๐Ÿ”— edit.share.stlite.net

  57. koxudaxi/fastapi-code-generator โญ 987
    This code generator creates FastAPI app from an openapi file.

  58. aeternalis-ingenium/FastAPI-Backend-Template โญ 600
    A backend project template with FastAPI, PostgreSQL with asynchronous SQLAlchemy 2.0, Alembic for asynchronous database migration, and Docker.


Interactive version: www.awesomepython.org, Hugging Face Dataset: awesome-python

Please raise a new issue to suggest a Python repo that you would like to see added.

1,534 hand-picked awesome Python libraries and frameworks, updated 12 Aug 2024

Hits