Top #llm Tools & Software

llm-cookbook

github

面向开发者的 LLM 入门教程，吴恩达大模型系列课程中文版

openai-agents-python

github

A lightweight, powerful framework for multi-agent workflows

ai

github

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

pandas-ai

github

Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

Scrapegraph-ai

github

Python scraper based on AI

mastra

github

From the team behind Gatsby, Mastra is a framework for building AI-powered applications and agents with a modern TypeScript stack.

vanna

github

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using Agentic Retrieval 🔄.

OpenViking

github

OpenViking is an open-source context database designed specifically for AI Agents(such as openclaw). OpenViking unifies the management of context (memory, resources, and skills) that Agents need through a file system paradigm, enabling hierarchical context delivery and self-evolving.

Awesome-Chinese-LLM

github

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

mlc-llm

github

Universal LLM Deployment Engine with ML Compilation

heretic

github

Fully automatic censorship removal for language models

letta

github

Letta is the platform for building stateful agents: AI with advanced memory that can learn and self-improve over time.

DeepSeek-TUI

github

Coding agent for DeepSeek models that runs in your terminal

GenAI_Agents

github

50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.

datasets

github

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

free-llm-api-resources

github

A list of free LLM inference resources accessible via API.

skyvern

github

Automate browser based workflows with AI

Qwen

github

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

peft

github

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

MaxKB

github

🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

promptfoo

github

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

architecture.of.internet-product

github

互联网公司技术架构，微信/淘宝/微博/腾讯/阿里/美团点评/百度/OpenAI/Google/Facebook/Amazon/eBay的架构，欢迎PR补充

CV

github

✔（已完结）超级全面的 深度学习 笔记【土堆 Pytorch】【李沐 动手学深度学习】【吴恩达 深度学习】【大飞 大模型Agent】

12-factor-agents

github

What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?