Top #large-language-models Tools & Software

langflow

github

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

LLMs-from-scratch

github

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

llm-course

github

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

gpt_academic

github

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

LlamaFactory

github

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

ray

github

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

langextract

github

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

LightRAG

github

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

storm

github

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

langfuse

github

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

Hands-On-Large-Language-Models

github

Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

haystack

github

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

agentscope

github

Build and run agents you can see, understand and trust.

Qwen

github

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

FinGPT

github

FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.