Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Python scraper based on AI

Llama中ちゅう文ぶん社しゃ区く，Llama3在ざい线体验和微ほろ调模型がた已やめ开放，实时汇总最新さいしんLlama3学がく习资料りょう，已やめ将はた所有しょゆう代だい码更新しん适配Llama3，构建最さい好こう的中てきちゅう文ぶんLlama大だい模型もけい，完全かんぜん开源可か商用しょうよう

Your AI second brain, open and self-hostable. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3).

《开源大だい模型もけい食用しょくよう指南しなん》基もと于Linux环境快速かいそく部署ぶしょ开源大だい模型もけい，更さら适合中国ちゅうごく宝たから宝たから的てき部署ぶしょ教程きょうてい

Firefly: 大だい模型もけい训练工具こうぐ，支持しじ训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等とう大だい模型もけい

SGLang is a fast serving framework for large language models and vision language models.

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

Start building LLM-empowered multi-agent applications in an easier way.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Llama3、Llama3.1 中ちゅう文ぶん仓库（随ずい书籍撰せん写うつし中ちゅう... 各かく种网友とも及厂商しょう微ほろ调、魔ま改版かいはん本有ほんゆう趣おもむき权重 & 训练、推理すいり、评测、部署ぶしょ教程きょうてい视频 & 文ぶん档）

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

Use PEFT or Full-parameter to finetune 350+ LLMs or 90+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vision, Llava, InternVL2, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, Yi-VL, DeepSeek-VL, Phi3.5-Vision, ...)

Devon: An open-source pair programmer