Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama for WhatsApp & Messenger.

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

Low-code framework for building custom LLMs, neural networks, and other AI models

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

中ちゅう文ぶんLLaMA-2 & Alpaca-2大だい模型もけい二に期き项目 + 64K超ちょう长上下じょうげ文ぶん模型もけい (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

Firefly: 大だい模型もけい训练工具こうぐ，支持しじ训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等とう大だい模型もけい

SGLang is a fast serving framework for large language models and vision language models.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

A series of large language models developed by Baichuan Intelligent Technology

Llama3、Llama3.1 中ちゅう文ぶん仓库（随ずい书籍撰せん写うつし中ちゅう... 各かく种网友とも及厂商しょう微ほろ调、魔ま改版かいはん本有ほんゆう趣おもむき权重 & 训练、推理すいり、评测、部署ぶしょ教程きょうてい视频 & 文ぶん档）

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

雅まさ意い大だい模型もけい：为客户打造づくり安全あんぜん可か靠もたれ的てき专属大だい模型もけい，基き于大规模中ちゅう英文えいぶん多た领域指令しれい数すう据すえ训练的てき LlaMA 2 & BLOOM 系列けいれつ模型もけい，由ゆかり中ちゅう科か闻歌算法さんぽう团队研けん发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM)