Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama for WhatsApp & Messenger.

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

Low-code framework for building custom LLMs, neural networks, and other AI models

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.

This chatbot app is built using the Llama 2 open source LLM from Meta.

LLM Finetuning with peft

中ちゅう文ぶんLLaMA-2 & Alpaca-2大だい模型もけい二に期き项目 + 64K超ちょう长上下じょうげ文ぶん模型もけい (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

Firefly: 大だい模型もけい训练工具こうぐ，支持しじ训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等とう大だい模型もけい

SGLang is a fast serving framework for large language models and vision language models.

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

中ちゅう文ぶんnlp解かい决方案あん(大だい模型もけい、数かず据すえ、模型もけい、训练、推理すいり)

Data framework for your LLM applications. Focus on server side solution

LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.