A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

中ちゅう文ぶんLLaMA&Alpaca大だい语言模型もけい+本地ほんじCPU/GPU训练部署ぶしょ (Chinese LLaMA & Alpaca LLMs)

Faster Whisper transcription with CTranslate2

[🔥updating ...] AI 自じ动量化か交易こうえき机つくえ器き人じん(完全かんぜん本地ほんじ部署ぶしょ) AI-powered Quantitative Investment Research Platform. 📃 online docs: https://ufund-me.github.io/Qbot ✨ :news: qbot-mini: https://github.com/Charmve/iQuant

Lossy PNG compressor — pngquant command based on libimagequant library

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Fast inference engine for Transformer models

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Sparsity-aware deep learning inference runtime for CPUs

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

Run Mixtral-8x7B models in Colab or consumer desktops

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、reg…

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

PaddleSlim is an open-source library for deep model compression and architecture search.