ncnn is a high-performance neural network inference framework optimized for the mobile platform

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

超ちょう轻量级中文ぶんocr，支持しじ竖排文字もじ识别, 支持しじncnn、mnn、tnn推理すいり ( dbnet(1.8M) + crnn(2.5M) + anglenet(378KB)) 总模型がた仅4.7M

Open3D: A Modern Library for 3D Data Processing

Transformer related optimization, including BERT, GPT

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

Tengine is a lite, high performance, modular inference engine for embedded device

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and …

Simplify your onnx model

Lightning fast C++/CUDA neural network framework

A retargetable MLIR-based machine learning compiler and runtime toolkit.

C++ library based on tensorrt integration

Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

校こう招、秋あき招、春はる招、实习好こう项目！带你从零实现一个高性能的深度学习推理库，支持しじ大だい模型もけい llama2 、Unet、Yolov5、Resnet等とう模型もけい的てき推理すいり。Implement a high-performance deep learning inference library step by step

Enabling PyTorch on XLA Devices (e.g. Google TPU)

TengineKit - Free, Fast, Easy, Real-Time Face Detection & Face Landmarks & Face Attributes & Hand Detection & Hand Landmarks & Body Detection & Body Landmarks & Iris Landmarks & Yolov5 SDK On Mobile.

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

C++ Implementation of PyTorch Tutorials for Everyone

This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India.

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.