LPRNet | Plate Recognition | C++/Python | FP32/FP16/INT8 |
ResNet | Image Classification | C++/Python | FP32/FP16/INT8 |
RetinaFace | Face Detection | C++/Python | FP32/FP16/INT8 |
SCRFD | Face Detection | C++/Python | FP32/FP16/INT8 |
segformer | Semantic Segmentation | C++/Python | FP32/FP16 |
SAM | Semantic Segmentation | Python | FP32/FP16 |
yolact | Image segmentation | C++/Python | FP32/FP16/INT8 |
YOLOv8_seg | Image segmentation | C++/Python | FP32/FP16/INT8 |
YOLOv9_seg | Image segmentation | C++/Python | FP32/FP16/INT8 |
PP-OCR | OCR | C++/Python | FP32/FP16 |
OpenPose | Pose Estimation | C++/Python | FP32/FP16/INT8 |
YOLOv8_pose | Pose Estimation | C++/Python | FP32/FP16/INT8 |
C3D | Video Motion Recognition | C++/Python | FP32/FP16/INT8 |
DeepSORT | Multi-Target Tracking | C++/Python | FP32/FP16/INT8 |
ByteTrack | Multi-Target Tracking | C++/Python | FP32/FP16/INT8 |
CenterNet | Object Detection, Pose Estimation | C++/Python | FP32/FP16/INT8 |
YOLOv5 | Object Detection | C++/Python | FP32/FP16/INT8 |
YOLOv34 | Object Detection | C++/Python | FP32/INT8 |
YOLOX | Object Detection | C++/Python | FP32/INT8 |
SSD | Object Detection | C++/Python | FP32/INT8 |
YOLOv7 | Object Detection | C++/Python | FP32/FP16/INT8 |
YOLOv8_det | Object Detection | C++/Python | FP32/FP16/INT8 |
YOLOv5_opt | Object Detection | C++/Python | FP32/FP16/INT8 |
YOLOv5_fuse | Object Detection | C++/Python | FP32/FP16/INT8 |
YOLOv9_det | Object Detection | C++/Python | FP32/FP16/INT8 |
YOLOv10 | Object Detection | C++/Python | FP32/FP16/INT8 |
ppYOLOv3 | Object Detection | C++/Python | FP32/FP16/INT8 |
ppYoloe | Object Detection | C++/Python | FP32/FP16 |
WeNet | Speech Recognition | C++/Python | FP32/FP16 |
Whisper | Speech Recognition | Python | FP16 |
Seamless | Speech Recognition | Python | FP32/FP16 |
BERT | LLM | C++/Python | FP32/FP16 |
ChatGLM2 | LLM | C++/Python | FP16/INT8/INT4 |
Llama2 | LLM | C++/Python | FP16/INT8/INT4 |
ChatGLM3 | LLM | Python | FP16/INT8/INT4 |
Qwen | LLM | Python | FP16/INT8/INT4 |
MiniCPM | LLM | C++ | INT8/INT4 |
Baichuan2 | LLM | Python | INT8/INT4 |
ChatGLM4 | LLM | Python | INT8/INT4 |
StableDiffusionV1.5 | Image Generation | Python | FP32/FP16 |
StableDiffusionXL | Image Generation | Python | FP32/FP16 |
GroundingDINO | Multimodal Object Detection | Python | FP16 |
Qwen-VL-Chat | LVLM | Python | FP16/INT8 |
Real-ESRGAN | Super-Resolution | C++/Python | FP32/FP16/INT8 |
P2PNet | Crowd counting | C++/Python | FP32/FP16/INT8 |
CLIP | Connecting text and images | Python | FP16 |
SuperGlue | Feature Matching | C++ | FP32/FP16 |