PaddlePaddle/FastDeploy PaddlePaddle/FastDeploy

  • Stars
    star
    2,637
  • Rank 16,601 (Top 0.4 %)
  • Language
    C++
  • License
    Apache License 2.0
  • Created almost 2 years ago
  • Updated about 2 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
PaddlePaddle/FastDeploy
github

PaddlePaddle

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

English | 简体中文 | हिन्दी | 日本語 | 한국인 | Pу́сский язы́к

⚡️FastDeploy

Installation | Documents | Quick Start | API Docs | Release Notes


⚡️FastDeploy is an Easy-to-use and High Performance AI model deployment toolkit for Cloud, Mobile and Edge with 📦out-of-the-box and unified experience, 🔚end-to-end optimization for over 🔥160+ Text, Vision, Speech and Cross-modal AI models. Including image classification, object detection, OCR, face detection, matting, pp-tracking, NLP, stable diffusion, TTS and other tasks to meet developers' industrial deployment needs for multi-scenario, multi-hardware and multi-platform.

🌠 Recent updates

  • ✨✨✨ In 2023.01.17 we released YOLOv8 for deployment on FastDeploy series hardware, which includes Paddle YOLOv8 and ultralytics YOLOv8

  • Serving deployment combined with VisualDL supports visual deployment. After the VDL service is started in the FastDeploy container, you can modify the model configuration, start/manage the model service, view performance data, and send requests on the VDL interface. For details, see related documents

  • ✨👥✨ Community

    • Slack：Join our Slack community and chat with other community members about ideas
    • Wechat：Scan the QR code below using WeChat, follow the PaddlePaddle official account and fill out the questionnaire to join the WeChat group, and share the deployment industry implementation pain points with the community developers

🌌 Inference Backend and Abilities
X86_64 CPU       





NVDIA GPU




Phytium CPU
KunlunXin XPU
Huawei Ascend NPU
Graphcore IPU
Sophgo
Intel graphics card
Jetson




ARM CPU

RK3588 etc.
RV1126 etc.
Amlogic
NXP

🔮 Contents

Quick Start💨

A Quick Start for Python SDK(click to fold)

🎆 Installation

🔸 Prerequisites
  • CUDA >= 11.2 、cuDNN >= 8.0 、 Python >= 3.6
  • OS: Linux x86_64/macOS/Windows 10
🔸 Install FastDeploy SDK with both CPU and GPU support
pip install fastdeploy-gpu-python -f https://www.paddlepaddle.org.cn/whl/fastdeploy.html
🔸 Conda Installation (Recommended✨)
conda config --add channels conda-forge && conda install cudatoolkit=11.2 cudnn=8.2
🔸 Install FastDeploy SDK with only CPU support
pip install fastdeploy-python -f https://www.paddlepaddle.org.cn/whl/fastdeploy.html

🎇 Python Inference Example

  • Prepare model and picture
wget https://bj.bcebos.com/paddlehub/fastdeploy/ppyoloe_crn_l_300e_coco.tgz
tar xvf ppyoloe_crn_l_300e_coco.tgz
wget https://gitee.com/paddlepaddle/PaddleDetection/raw/release/2.4/demo/000000014439.jpg
  • Test inference results
# For deployment of GPU/TensorRT, please refer to examples/vision/detection/paddledetection/python
import cv2
import fastdeploy.vision as vision

im = cv2.imread("000000014439.jpg")
model = vision.detection.PPYOLOE("ppyoloe_crn_l_300e_coco/model.pdmodel",
                                 "ppyoloe_crn_l_300e_coco/model.pdiparams",
                                 "ppyoloe_crn_l_300e_coco/infer_cfg.yml")

result = model.predict(im)
print(result)

vis_im = vision.vis_detection(im, result, score_threshold=0.5)
cv2.imwrite("vis_image.jpg", vis_im)
A Quick Start for C++ SDK(click to expand)

🎆 Installation

🎇 C++ Inference Example

  • Prepare models and pictures
wget https://bj.bcebos.com/paddlehub/fastdeploy/ppyoloe_crn_l_300e_coco.tgz
tar xvf ppyoloe_crn_l_300e_coco.tgz
wget https://gitee.com/paddlepaddle/PaddleDetection/raw/release/2.4/demo/000000014439.jpg
  • Test inference results
// For GPU/TensorRT deployment, please refer to examples/vision/detection/paddledetection/cpp
#include "fastdeploy/vision.h"

int main(int argc, char* argv[]) {
  namespace vision = fastdeploy::vision;
  auto im = cv::imread("000000014439.jpg");
  auto model = vision::detection::PPYOLOE("ppyoloe_crn_l_300e_coco/model.pdmodel",
                                          "ppyoloe_crn_l_300e_coco/model.pdiparams",
                                          "ppyoloe_crn_l_300e_coco/infer_cfg.yml");

  vision::DetectionResult res;
  model.Predict(&im, &res);

  auto vis_im = vision::VisDetection(im, res, 0.5);
  cv::imwrite("vis_image.jpg", vis_im);
  return 0;
 }

For more deployment models, please refer to Vision Model Deployment Examples .

✴️ ✴️ Server-side and Cloud Model List ✴️ ✴️

Notes: ✅: already supported; ❔: to be supported in the future; N/A: Not Available;

Server-side and cloud model list(click to fold)
Task Model Linux Linux Win Win Mac Mac Linux Linux Linux Linux Linux Linux Linux
--- --- X86 CPU NVIDIA GPU X86 CPU NVIDIA GPU X86 CPU Arm CPU AArch64 CPU Phytium D2000 aarch64 NVIDIA Jetson Graphcore IPU kunlunxin XPU Huawei Ascend Serving
Classification PaddleClas/ResNet50 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Classification TorchVison/ResNet ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ❔
Classification ltralytics/YOLOv5Cls ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔
Classification PaddleClas/PP-LCNet ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Classification PaddleClas/PP-LCNetv2 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Classification PaddleClas/EfficientNet ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Classification PaddleClas/GhostNet ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Classification PaddleClas/MobileNetV1 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Classification PaddleClas/MobileNetV2 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Classification PaddleClas/MobileNetV3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Classification PaddleClas/ShuffleNetV2 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Classification PaddleClas/SqueeezeNetV1.1 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Classification PaddleClas/Inceptionv3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅
Classification PaddleClas/PP-HGNet ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Detection 🔥🔥PaddleDetection/PP-YOLOE+ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅
Detection 🔥PaddleDetection/YOLOv8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ❔
Detection 🔥ultralytics/YOLOv8 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ❔ ❔
Detection PaddleDetection/PicoDet ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ✅
Detection PaddleDetection/YOLOX ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅
Detection PaddleDetection/YOLOv3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅
Detection PaddleDetection/PP-YOLO ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅
Detection PaddleDetection/PP-YOLOv2 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅
Detection PaddleDetection/Faster-RCNN ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ✅
Detection PaddleDetection/Mask-RCNN ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ✅
Detection Megvii-BaseDetection/YOLOX ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ❔
Detection WongKinYiu/YOLOv7 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ❔
Detection WongKinYiu/YOLOv7end2end_trt ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ❔ ❔
Detection WongKinYiu/YOLOv7end2end_ort ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
Detection meituan/YOLOv6 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔
Detection ultralytics/YOLOv5 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅
Detection WongKinYiu/YOLOR ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ✅ ❔
Detection WongKinYiu/ScaledYOLOv4 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
Detection ppogg/YOLOv5Lite ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ? ❔ ❔ ❔
Detection RangiLyu/NanoDetPlus ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
Perception Paddle3D/Smoke ❔ ✅ ❔ ✅ ❔ ❔ ❔ ❔ ❔ ❔ ❔ ❔ ✅
KeyPoint PaddleDetection/TinyPose ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔
KeyPoint PaddleDetection/PicoDet + TinyPose ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔
HeadPose omasaht/headpose ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ❔ ❔
Tracking PaddleDetection/PP-Tracking ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
OCR PaddleOCR/PP-OCRv2 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ✅ ✅ ❔
OCR PaddleOCR/PP-OCRv3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅
Segmentation PaddleSeg/PP-LiteSeg ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ✅ ❔ ❔
Segmentation PaddleSeg/PP-HumanSegLite ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ✅ ✅ ❔
Segmentation PaddleSeg/HRNet ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ✅ ✅ ❔
Segmentation PaddleSeg/PP-HumanSegServer ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ✅ ✅ ❔
Segmentation PaddleSeg/Unet ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ✅ ✅ ❔
Segmentation PaddleSeg/Deeplabv3 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ✅ ✅ ❔
FaceDetection biubug6/RetinaFace ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
FaceDetection Linzaer/UltraFace ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
FaceDetection deepcam-cn/YOLOv5Face ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
FaceDetection insightface/SCRFD ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
FaceAlign Hsintao/PFLD ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
FaceAlign Single430/FaceLandmark1000 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ❔ ❔
FaceAlign jhb86253817/PIPNet ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ❔ ❔
FaceRecognition insightface/ArcFace ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
FaceRecognition insightface/CosFace ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
FaceRecognition insightface/PartialFC ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
FaceRecognition insightface/VPL ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
Matting ZHKKKe/MODNet ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ❔ ❔
Matting PeterL1n/RobustVideoMatting ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ❔ ❔
Matting PaddleSeg/PP-Matting ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ❔
Matting PaddleSeg/PP-HumanMatting ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ✅ ❔
Matting PaddleSeg/ModNet ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ❔
Video Super-Resolution PaddleGAN/BasicVSR ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ❔ ❔
Video Super-Resolution PaddleGAN/EDVR ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ❔ ❔
Video Super-Resolution PaddleGAN/PP-MSVSR ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ❔ ❔
Information Extraction PaddleNLP/UIE ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ✅ ❔ ❔ ❔
NLP PaddleNLP/ERNIE-3.0 ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ ❔ ✅ ❔ ✅
Speech PaddleSpeech/PP-TTS ✅ ✅ ✅ ✅ ✅ ✅ ✅ ❔ ❔ -- ❔ ❔ ✅

📳 Mobile and Edge Device Deployment

Mobile and Edge Model List（click to fold）
Task Model Size(MB) Linux Android Linux Linux Linux Linux Linux TBD ...
--- --- --- ARM CPU ARM CPU Rockchip NPU
RK3588/RK3568/RK3566		 Rockchip NPU
RV1109/RV1126/RK1808		 Amlogic NPU
A311D/S905D/C308X		 NXP NPU
i.MX 8M Plus		 TBD...
Classification PaddleClas/ResNet50 98 ✅ ✅ ✅ ✅
Classification PaddleClas/PP-LCNet 11.9 ✅ ✅ ❔ ✅ -- -- --
Classification PaddleClas/PP-LCNetv2 26.6 ✅ ✅ ❔ ✅ -- -- --
Classification PaddleClas/EfficientNet 31.4 ✅ ✅ ❔ ✅ -- -- --
Classification PaddleClas/GhostNet 20.8 ✅ ✅ ❔ ✅ -- -- --
Classification PaddleClas/MobileNetV1 17 ✅ ✅ ❔ ✅ -- -- --
Classification PaddleClas/MobileNetV2 14.2 ✅ ✅ ❔ ✅ -- -- --
Classification PaddleClas/MobileNetV3 22 ✅ ✅ ❔ ✅ ❔ ❔ --
Classification PaddleClas/ShuffleNetV2 9.2 ✅ ✅ ❔ ✅ -- -- --
Classification PaddleClas/SqueezeNetV1.1 5 ✅ ✅ ❔ ✅ -- -- --
Classification PaddleClas/Inceptionv3 95.5 ✅ ✅ ❔ ✅ -- -- --
Classification PaddleClas/PP-HGNet 59 ✅ ✅ ❔ ✅ -- -- --
Detection PaddleDetection/PicoDet_s 4.9 ✅ ✅ ✅ ✅ ✅ ✅ --
Detection YOLOv5 ❔ ❔ ✅ ❔ ❔ ❔ --
Face Detection deepinsight/SCRFD 2.5 ✅ ✅ ✅ -- -- -- --
Keypoint Detection PaddleDetection/PP-TinyPose 5.5 ✅ ✅ ❔ ❔ ❔ ❔ --
Segmentation PaddleSeg/PP-LiteSeg(STDC1) 32.2 ✅ ✅ ✅ -- -- -- --
Segmentation PaddleSeg/PP-HumanSeg-Lite 0.556 ✅ ✅ ✅ -- -- -- --
Segmentation PaddleSeg/HRNet-w18 38.7 ✅ ✅ ✅ -- -- -- --
Segmentation PaddleSeg/PP-HumanSeg 107.2 ✅ ✅ ✅ -- -- -- --
Segmentation PaddleSeg/Unet 53.7 ✅ ✅ ✅ -- -- -- --
Segmentation PaddleSeg/Deeplabv3 150 ❔ ✅ ✅
OCR PaddleOCR/PP-OCRv2 2.3+4.4 ✅ ✅ ❔ -- -- -- --
OCR PaddleOCR/PP-OCRv3 2.4+10.6 ✅ ❔ ❔ ❔ ❔ ❔ --

⚛️ Web and Mini Program Model List

Web and mini program model list(click to fold)
Task Model web_demo
--- --- Paddle.js
Detection FaceDetection ✅
Detection ScrewDetection ✅
Segmentation PaddleSeg/HumanSeg ✅
Object Recognition GestureRecognition ✅
Object Recognition ItemIdentification ✅
OCR PaddleOCR/PP-OCRv3 ✅

💐 Acknowledge

We sincerely appreciate the open-sourced capabilities in EasyEdge as we adopt it for the SDK generation and download in this project.

©️ License

FastDeploy is provided under the Apache-2.0.

More Repositories

1

PaddleOCR

Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and deployment among server, mobile, embedded and IoT devices)
Python
38,185
star
2

Paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
C++
21,580
star
3

PaddleHub

Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)
Python
12,439
star
4

PaddleDetection

Object Detection toolkit based on PaddlePaddle. It supports object detection, instance segmentation, multiple object tracking and real-time multi-person keypoint detection.
Python
12,003
star
5

PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
Python
11,233
star
6

PaddleSpeech

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.
Python
10,060
star
7

PaddleSeg

Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.
Python
8,188
star
8

PaddleGAN

PaddlePaddle GAN library, including lots of interesting applications like First-Order motion transfer, Wav2Lip, picture repair, image editing, photo2cartoon, image style transfer, GPEN, and so on.
Python
7,661
star
9

models

Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.
Python
6,865
star
10

Paddle-Lite

PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）
C++
6,831
star
11

ERNIE

Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.
Python
6,162
star
12

PaddleClas

A treasure chest for visual classification and recognition powered by PaddlePaddle
Python
5,244
star
13

VisualDL

Deep Learning Visualization Toolkit（『飞桨』深度学习可视化工具 ）
HTML
4,716
star
14

PaddleX

PaddlePaddle End-to-End Development Toolkit（『飞桨』深度学习全流程开发工具）
Python
4,562
star
15

PaddleRec

Recommendation Algorithm大规模推荐算法库，包含推荐系统经典及最新算法LR、Wide&Deep、DSSM、TDM、MIND、Word2Vec、Bert4Rec、DeepWalk、SSR、AITM，DSIN，SIGN，IPREC、GRU4Rec、Youtube_dnn、NCF、GNN、FM、FFM、DeepFM、DCN、DIN、DIEN、DLRM、MMOE、PLE、ESMM、ESCMM, MAML、xDeepFM、DeepFEFM、NFM、AFM、RALM、DMR、GateNet、NAML、DIFM、Deep Crossing、PNN、BST、AutoInt、FGCNN、FLEN、Fibinet、ListWise、DeepRec、ENSFM，TiSAS，AutoFIS等，包含经典推荐系统数据集criteo 、movielens等
Python
4,077
star
16

PARL

A high-performance distributed training framework for Reinforcement Learning
Python
3,182
star
17

awesome-DeepLearning

深度学习入门课、资深课、特色课、学术案例、产业实践案例、深度学习知识百科及面试题库The course, case and knowledge of Deep Learning and AI
Jupyter Notebook
2,752
star
18

book

Deep Learning 101 with PaddlePaddle （『飞桨』深度学习框架入门教程）
Jupyter Notebook
2,728
star
19

Research

novel deep learning research works with PaddlePaddle
Python
1,693
star
20

PGL

Paddle Graph Learning (PGL) is an efficient and flexible graph learning framework based on PaddlePaddle
Python
1,558
star
21

PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.
Python
1,507
star
22

PaddleVideo

Awesome video understanding toolkits based on PaddlePaddle. It supports video data annotation tools, lightweight RGB and skeleton based action recognition model, practical applications for video tagging and sport action detection.
Python
1,392
star
23

Paddle.js

Paddle.js is a web project for Baidu PaddlePaddle, which is an open source deep learning framework running in the browser. Paddle.js can either load a pre-trained model, or transforming a model from paddle-hub with model transforming tools provided by Paddle.js. It could run in every browser with WebGL/WebGPU/WebAssembly supported. It could also run in Baidu Smartprogram and WX miniprogram.
JavaScript
928
star
24

Serving

A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
C++
869
star
25

PaddleHelix

Bio-Computing Platform Featuring Large-Scale Representation Learning and Multi-Task Deep Learning “螺旋桨”生物计算工具集
Python
784
star
26

RocketQA

🚀 RocketQA, dense retrieval for information retrieval and question answering, including both Chinese and English state-of-the-art models.
Python
736
star
27

X2Paddle

Deep learning model converter for PaddlePaddle. (『飞桨』深度学习模型转换工具)
Python
713
star
28

Knover

Large-scale open domain KNOwledge grounded conVERsation system based on PaddlePaddle
Python
670
star
29

Paddle2ONNX

ONNX Model Exporter for PaddlePaddle
Python
637
star
30

Paddle-Lite-Demo

lib, demo, model, data
C++
634
star
31

Parakeet

PAddle PARAllel text-to-speech toolKIT (supporting Tacotron2, Transformer TTS, FastSpeech2/FastPitch, SpeedySpeech, WaveFlow and Parallel WaveGAN)
Python
599
star
32

FlyCV

FlyCV is a high-performance library for processing computer visual tasks.
C++
560
star
33

Anakin

High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.
C++
530
star
34

Paddle3D

A 3D computer vision development toolkit based on PaddlePaddle. It supports point-cloud object detection, segmentation, and monocular 3D object detection models.
Python
529
star
35

Quantum

Jupyter Notebook
528
star
36

PaddleYOLO

🚀🚀🚀 YOLO series of PaddlePaddle implementation, PP-YOLOE+, RT-DETR, YOLOv5, YOLOv6, YOLOv7, YOLOv8, YOLOX, YOLOv5u, YOLOv7u, YOLOv6Lite, RTMDet and so on. 🚀🚀🚀
Python
500
star
37

PaddleFL

Federated Deep Learning in PaddlePaddle
Python
480
star
38

VIMER

视觉预训练基础模型仓库
Python
479
star
39

PaddleTS

Awesome Easy-to-Use Deep Time Series Modeling based on PaddlePaddle, including comprehensive functionality modules like TSDataset, Analysis, Transform, Models, AutoTS, and Ensemble, etc., supporting versatile tasks like time series forecasting, representation learning, and anomaly detection, etc., featured with quick tracking of SOTA deep models.
Python
444
star
40

PaddleFleetX

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。
Python
417
star
41

PaddleRS

Awesome Remote Sensing Toolkit based on PaddlePaddle.
Python
330
star
42

PaddleSpatial

PaddleSpatial is an open-source spatial-temporal computing tool based on PaddlePaddle.
GLSL
315
star
43

PaddleCloud

PaddlePaddle Docker images and K8s operators for PaddleOCR/Detection developers to use on public/private cloud.
Go
278
star
44

ERNIE-SDK

ERNIE Bot Agent is a Large Language Model (LLM) Agent Framework, powered by the advanced capabilities of ERNIE Bot and the platform resources of Baidu AI Studio.
Jupyter Notebook
274
star
45

MetaGym

Collection of Reinforcement Learning / Meta Reinforcement Learning Environments.
Python
267
star
46

PASSL

PASSL包含 SimCLR，MoCo v1/v2，BYOL，CLIP，PixPro，simsiam, SwAV, BEiT，MAE 等图像自监督算法以及 Vision Transformer，DEiT，Swin Transformer，CvT，T2T-ViT，MLP-Mixer，XCiT，ConvNeXt，PVTv2 等基础视觉算法
Python
257
star
47

docs

Documentations for PaddlePaddle
Python
228
star
48

PaddleScience

PaddleScience is SDK and library for developing AI-driven scientific computing applications based on PaddlePaddle.
Python
226
star
49

InterpretDL

InterpretDL: Interpretation of Deep Learning Models，基于『飞桨』的模型可解释性算法库。
Python
226
star
50

Paddle-Inference-Demo

C++
223
star
51

PaddleRobotics

PaddleRobotics is an open-source algorithm library for robots based on Paddle, including open-source parts such as human-robot interaction, complex motion control, environment perception, SLAM positioning, and navigation.
Python
210
star
52

PaddleMIX

Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.
Python
207
star
53

TrustAI

飞桨可信AI
Python
179
star
54

ElasticCTR

ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部署，具备高性能、工业级部署、端到端体验的特点，并且作为开源套件，满足二次深度开发的需求。
Python
176
star
55

PALM

a Fast, Flexible, Extensible and Easy-to-use NLP Large-scale Pretraining and Multi-task Learning Framework.
Python
174
star
56

AutoDL

Python
158
star
57

PLSC

Paddle Large Scale Classification Tools，supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT, Swin, DeiT, CaiT, FaceViT, MoCo, MAE, ConvMAE, CAE.
Python
142
star
58

CINN

Compiler Infrastructure for Neural Networks
C++
139
star
59

LiteKit

Off-The-Shelf AI Development Kit for APP Developers based on Paddle Lite （『飞桨』移动端开箱即用AI套件, 包含Java & Objective C接口支持）
Objective-C
131
star
60

PaddleFlow

Go
103
star
61

PaddleDTX

Paddle with Decentralized Trust based on Xuperchain
Go
87
star
62

PaddleSports

Python
86
star
63

XWorld

A C++/Python simulator package for reinforcement learning
C++
84
star
64

hapi

hapi is a High-level API that supports both static and dynamic execution modes
Jupyter Notebook
76
star
65

benchmark

Python
74
star
66

PaddleSleeve

PaddleSleeve
Python
70
star
67

Mobile

Embedded and Mobile Deployment
Python
70
star
68

PaConvert

Code Convert to PaddlePaddle Toolkit
Python
66
star
69

community

PaddlePaddle Developer Community
Jupyter Notebook
63
star
70

PaddleDepth

Python
58
star
71

PaddleCustomDevice

PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
C++
49
star
72

PaddlePaddle.org

PaddlePaddle.org is the repository for the website of the PaddlePaddle open source project.
CSS
48
star
73

PaddleTest

PaddlePaddle TestSuite
Python
43
star
74

PaDiff

Paddle Automatically Diff Precision Toolkits.
Python
42
star
75

EasyData

Python
35
star
76

epep

Easy & Effective Application Framework for PaddlePaddle
Python
34
star
77

paddle-ce-latest-kpis

Paddle Continuous Evaluation, keep updating.
Python
26
star
78

VisionTools

Python
22
star
79

PaddleCraft

Take neural networks as APIs for human-like AI.
Python
20
star
80

Contrib

contribution works with PaddlePaddle from the third party developers
Python
20
star
81

PaddleTransfer

飞桨迁移学习算法库
Python
19
star
82

recordio

An implementation of the RecordIO file format.
Go
19
star
83

continuous_evaluation

Macro Continuous Evaluation Platform for Paddle.
Python
19
star
84

Perf

SOTA benchmark
Python
17
star
85

Paddle-bot

Python
17
star
86

examples

Python
17
star
87

continuous_integration

Python
16
star
88

tape

C++
14
star
89

PaddleSOT

A Bytecode level Implementation of Symbolic OpCode Translator For PaddlePaddle
Python
14
star
90

paddle_upgrade_tool

upgrade paddle-1.x to paddle-2.0
Python
12
star
91

talks

Shell
6
star
92

CLA

5
star
93

any

Legacy Repo only for PaddlePaddle with version <= 1.3
C++
5
star