• Stars
    star
    1,439
  • Rank 32,712 (Top 0.7 %)
  • Language
    C++
  • License
    GNU General Publi...
  • Created over 4 years ago
  • Updated over 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

🍅 Deploy ncnn on mobile phones. Support Android and iOS. 移动端ncnn部署,支持Android与iOS。

中文说明

🚀 If it helps you, click a star!

Ncnn deployment on mobile,support:YOLOv5s,YOLOv4-tiny,MobileNetV2-YOLOv3-nano,Simple-Pose,Yolact,ChineseOCR-lite,ENet,Landmark106,DBFace,MBNv2-FCN and MBNv3-Seg-small on camera.

iOS:

  • Xcode 12.4
  • macOS 11.2.3
  • iPhone 6sp 13.5.1

Android:

  • Android Studio 4.1
  • Win10 20H2
  • CPU:Qualcomm 710 GPU:Adreno 616

iOS

Select the model to be tested directly on the interface.

Android

Select the model to be tested directly on the interface.

Models

model android iOS from other
YOLOv5s yes yes Github TNN
YOLOv4-tiny yes yes Github
YOLOv3-nano yes yes Github
YOLOv5s_custom_op yes yes zhihu
NanoDet yes yes Github TNN MNN
YOLO-Fastest-xl yes yes Github
Simple-Pose yes yes Github
Yolact yes yes Github zhihu
ChineseOCR_lite yes yes Github zhihu
ENet bug cancel Github
Landmark106 yes yes Github
DBFace yes yes Github
MBNv2-FCN yes yes Github
MBNv3-Seg-small yes yes Github
Light_OpenPose yes yes Github

iOS:

  • Copy .param and .bin from "android_YOLOV5_NCNN\app\src\main\assets" to "iOS_YOLOv5NCNN\YOLOv5NCNN\res"
  • If it prompts that net.h can't be found, you need to download it from the ncnn official website or compile .framework(20201208) yourself and replace it in the project. If opencv2.framework(4.3.0) is useful, you need to download it again and replace it in the project.
  • The default library used by iOS does not include vulkan and bitcode.
  • Normally, you need to re-download ncnn.framework/glslang.framework/openmp.framework/opencv2.framework and replace it with the project.
  • For the configuration of Vulkan, please refer to the general configuration mentioned in Issues.

Android:

  • Due to factors such as mobile phone performance and image size, FPS varies greatly on different mobile phones. This project mainly tests the use of the NCNN framework. For the conversion of specific models, you can go to the NCNN official to view the conversion tutorial.
  • Because the opencv library is too large, only arm64-v8a/armeabi-v7a is reserved. If you need other versions, go to the official download.
  • ncnn temporarily uses the vulkan version, and acceleration needs to be turned on before loading, which is not turned on in this project. If you want to use the ncnn version, you need to modify the CMakeLists.txt configuration.
  • Different AS versions may have various problems with compilation. If the compilation error cannot be solved, it is recommended to use AS4.0 or higher to try.
  • ncnn has been updated to a new version, which includes ncnn The official import method of cmake.

This project is more about practicing the use and deployment of various models, without too much processing in terms of speed. If you have requirements for speed, you can directly obtain data such as YUV for direct input or use methods such as texture and opengl to achieve data input, reducing intermediate data transmission and conversion.

Convert locally(Will not upload model): xxxx -> ncnn

Minimal OpenCV:opencv-mobile

🎨 Screenshot

Android iOS

Android

mbnv2-yolov3-nano yolov4-tiny yolov5s
simple_pose yolact chineseocr_lite_01
chineseocr_lite_02 ENet yoloface500k-landmark106
dbface mbnv2_fcn mbnv3_seg_small
yolov5s_custom_op nanodet yolo-fastest-xl
light_openpose

iOS

mbnv2-yolov3-nano yolov4-tiny yolov5s
yolov5s_custom_op nanodet yolo-fastest-xl
mbnv2_fcn mbnv3_seg_small simple_pose
chineseocr_lite_01 chineseocr_lite_02 light_openpose
yolact yoloface500k-landmark106 dbface

Thanks: