• Stars
    star
    269
  • Rank 152,662 (Top 4 %)
  • Language
    C++
  • License
    Other
  • Created over 7 years ago
  • Updated about 6 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Heterogeneous Run Time version of Caffe. Added heterogeneous capabilities to the Caffe, uses heterogeneous computing infrastructure framework to speed up Deep Learning on Arm-based heterogeneous embedded platform. It also retains all the features of the original Caffe architecture which users deploy their applications seamlessly.

Caffe-HRT

License

Caffe-HRT is a project that is maintained by OPEN AI LAB, it uses heterogeneous computing infrastructure framework to speed up Caffe and provide utilities to debug, profile and tune application performance.

The release version is 0.5.0, is based on Rockchip RK3399 Platform, target OS is Ubuntu 16.04. Can download the source code from OAID/Caffe-HRT

  • The ARM Computer Vision and Machine Learning library is a set of functions optimised for both ARM CPUs and GPUs using SIMD technologies. See also Arm Compute Library.
  • Caffe is a fast open framework for deep learning. See also Caffe.

Documents

Arm Compute Library Compatibility Issues :

There are some compatibility issues between ACL and Caffe Layers, we bypass it to Caffe's original layer class as the workaround solution for the below issues

  • Normalization in-channel issue
  • Tanh issue
  • Softmax supporting multi-dimension issue
  • Group issue

Performance need be fine turned in the future

Release History

The Caffe based version is 793bd96351749cb8df16f1581baf3e7d8036ac37.

Version 0.5.0 - Jan 31, 2018

Support Arm Compute Library version 17.12

Version 0.4.1 - Nov 23, 2017

Support Arm Compute Library version 17.10

Version 0.4.0 - Oct 11, 2017

Support Arm Compute Library version 17.09

Version 0.3.0 - Aug 26, 2017

Support Arm Compute Library version 17.06 with 4 new layers added

  • Batch Normalization Layer
  • Direct convolution Layer
  • Locally Connect Layer
  • Concatenate layer

Version 0.2.0 - Jul 2, 2017

Fix the issues:

  • Compatible with Arm Compute Library version 17.06
  • When OpenCL initialization fails, even if Caffe uses CPU-mode,it doesn't work properly.

Version 0.1.0 - Jun 2, 2017

Initial version supports 10 Layers accelerated by Arm Compute Library version 17.05 :

  • Convolution Layer
  • Pooling Layer
  • LRN Layer
  • ReLU Layer
  • Sigmoid Layer
  • Softmax Layer
  • TanH Layer
  • AbsVal Layer
  • BNLL Layer
  • InnerProduct Layer

Issue Report

Encounter any issue, please report on issue report. Issue report should contain the following information :

  • The exact description of the steps that are needed to reproduce the issue
  • The exact description of what happens and what you think is wrong

More Repositories

1

Tengine

Tengine is a lite, high performance, modular inference engine for embedded device
C++
4,625
star
2

TengineKit

TengineKit - Free, Fast, Easy, Real-Time Face Detection & Face Landmarks & Face Attributes & Hand Detection & Hand Landmarks & Body Detection & Body Landmarks & Iris Landmarks & Yolov5 SDK On Mobile.
C++
2,386
star
3

AutoKernel

AutoKernel 是一个简单易用,低门槛的自动算子优化工具,提高深度学习算法部署效率。
C++
776
star
4

FaceDetection

C++ project to implement MTCNN, a perfect face detect algorithm, on different DL frameworks. The most popular frameworks: caffe/mxnet/tensorflow, are all suppported now
C++
270
star
5

YSQfastfd

A fast binary library for face detection and face landmark detection in images. No float point operations, especially suit for low cost Arm CPUs, The highest accuracy on FDDB among non deep learning methods
C++
197
star
6

FaceRecognition

This is an implematation project of face detection and recognition. The face detection using MTCNN algorithm, and recognition using LightenenCNN algorithm.
C++
148
star
7

Tengine-Convert-Tools

Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.
C++
94
star
8

TengineFactory

Algorithm acceleration landing framework, let you complete the development of algorithm at low cost.eg: Facedetect, FaceLandmark..
C++
90
star
9

TengineGst

TengineGst is a streaming media analytics framework, based on GStreamer multimedia framework, for creating varied complex media analytics pipelines. It ensures pipeline interoperability and provides optimized media, and inference operations using Tengine Toolkit Inference Engine backend, across varied architecture - CPU, iGPU and VPU.
C++
75
star
10

MXNet-HRT

Heterogeneous Run Time version of MXNet. Added heterogeneous capabilities to the MXNet, uses heterogeneous computing infrastructure framework to speed up Deep Learning on Arm-based heterogeneous embedded platform. It also retains all the features of the original MXNet architecture which users deploy their applications seamlessly.
C++
72
star
11

cortex-m-kws

Cortex M KWS example with Tengine Lite.
C
71
star
12

Tengine-app

This is a repository for applications powered by Tengine. Please feel free to try them on your device
C++
56
star
13

ObjectTracker

This object Tracker algorithm is a TLD(Long-term tracker) tracker base on KCF or DSST.
C++
45
star
14

SpeechRecognition

A local auto speech recognition project based on Kaldi and ALSA.
C++
36
star
15

TensorFlow-HRT

Heterogeneous Run Time version of TensorFlow. Added heterogeneous capabilities to the TensorFlow, uses heterogeneous computing infrastructure framework to speed up Deep Learning on Arm-based heterogeneous embedded platform. It also retains all the features of the original TensorFlow architecture which users deploy their applications seamlessly.
C++
36
star
16

CVGesture

It implements detection and recognition to different hand gestures, based on OpenCV 3.3.0 (Open Source Computer Vision Library)
C++
31
star
17

TengineInferPipe

C++
24
star
18

FaceRecognition2

FaceRecognition2 is an implementation project of face detection and recognition. The face detection using MTCNN algorithm, and recognition using LightenedCNN algorithm.
C++
20
star
19

AndroidFacedemo

An face recogniztion detect project on android based on CaffeOnACL
C++
11
star
20

AndroidCVDemo

An CV demo in Android, include Gesture recognition and Object traking
C++
4
star
21

autokernel-docs-en

autokernel documentation (english version)
Python
3
star
22

autokernel-docs-cn

autokernel documentation
Python
1
star