CoreML-Models

Converted CoreML Model Zoo.

CoreML is a machine learning framework by Apple. If you are iOS developer, you can easly use machine learning models in your Xcode project.

How to use

Take a look this model zoo, and if you found the CoreML model you want, download the model from google drive link and bundle it in your project. Or if the model have sample project link, try it and see how to use the model in the project. You are free to do or not.

If you like this repository, please give me a star so I can do my best.

Section Link

• Image Classifier

  • Efficientnetb0
  • Efficientnetv2
  • VisionTransformer
  • Conformer
  • DeiT
  • RepVGG
  • RegNet
  • MobileViTv2

• Object Detection

  • YOLOv5s
  • YOLOv7
  • YOLOv8

• Segmentation

  • U2Net
  • IS-Net
  • face-parsing
  • Segformer
  • BiseNetv2
  • DNL
  • ISANet
  • FastFCN
  • GCNet
  • DANet
  • Semantic FPN
  • cloths_segmentation

• Super Resolution

  • Real ESRGAN
  • GFPGAN
  • BSRGAN
  • A-ESRGAN
  • Beby-GAN
  • RRDN
  • Fast-SRGAN
  • ESRGAN
  • SRGAN
  • SRResNet
  • LESRCNN
  • MMRealSR

• Low Light Enhancement

  • StableLLVE
  • Zero-DCE

• Image Restoration

  • MPRNet
  • MIRNetv2

• Image Generation

  • MobileStyleGAN
  • DCGAN

• Image2Image

  • Anime2Sketch
  • AnimeGAN2Face_Paint_512_v2
  • Photo2Cartoon
  • AnimeGANv2_Hayao
  • AnimeGANv2_Paprika
  • WarpGAN Caricature
  • UGATIT_selfie2anime
  • Fast-Neural-Style-Transfer
  • White_box_Cartoonization
  • FacialCartoonization

• Inpainting

  • AOT-GAN-for-Inpainting

• Monocular Depth Estimation

  • MiDaS

• Stable Diffusion :text2image

  • stable-diffusion-v1-5
  • pastel-mix
  • Orange Mix
  • Counterfeit-V2.5
  • anything-v4.5
  • Openjourney
  • dreamlike-photoreal-2.0

How to get the model

You can get the model converted to CoreML format from the link of Google drive. See the section below for how to use it in Xcode. The license for each model conforms to the license for the original project.

Image Classifier

Efficientnet

Efficientnetv2

VisionTransformer

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.

Conformer

Local Features Coupling Global Representations for Visual Recognition.

DeiT

Data-efficient Image Transformers

RepVGG

Making VGG-style ConvNets Great Again

RegNet

Designing Network Design Spaces

MobileViTv2

CVNets: A library for training computer vision networks

Google Drive Link	Size	Dataset	Original Project	License	Year	Conversion Script
MobileViTv2	18.8 MB	ImageNet	apple/ml-cvnets	apple	2022

Object Detection

YOLOv5s

YOLOv7

Google Drive Link	Size	Output	Original Project	License	Note	Sample Project	Conversion Script
YOLOv7	147.9MB	Confidence(MultiArray (Double 0 × 80)), Coordinates (MultiArray (Double 0 × 4))	WongKinYiu/yolov7	GNU	Non Maximum Suppression has been added.	CoreML-YOLOv5

YOLOv8

Segmentation

U2Net

IS-Net

Google Drive Link	Size	Output	Original Project	License	Year	Conversion Script
IS-Net	176.1 MB	Image(GRAYSCALE 1024 × 1024)	xuebinqin/DIS	Apache	2022
IS-Net-General-Use	176.1 MB	Image(GRAYSCALE 1024 × 1024)	xuebinqin/DIS	Apache	2022

face-Parsing

Segformer

Simple and Efficient Design for Semantic Segmentation with Transformers

BiSeNetV2

Bilateral Network with Guided Aggregation for Real-time Semantic Segmentation

DNL

Disentangled Non-Local Neural Networks

ISANet

Interlaced Sparse Self-Attention for Semantic Segmentation

FastFCN

Rethinking Dilated Convolution in the Backbone for Semantic Segmentation

GCNet

Non-local Networks Meet Squeeze-Excitation Networks and Beyond

DANet

Dual Attention Network for Scene Segmentation(CVPR2019)

Semantic-FPN

Panoptic Feature Pyramid Networks

cloths_segmentation

Code for binary segmentation of various cloths.

Super Resolution

Real ESRGAN

GFPGAN

Towards Real-World Blind Face Restoration with Generative Facial Prior

BSRGAN

A-ESRGAN

Google Drive Link	Size	Output	Original Project	License	year	Conversion Script
A-ESRGAN	63.8 MB	Image(RGB 1024x1024)	aesrgan/A-ESRGANN	BSD 3-Clause License	2021

Beby-GAN

Best-Buddy GANs for Highly Detailed Image Super-Resolution

RRDN

The Residual in Residual Dense Network for image super-scaling.

Fast-SRGAN

Fast-SRGAN.

ESRGAN

Enhanced-SRGAN.

SRGAN

Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network.

SRResNet

Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network.

LESRCNN

Lightweight Image Super-Resolution with Enhanced CNN.

Google Drive Link	Size	Output	Original Project	License	year	Conversion Script
LESRCNN	4.3 MB	Image(RGB 512x512)	hellloxiaotian/LESRCNN		2020

MMRealSR

Metric Learning based Interactive Modulation for Real-World Super-Resolution

Google Drive Link	Size	Output	Original Project	License	year	Conversion Script
MMRealSRGAN	104.6 MB	Image(RGB 1024x1024)	TencentARC/MM-RealSR	BSD 3-Clause	2022
MMRealSRNet	104.6 MB	Image(RGB 1024x1024)	TencentARC/MM-RealSR	BSD 3-Clause	2022

Low Light Enhancement

StableLLVE

Learning Temporal Consistency for Low Light Video Enhancement from Single Images.

Zero-DCE

Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement

Google Drive Link	Size	Output	Original Project	License	Year	Conversion Script
Zero-DCE	320KB	Image(RGB 512x512)	Li-Chongyi/Zero-DCE	See Repo	2021

Image Restoration

MPRNet

Multi-Stage Progressive Image Restoration.

Debluring

Denoising

Deraining

MIRNetv2

Learning Enriched Features for Fast Image Restoration and Enhancement.

Denoising

Super Resolution

Contrast Enhancement

Low Light Enhancement

Google Drive Link	Size	Output	Original Project	License	Year	Conversion Script
MIRNetv2Denoising	42.5 MB	Image(RGB 512x512)	swz30/MIRNetv2	ACADEMIC PUBLIC LICENSE	2022
MIRNetv2SuperResolution	42.5 MB	Image(RGB 512x512)	swz30/MIRNetv2	ACADEMIC PUBLIC LICENSE	2022
MIRNetv2ContrastEnhancement	42.5 MB	Image(RGB 512x512)	swz30/MIRNetv2	ACADEMIC PUBLIC LICENSE	2022
MIRNetv2LowLightEnhancement	42.5 MB	Image(RGB 512x512)	swz30/MIRNetv2	ACADEMIC PUBLIC LICENSE	2022

Image Generation

MobileStyleGAN

DCGAN

Image2Image

Anime2Sketch

AnimeGAN2Face_Paint_512_v2

Google Drive Link	Size	Output	Original Project	Conversion Script
AnimeGAN2Face_Paint_512_v2	8.6MB	Image(Color 512 × 512)	bryandlee/animegan2-pytorch

Photo2Cartoon

AnimeGANv2_Hayao

AnimeGANv2_Paprika

WarpGAN Caricature

UGATIT_selfie2anime

CartoonGAN

Fast-Neural-Style-Transfer

White_box_Cartoonization

Learning to Cartoonize Using White-box Cartoon Representations

FacialCartoonization

White-box facial image cartoonizaiton

Inpainting

AOT-GAN-for-Inpainting

Monocular Depth Estimation

MiDaS

Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer

Google Drive Link	Size	Output	Original Project	License	Year	Conversion Script
MiDaS_Small	66.3MB	MultiArray(1x256x256)	isl-org/MiDaS	MIT	2022

Stable Diffusion

stable-diffusion-v1-5

pastel-mix

Pastel Mix - a stylized latent diffusion model.This model is intended to produce high-quality, highly detailed anime style with just a few prompts.

Orange Mix

Counterfeit

anything-v4

Openjourney

dreamlike-photoreal-2

Models converted by someone other than me.

Stable Diffusion

apple/ml-stable-diffusion

How to use in a xcode project.

Option 1,implement Vision request.

import Vision
lazy var coreMLRequest:VNCoreMLRequest = {
   let model = try! VNCoreMLModel(for: modelname().model)
   let request = VNCoreMLRequest(model: model, completionHandler: self.coreMLCompletionHandler)
   return request
   }()

let handler = VNImageRequestHandler(ciImage: ciimage,options: [:])
   DispatchQueue.global(qos: .userInitiated).async {
   try? handler.perform([coreMLRequest])
}

If the model has Image type output:

let result = request?.results?.first as! VNPixelBufferObservation
let uiimage = UIImage(ciImage: CIImage(cvPixelBuffer: result.pixelBuffer))

Else the model has Multiarray type output:

For visualizing multiArray as image, Mr. Hollance’s “CoreML Helpers” are very convenient. CoreML Helpers

Converting from MultiArray to Image with CoreML Helpers.

func coreMLCompletionHandler（request：VNRequest？、error：Error？）{
   let = coreMLRequest.results？.first as！VNCoreMLFeatureValueObservation
   let multiArray = result.featureValue.multiArrayValue
   let cgimage = multiArray？.cgImage（min：-1、max：1、channel：nil）

Option 2,Use CoreGANContainer. You can use models with dragging&dropping into the container project.

Make the model lighter

You can make the model size lighter with Quantization if you want. https://coremltools.readme.io/docs/quantization

The lower the number of bits, more the chances of degrading the model accuracy. The loss in accuracy varies with the model.

import coremltools as ct
from coremltools.models.neural_network import quantization_utils

# load full precision model
model_fp32 = ct.models.MLModel('model.mlmodel')

model_fp16 = quantization_utils.quantize_weights(model_fp32, nbits=16)
# nbits can be 16(half size model), 8(1/4), 4(1/8), 2, 1

quantized sample (U2Net)

InputImage / nbits=32(original) / nbits=16 / nbits=8 / nbits=4

Thanks

Cover image was taken from Ghibli free images.

On YOLOv5 convertion, dbsystel/yolov5-coreml-tools give me the super inteligent convert script.

And all of original projects

Auther

Daisuke Majima Freelance engineer. iOS/MachineLearning/AR I can work on mobile ML projects and AR project. Feel free to contact: [email protected]

GitHub Twitter Medium