Discover k9ele7en/Triton-TensorRT-Inference-CRAFT-pytorch Open Source

Stars
31
Rank 820,005 (Top 17 %)
Language
Python
License
BSD 3-Clause "New...
Created over 3 years ago
Updated over 3 years ago

k9ele7en

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> ONNX -> TensorRT, Inference pipelines (TensorRT, Triton server - multi-format). Supported model format for Triton inference: TensorRT engine, Torchscript, ONNX

ONNX-TensorRT-Inference-CRAFT-pytorch

Advance inference performance using TensorRT for CRAFT Text detection. Implemented modules to convert Pytorch -> ONNX -> TensorRT, with dynamic shapes (multi-size input) inference.

Python

torch2tensorRT-dynamic-CRAFT-pytorch

Convenient Convert CRAFT Text detection pretrain Pytorch model into TensorRT engine directly, without ONNX step between

Python

triton-exp

Repo for experimenting NVIDIA Triton Inference server

k9ele7en/Triton-TensorRT-Inference-CRAFT-pytorch

k9ele7en

Reviews

Repository Details

More Repositories