Triton-TensorRT-Inference-CRAFT-pytorch

Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> ONNX -> TensorRT, Inference pipelines (TensorRT, Triton server - multi-format). Supported model format for Triton inference: TensorRT engine, Torchscript, ONNX

ONNX-TensorRT-Inference-CRAFT-pytorch

Advance inference performance using TensorRT for CRAFT Text detection. Implemented modules to convert Pytorch -> ONNX -> TensorRT, with dynamic shapes (multi-size input) inference.

torch2tensorRT-dynamic-CRAFT-pytorch

Convenient Convert CRAFT Text detection pretrain Pytorch model into TensorRT engine directly, without ONNX step between

triton-exp

Repo for experimenting NVIDIA Triton Inference server