hahnyuan/TorchQuantExtension

Stars
8
Rank 2,099,232 (Top 42 %)
Language Cuda
License
MIT License
Created about 1 year ago
Updated about 1 year ago

hahnyuan/TorchQuantExtension

hahnyuan

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Pytorch extension for quantization with high-efficient CUDA kernels

nn_tools

Neural Network Tools: Converter and Analyzer. For caffe, pytorch, draknet and so on.

LLM-Viewer

Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.

RPTQ4LLM

Reorder-based post-training quantization for large language model

PTQ4ViT

Post-Training Quantization for Vision transformers.

PB-LLM

PB-LLM: Partially Binarized Large Language Models

video_labeler

A GUI tool for conveniently label the objects in video, using the powerful object tracking.

ASVD4LLM

Activation-aware Singular Value Decomposition for Compressing Large Language Models

darknet-visualizer

A visualizer of darknet nerual network's network

ModelASV

ModelASV: Analyze, Simulate and Visulize the Performance of Large Neural Network Models

shadowsocks_autoset

Automatically set the free SS account from a website for windows shadowsocks client.

MTCNN_API

Convenient API of MTCNN face or face landmark detection

MiscTritonCuda

MiscTritonCuda is a feature-rich library designed to provide miscellaneous operators and helper functions related to Triton and CUDA acceleration.

PIMAnalyzer

Tool for analyzing the details of crossbar for different applications on PIM

WechatBot