Discover hahnyuan/LLM-Viewer Open Source project

Stars
275
Rank 149,796 (Top 3 %)
Language
Python
License
MIT License
Created 11 months ago
Updated 2 months ago

hahnyuan

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.

nn_tools

Neural Network Tools: Converter and Analyzer. For caffe, pytorch, draknet and so on.

Python

354

RPTQ4LLM

Reorder-based post-training quantization for large language model

Python

178

PTQ4ViT

Post-Training Quantization for Vision transformers.

Python

176

PB-LLM

PB-LLM: Partially Binarized Large Language Models

Python

143

video_labeler

A GUI tool for conveniently label the objects in video, using the powerful object tracking.

Python

ASVD4LLM

Activation-aware Singular Value Decomposition for Compressing Large Language Models

Python

darknet-visualizer

A visualizer of darknet nerual network's network

Python

TorchQuantExtension

Pytorch extension for quantization with high-efficient CUDA kernels

Cuda

ModelASV

ModelASV: Analyze, Simulate and Visulize the Performance of Large Neural Network Models

Python

shadowsocks_autoset

Automatically set the free SS account from a website for windows shadowsocks client.

Python

MTCNN_API

Convenient API of MTCNN face or face landmark detection

Python

MiscTritonCuda

MiscTritonCuda is a feature-rich library designed to provide miscellaneous operators and helper functions related to Triton and CUDA acceleration.

Python

PIMAnalyzer

Tool for analyzing the details of crossbar for different applications on PIM

Python

WechatBot

TypeScript

hahnyuan/LLM-Viewer

hahnyuan

Reviews

Repository Details

More Repositories