• Stars
    star
    1,255
  • Rank 37,093 (Top 0.8 %)
  • Language
    C++
  • License
    MIT License
  • Created 9 months ago
  • Updated 28 days ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.