Petals
BitTorrent-style open-source system for running 100B+ LLMs collaboratively — share your GPU, run models 10x faster than offloading. Free distributed inference.
Tags
Open Source · Distributed · LLM Inference · Peer-to-Peer · Free · Self-Hostable · Collaborative · Petals · free tools · free ai tools · no cost