torchchat
PyTorch's official reference for running LLMs on laptops, desktops, and phones. Native quantization, mobile export, and Python-free C++ runtime for local inference.
Tags
Open Source · PyTorch · Local LLM · Mobile · Free · Self-Hostable · Inference · torchchat · free tools · free ai tools · no cost