Petals on a Mac
BitTorrent-style distributed inference of big models · AI Clusters
Petals runs large language models (e.g. Llama-class) collaboratively; you load a small slice of the model and connect over the public/private swarm to other peers serving the rest, BitTorrent-style, for inference and fine-tuning of models too big for local RAM. pip install petals; run a server with python -m petals.cli.run_server to contribute, or use the client to generate. Linux/CUDA-oriented; private swarms supported.
Run Petals with FrontierStack
Install or connect Petals; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks, Malware Audit and backups where they apply.
Run it from your Mac.
FrontierStack installs, monitors and secures services on this Mac and on linked servers.
Download FrontierStackApple notarized · Safe & secure · macOS 13 Ventura+