LiteLLM on a Mac
Proxy/gateway for 100+ LLM APIs (OpenAI-compatible) · AI / LLMs
LiteLLM is a unified gateway that puts an OpenAI-compatible API in front of 100+ providers (OpenAI, Anthropic, Bedrock, Azure, Ollama, vLLM…). Run the proxy (pip install 'litellm[proxy]' then litellm --config config.yaml) on :4000 for one endpoint with routing, fallbacks, rate limits, key management and spend tracking; a natural front door for the Model Costs pane. Self-host or use the Python SDK.
Run LiteLLM with FrontierStack
Install or connect LiteLLM; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks, Malware Audit and backups where they apply.
Run it from your Mac.
FrontierStack installs, monitors and secures services on this Mac and on linked servers.
Download FrontierStackApple notarized · Safe & secure · macOS 13 Ventura+