홈 › 서비스 › AI / LLMs › MLX

맥에서 MLX

Apple-silicon model serving — the MLX-LM CLI server, the oMLX inference server, or Inco AI's Splash engine · AI / LLMs

MLX runs large language models natively on Apple Silicon — unified M-series memory, often faster and lighter than llama.cpp on a Mac, with models from the mlx-community org on Hugging Face. FrontierStack manages both ways to serve them, in this one pane: MLX-LM (pip install mlx-lm, then mlx_lm.server --model … --port 8080 — a plain OpenAI-compatible API) and oMLX ([jundot/omlx](https://github.com/jundot/omlx), Apache-2.0) — an MLX inference server built for throughput: continuous batching and a two-tier KV cache (hot in RAM, cold on SSD), serving LLM, vision, OCR, embedding and reranker models on :8000 with OpenAI-compatible endpoints (/v1/chat/completions, /v1/embeddings, /v1/rerank) and the Anthropic /v1/messages API, plus an admin dashboard and chat at /admin. It is run from its native menu-bar app or its own CLI (omlx start / omlx stop, brew services start omlx); install the signed .dmg from GitHub Releases, or brew tap jundot/omlx https://github.com/jundot/omlx && brew install jundot/omlx/omlx. macOS 15+. Point LibreChat, OpenCode, Claude Code or the Model Costs pane at either; all three appear in the AI-harness model picker when running. The pane also runs Splash (Inco AI's open-source Apple-silicon engine, brew install incoai/tap/splash; OpenAI *and* Anthropic APIs; M3+ Mac, macOS 26.4+, 36 GB+ memory) — not MLX-format models, but the same kind of local server; FrontierStack starts it on :8100 so it does not collide with oMLX on :8000. Underneath all of it is MLX itself, Apple's open-source array/ML framework ([ml-explore/mlx](https://github.com/ml-explore/mlx)) — a NumPy-like API with lazy evaluation and a PyTorch-style nn module, for on-device training and inference; pip install mlx mlx-lm installs the framework with the LLM toolkit, and MLX-VLM adds vision models. MLX-VLM is also how the pane serves Bonsai 2 (PrismML's ternary models — 2B to 27B, a 9B in 3.5 GB, text + image, 262k context): pick one in the model list and it starts mlx_vlm.server instead, since mlx-lm can't load those packs yet.

FrontierStack으로 MLX 실행하기

MLX을(를) 설치하거나 연결한 뒤 FrontierStack에서 상태, 포트, 인증서를 확인하십시오. 해당되는 경우 같은 화면에서 방화벽 점검, 백업으로 이동할 수 있습니다.

Mac에서 모두 운영하십시오.

FrontierStack은 이 Mac과 연결된 서버에서 서비스를 설치, 모니터링, 보호하며 — 암호와 키는 어떤 AI에게도 보이지 않게 지킵니다.

FrontierStack 다운로드

Apple 공증 완료 · 안전 & 보안 · macOS 13 Ventura 이상

관련 AI / LLMs

AI / LLM 29개 모두 비교 →