맥에서 Needle 2

45M on-device model for tool calling and structured extraction · AI / LLMs

Needle 2 (Cactus Compute, Apache-2.0) is a 45M-parameter foundation model small enough to run on any Mac — the weights are a single 14 MB .cact file baked into the inference engine. It is built for tool calling, device use and structured extraction: text in, JSON out, with confidence-gated responses, built-in tool retrieval from large catalogs, and bounded memory from a 256-token sliding window. Install it with pip install cactus-needle; needle playground serves its own web UI on 127.0.0.1:7860. FrontierStack's Needle pane installs it, runs the playground and extracts structured fields from a passage of text. It also fine-tunes: needle generate-data, needle finetune and needle build produce a tuned .cact you can point the playground at (add the [train,metal] extra for Apple Silicon GPU training). Note it is not an OpenAI-compatible server and not an assistant model — it appears in the AI Models picker but is deliberately refused for the assistant's tools, because at 45M parameters with a 256-token window it cannot drive them reliably.

FrontierStack으로 Needle 2 실행하기

Needle 2을(를) 설치하거나 연결한 뒤 FrontierStack에서 상태, 포트, 인증서를 확인하십시오. 해당되는 경우 같은 화면에서 방화벽 점검, 악성코드 감사, 백업으로 이동할 수 있습니다.

관련 AI / LLMs

• Vane (Perplexica)
• MLX
• TurboFieldfare
• Cerebras
• Darkbloom
• MLX (Apple)
• vLLM
• llama.cpp Server