Home › Services › Message Queues & Streaming

Message Queues & Streaming: 12 solutions compared

Which Message Queues & Streaming tools can you self-host, run on a Mac or connect to? FrontierStack's catalogue covers 12 Message Queues & Streaming options: AKHQ, Apache Kafka, Apache Pulsar, Apache RocketMQ, Apache ZooKeeper, Celery and others. For 12 of them FrontierStack installs the service on a Mac or server, or connects to one you already run, and checks status, ports and certificates where they apply.

NameTypeWhat FrontierStack does
AKHQSelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply
Apache KafkaSelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply
Apache PulsarSelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply
Apache RocketMQSelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply
Apache ZooKeeperSelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply
CelerySelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply
NATSSelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply
RabbitMQSelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply
Redis StreamsSelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply
RedpandaSelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply
SidekiqSelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply
Supabase RealtimeSelf-hosted or connectedInstall or connect; status, ports and certificate checks where they apply

AKHQ

Web administration and observability console for Kafka

AKHQ is a self-hosted web console for Apache Kafka: inspect clusters, topics, records, consumer groups, ACLs, Schema Registry, Kafka Connect and ksqlDB. FrontierStack monitors AKHQ's separate application-health interface and links to the official Docker, standalone-JAR and Kubernetes installation paths. Because AKHQ can read and change Kafka data, enable authentication, least-privilege roles and data masking before sharing its UI.

Install or connect AKHQ; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply.

Apache Kafka

Distributed event streaming (self-hosted)

Apache Kafka is the de-facto distributed event-streaming platform; durable, partitioned topics for high-throughput pipelines and event sourcing. Install with Homebrew (brew install kafka) and run in KRaft mode (no ZooKeeper needed on current versions); brokers listen on :9092. Pair with a UI like Redpanda Console or AKHQ.

Install or connect Apache Kafka; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply.

Apache Pulsar

Distributed pub-sub & queuing with tiered storage

Apache Pulsar is a cloud-native messaging and streaming platform combining pub-sub and queuing, with multi-tenancy, geo-replication and tiered storage separating compute from storage (BookKeeper). Self-host via Docker/standalone; the binary protocol on :6650 and an admin REST API + WebSocket on :8080 to manage topics and integrate.

Install or connect Apache Pulsar; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply.

Apache RocketMQ

Low-latency distributed messaging (ordered, transactional)

Apache RocketMQ is a distributed messaging and streaming platform from Alibaba; low latency, ordered and transactional messages, popular for high-scale e-commerce/financial workloads. Self-host the NameServer + Broker (Docker/binaries); broker on :10911, NameServer on :9876, with an HTTP admin Dashboard and SDKs/REST proxy for integration.

Install or connect Apache RocketMQ; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply.

Apache ZooKeeper

Distributed coordination, quorum and leader election

Apache ZooKeeper is a replicated coordination service used for naming, configuration, leader election and distributed locks. FrontierStack can install and control the Homebrew service, detect its JVM safely, and inspect read-only application health, quorum role, latency and workload. Current Kafka can use KRaft without ZooKeeper, but many Hadoop, HBase, Solr and older Kafka deployments still depend on a ZooKeeper ensemble.

Install or connect Apache ZooKeeper; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply.

Celery

Distributed task queue for Python (workers + broker)

Celery is the standard distributed task/job queue for Python; offload background work, schedule periodic tasks (Celery Beat), and scale out across worker processes/machines. It runs on a broker; Redis or RabbitMQ (both in this app); with an optional result backend. Install with pip (pip install celery), define tasks, then run celery -A app worker. Monitor live with Flower (pip install flower; web UI on :5555). Pairs with Redis Streams / RabbitMQ here.

Install or connect Celery; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply.

NATS

High-performance messaging + JetStream (self-hosted)

NATS is a fast, simple messaging system; pub/sub, request/reply and queue groups, plus JetStream for persistent streams and work queues (a lighter alternative to Kafka). Install with Homebrew (nats-server); client port 4222, HTTP monitoring on :8222. The nats CLI publishes/subscribes and manages streams.

Install or connect NATS; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply.

RabbitMQ

AMQP message broker with queue monitoring and optional MQTT

RabbitMQ is a reliable AMQP message broker with exchanges, queues, routing, acknowledgements, clustering and optional MQTT/STOMP plugins. AMQP clients normally use :5672; MQTT uses :1883 only when its plugin is enabled; the management UI and read-only HTTP API use :15672. FrontierStack's Queue Operations dashboard reads queue depth, in-flight messages and consumer counts without retrieving or changing messages.

Install or connect RabbitMQ; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply.

Redis Streams

Lightweight log/stream with consumer groups (Redis)

Redis Streams is an append-only log data type built into Redis; XADD/XREAD, persistence, and consumer groups (XREADGROUP + XACK) for at-least-once delivery with load balancing and replay. A simple, very fast queue/stream when you don't need full Kafka: ideal for job pipelines, event fan-out and activity feeds. No separate install; it's Redis (brew install redis, port 6379); see the Redis entry under Caching. Pairs with Celery (below) and is the broker behind many app frameworks.

Install or connect Redis Streams; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply.

Redpanda

Kafka-compatible streaming, no JVM/ZooKeeper

Redpanda is a streaming data platform that speaks the Kafka API; a single C++ binary, no JVM or ZooKeeper, lower latency and simpler ops. Run via rpk/Docker; brokers on :9092 (Kafka-compatible), admin/HTTP proxy on :8082, schema registry on :8081. Drop-in for Kafka clients, with a built-in Console UI.

Install or connect Redpanda; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply.

Sidekiq

Background jobs for Ruby (threaded workers on Redis)

Sidekiq is the standard background-job processor for Ruby and Rails; the Ruby counterpart to Celery. It runs many jobs concurrently as threads in one process (default concurrency 30, though most apps want 10 or less) and stores its queues in Redis 7.0+ (Valkey 7.2+ and Dragonfly 1.27+ also work; all three are in this app), so install one of those first and point REDIS_URL at it. Needs Ruby 3.2+ (MRI) or JRuby 9.4+; Rails/Active Job 7.0+ for Sidekiq 8. Install with bundle add sidekiq (or gem install sidekiq) and run bundle exec sidekiq alongside your Puma web processes. The bundled Web UI is a Rack app (Sidekiq::Web) you mount in your routes; queues, retries, scheduled and dead jobs, live stats; mount it behind authentication, never open. Editions: the open-source gem (LGPL), plus commercial Sidekiq Pro (reliable fetch, batches) and Sidekiq Enterprise (rate limiting, unique jobs, periodic jobs, multi-process); record a paid plan in Plan & Cost below. Watch the Redis it depends on in Database Health.

Install or connect Sidekiq; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply. Full page →

Supabase Realtime

Postgres change streams over WebSockets

Supabase Realtime broadcasts Postgres changes (and presence / broadcast channels) to clients over WebSockets. Part of the Supabase stack; bring it up locally with supabase start. Manage the local stack from the Supabase pane.

Install or connect Supabase Realtime; then check its status, ports and certificate from FrontierStack. The same screen links to firewall checks and backups where they apply.

All service genres →

Run it from your Mac.

FrontierStack installs, monitors and secures services on this Mac and on linked servers; and keeps your passwords and keys out of any AI's sight.

Download FrontierStack

Apple notarized · Safe & secure · macOS 13 Ventura+