Bootstrap

用 docker 快速搭建 kafka(qbit)

前言

  • 技术栈

OS: Ubuntu 20.04 LTS
docker: 20.10.12
docker-compose: 1.25.0
kafka: 2.8.1
LogiKM: 2.6.0
MySQL: 8.0.27

搭建 kafka

  • kafka docker 镜像:

  • kafka docker 镜像 github:

  • 搜索 kafka 镜像

# docker search kafka
NAME                                    DESCRIPTION                                     STARS     OFFICIAL   AUTOMATED
wurstmeister/kafka                      Multi-Broker Apache Kafka Image                 1469                 [OK]
spotify/kafka                           A simple docker image with both Kafka and Zo…   414                  [OK]
sheepkiller/kafka-manager               kafka-manager                                   214                  [OK]
kafkamanager/kafka-manager              Docker image for Kafka manager                  145                  
ches/kafka                              Apache Kafka. Tagged versions. JMX. Cluster-…   117                  [OK]
  • 列出 tag

wget -q https://registry.hub.docker.com/v1/repositories/wurstmeister/kafka/tags -O -  | sed -e 's/[][]//g' -e 's/"//g' -e 's/ //g' | tr '}' '\n'  | awk -F: '{print $3}'
  • 也可以用 命令列出

docker image search --list-tags wurstmeister/kafka --limit 1000
  • 编排文件

version: '3.5'
services:
  zookeeper:
    image: wurstmeister/zookeeper:3.4.6
    container_name: zookeeper
    ports:
      - "2181:2181"
    restart: unless-stopped
  kafka:
    image: wurstmeister/kafka:2.13-2.8.1
    container_name: kafka
    ports:
      - "9092:9092"
    environment:
      - KAFKA_ZOOKEEPER_CONNECT=zookeeper:2181
      - KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://192.168.1.46:9092
      - KAFKA_LISTENERS=PLAINTEXT://:9092
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
    restart: unless-stopped
  • 启动 kafka 和 zookeeper

docker-compose up -d
  • 查看 kafka 和 zookeeper 是否正常运行

docker stats kafka zookeeper

LogiKM 可视化工具

  • LogiKM github:

  • LogiKM 的安装参见滴滴即可

  • LogiKM 接入 kafka 是通过 web 界面,不是通过配置文件

本文出自