13518219792
这篇文章主要讲解了“docke swarm怎么搭建部署zookeeper+kafka”，文中的讲解内容简单清晰，易于学习与理解，下面请大家跟着小编的思路慢慢深入，一起来研究和学习“docke swarm怎么搭建部署zookeeper+kafka”吧！
成都网站建设哪家好，找创新互联建站！专注于网页设计、成都网站建设公司、微信开发、小程序制作、集团成都定制网站等服务项目。核心团队均拥有互联网行业多年经验，服务众多知名企业客户；涵盖的客户类型包括：社区文化墙等众多领域，积累了大量丰富的经验，同时也获得了客户的一致赞赏！
1. 机器准备
准备三台机器，IP分别为192.168.10.51、192.168.10.52、192.168.10.53;主机名分别为centos51、centos52、centos53。三台机器已经准备好docker swarm环境。docker swarm搭建可以参考另一篇文章 docker swarm 集群搭建。
2. 准备镜像。
在 https://hub.docker.com/ 上拉取zookeeper、kafka、kafka manager相关镜像
docker pull zookeeper:3.6.1
docker pull wurstmeister/kafka:2.12-2.5.0
docker pull kafkamanager/kafka-manager:3.0.0.4
3. zookeeper 相关compose准备。
文件名：docker-stack-zookeeper.yml
version: "3.2" services: #zookeeper服务 zookeeper-server-a: hostname: zookeeper-server-a image: zookeeper:3.6.1 ports: - "12181:2181" networks: swarm-net: aliases: - zookeeper-server-a environment: TZ: Asia/Shanghai ZOO_MY_ID: 1 ZOO_SERVERS: server.1=zookeeper-server-a:2888:3888;2181 server.2=zookeeper-server-b:2888:3888;2181 server.3=zookeeper-server-c:2888:3888;2181 volumes: - /data/kafka_cluster/zookeeper/data:/data deploy: replicas: 1 restart_policy: condition: on-failure placement: constraints: [node.hostname == centos51] resources: limits: # cpus: '1' memory: 1GB reservations: # cpus: '0.2' memory: 512M zookeeper-server-b: hostname: zookeeper-server-b image: zookeeper:3.6.1 ports: - "22181:2181" networks: swarm-net: aliases: - zookeeper-server-b environment: TZ: Asia/Shanghai ZOO_MY_ID: 2 ZOO_SERVERS: server.1=zookeeper-server-a:2888:3888;2181 server.2=zookeeper-server-b:2888:3888;2181 server.3=zookeeper-server-c:2888:3888;2181 volumes: - /data/kafka_cluster/zookeeper/data:/data deploy: replicas: 1 restart_policy: condition: on-failure placement: constraints: [node.hostname == centos52] resources: limits: # cpus: '1' memory: 1GB reservations: # cpus: '0.2' memory: 512M zookeeper-server-c: hostname: zookeeper-server-c image: zookeeper:3.6.1 ports: - "32181:2181" networks: swarm-net: aliases: - zookeeper-server-c environment: TZ: Asia/Shanghai ZOO_MY_ID: 3 ZOO_SERVERS: server.1=zookeeper-server-a:2888:3888;2181 server.2=zookeeper-server-b:2888:3888;2181 server.3=zookeeper-server-c:2888:3888;2181 volumes: - /data/kafka_cluster/zookeeper/data:/data deploy: replicas: 1 restart_policy: condition: on-failure placement: constraints: [node.hostname == centos53] resources: limits: # cpus: '1' memory: 1GB reservations: # cpus: '0.2' memory: 512M networks: swarm-net: external: name: swarm-net
4. kafka 相关compose 准备
文件名： docker-stack-kafka.yml
version: "3.2" services: #kafka服务 kafka-server-a: hostname: kafka-server-a image: wurstmeister/kafka:2.12-2.5.0 ports: - "19092:9092" networks: swarm-net: aliases: - kafka-server-a environment: - TZ=CST-8 - KAFKA_ADVERTISED_HOST_NAME=kafka-server-a - HOST_IP=kafka-server-a - KAFKA_ADVERTISED_PORT=9092 - KAFKA_ZOOKEEPER_CONNECT=zookeeper-server-a:2181,zookeeper-server-b:2181,zookeeper-server-c:2181 - KAFKA_BROKER_ID=0 - KAFKA_HEAP_OPTS="-Xmx512M -Xms16M" volumes: - /data/kafka_cluster/kafka/data:/kafka/kafka-logs-kafka-server-a - /data/kafka_cluster/kafka/logs:/opt/kafka/logs deploy: replicas: 1 restart_policy: condition: on-failure placement: constraints: [node.hostname == centos51] resources: limits: # cpus: '1' memory: 1GB reservations: # cpus: '0.2' memory: 512M kafka-server-b: hostname: kafka-server-b image: wurstmeister/kafka:2.12-2.5.0 ports: - "29092:9092" networks: swarm-net: aliases: - kafka-server-b environment: - TZ=CST-8 - KAFKA_ADVERTISED_HOST_NAME=kafka-server-b - HOST_IP=kafka-server-b - KAFKA_ADVERTISED_PORT=9092 - KAFKA_ZOOKEEPER_CONNECT=zookeeper-server-a:2181,zookeeper-server-b:2181,zookeeper-server-c:2181 - KAFKA_BROKER_ID=1 - KAFKA_HEAP_OPTS="-Xmx512M -Xms16M" volumes: - /data/kafka_cluster/kafka/data:/kafka/kafka-logs-kafka-server-b - /data/kafka_cluster/kafka/logs:/opt/kafka/logs deploy: replicas: 1 restart_policy: condition: on-failure placement: constraints: [node.hostname == centos52] resources: limits: # cpus: '1' memory: 1GB reservations: # cpus: '0.2' memory: 512M kafka-server-c: hostname: kafka-server-c image: wurstmeister/kafka:2.12-2.5.0 ports: - "39092:9092" networks: swarm-net: aliases: - kafka-server-c environment: - TZ=CST-8 - KAFKA_ADVERTISED_HOST_NAME=kafka-server-c - HOST_IP=kafka-server-c - KAFKA_ADVERTISED_PORT=9092 - KAFKA_ZOOKEEPER_CONNECT=zookeeper-server-a:2181,zookeeper-server-b:2181,zookeeper-server-c:2181 - KAFKA_BROKER_ID=2 - KAFKA_HEAP_OPTS="-Xmx512M -Xms16M" volumes: - /data/kafka_cluster/kafka/data:/kafka/kafka-logs-kafka-server-c - /data/kafka_cluster/kafka/logs:/opt/kafka/logs deploy: replicas: 1 restart_policy: condition: on-failure placement: constraints: [node.hostname == centos53] resources: limits: # cpus: '1' memory: 1GB reservations: # cpus: '0.2' memory: 512M networks: swarm-net: external: name: swarm-net
5. kafka manager相关compose准备
文件名： docker-stack-kafka-manager.yml
version: "3.2" services: #kafka manager服务 kafka-manager: hostname: kafka-manager image: kafkamanager/kafka-manager:3.0.0.4 ports: - "19000:9000" networks: swarm-net: aliases: - kafka-manager environment: - ZK_HOSTS=zookeeper-server-a:2181,zookeeper-server-b:2181,zookeeper-server-c:2181 deploy: replicas: 1 restart_policy: condition: on-failure placement: constraints: [node.hostname == centos51] resources: limits: # cpus: '1' memory: 1GB reservations: # cpus: '0.2' memory: 512M networks: avatar-net: external: name: swarm-net
6. 在三台机器上创建文件映射路径
mkdir -p {/data/kafka_cluster/zookeeper/data,/data/kafka_cluster/kafka/data,/data/kafka_cluster/kafka/logs}
chown -R 777 /data/kafka_cluster/7. 执行compose
一定要按照顺序执行，执行成功再执行下一个命令
docker stack deploy -c docker-stack-zookeeper.yml zoo --resolve-image=never --with-registry-auth
docker stack deploy -c docker-stack-kafka.yml kafka --resolve-image=never --with-registry-auth
docker stack deploy -c docker-stack-kafka-manager.yml kafka_manager --resolve-image=never --with-registry-auth
感谢各位的阅读，以上就是“docke swarm怎么搭建部署zookeeper+kafka”的内容了，经过本文的学习后，相信大家对docke swarm怎么搭建部署zookeeper+kafka这一问题有了更深刻的体会，具体使用情况还需要大家实践验证。这里是创新互联，小编将为大家推送更多相关知识点的文章，欢迎关注！
