centos(或openEuler系统)安装kafka集群
安装192.168.9.60、192.168.9.61、192.168.9.62这3台kafka集群(kraft模式,不用zookeeper)
不带密码的
1.每台机器安装kafka:
cd /home/kafka
wget https://downloads.apache.org/kafka/3.3.1/kafka_2.13-3.3.1.tgz
不通就换这个: wget https://archive.apache.org/dist/kafka/3.4.0/kafka_2.13-3.4.0.tgz
tar -xzf kafka_2.13-3.4.0.tgz
cd kafka_2.13-3.4.0
2. 编辑/kraft/server.properties 文件
在每台机器上编辑 /home/kafka/kafka_2.13-3.4.0/config/kraft/server.properties 文件。
机器1 (192.168.9.60)
process.roles=broker,controller
node.id=1
controller.quorum.voters=1@192.168.9.60:9093,2@192.168.9.61:9093,3@192.168.9.62:9093
listeners=PLAINTEXT://192.168.9.60:9092,CONTROLLER://192.168.9.60:9093
advertised.listeners=PLAINTEXT://192.168.9.60:9092
log.dirs=/var/lib/kafka/logs
机器2 (192.168.9.61)
process.roles=broker,controller
node.id=2
controller.quorum.voters=1@192.168.9.60:9093,2@192.168.9.61:9093,3@192.168.9.62:9093
listeners=PLAINTEXT://192.168.9.61:9092,CONTROLLER://192.168.9.61:9093
advertised.listeners=PLAINTEXT://192.168.9.61:9092
log.dirs=/var/lib/kafka/logs
机器3 (192.168.9.62)
process.roles=broker,controller
node.id=3
controller.quorum.voters=1@192.168.9.60:9093,2@192.168.9.61:9093,3@192.168.9.62:9093
listeners=PLAINTEXT://192.168.9.62:9092,CONTROLLER://192.168.9.62:9093
advertised.listeners=PLAINTEXT://192.168.9.62:9092
log.dirs=/var/lib/kafka/logs
3.需要格式化日志目录:
在其中1台中获取uuid
./bin/kafka-storage.sh random-uuid
假如结果是:tP0gwpToQbGRypThUKq6mg
在每台机器上执行一样的命令,3台机器的格式化uuid必须一样的:
bin/kafka-storage.sh format -t tP0gwpToQbGRypThUKq6mg -c config/kraft/server.properties
4.启动和停止:
启动:nohup bin/kafka-server-start.sh config/kraft/server.properties > kafka.log 2>&1 &
tail -f kafka.log
停止:bin/kafka-server-stop.sh
查看端口:
是否有9092和9093
ss -nlpt
5.验证:
在63机器上执行60机器的创建topic:
bin/kafka-topics.sh --create --topic test --bootstrap-server 192.168.9.60:9092
新建的topic会自动出现在每个机器上
bin/kafka-topics.sh --list --bootstrap-server 192.168.9.60:9092