AWS msk kafka tutorial | Access IAM authentication
AWS msk kafka tutorial. In this video, we are going to demostrate how to access an IAM auth enabled MSK kafka cluster.
Get the scripts here: https://github.com/maxcotec/aws-IAM-a...
#maxcoteclearning #aws #awsmsk #awsiam #kafka
timeline;
00:00 intro
00:25 outline
00:48 opening
00:54 setup kafka cluster
01:46 Create IAM policies and Users
02:43 Create machine where to test access kafka
04:12 Prepare machine
06:08 export IAM user
06:56 create kafka topics
08:42 spin kafka producer
09:41 spin kafka consumer
11:21 test end-to-end
11:39 outro
Common Issues/Errors:
1. @07:57 -
Error: Uncaught Exception in thread 'kafka-admin-client-thread java.lang.OutOfMemoryError: Javaheap space'
Reason: Caused because we didn't provided client.properties files with kafka-topics.sh script. provide the following option when running kafka-topics.sh script; `--command-config ./kafka_2.12-3.4.1/client.properties`
2. @09:17
Error: Bootstrap-broker (id: -1 rack: null) disconnected
Reason: Again caused due to not providing client-properties file. provide the following option when running kafka-console-producer.sh script; `--producer.config kafka_2.12-3.4.1/client.properties`
3. @10:48
Error: Not authorised to access group
Reason: because we have restricted consumer IAM user to access group named `reader-group`, thats why we have to specifically provide consumer group name with kafka-console-consumer.sh script. `--consumer.config kafka_2.12-3.4.1/client.properties --group reader-group`
Смотрите видео AWS msk kafka tutorial | Access IAM authentication онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь MaxcoTec Learning 01 Январь 1970, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 3,357 раз и оно понравилось 30 людям.