🎄Twelve Days of SMT 🎄 - Day 10: ReplaceField
The ReplaceField Single Message Transform has three modes of operation on fields of data passing through Kafka Connect, either in a Source connector or Sink connector.
Include only the fields specified in the list (`whitelist`)
Include all fields except the ones specified (`blacklist`)
Rename field(s) (`renames`)
---
👾 Demo code and details: https://github.com/confluentinc/demo-...
🗒️ SMT reference: https://docs.confluent.io/platform/cu...
Learn more about Kafka Connect here:
🏃♂️ Quick: • Kafka Connect in 60 seconds
🚶 More detail: https://rmoff.dev/kafka-connect-zero-...
---
⏱️ Time codes:
00:00:00 Introduction to the ReplaceField transformation
00:02:21 KIP-629: Use racially neutral terms in our codebase
00:02:35 Excluding fields from messages passing through Kafka Connect
00:02:53 Mask vs Exclude
00:03:47 Include only listed fields of a message as it passes through Kafka Connect
00:04:22 Should you use Transforms in the source, or the sink?
00:05:57 Using the include / whitelist configuration
00:08:46 Renaming fields in a message with ReplaceField
00:11:16 Recap
---
☁️ Confluent Cloud: https://confluent.cloud/signup?utm_so...
💾Download Confluent Platform: https://www.confluent.io/download/?ut...
📺 Kafka Connect connector deep-dives: • Kafka Connect
✍️Kafka Connect documentation: https://docs.confluent.io/current/con...
🧩Confluent Hub: https://www.confluent.io/hub/?utm_sou...
Watch video 🎄Twelve Days of SMT 🎄 - Day 10: ReplaceField online without registration, duration hours minute second in high quality. This video was added by user Robin Moffatt 21 December 2020, don't forget to share it with your friends and acquaintances, it has been viewed on our site 1,11 once and liked it 2 people.