Kafka - simple way to copy data from one topic to another

DevOps Kafka
1

Hi, looking for a simple way to copy data from one topic to another in the same cluster. can I use Replicator to do this … I see it is backed by a Kafka connect

2

> same cluster
Don’t use replicator. Use Kafka Streams

3

Or a ksqlDB INSERT … SELECT … statement.

4

Yeah … ksql seems to be the no code option … thnq

5

You’re welcome.

Oh, you’re probably going to want SET 'auto.offset.reset' = 'earliest'; if you want to start copying from the first event in the topic. Otherwise it’ll only copy new events.

6

Hi … it looks like ksql is trying to force avro field names to be upper when writing … is there a workaround without being explicitly defining schema in my persistent query…

appreciate your help

7

Ah yes , backprimes will force ksqlDB to preserve the case you specify. For example:

  `username` STRING
) ...```
8

I think schema inference solved my issue … Thnx … didnt want to explicitly define schema in ksql

9

Fair enough. Glad you got it solved. :slightly_smiling_face: