hello! is it possible to use cluster linking between onprem cluster(source) and cfk(destination)?
Sorry, I should have read the question instead answering at a stop light.
There’s other trade offs, but some might be advantageous depending on your needs
we have 2 clusters and I thought mirroring a topic should work between onprem on cfk with cluster linking. my question was more of a concern because afaik this might not work with cfk but more with confluent cloud.
https://docs.confluent.io/platform/current/multi-dc-deployments/cluster-linking/configs.html#using-cluster-linking-with-co-long
It looks like the destination cluster(cfk) it’s not reaching the onprem:
Failed to create reverse connection for requestId=421
org.apache.kafka.common.errors.NetworkException: Request cannot be forwarded to remote link coordinator because persistent connection is not yet available
Clustering link will work between two clusters, but there are some constraints around versions.
What versions are you using for the on-premises (source) and CFK (destination)?
onprem - 7.4, cfk - 7.6.2
we’re probably missing something in the SSL configuration. we’re using jks for the mTLS communication.
when using cfk with network encryption do I also need to define the password.encoder.secret ?
“Configure destination Kafka security
The destination Kafka brokers must be configured with password.encoder.secret for encrypting sensitive link configurations when security is enabled, such as certificates and password for SASL/PLAIN, mTLS, or TLS mode.”
[2024-07-31T15:05:27.870+0200] WARN [ClusterLinkMetadataClient clusterlink-demo-source-broker-101}] Connection to node 2 terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)
7.4 - > 7.6.2 works. but you should consult the documentation https://docs.confluent.io/platform/current/multi-dc-deployments/cluster-linking/index.html
