Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate connectors to kafka 3.6.x plugin discovery #1633

Open
davsclaus opened this issue May 8, 2024 · 2 comments
Open

Migrate connectors to kafka 3.6.x plugin discovery #1633

davsclaus opened this issue May 8, 2024 · 2 comments
Milestone

Comments

@davsclaus
Copy link
Contributor

https://kafka.apache.org/documentation.html#connect_plugindiscovery

[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.776 s <<< FAILURE! - in org.apache.camel.kafkaconnector.cassandra.sink.CamelSinkCassandraITCase
[ERROR] org.apache.camel.kafkaconnector.cassandra.sink.CamelSinkCassandraITCase Time elapsed: 0.776 s <<< ERROR!
org.apache.kafka.connect.errors.ConnectException:
One or more plugins are missing ServiceLoader manifests may not be usable with plugin.discovery=service_load: [
classpath io.apicurio.registry.utils.converter.AvroConverter converter undefined
classpath io.apicurio.registry.utils.converter.ExtJsonConverter converter undefined
classpath io.apicurio.registry.utils.converter.SchemalessConverter converter undefined
classpath org.apache.camel.kafkaconnector.CamelSinkConnector sink 4.4.2-SNAPSHOT
classpath org.apache.camel.kafkaconnector.CamelSourceConnector source 4.4.2-SNAPSHOT
file:/Users/davsclaus/workspace/camel-kafka-connector/connectors/camel-cassandra-sink-kafka-connector/target/classes/ org.apache.camel.kafkaconnector.cassandrasink.CamelCassandrasinkSinkConnector sink 4.4.2-SNAPSHOT
classpath org.apache.camel.kafkaconnector.transforms.CamelTypeConverterTransform$Key transformation undefined
classpath org.apache.camel.kafkaconnector.transforms.CamelTypeConverterTransform$Value transformation undefined
classpath org.apache.camel.kafkaconnector.transforms.ConnectRecordValueToMapTransforms transformation undefined
classpath org.apache.camel.kafkaconnector.transforms.FieldsToHeadersTransform$Key transformation undefined
classpath org.apache.camel.kafkaconnector.transforms.FieldsToHeadersTransform$Value transformation undefined
classpath org.apache.camel.kafkaconnector.transforms.SchemaAndStructToJsonTransform transformation undefined
classpath org.apache.camel.kafkaconnector.transforms.SinkPojoToSchemaAndStructTransform transformation undefined
classpath org.apache.camel.kafkaconnector.transforms.SourcePojoToSchemaAndStructTransform transformation undefined
]
Read the documentation at https://kafka.apache.org/documentation.html#connect_plugindiscovery for instructions on migrating your plugins to take advantage of the performance improvements of service_load mode. To silence this error, set plugin.discovery=hybrid_warn in the worker config.
at org.apache.camel.kafkaconnector.cassandra.sink.CamelSinkCassandraITCase.(CamelSinkCassandraITCase.java:45)

@davsclaus
Copy link
Contributor Author

This works on the older kafka 3.5.x base, so we need to migrate for 3.6.x onwards.

@davsclaus davsclaus added this to the 4.4.0 milestone May 8, 2024
@davsclaus
Copy link
Contributor Author

We have a hybrid discovery now. But I think it would be good to migrate to new style in the future and to drop hybrid

@oscerd oscerd modified the milestones: 4.4.0, 4.4.3 Sep 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants