mirror of
https://github.com/apache/camel-kafka-connector.git
synced 2026-11-06 10:16:40 +00:00
Camel Kafka Connector allows you to use all Camel components as Kafka Connect connectors
https://camel.apache.org
- Java 99.3%
- Shell 0.7%
| Filename | Latest commit message | Latest commit date |
|---|---|---|
b240c5503b
Some checks are pending
The source task receives exchanges through seda:end, but the camel.source.pollingConsumer* options were only added to its URI as the generic DefaultEndpoint polling-consumer options, which SedaEndpoint ignores. The queue kept SEDA's defaults (size 1000, blockWhenFull=false), so a burst failed with IllegalStateException: Queue full. Pass the values as SEDA's own size, blockWhenFull and offerTimeout options too. A negative pollingConsumerBlockTimeout is clamped to 0, since a negative offerTimeout makes SEDA fall back to add() and throw when full; the option is documented as "0 or negative means no timeout". Behaviour change: with the default blockWhenFull=true the Camel consumer thread now blocks while the queue is full, and the endpoint size takes precedence over camel.component.seda.queueSize. A consumer blocked on a full queue holds an in-flight exchange, so stopping the task can wait up to camel.main.shutdownTimeout, longer than Kafka Connect's default task.shutdown.graceful.timeout.ms of 5s. The user guide documents this. Signed-off-by: Brian Hayden <5826711+bhayden53@users.noreply.github.com> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> |
||
| .github | ||
| .mvn | ||
| .oss-ai-helper-rules | ||
| archetypes | ||
| buildingtools | ||
| camel-kafka-connector-catalog | ||
| config | ||
| connectors | ||
| core | ||
| distribution | ||
| docs | ||
| examples | ||
| parent | ||
| release-utils | ||
| tests | ||
| tooling | ||
| .asf.yaml | ||
| .gitignore | ||
| .gitmodules | ||
| AGENTS.md | ||
| CHANGELOG.md | ||
| Jenkinsfile | ||
| Jenkinsfile.deploy | ||
| Jenkinsfile.jdk17 | ||
| KEYS | ||
| LICENSE.txt | ||
| mvnw | ||
| mvnw.cmd | ||
| NOTICE.txt | ||
| pom.xml | ||
| README.adoc | ||
| SECURITY.md | ||
= Camel Kafka Connector image:https://img.shields.io/badge/zulip-join_chat-brightgreen.svg["Chat on Zulip", link="https://camel.zulipchat.com"] image:https://github.com/apache/camel-kafka-connector/workflows/master%20build/badge.svg[Master Build, link="https://github.com/apache/camel-kafka-connector/actions?query=workflow%3A%22master+build%22"] == Introduction [NOTE] ==== This project is mostly based on the Kamelets catalog we are providing in https://github.com/apache/camel-kamelets The connectors released in this repository are based on Kamelets catalog. ==== This is a "Camel Kafka connector adapter" that aims to provide a user-friendly way to use all Apache Camel components in Kafka Connect. For more information about Kafka Connect take a look http://kafka.apache.org/documentation/#connect[here]. == Build the project [source,bash] ---- mvn clean package ---- == Run integration tests To run the integration tests it is required to: * have Docker version 17.05 or higher running * then run: + [source,bash] ---- mvn -DskipIntegrationTests=false clean verify package ---- It is also possible to point the tests to use an external services. Please check the link:./docs/modules/ROOT/pages/testing.adoc[testing guide]. == Documentation Read the https://camel.apache.org/camel-kafka-connector/latest/index.html[Official latest documentation] or try the local link:./docs/modules/ROOT/pages/user-guide/index.adoc[Getting started guide].