Commit Graph

38 Commits

Author SHA1 Message Date
ggaborg
fcd2664d2e DBZ-5513 constant for offset.storage prefix 2022-08-17 15:44:39 +02:00
ggaborg
6c3955aa01 DBZ-5513 Simplify passing of SINK config properties to OffsetBackingStore 2022-08-17 15:44:39 +02:00
ggaborg
469d7b9aec DBZ-5035 Redis Sink config properties are not passed to DB history 2022-08-15 13:29:12 +02:00
Vojtech Juranek
43787b8a21 DBZ-5116 Provide more clear message when cannot load config
Example output after the failure:

    $ ./run.sh
    Failed to load mandatory config value 'debezium.sink.type'. Please check you have correct Debezium server config in /home/vjuranek/tmp/debezium-server/conf/application.properties or required properties are defined via system or environment variables.
    {"timestamp":"2022-08-08T13:37:35.848+02:00","sequence":155,"loggerClassName":"org.jboss.logging.Logger","loggerName":"io.quarkus.runtime.Application","level":"ERROR","message":"Failed to start application (with profile prod)","threadName":"main","threadId":1,"mdc":{},"ndc":"","hostName":"fedora","processName":"io.debezium.server.Main","processId":1048188,"exception":{"refId":1,"exceptionType":"java.util.NoSuchElementException","message":"SRCFG00014: The config property debezium.sink.type is required but it could not be found in any config source","frames":[{"class":"io.smallrye.config.SmallRyeConfig","method":"convertValue","line":282},{"class":"io.smallrye.config.SmallRyeConfig","method":"getValue","line":239},{"class":"io.smallrye.config.SmallRyeConfig","method":"getValue","line":167},{"class":"io.debezium.server.DebeziumServer","method":"start","line":104},{"class":"io.debezium.server.DebeziumServer_Bean","method":"create"},{"class":"io.debezium.server.DebeziumServer_Bean","method":"create"},{"class":"io.quarkus.arc.impl.AbstractSharedContext","method":"createInstanceHandle","line":111},{"class":"io.quarkus.arc.impl.AbstractSharedContext$1","method":"get","line":35},{"class":"io.quarkus.arc.impl.AbstractSharedContext$1","method":"get","line":32},{"class":"io.quarkus.arc.impl.LazyValue","method":"get","line":26},{"class":"io.quarkus.arc.impl.ComputingCache","method":"computeIfAbsent","line":69},{"class":"io.quarkus.arc.impl.AbstractSharedContext","method":"get","line":32},{"class":"io.quarkus.arc.impl.ClientProxies","method":"getApplicationScopedDelegate","line":19},{"class":"io.debezium.server.DebeziumServer_ClientProxy","method":"arc$delegate"},{"class":"io.debezium.server.DebeziumServer_ClientProxy","method":"arc_contextualInstance"},{"class":"io.debezium.server.DebeziumServer_Observer_Synthetic_d70cd75bf32ab6598217b9a64a8473d65e248c05","method":"notify"},{"class":"io.quarkus.arc.impl.EventImpl$Notifier","method":"notifyObservers","line":323},{"class":"io.quarkus.arc.impl.EventImpl$Notifier","method":"notify","line":305},{"class":"io.quarkus.arc.impl.EventImpl","method":"fire","line":73},{"class":"io.quarkus.arc.runtime.ArcRecorder","method":"fireLifecycleEvent","line":130},{"class":"io.quarkus.arc.runtime.ArcRecorder","method":"handleLifecycleEvents","line":99},{"class":"io.quarkus.deployment.steps.LifecycleEventsBuildStep$startupEvent1144526294","method":"deploy_0"},{"class":"io.quarkus.deployment.steps.LifecycleEventsBuildStep$startupEvent1144526294","method":"deploy"},{"class":"io.quarkus.runner.ApplicationImpl","method":"doStart"},{"class":"io.quarkus.runtime.Application","method":"start","line":101},{"class":"io.quarkus.runtime.ApplicationLifecycleManager","method":"run","line":103},{"class":"io.quarkus.runtime.Quarkus","method":"run","line":67},{"class":"io.quarkus.runtime.Quarkus","method":"run","line":41},{"class":"io.quarkus.runtime.Quarkus","method":"run","line":120},{"class":"io.debezium.server.Main","method":"main","line":15}]}}
2022-08-08 10:24:56 -04:00
Jiri Pechanec
ad7e65fbac DBZ-5235 Use JMX to get queue size 2022-07-12 16:40:48 +02:00
Ismail Simsek
d84559f147 DBZ-5235 read Debezium metrics from consumer 2022-07-12 16:40:48 +02:00
Vojtech Juranek
db08e894fc DBZ-5045 Remove deprecated TABLE_WHITELIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
f8d4307155 DBZ-5052 Send tombstones only when consumer is able to consume them
Change event consumer may specify if is able to consume tombstones or
not. If the it's not, don't send them. However, connector configuration
takes precence and thus cunsumer capability is taken into account only
when `tombstones.on.delete` is not explicitely configured for the
connector.

Also fix debezium server - setting notifier has to be done once embedded
config already exists, not before it.
2022-05-26 12:40:02 +02:00
Vojtech Juranek
ff6d7007aa DBZ-5105 Allow empty DBZ server config value
An example when empty config value is meaningful is
`debezium.sink.kafka.producer.ssl.endpoint.identification.algorithm`
which means that server host name verification is turned off when
leave empty [1].

[1] https://docs.confluent.io/platform/current/kafka/authentication_ssl.html#optional-settings
2022-05-11 16:01:33 +02:00
zalmane
304d9631af DBZ-4742 update tests 2022-03-31 08:54:46 +02:00
zalmane
9408176bf4 DBZ-4742 support file config provider 2022-03-31 08:54:46 +02:00
zalmane
596142c8b2 DBZ-4864 pass sink properties 2022-03-29 12:40:05 +02:00
Chris Baumbauer
c54d5ebe6a DBZ-2097 Support Knative Eventing 2022-03-03 13:20:27 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Vojtech Juranek
9ca7629f1b DBZ-3570 return non-zero exit code from Debezium server upon failure 2021-11-15 08:07:32 +01:00
Ismail Simsek
912754f19d DBZ-3760 change regexp to more readable equivalent one 2021-08-23 13:26:41 +02:00
Ismail Simsek
62fc087f30 DBZ-3760 fix regexp identifying env vars 2021-08-23 13:26:41 +02:00
Ismail Simsek
76cd5fe25d DBZ-3760 fix regexp identifying env vars 2021-08-23 13:26:41 +02:00
Ismail Simsek
c5f1568b51 DBZ-3760 fix regexp identifying env vars 2021-08-23 13:26:41 +02:00
Jiri Pechanec
4ad69f1037 DBZ-3550 Align with new HealthCheck API 2021-06-08 14:49:04 +02:00
Anisha Mohanty
2509e88eba DBZ-2622 Add test to configure DS via env vars 2021-05-12 10:10:21 +02:00
Anisha Mohanty
9f1469ecd8 DBZ-2622 Configure Debezium Server via smallrye/microprofile env variables 2021-05-12 10:10:21 +02:00
Alfusainey Jallow
ccfc3ccfe8 DBZ-3382 Support pass-through config properties
Signed-off-by: Alfusainey Jallow <alf.jallow@gmail.com>
2021-05-04 09:02:19 +02:00
Jiri Pechanec
3dcd4cf7c8 DBZ-3369 Assert magic byte; add profile 2021-04-09 10:03:18 +02:00
Anisha Mohanty
23fdb179a0 DBZ-3369 Add Schema Registry Lifecycle Manager to test Protobuf converters 2021-04-09 10:03:18 +02:00
Anisha Mohanty
2c8edab2b3 DBZ-2388 Use annotations for skiping apicurio tests 2021-03-31 15:23:15 +02:00
Anisha Mohanty
341ce97479 DBZ-2388 Use separate profile for Apicurio to support tests 2021-03-31 15:23:15 +02:00
Gunnar Morling
dfd7b02554 DBZ-2868 Removing superfluous property definitions 2021-01-12 17:47:16 +01:00
Ismail Simsek
0be379ab79 DBZ-2868 move TestDatabase to debezium-testing-testcontainers project and rename to PostgresTestResourceLifecycleManager 2021-01-12 17:47:16 +01:00
Ismail Simsek
a0ba33fddd DBZ-2868 change TestDatabase to QuarkusTestResource for debezium-server integration tests 2021-01-12 17:47:16 +01:00
hauntingEcho
f867e298cf DBZ-2785 shut down Quarkus server if debezium-server crashes 2020-12-01 18:12:34 +01:00
rkerner
2c5c093587 DBZ-2171 avoid divisive language 2020-08-21 09:29:04 +02:00
Chris Cranford
cee329afbc DBZ-2277 ChangeConsumer indicates if tombstones are to be emitted 2020-08-05 21:24:36 +02:00
Chris Cranford
863896b0de DBZ-2277 Disable tombstones when using Google PubSub sink 2020-08-05 21:24:36 +02:00
abhishek
4059406f25 DBZ-2282 Azure Event Hubs sink adapter for Debezium Server 2020-07-31 15:37:09 +02:00
victorxiang30
2d6301591c
DBZ-2381 ProtoBuf support for Debezium Server 2020-07-29 12:18:26 +02:00
Jiri Pechanec
5aaf4d420d DBZ-2112 Added Pulsar support 2020-06-03 08:57:13 +02:00
Jiri Pechanec
60767a02a0 DBZ-2092 Modularization; test documentation 2020-05-29 18:10:23 +02:00