Commit Graph

7521 Commits

Author SHA1 Message Date
jcechace
21ed5f9b9f DBZ-4733 Refactor ReplicaSets.parse into more readable form 2022-08-19 12:55:58 +02:00
jcechace
752062c1a3 DBZ-4733 Fixed thread safety of MongoClients 2022-08-19 12:55:58 +02:00
jcechace
1d9d75754c DBZ-4733 Refactoring ReplicaSetDiscovery to properly use mongodb driver 4.x 2022-08-19 12:55:58 +02:00
jcechace
3a385aa768 DBZ-4733 Refactoring: unified client factory method names 2022-08-19 12:55:58 +02:00
jcechace
cc04a94fd5 DBZ-4733 Ininital connection string filed introduction 2022-08-19 12:55:58 +02:00
Chris Cranford
176529e83b DBZ-5521 Fix concatenation operator handling in LogMiner DML parser 2022-08-19 11:19:45 +02:00
ggaborg
41ebaa871c DBZ-4631 check SQLServer Agent status only once 2022-08-19 11:09:15 +02:00
ggaborg
80a02f280e DBZ-4631 fix whitespace 2022-08-19 11:09:15 +02:00
ggaborg
a9d0736c75 DBZ-4631 formatting 2022-08-19 11:09:15 +02:00
ggaborg
9676af7a93 DBZ-4631 fix compilation error "text blocks are not supported in -source 11" 2022-08-19 11:09:15 +02:00
ggaborg
0181122274 DBZ-4631 Fix "No maximum LSN recorded" log message can be spammed on low-activity databases 2022-08-19 11:09:15 +02:00
Sergei Morozov
1c99437890 DBZ-5470: Remove the dependency of JdbcConnection on DatabaseSchema 2022-08-19 11:06:59 +02:00
Chris Cranford
b25dae6a0a DBZ-5497 Fix skipped operations logic for SQL Server 2022-08-19 11:05:29 +02:00
Chris Cranford
b7e2112603 DBZ-5497 Align test behavior 2022-08-19 11:05:29 +02:00
Chris Cranford
37b97970a6 DBZ-5497 Skip truncate operations by default
* Promote truncate skip default from PostgreSQL to core library
* Adjust behavior for Oracle with truncates skipped by default
2022-08-19 11:05:29 +02:00
Chris Cranford
07f05e8659 DBZ-5526 Support JSON-based CHECK conditions 2022-08-19 09:19:43 +02:00
Chris Cranford
304e9b7b47 DBZ-5527 Mark verifyOffsets test as ignored 2022-08-18 16:01:35 -04:00
Chris Cranford
08566262c2 DBZ-5525 Fix test failures - EventProcessingFailureHandlingIT 2022-08-18 16:01:35 -04:00
ggaborg
fcd2664d2e DBZ-5513 constant for offset.storage prefix 2022-08-17 15:44:39 +02:00
ggaborg
6c3955aa01 DBZ-5513 Simplify passing of SINK config properties to OffsetBackingStore 2022-08-17 15:44:39 +02:00
comil4444
6e99431afc [docs] correct cn readme jdk version 2022-08-17 12:33:07 +02:00
debjeetsarkar
f00ac928db DBZ-2663 | Synced with the latest main. 2022-08-17 10:22:23 +02:00
debjeetsarkar
b824c138db DBZ-2663 | Updated with checkstyle fixes.
More Ref:
https://debezium.zulipchat.com/#narrow/stream/302533-dev/topic/Handling.20Transaction.20Payload.20Events.20for.20Mysql/near/289650440
https://github.com/osheroff/mysql-binlog-connector-java/pull/76#issuecomment-1185629635
2022-08-17 10:22:23 +02:00
debjeetsarkar
f41474847d DBZ-2663 | Update mysql binlog connector library and add support for TRANSACTION PAYLOAD EVENT.
More Ref:
https://debezium.zulipchat.com/#narrow/stream/302533-dev/topic/Handling.20Transaction.20Payload.20Events.20for.20Mysql/near/289650440
https://github.com/osheroff/mysql-binlog-connector-java/pull/76#issuecomment-1185629635
2022-08-17 10:22:23 +02:00
Vivek Wassan
d89e71ebeb DBZ-5327 Smart Backfills 2022-08-17 10:05:55 +02:00
harveyyue
a08420b21c DBZ-5511 Keep consistence with method serialize of Connect/Json Table Change Serializer 2022-08-16 16:58:07 +02:00
ggaborg
727e8819e9 DBZ-5506 duplicate call to config.validateAndRecord() in RedisDatabaseHistory 2022-08-16 08:31:48 -04:00
ggaborg
3489217e0d DBZ-5035 updated test 2022-08-15 13:29:12 +02:00
ggaborg
469d7b9aec DBZ-5035 Redis Sink config properties are not passed to DB history 2022-08-15 13:29:12 +02:00
harveyyue
e8a7651d73 DBZ-5508 DDL statement couldn't be parsed : mismatched input 'ENGINE' 2022-08-15 12:03:39 +02:00
harveyyue
5d27e6f9ab DBZ-5505 My connector parse the mariadb relevant sequence statement failed 2022-08-12 11:59:51 +02:00
Chris Cranford
504d5700e3 DBZ-5290 Document SSL usage 2022-08-11 13:28:45 +02:00
Chris Cranford
8f91e0874e DBZ-5290 Use SSL for SQL Server tests 2022-08-11 13:28:45 +02:00
Chris Cranford
636ee54eae DBZ-5290 Upgrade SQL Server driver to 10.2.1.jre8 2022-08-11 13:28:45 +02:00
Chris Cranford
58177b4685 DBZ-5488 Support undocumented DATAPUMP DDL clauses 2022-08-11 09:36:52 +02:00
Chris Cranford
9ae17f5164 DBZ-5501 Force snapshot updates when building UI 2022-08-10 17:57:11 -04:00
Chris Cranford
0290852702 DBZ-5463 Upgrade Kafka to 3.2.1 2022-08-10 09:40:01 +02:00
harveyyue
831fadc09a DBZ-5499 Mysql connector parser the ddl statement failed when including keyword "buckets" 2022-08-10 09:37:23 +02:00
Bob Roldan
0a3d182537 DBZ-4345 Adjust position of entry in configuration properties table 2022-08-09 12:48:46 -04:00
Bob Roldan
1670753cd9 DBZ-4345 Document snapshot.include.collection.list property for Db2 2022-08-09 12:48:46 -04:00
Chris Cranford
f549ebd390 DBZ-5493 Upgrade PostgreSQL driver to 42.4.1 2022-08-09 15:26:23 +02:00
Chris Cranford
fcb845024f DBZ-5483 Fix testStopSnapshotKafkaSignal random failure 2022-08-08 15:55:56 -04:00
Vojtech Juranek
43787b8a21 DBZ-5116 Provide more clear message when cannot load config
Example output after the failure:

    $ ./run.sh
    Failed to load mandatory config value 'debezium.sink.type'. Please check you have correct Debezium server config in /home/vjuranek/tmp/debezium-server/conf/application.properties or required properties are defined via system or environment variables.
    {"timestamp":"2022-08-08T13:37:35.848+02:00","sequence":155,"loggerClassName":"org.jboss.logging.Logger","loggerName":"io.quarkus.runtime.Application","level":"ERROR","message":"Failed to start application (with profile prod)","threadName":"main","threadId":1,"mdc":{},"ndc":"","hostName":"fedora","processName":"io.debezium.server.Main","processId":1048188,"exception":{"refId":1,"exceptionType":"java.util.NoSuchElementException","message":"SRCFG00014: The config property debezium.sink.type is required but it could not be found in any config source","frames":[{"class":"io.smallrye.config.SmallRyeConfig","method":"convertValue","line":282},{"class":"io.smallrye.config.SmallRyeConfig","method":"getValue","line":239},{"class":"io.smallrye.config.SmallRyeConfig","method":"getValue","line":167},{"class":"io.debezium.server.DebeziumServer","method":"start","line":104},{"class":"io.debezium.server.DebeziumServer_Bean","method":"create"},{"class":"io.debezium.server.DebeziumServer_Bean","method":"create"},{"class":"io.quarkus.arc.impl.AbstractSharedContext","method":"createInstanceHandle","line":111},{"class":"io.quarkus.arc.impl.AbstractSharedContext$1","method":"get","line":35},{"class":"io.quarkus.arc.impl.AbstractSharedContext$1","method":"get","line":32},{"class":"io.quarkus.arc.impl.LazyValue","method":"get","line":26},{"class":"io.quarkus.arc.impl.ComputingCache","method":"computeIfAbsent","line":69},{"class":"io.quarkus.arc.impl.AbstractSharedContext","method":"get","line":32},{"class":"io.quarkus.arc.impl.ClientProxies","method":"getApplicationScopedDelegate","line":19},{"class":"io.debezium.server.DebeziumServer_ClientProxy","method":"arc$delegate"},{"class":"io.debezium.server.DebeziumServer_ClientProxy","method":"arc_contextualInstance"},{"class":"io.debezium.server.DebeziumServer_Observer_Synthetic_d70cd75bf32ab6598217b9a64a8473d65e248c05","method":"notify"},{"class":"io.quarkus.arc.impl.EventImpl$Notifier","method":"notifyObservers","line":323},{"class":"io.quarkus.arc.impl.EventImpl$Notifier","method":"notify","line":305},{"class":"io.quarkus.arc.impl.EventImpl","method":"fire","line":73},{"class":"io.quarkus.arc.runtime.ArcRecorder","method":"fireLifecycleEvent","line":130},{"class":"io.quarkus.arc.runtime.ArcRecorder","method":"handleLifecycleEvents","line":99},{"class":"io.quarkus.deployment.steps.LifecycleEventsBuildStep$startupEvent1144526294","method":"deploy_0"},{"class":"io.quarkus.deployment.steps.LifecycleEventsBuildStep$startupEvent1144526294","method":"deploy"},{"class":"io.quarkus.runner.ApplicationImpl","method":"doStart"},{"class":"io.quarkus.runtime.Application","method":"start","line":101},{"class":"io.quarkus.runtime.ApplicationLifecycleManager","method":"run","line":103},{"class":"io.quarkus.runtime.Quarkus","method":"run","line":67},{"class":"io.quarkus.runtime.Quarkus","method":"run","line":41},{"class":"io.quarkus.runtime.Quarkus","method":"run","line":120},{"class":"io.debezium.server.Main","method":"main","line":15}]}}
2022-08-08 10:24:56 -04:00
harveyyue
78cb8e5890 DBZ-5485 Support wait/nowait clause in mariadb 2022-08-07 11:54:01 -04:00
harveyyue
f86c88477a DBZ-5487 Adapt create function syntax of mariadb 2022-08-07 11:43:36 -04:00
Sergei Morozov
8f0f9fe3ed DBZ-5477: Remove SQL Server connector SourceTimestampMode 2022-08-05 12:26:39 -04:00
Vojtech Juranek
8e0ad245e5 DBZ-5475 Ensure Outbox JSON NUMBER arrays are of the same type 2022-08-05 11:00:46 -04:00
Vojtech Juranek
7256f62f6b DBZ-5475 Remove unneeded checks from Outbox payload conversion
* remove float check as we return `float64` by default anyway
* simplify/narrow the checks when detemining array type, also add a test
  for array having the first element `null`
2022-08-05 11:00:46 -04:00
nicholas-fwang
58a91cddb4 DBZ-5479 Retry MongoNodeIsRecoveringException when failover 2022-08-05 10:52:46 -04:00
Vojtech Juranek
db446f85c4 DBZ-4329 Don't send fileds with obsolete values
During incremental snapshot fields `xmin`, `lsn` and `txId` are not
updated and therefore we stream obsolete values from previous records
in `source` struct. Don't include these obsolete value in the `source`
struct during incremental snapshot.
2022-08-05 10:23:47 -04:00