Commit Graph

7208 Commits

Author SHA1 Message Date
Chris Cranford
b7e2112603 DBZ-5497 Align test behavior 2022-08-19 11:05:29 +02:00
Chris Cranford
37b97970a6 DBZ-5497 Skip truncate operations by default
* Promote truncate skip default from PostgreSQL to core library
* Adjust behavior for Oracle with truncates skipped by default
2022-08-19 11:05:29 +02:00
Chris Cranford
07f05e8659 DBZ-5526 Support JSON-based CHECK conditions 2022-08-19 09:19:43 +02:00
Chris Cranford
304e9b7b47 DBZ-5527 Mark verifyOffsets test as ignored 2022-08-18 16:01:35 -04:00
Chris Cranford
08566262c2 DBZ-5525 Fix test failures - EventProcessingFailureHandlingIT 2022-08-18 16:01:35 -04:00
ggaborg
fcd2664d2e DBZ-5513 constant for offset.storage prefix 2022-08-17 15:44:39 +02:00
ggaborg
6c3955aa01 DBZ-5513 Simplify passing of SINK config properties to OffsetBackingStore 2022-08-17 15:44:39 +02:00
comil4444
6e99431afc [docs] correct cn readme jdk version 2022-08-17 12:33:07 +02:00
debjeetsarkar
f00ac928db DBZ-2663 | Synced with the latest main. 2022-08-17 10:22:23 +02:00
debjeetsarkar
b824c138db DBZ-2663 | Updated with checkstyle fixes.
More Ref:
https://debezium.zulipchat.com/#narrow/stream/302533-dev/topic/Handling.20Transaction.20Payload.20Events.20for.20Mysql/near/289650440
https://github.com/osheroff/mysql-binlog-connector-java/pull/76#issuecomment-1185629635
2022-08-17 10:22:23 +02:00
debjeetsarkar
f41474847d DBZ-2663 | Update mysql binlog connector library and add support for TRANSACTION PAYLOAD EVENT.
More Ref:
https://debezium.zulipchat.com/#narrow/stream/302533-dev/topic/Handling.20Transaction.20Payload.20Events.20for.20Mysql/near/289650440
https://github.com/osheroff/mysql-binlog-connector-java/pull/76#issuecomment-1185629635
2022-08-17 10:22:23 +02:00
Vivek Wassan
d89e71ebeb DBZ-5327 Smart Backfills 2022-08-17 10:05:55 +02:00
harveyyue
a08420b21c DBZ-5511 Keep consistence with method serialize of Connect/Json Table Change Serializer 2022-08-16 16:58:07 +02:00
ggaborg
727e8819e9 DBZ-5506 duplicate call to config.validateAndRecord() in RedisDatabaseHistory 2022-08-16 08:31:48 -04:00
ggaborg
3489217e0d DBZ-5035 updated test 2022-08-15 13:29:12 +02:00
ggaborg
469d7b9aec DBZ-5035 Redis Sink config properties are not passed to DB history 2022-08-15 13:29:12 +02:00
harveyyue
e8a7651d73 DBZ-5508 DDL statement couldn't be parsed : mismatched input 'ENGINE' 2022-08-15 12:03:39 +02:00
harveyyue
5d27e6f9ab DBZ-5505 My connector parse the mariadb relevant sequence statement failed 2022-08-12 11:59:51 +02:00
Chris Cranford
504d5700e3 DBZ-5290 Document SSL usage 2022-08-11 13:28:45 +02:00
Chris Cranford
8f91e0874e DBZ-5290 Use SSL for SQL Server tests 2022-08-11 13:28:45 +02:00
Chris Cranford
636ee54eae DBZ-5290 Upgrade SQL Server driver to 10.2.1.jre8 2022-08-11 13:28:45 +02:00
Chris Cranford
58177b4685 DBZ-5488 Support undocumented DATAPUMP DDL clauses 2022-08-11 09:36:52 +02:00
Chris Cranford
9ae17f5164 DBZ-5501 Force snapshot updates when building UI 2022-08-10 17:57:11 -04:00
Chris Cranford
0290852702 DBZ-5463 Upgrade Kafka to 3.2.1 2022-08-10 09:40:01 +02:00
harveyyue
831fadc09a DBZ-5499 Mysql connector parser the ddl statement failed when including keyword "buckets" 2022-08-10 09:37:23 +02:00
Bob Roldan
0a3d182537 DBZ-4345 Adjust position of entry in configuration properties table 2022-08-09 12:48:46 -04:00
Bob Roldan
1670753cd9 DBZ-4345 Document snapshot.include.collection.list property for Db2 2022-08-09 12:48:46 -04:00
Chris Cranford
f549ebd390 DBZ-5493 Upgrade PostgreSQL driver to 42.4.1 2022-08-09 15:26:23 +02:00
Chris Cranford
fcb845024f DBZ-5483 Fix testStopSnapshotKafkaSignal random failure 2022-08-08 15:55:56 -04:00
Vojtech Juranek
43787b8a21 DBZ-5116 Provide more clear message when cannot load config
Example output after the failure:

    $ ./run.sh
    Failed to load mandatory config value 'debezium.sink.type'. Please check you have correct Debezium server config in /home/vjuranek/tmp/debezium-server/conf/application.properties or required properties are defined via system or environment variables.
    {"timestamp":"2022-08-08T13:37:35.848+02:00","sequence":155,"loggerClassName":"org.jboss.logging.Logger","loggerName":"io.quarkus.runtime.Application","level":"ERROR","message":"Failed to start application (with profile prod)","threadName":"main","threadId":1,"mdc":{},"ndc":"","hostName":"fedora","processName":"io.debezium.server.Main","processId":1048188,"exception":{"refId":1,"exceptionType":"java.util.NoSuchElementException","message":"SRCFG00014: The config property debezium.sink.type is required but it could not be found in any config source","frames":[{"class":"io.smallrye.config.SmallRyeConfig","method":"convertValue","line":282},{"class":"io.smallrye.config.SmallRyeConfig","method":"getValue","line":239},{"class":"io.smallrye.config.SmallRyeConfig","method":"getValue","line":167},{"class":"io.debezium.server.DebeziumServer","method":"start","line":104},{"class":"io.debezium.server.DebeziumServer_Bean","method":"create"},{"class":"io.debezium.server.DebeziumServer_Bean","method":"create"},{"class":"io.quarkus.arc.impl.AbstractSharedContext","method":"createInstanceHandle","line":111},{"class":"io.quarkus.arc.impl.AbstractSharedContext$1","method":"get","line":35},{"class":"io.quarkus.arc.impl.AbstractSharedContext$1","method":"get","line":32},{"class":"io.quarkus.arc.impl.LazyValue","method":"get","line":26},{"class":"io.quarkus.arc.impl.ComputingCache","method":"computeIfAbsent","line":69},{"class":"io.quarkus.arc.impl.AbstractSharedContext","method":"get","line":32},{"class":"io.quarkus.arc.impl.ClientProxies","method":"getApplicationScopedDelegate","line":19},{"class":"io.debezium.server.DebeziumServer_ClientProxy","method":"arc$delegate"},{"class":"io.debezium.server.DebeziumServer_ClientProxy","method":"arc_contextualInstance"},{"class":"io.debezium.server.DebeziumServer_Observer_Synthetic_d70cd75bf32ab6598217b9a64a8473d65e248c05","method":"notify"},{"class":"io.quarkus.arc.impl.EventImpl$Notifier","method":"notifyObservers","line":323},{"class":"io.quarkus.arc.impl.EventImpl$Notifier","method":"notify","line":305},{"class":"io.quarkus.arc.impl.EventImpl","method":"fire","line":73},{"class":"io.quarkus.arc.runtime.ArcRecorder","method":"fireLifecycleEvent","line":130},{"class":"io.quarkus.arc.runtime.ArcRecorder","method":"handleLifecycleEvents","line":99},{"class":"io.quarkus.deployment.steps.LifecycleEventsBuildStep$startupEvent1144526294","method":"deploy_0"},{"class":"io.quarkus.deployment.steps.LifecycleEventsBuildStep$startupEvent1144526294","method":"deploy"},{"class":"io.quarkus.runner.ApplicationImpl","method":"doStart"},{"class":"io.quarkus.runtime.Application","method":"start","line":101},{"class":"io.quarkus.runtime.ApplicationLifecycleManager","method":"run","line":103},{"class":"io.quarkus.runtime.Quarkus","method":"run","line":67},{"class":"io.quarkus.runtime.Quarkus","method":"run","line":41},{"class":"io.quarkus.runtime.Quarkus","method":"run","line":120},{"class":"io.debezium.server.Main","method":"main","line":15}]}}
2022-08-08 10:24:56 -04:00
harveyyue
78cb8e5890 DBZ-5485 Support wait/nowait clause in mariadb 2022-08-07 11:54:01 -04:00
harveyyue
f86c88477a DBZ-5487 Adapt create function syntax of mariadb 2022-08-07 11:43:36 -04:00
Sergei Morozov
8f0f9fe3ed DBZ-5477: Remove SQL Server connector SourceTimestampMode 2022-08-05 12:26:39 -04:00
Vojtech Juranek
8e0ad245e5 DBZ-5475 Ensure Outbox JSON NUMBER arrays are of the same type 2022-08-05 11:00:46 -04:00
Vojtech Juranek
7256f62f6b DBZ-5475 Remove unneeded checks from Outbox payload conversion
* remove float check as we return `float64` by default anyway
* simplify/narrow the checks when detemining array type, also add a test
  for array having the first element `null`
2022-08-05 11:00:46 -04:00
nicholas-fwang
58a91cddb4 DBZ-5479 Retry MongoNodeIsRecoveringException when failover 2022-08-05 10:52:46 -04:00
Vojtech Juranek
db446f85c4 DBZ-4329 Don't send fileds with obsolete values
During incremental snapshot fields `xmin`, `lsn` and `txId` are not
updated and therefore we stream obsolete values from previous records
in `source` struct. Don't include these obsolete value in the `source`
struct during incremental snapshot.
2022-08-05 10:23:47 -04:00
Sergei Morozov
fc7910e1a4 DBZ-5478: Restart SQL Server task on "Socket closed" exception 2022-08-05 10:16:27 -04:00
Chris Cranford
f8e67e3ff9 DBZ-5453 Add stop-snapshot MySQL read-only Kafka signal 2022-08-04 16:16:42 -04:00
Chris Cranford
d4261bd2fd DBZ-5476 Fix record accumulator during statistics log entry 2022-08-04 15:28:46 -04:00
Chris Cranford
22c0892ae2 DBZ-5472 Support CREATE INDEX using TABLESPACE with quoted identifiers 2022-08-04 15:21:05 -04:00
Martin Medek
f7001f47fe DBZ-5165 refactor, returned deployment-template, testsuite-helper no longer needed 2022-08-04 19:04:56 +02:00
Martin Medek
fc6d394df9 DBZ-5165 when running from OCP don't create kafka external service, removed testsuite-deployment script and inlined the ocp job descriptor creation to pipelone 2022-08-04 19:04:56 +02:00
Martin Medek
3405c49c41 DBZ-5165 refactoring the testsuite in OCP so that preparations are done in jenkins job and in OCP project is only cloned, build and ran 2022-08-04 19:04:56 +02:00
Martin Medek
3c7f26b611 DBZ-5165 fixing comments from code review 2022-08-04 19:04:56 +02:00
Martin Medek
301ecd4cbb DBZ-5165 checkstyle 2022-08-04 19:04:56 +02:00
Martin Medek
a0b414e2a8 DBZ-5165 cleanup of forsaken changes 2022-08-04 19:04:56 +02:00
Martin Medek
8eeab0802c DBZ-5165 refactoring the jenkins jobs, removing need for secret name specification 2022-08-04 19:04:56 +02:00
Martin Medek
7216569677 DBZ-5165 Fixed the copy secret action, refactor 2022-08-04 19:04:56 +02:00
Martin Medek
26d793bae4 DBZ-5165 Removed the java changes enabling using secret name instead of path 2022-08-04 19:04:56 +02:00