Commit Graph

7214 Commits

Author SHA1 Message Date
Vojtech Juranek
75e5675375 DBZ-5307 Retry upon failure when sending to HTTP sink
If sending record to HTTP consumer fails, retry sending couple of times
and fail eventually. Retrying immdiatelly usually have no effect,
therefore sleep some time between retries.

Intorduce new config option to `HttpChangeConsumer`:
* `retries` - number of retries before exception is throws
* `retry.interval.ms` - amount of time to sleep before next retry
2022-07-28 14:19:13 -04:00
Vojtech Juranek
0e165834bd DBZ-5307 Add method for resetting WireMock
Normally WireMock is reset after each test. However, as we run WireMock
as a container, it's not reset and we have to do so manully. Add
a method which resets WireMock by sending HTTP request.
2022-07-28 14:19:13 -04:00
Vojtech Juranek
72f8388bba DBZ-5307 Refactor HttpChangeConsumer
Refactor HttpChangeConsumer and its test to prepare for further changes
in follow-up patch. Move sending of records into separate method. Also
assert events in the tests in dedicated method.
2022-07-28 14:19:13 -04:00
harveyyue
5f430f1a8e DBZ-5457 Deprecate legacy topic selector for all connectors 2022-07-28 12:58:59 -04:00
Gunnar Morling
a288e2803a [docs] Removing obsolete ZK reference from tutorial 2022-07-27 12:39:20 -04:00
Gunnar Morling
31ade1dda0 [docs] Avoiding reference to Guava types 2022-07-27 12:19:56 -04:00
Martin Medek
2cb482fe17 DBZ-5412 changed mailer to debezium-qe 2022-07-27 13:25:59 +02:00
Martin Medek
9a0c0e05cf DBZ-5412 replaced the old Oracle connector tests job with new one 2022-07-27 13:25:59 +02:00
Martin Medek
0f3b648e64 DBZ-5412 added new job to run oracle connector matrix as real matrix job 2022-07-27 13:25:59 +02:00
ggaborg
2c8d71a36f DBZ-5452 Fix unit test failing on Windows platform 2022-07-26 15:50:28 -04:00
gongzhongqiang
7000f06aac DBZ-5450 Typo in postgresql document. 2022-07-26 15:45:53 -04:00
Debezium Builder
d1ae85d7f0 [release] Development version for testing module deps 2022-07-26 18:35:31 +00:00
Debezium Builder
1ab51ae8d0 [maven-release-plugin] prepare for next development iteration 2022-07-26 18:13:10 +00:00
Debezium Builder
d247a48b79 [maven-release-plugin] prepare release v2.0.0.Beta1 2022-07-26 18:13:09 +00:00
Debezium Builder
f0ef85f1dc [release] Stable 2.0.0.Beta1 for testing module deps 2022-07-26 18:06:30 +00:00
Chris Cranford
cf92aa2dcc
[release] Update contributor aliases 2022-07-26 13:58:16 -04:00
Chris Cranford
200776524a [release] Changelog for 2.0.0.Beta1 2022-07-26 13:53:00 -04:00
harveyyue
8d76ba217f DBZ-5333 Caused by: java.io.EOFException: Failed to read next byte from position 2005308603 2022-07-26 11:10:29 -04:00
Chris Cranford
412498db41
DBZ-5295 Avoid NPE With Xstream emitter 2022-07-26 11:05:17 -04:00
Chris Cranford
fe5232dedf DBZ-5446 Upgrade impsort-maven-plugin to 1.7.0 2022-07-25 15:00:21 -04:00
Chris Cranford
f612f3f677 DBZ-5445 Upgrade formatter-maven-plugin to 2.20.0 2022-07-25 14:59:59 -04:00
harveyyue
6534385a1c DBZ-5292 Treat SQLServerException with "Broken pipe (Write failed)" exception message as a retriable exception 2022-07-25 13:09:41 -04:00
Chris Cranford
de4d8e17d3 DBZ-5371 Check for $natural not supported, treat as no oplog entry 2022-07-25 10:20:46 -04:00
harveyyue
187ccb25db DBZ-5398 The column is referenced as PRIMARY KEY, but a matching column is not defined in table 2022-07-25 10:11:43 -04:00
Chris Cranford
46753e90e5 DBZ-5440 Update COPYRIGHT.txt 2022-07-25 08:27:48 -04:00
gongzhongqiang
6f1fb9701f DBZ-5440 Fix typo in sqlserver document. 2022-07-25 08:27:48 -04:00
Chris Cranford
33e1498152 DBZ-5427 Upgrade to Quarkus 2.11.0.Final 2022-07-22 16:39:55 -04:00
doupengwei
eb34c2cdf7 DBZ-5249 KafkaDatabaseHistory without check database history topic create result caused UnknowTopicOrPartitionException 2022-07-22 16:35:37 -04:00
Jan Doms
b5adede223 DBZ-5433 stop OffsetStore if it fails to fully start 2022-07-22 09:29:13 -04:00
Vojtech Juranek
9f35b840fc [docs] Fix defaut values of max.batch.size and poll.interval.ms
Default `max.batch.size` is 2048 [1].
Default `poll.interval.ms` is 500 ms [2] (except Cassandra where it's
still 1000 ms and Mongo which has it's own config)

[1] https://github.com/debezium/debezium/blob/v2.0.0.Alpha3/debezium-core/src/main/java/io/debezium/config/CommonConnectorConfig.java#L300
[2] https://github.com/debezium/debezium/blob/v2.0.0.Alpha3/debezium-core/src/main/java/io/debezium/config/CommonConnectorConfig.java#L302
2022-07-21 08:14:08 -04:00
Andrew Walker
dba5bc1c35 DBZ-5429: Modify Db2 docs to reflect new INITIAL_ONLY flag 2022-07-21 02:48:42 -04:00
Chris Cranford
b7a4bbb183 DBZ-4004 Fix SQL Server test EventProcessingFailureHandlingIT 2022-07-20 16:38:24 -04:00
Chris Cranford
2c2cb9213a DBZ-5248 Avoid NumberFormatException in OracleConnectorIT tests 2022-07-20 13:21:59 -04:00
harveyyue
9683b0fa77 DBZ-5424 Verify the unique index whether including function or arbitrary expression 2022-07-20 14:38:25 +02:00
harveyyue
7730610320 DBZ-5425 Remove the duplicated SimpleDdlParserListener from mysql connector 2022-07-20 14:35:34 +02:00
Chris Cranford
fdf6fc1fa3 DBZ-5396 Document relational attributes in JSON schema change events 2022-07-19 15:41:02 -04:00
Chris Cranford
75ad893d67 DBZ-5396 Scope attributes inside table document 2022-07-19 15:41:02 -04:00
Chris Cranford
76dafedea7 DBZ-5396 Add multi-type accessors for attribute values 2022-07-19 15:41:02 -04:00
Chris Cranford
f412c2e6a4 DBZ-5396 Add support for connector-specific relational model attributes 2022-07-19 15:41:02 -04:00
Bob Roldan
a10b492df8 DBZ-2595 Removes unused documentation variables in antora.yml 2022-07-19 14:45:19 -04:00
Chris Cranford
f8d097ebc3
DBZ-5419 Fix OracleSchemaMigrationIT (non-CDB) test failure 2022-07-19 09:23:16 -04:00
Bob Roldan
69d506991a DBZ-5418 Downstream edits based on review 2022-07-19 07:59:43 -04:00
Vojtech Juranek
5315dbd9cb DBZ-5047 Remove setting last snapshot event in MySQL connector
MySQL connector sets last snapshot event twice - the first time during
the streaming and the second time in
`MySqlSnapshotChangeEventSource.postSnapshot()` [1]. Remove setting the
last snapshot event during the streaming and keep it only in one place
in `postSnapshot()` method.

[1] https://github.com/debezium/debezium/blob/v2.0.0.Alpha3/debezium-connector-mysql/src/main/java/io/debezium/connector/mysql/MySqlSnapshotChangeEventSource.java#L563
2022-07-19 11:19:52 +02:00
Vojtech Juranek
109c3d1e0d DBZ-5047 Remove deprecated unused method from SourceInfo 2022-07-19 11:19:52 +02:00
Sergei Morozov
77f853f936 DBZ-4726: Remove SQL Server single-partition mode 2022-07-19 09:20:40 +02:00
Bob Roldan
383333a50c DBZ-4312 Remove disclaimer re: connector not being tested against Azure 2022-07-18 15:27:39 -04:00
harveyyue
daf329bc06 DBZ-5413 Update the topic naming strategy doc to all connectors 2022-07-18 10:18:12 -04:00
harveyyue
77c7db163d DBZ-5414 Validate topic naming strategy relative topic name properties 2022-07-18 09:58:51 -04:00
Martin Medek
db26d638a1 DBZ-5392 added downstream/upstream suffix to the preparation jenkins jobs, removed redundant job attributes in downstream trigger job 2022-07-17 22:22:15 +02:00
Chris Cranford
95a4576df4 DBZ-5411 Fix Oracle non-cdb builds to use correct env variables 2022-07-15 06:10:52 +02:00