Commit Graph

10022 Commits

Author SHA1 Message Date
twthorn
879e02e40f DBZ-7698 DBZ-7773 Add review suggestions 2024-04-24 06:07:17 +02:00
twthorn
d452286b99 DBZ-7698 Add docs 2024-04-24 06:07:17 +02:00
twthorn
33fa1a7700 DBZ-7773 Add docs 2024-04-24 06:07:17 +02:00
roldanbob
dcaf29188b DBZ-7789 Adds warning explaining unexpected behavior of lookup setting 2024-04-23 14:46:08 +02:00
ani-sha
a26281d837 DBZ-7138 Provide separate method for stripping parenthesis 2024-04-23 14:38:29 +02:00
ani-sha
fbe31a77cd DBZ-7138 Additional Conditions for MongoDb Incremental Snapshot 2024-04-23 14:38:29 +02:00
Jochen Schalanda
a52ab79f76 DBZ-7798 Fix documentation for header variable in filters (part 2) 2024-04-22 10:37:10 -04:00
Fiore Mario Vitale
4310a6fda6 DBZ-7616 Document database.query.timeout.ms property
Co-authored-by: roldanbob <broldan@redhat.com>
2024-04-22 15:45:02 +02:00
mfvitale
7ab02735bf DBZ-7616 Document database.query.timeout.ms property 2024-04-22 15:45:02 +02:00
Jochen Schalanda
03c9cd71a6 DBZ-7798 Fix documentation for header variable in filters 2024-04-22 14:14:33 +02:00
Robin Moffatt
51b2fc1094 [docs] Fix typo (CDD -> CDC) 2024-04-22 07:21:40 -04:00
ani-sha
4f7a5c9fa6 DBZ-7485 Refine testing for database and collection filters in MongoDb 2024-04-22 11:31:14 +02:00
mfvitale
f554d7f60d DBZ-7780 Avoid throw exception when snapshot is not completed and snapshot mode is no_data 2024-04-22 09:52:16 +02:00
mfvitale
7ee8935694 DBZ-7616 Align query timeout changes to MariaDB connector 2024-04-22 09:17:44 +02:00
mfvitale
a708ef1009 DBZ-7616 Simplify Oracle tests assertion on SQLTimeoutException 2024-04-22 09:17:44 +02:00
mfvitale
30c11242ac DBZ-7616 Avoid to filter out every SET STATEMENT queries and filter just the ones related to Amazon RDS 2024-04-22 09:17:44 +02:00
mfvitale
8206d2d98d DBZ-7616 Add query timeout on JdbcConnection controlled by query.timeout.ms property 2024-04-22 09:17:44 +02:00
Vojtech Juranek
294fdb9d3f DBZ-7777 Use explicit list iterator in for cycle 2024-04-19 15:11:48 +02:00
Vojtech Juranek
c4a54962ad DBZ-7777 Avoid using List#get() in ParallelSmtConsumerProcessor
Before the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt   Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       88.006           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       90.226           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       83.129           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       81.417           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       90.936           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       83.645           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       77.527           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       88.495           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       79.590           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       90.246           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss        0.125           s/op

After the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt  Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       0.514           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       0.391           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       0.467           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       0.393           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       0.462           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       0.410           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       0.431           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       0.460           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       0.419           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       0.448           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss       0.230           s/op
2024-04-19 15:11:48 +02:00
Vojtech Juranek
8f0d5a8e66 DBZ-7777 Add JMH benchmark for engine without converter 2024-04-19 15:11:48 +02:00
Vojtech Juranek
675890eb4a DBZ-7777 Refactor DebeziumEnginePerf to abstract base class and JMH benchmark for converting engine 2024-04-19 15:11:48 +02:00
Vojtech Juranek
17d537c67f DBZ-7777 Avoid using List#get() in ParallelSmtAndConvertConsumerProcessor
Before the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt    Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       295.353           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       310.652           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       305.956           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       334.755           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       306.477           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       257.661           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss        78.385           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss        75.899           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss        81.068           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss        94.506           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss         0.857           s/op

After the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt  Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       0.738           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       0.404           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       0.524           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       0.505           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       0.428           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       0.685           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       0.400           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       0.357           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       0.508           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       0.410           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss       0.857           s/op
2024-04-19 15:11:48 +02:00
Chris Cranford
d7385d1c77 DBZ-7788 Support with clause in MariaDB compound statements 2024-04-19 11:16:04 +02:00
Chris Cranford
134583ce75 DBZ-7788 Support with statements in MySQL compound statements 2024-04-19 11:16:04 +02:00
twthorn
3a9ea7ac4e DBZ-7698 Refactor to single factory interface/class/config 2024-04-19 10:23:30 +02:00
twthorn
0b80389f92 DBZ-7698 Rename from basic to default transaction info, add documentation, other minor changes 2024-04-19 10:23:30 +02:00
twthorn
0131401a19 DBZ-7698 Add instance method for load 2024-04-19 10:23:30 +02:00
twthorn
46ee422b53 DBZ-7698 Update config docs 2024-04-19 10:23:30 +02:00
twthorn
68cd944dc4 DBZ-7698 Add more tests 2024-04-19 10:23:30 +02:00
twthorn
993b6e73cc DBZ-7698 Fix variable definition 2024-04-19 10:23:30 +02:00
twthorn
261253d9f0 DBZ-7698 Refactor to generic transaction block customization 2024-04-19 10:23:30 +02:00
twthorn
efdc92a926 DBZ-7698 add method for backward compatibility 2024-04-19 10:23:30 +02:00
twthorn
24e4e4eb80 DBZ-7698 fix some failing tests 2024-04-19 10:23:30 +02:00
twthorn
ea8dddade3 DBZ-7698 Add ordered transaction metadata 2024-04-19 10:23:30 +02:00
ismail simsek
f7c4511432 DBZ-7695 add _id field to tombstone rewrite events, for delete events 2024-04-18 14:53:02 +02:00
Chris Cranford
440b728020 DBZ-7693 Re-enable all test modules 2024-04-18 10:27:21 +02:00
Chris Cranford
531fef359d DBZ-7693 Reduce read-only incremental snapshot test verbosity 2024-04-18 10:27:21 +02:00
Chris Cranford
57384e6196 DBZ-7693 Binlog test to MySQL test suite 2024-04-18 10:27:21 +02:00
Chris Cranford
317bd68f10 DBZ-7693 Assign binlog field groups 2024-04-18 10:27:21 +02:00
Chris Cranford
72d252d1ac DBZ-7693 Fix MySQL resolution of JDBC_PROTOCOL 2024-04-18 10:27:21 +02:00
Chris Cranford
af990a2c7d DBZ-7693 Remove dependency on MySQL test-jar 2024-04-18 10:27:21 +02:00
Chris Cranford
8a39e04ca6 DBZ-7693 Refactor MySQL to use binlog-connector 2024-04-18 10:27:21 +02:00
Chris Cranford
a3007cc6ab DBZ-7693 Additional refactor (binlog/mariadb) 2024-04-18 10:27:21 +02:00
Chris Cranford
c20c91111d DBZ-7693 Add support for NATIONAL CHAR to MariaDB grammar 2024-04-18 10:27:21 +02:00
Chris Cranford
421ecc9c9a DBZ-7693 Enable MySQL tests (verify parser changes) 2024-04-18 10:27:21 +02:00
Chris Cranford
1fa9453b1d DBZ-7693 Introduce MariaDB-specific grammar 2024-04-18 10:27:21 +02:00
Chris Cranford
23677ba2cb DBZ-7693 Move MySQL-specific behavior to MySQL impl 2024-04-18 10:27:21 +02:00
Chris Cranford
1a8cbfc915 DBZ-7693 Fix custom snapshotter test failure 2024-04-18 10:27:21 +02:00
Chris Cranford
dc5b496c28 DBZ-7693 Correctly enable row-query events 2024-04-18 10:27:21 +02:00
Chris Cranford
0cde7e664e DBZ-7693 Explicitly toggle off binlog compression for MariaDB 2024-04-18 10:27:21 +02:00