Commit Graph

10113 Commits

Author SHA1 Message Date
Jochen Schalanda
03c9cd71a6 DBZ-7798 Fix documentation for header variable in filters 2024-04-22 14:14:33 +02:00
Robin Moffatt
51b2fc1094 [docs] Fix typo (CDD -> CDC) 2024-04-22 07:21:40 -04:00
ani-sha
4f7a5c9fa6 DBZ-7485 Refine testing for database and collection filters in MongoDb 2024-04-22 11:31:14 +02:00
mfvitale
f554d7f60d DBZ-7780 Avoid throw exception when snapshot is not completed and snapshot mode is no_data 2024-04-22 09:52:16 +02:00
mfvitale
7ee8935694 DBZ-7616 Align query timeout changes to MariaDB connector 2024-04-22 09:17:44 +02:00
mfvitale
a708ef1009 DBZ-7616 Simplify Oracle tests assertion on SQLTimeoutException 2024-04-22 09:17:44 +02:00
mfvitale
30c11242ac DBZ-7616 Avoid to filter out every SET STATEMENT queries and filter just the ones related to Amazon RDS 2024-04-22 09:17:44 +02:00
mfvitale
8206d2d98d DBZ-7616 Add query timeout on JdbcConnection controlled by query.timeout.ms property 2024-04-22 09:17:44 +02:00
Vojtech Juranek
294fdb9d3f DBZ-7777 Use explicit list iterator in for cycle 2024-04-19 15:11:48 +02:00
Vojtech Juranek
c4a54962ad DBZ-7777 Avoid using List#get() in ParallelSmtConsumerProcessor
Before the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt   Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       88.006           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       90.226           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       83.129           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       81.417           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       90.936           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       83.645           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       77.527           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       88.495           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       79.590           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       90.246           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss        0.125           s/op

After the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt  Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       0.514           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       0.391           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       0.467           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       0.393           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       0.462           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       0.410           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       0.431           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       0.460           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       0.419           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       0.448           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss       0.230           s/op
2024-04-19 15:11:48 +02:00
Vojtech Juranek
8f0d5a8e66 DBZ-7777 Add JMH benchmark for engine without converter 2024-04-19 15:11:48 +02:00
Vojtech Juranek
675890eb4a DBZ-7777 Refactor DebeziumEnginePerf to abstract base class and JMH benchmark for converting engine 2024-04-19 15:11:48 +02:00
Vojtech Juranek
17d537c67f DBZ-7777 Avoid using List#get() in ParallelSmtAndConvertConsumerProcessor
Before the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt    Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       295.353           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       310.652           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       305.956           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       334.755           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       306.477           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       257.661           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss        78.385           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss        75.899           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss        81.068           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss        94.506           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss         0.857           s/op

After the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt  Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       0.738           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       0.404           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       0.524           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       0.505           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       0.428           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       0.685           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       0.400           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       0.357           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       0.508           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       0.410           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss       0.857           s/op
2024-04-19 15:11:48 +02:00
Chris Cranford
d7385d1c77 DBZ-7788 Support with clause in MariaDB compound statements 2024-04-19 11:16:04 +02:00
Chris Cranford
134583ce75 DBZ-7788 Support with statements in MySQL compound statements 2024-04-19 11:16:04 +02:00
twthorn
3a9ea7ac4e DBZ-7698 Refactor to single factory interface/class/config 2024-04-19 10:23:30 +02:00
twthorn
0b80389f92 DBZ-7698 Rename from basic to default transaction info, add documentation, other minor changes 2024-04-19 10:23:30 +02:00
twthorn
0131401a19 DBZ-7698 Add instance method for load 2024-04-19 10:23:30 +02:00
twthorn
46ee422b53 DBZ-7698 Update config docs 2024-04-19 10:23:30 +02:00
twthorn
68cd944dc4 DBZ-7698 Add more tests 2024-04-19 10:23:30 +02:00
twthorn
993b6e73cc DBZ-7698 Fix variable definition 2024-04-19 10:23:30 +02:00
twthorn
261253d9f0 DBZ-7698 Refactor to generic transaction block customization 2024-04-19 10:23:30 +02:00
twthorn
efdc92a926 DBZ-7698 add method for backward compatibility 2024-04-19 10:23:30 +02:00
twthorn
24e4e4eb80 DBZ-7698 fix some failing tests 2024-04-19 10:23:30 +02:00
twthorn
ea8dddade3 DBZ-7698 Add ordered transaction metadata 2024-04-19 10:23:30 +02:00
ismail simsek
f7c4511432 DBZ-7695 add _id field to tombstone rewrite events, for delete events 2024-04-18 14:53:02 +02:00
Chris Cranford
440b728020 DBZ-7693 Re-enable all test modules 2024-04-18 10:27:21 +02:00
Chris Cranford
531fef359d DBZ-7693 Reduce read-only incremental snapshot test verbosity 2024-04-18 10:27:21 +02:00
Chris Cranford
57384e6196 DBZ-7693 Binlog test to MySQL test suite 2024-04-18 10:27:21 +02:00
Chris Cranford
317bd68f10 DBZ-7693 Assign binlog field groups 2024-04-18 10:27:21 +02:00
Chris Cranford
72d252d1ac DBZ-7693 Fix MySQL resolution of JDBC_PROTOCOL 2024-04-18 10:27:21 +02:00
Chris Cranford
af990a2c7d DBZ-7693 Remove dependency on MySQL test-jar 2024-04-18 10:27:21 +02:00
Chris Cranford
8a39e04ca6 DBZ-7693 Refactor MySQL to use binlog-connector 2024-04-18 10:27:21 +02:00
Chris Cranford
a3007cc6ab DBZ-7693 Additional refactor (binlog/mariadb) 2024-04-18 10:27:21 +02:00
Chris Cranford
c20c91111d DBZ-7693 Add support for NATIONAL CHAR to MariaDB grammar 2024-04-18 10:27:21 +02:00
Chris Cranford
421ecc9c9a DBZ-7693 Enable MySQL tests (verify parser changes) 2024-04-18 10:27:21 +02:00
Chris Cranford
1fa9453b1d DBZ-7693 Introduce MariaDB-specific grammar 2024-04-18 10:27:21 +02:00
Chris Cranford
23677ba2cb DBZ-7693 Move MySQL-specific behavior to MySQL impl 2024-04-18 10:27:21 +02:00
Chris Cranford
1a8cbfc915 DBZ-7693 Fix custom snapshotter test failure 2024-04-18 10:27:21 +02:00
Chris Cranford
dc5b496c28 DBZ-7693 Correctly enable row-query events 2024-04-18 10:27:21 +02:00
Chris Cranford
0cde7e664e DBZ-7693 Explicitly toggle off binlog compression for MariaDB 2024-04-18 10:27:21 +02:00
Chris Cranford
baf7f93d5a DBZ-7693 Reduce logging back to normal 2024-04-18 10:27:21 +02:00
Chris Cranford
3527fdd320 DBZ-7693 Fix running mariadb-ci-gtids profile 2024-04-18 10:27:21 +02:00
Chris Cranford
2181d8b7a3 DBZ-7693 Support reading DDL SQL resources from test-jar file 2024-04-18 10:27:21 +02:00
Chris Cranford
9d8cb8e534 DBZ-7693 Fix port resolution 2024-04-18 10:27:21 +02:00
Chris Cranford
db58fa6856 DBZ-7693 Add missing MariaDB key/trust stores 2024-04-18 10:27:21 +02:00
Chris Cranford
0cfd8f0c78 DBZ-7693 Rolled branch forward based on main changes 2024-04-18 10:27:21 +02:00
Chris Cranford
60ac3c00a1 DBZ-7693 Add MariaDB connector 2024-04-18 10:27:21 +02:00
Chris Cranford
ab306ebba0 DBZ-7693 Disable all CI except MariaDB 2024-04-18 10:27:21 +02:00
Ondrej Babec
48c7cf4195 [ci] Bump TF duration for Oracle 2024-04-17 15:57:31 +02:00