alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
10,101 Commits 3 Branches 0 Tags 51 MiB
6c0b268652
Commit Graph

10101 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Vojtech Juranek
17d537c67f DBZ-7777 Avoid using List#get() in ParallelSmtAndConvertConsumerProcessor 
Before the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt    Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       295.353           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       310.652           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       305.956           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       334.755           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       306.477           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       257.661           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss        78.385           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss        75.899           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss        81.068           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss        94.506           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss         0.857           s/op

After the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt  Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       0.738           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       0.404           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       0.524           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       0.505           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       0.428           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       0.685           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       0.400           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       0.357           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       0.508           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       0.410           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss       0.857           s/op
 2024-04-19 15:11:48 +02:00
Chris Cranford
d7385d1c77 DBZ-7788 Support with clause in MariaDB compound statements 2024-04-19 11:16:04 +02:00
Chris Cranford
134583ce75 DBZ-7788 Support with statements in MySQL compound statements 2024-04-19 11:16:04 +02:00
twthorn
3a9ea7ac4e DBZ-7698 Refactor to single factory interface/class/config 2024-04-19 10:23:30 +02:00
twthorn
0b80389f92 DBZ-7698 Rename from basic to default transaction info, add documentation, other minor changes 2024-04-19 10:23:30 +02:00
twthorn
0131401a19 DBZ-7698 Add instance method for load 2024-04-19 10:23:30 +02:00
twthorn
46ee422b53 DBZ-7698 Update config docs 2024-04-19 10:23:30 +02:00
twthorn
68cd944dc4 DBZ-7698 Add more tests 2024-04-19 10:23:30 +02:00
twthorn
993b6e73cc DBZ-7698 Fix variable definition 2024-04-19 10:23:30 +02:00
twthorn
261253d9f0 DBZ-7698 Refactor to generic transaction block customization 2024-04-19 10:23:30 +02:00
twthorn
efdc92a926 DBZ-7698 add method for backward compatibility 2024-04-19 10:23:30 +02:00
twthorn
24e4e4eb80 DBZ-7698 fix some failing tests 2024-04-19 10:23:30 +02:00
twthorn
ea8dddade3 DBZ-7698 Add ordered transaction metadata 2024-04-19 10:23:30 +02:00
ismail simsek
f7c4511432 DBZ-7695 add _id field to tombstone rewrite events, for delete events 2024-04-18 14:53:02 +02:00
Chris Cranford
440b728020 DBZ-7693 Re-enable all test modules 2024-04-18 10:27:21 +02:00
Chris Cranford
531fef359d DBZ-7693 Reduce read-only incremental snapshot test verbosity 2024-04-18 10:27:21 +02:00
Chris Cranford
57384e6196 DBZ-7693 Binlog test to MySQL test suite 2024-04-18 10:27:21 +02:00
Chris Cranford
317bd68f10 DBZ-7693 Assign binlog field groups 2024-04-18 10:27:21 +02:00
Chris Cranford
72d252d1ac DBZ-7693 Fix MySQL resolution of JDBC_PROTOCOL 2024-04-18 10:27:21 +02:00
Chris Cranford
af990a2c7d DBZ-7693 Remove dependency on MySQL test-jar 2024-04-18 10:27:21 +02:00
Chris Cranford
8a39e04ca6 DBZ-7693 Refactor MySQL to use binlog-connector 2024-04-18 10:27:21 +02:00
Chris Cranford
a3007cc6ab DBZ-7693 Additional refactor (binlog/mariadb) 2024-04-18 10:27:21 +02:00
Chris Cranford
c20c91111d DBZ-7693 Add support for NATIONAL CHAR to MariaDB grammar 2024-04-18 10:27:21 +02:00
Chris Cranford
421ecc9c9a DBZ-7693 Enable MySQL tests (verify parser changes) 2024-04-18 10:27:21 +02:00
Chris Cranford
1fa9453b1d DBZ-7693 Introduce MariaDB-specific grammar 2024-04-18 10:27:21 +02:00
Chris Cranford
23677ba2cb DBZ-7693 Move MySQL-specific behavior to MySQL impl 2024-04-18 10:27:21 +02:00
Chris Cranford
1a8cbfc915 DBZ-7693 Fix custom snapshotter test failure 2024-04-18 10:27:21 +02:00
Chris Cranford
dc5b496c28 DBZ-7693 Correctly enable row-query events 2024-04-18 10:27:21 +02:00
Chris Cranford
0cde7e664e DBZ-7693 Explicitly toggle off binlog compression for MariaDB 2024-04-18 10:27:21 +02:00
Chris Cranford
baf7f93d5a DBZ-7693 Reduce logging back to normal 2024-04-18 10:27:21 +02:00
Chris Cranford
3527fdd320 DBZ-7693 Fix running mariadb-ci-gtids profile 2024-04-18 10:27:21 +02:00
Chris Cranford
2181d8b7a3 DBZ-7693 Support reading DDL SQL resources from test-jar file 2024-04-18 10:27:21 +02:00
Chris Cranford
9d8cb8e534 DBZ-7693 Fix port resolution 2024-04-18 10:27:21 +02:00
Chris Cranford
db58fa6856 DBZ-7693 Add missing MariaDB key/trust stores 2024-04-18 10:27:21 +02:00
Chris Cranford
0cfd8f0c78 DBZ-7693 Rolled branch forward based on main changes 2024-04-18 10:27:21 +02:00
Chris Cranford
60ac3c00a1 DBZ-7693 Add MariaDB connector 2024-04-18 10:27:21 +02:00
Chris Cranford
ab306ebba0 DBZ-7693 Disable all CI except MariaDB 2024-04-18 10:27:21 +02:00
Ondrej Babec
48c7cf4195 [ci] Bump TF duration for Oracle 2024-04-17 15:57:31 +02:00
Vojtech Juranek
a6a2801b01 DBZ-7776 JMH benchmarks for engine processing only 
Example output (and yes, very poor async-engine results are not a mistake,
see DBZ-7777):

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt    Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       295.353           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       310.652           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       305.956           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       334.755           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       306.477           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       257.661           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss        78.385           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss        75.899           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss        81.068           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss        94.506           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss         0.857           s/op
 2024-04-17 09:29:56 +02:00
dependabot[bot]
a948675c4d [ci] Bump tj-actions/changed-files from 43.0.1 to 44.0.1 
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 43.0.1 to 44.0.1.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v43.0.1...v44.0.1)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-04-16 18:51:41 -04:00
Chris Cranford
083d340f3b DBZ-7762 Document Oracle/MySQL custom converters 2024-04-16 18:45:21 -04:00
ani-sha
5fad9e57a7 DBZ-7759 Use Testing.print method 2024-04-12 13:49:16 +02:00
ani-sha
5401041514 DBZ-7759 Modify test to ensure streaming of events smoothly 2024-04-12 13:49:16 +02:00
Jakub Cechacek
725041d62f DBZ-7759 Await fetcher thread shutdown when BufferingChangeStreamCursor gets closed 2024-04-12 13:49:16 +02:00
ani-sha
6b2f275142 DBZ-7759 Add appropriate logging 2024-04-12 09:19:05 +02:00
ani-sha
719d2325c5 DBZ-7759 Suggestions for code review to simplyfy the error handling 2024-04-12 09:19:05 +02:00
ani-sha
aef55a1ccd DBZ-7759 Use MongoException in error handling 2024-04-12 09:19:05 +02:00
ani-sha
1b7481d357 DBZ-7759 Ensure error handling of oversized events swallowed by BufferedChangeStreamCursor thread 2024-04-12 09:19:05 +02:00
Chris Cranford
9467d4ac7d [docs] Include new documentation section on mining strategies 2024-04-11 14:33:44 -04:00
Jakub Cechacek
4061a02f8b DBZ-7770 Added test verifying invalid log position is properly logged for MongoDB 2024-04-11 14:58:07 +02:00