Vojtech Juranek
|
c4a54962ad
|
DBZ-7777 Avoid using List#get() in ParallelSmtConsumerProcessor
Before the change:
Benchmark (processingOrder) (recordCount) (threadCount) Mode Cnt Score Error Units
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 1 ss 88.006 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 2 ss 90.226 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 4 ss 83.129 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 8 ss 81.417 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 16 ss 90.936 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 1 ss 83.645 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 2 ss 77.527 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 4 ss 88.495 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 8 ss 79.590 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 16 ss 90.246 s/op
DebeziumEnginePerf.processRecordsEmbeddedEngine N/A 100000 N/A ss 0.125 s/op
After the change:
Benchmark (processingOrder) (recordCount) (threadCount) Mode Cnt Score Error Units
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 1 ss 0.514 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 2 ss 0.391 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 4 ss 0.467 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 8 ss 0.393 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 16 ss 0.462 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 1 ss 0.410 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 2 ss 0.431 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 4 ss 0.460 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 8 ss 0.419 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 16 ss 0.448 s/op
DebeziumEnginePerf.processRecordsEmbeddedEngine N/A 100000 N/A ss 0.230 s/op
|
2024-04-19 15:11:48 +02:00 |
|
Vojtech Juranek
|
8f0d5a8e66
|
DBZ-7777 Add JMH benchmark for engine without converter
|
2024-04-19 15:11:48 +02:00 |
|
Vojtech Juranek
|
675890eb4a
|
DBZ-7777 Refactor DebeziumEnginePerf to abstract base class and JMH benchmark for converting engine
|
2024-04-19 15:11:48 +02:00 |
|
Vojtech Juranek
|
17d537c67f
|
DBZ-7777 Avoid using List#get() in ParallelSmtAndConvertConsumerProcessor
Before the change:
Benchmark (processingOrder) (recordCount) (threadCount) Mode Cnt Score Error Units
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 1 ss 295.353 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 2 ss 310.652 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 4 ss 305.956 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 8 ss 334.755 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 16 ss 306.477 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 1 ss 257.661 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 2 ss 78.385 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 4 ss 75.899 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 8 ss 81.068 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 16 ss 94.506 s/op
DebeziumEnginePerf.processRecordsEmbeddedEngine N/A 100000 N/A ss 0.857 s/op
After the change:
Benchmark (processingOrder) (recordCount) (threadCount) Mode Cnt Score Error Units
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 1 ss 0.738 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 2 ss 0.404 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 4 ss 0.524 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 8 ss 0.505 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 16 ss 0.428 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 1 ss 0.685 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 2 ss 0.400 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 4 ss 0.357 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 8 ss 0.508 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 16 ss 0.410 s/op
DebeziumEnginePerf.processRecordsEmbeddedEngine N/A 100000 N/A ss 0.857 s/op
|
2024-04-19 15:11:48 +02:00 |
|
Chris Cranford
|
d7385d1c77
|
DBZ-7788 Support with clause in MariaDB compound statements
|
2024-04-19 11:16:04 +02:00 |
|
Chris Cranford
|
134583ce75
|
DBZ-7788 Support with statements in MySQL compound statements
|
2024-04-19 11:16:04 +02:00 |
|
twthorn
|
3a9ea7ac4e
|
DBZ-7698 Refactor to single factory interface/class/config
|
2024-04-19 10:23:30 +02:00 |
|
twthorn
|
0b80389f92
|
DBZ-7698 Rename from basic to default transaction info, add documentation, other minor changes
|
2024-04-19 10:23:30 +02:00 |
|
twthorn
|
0131401a19
|
DBZ-7698 Add instance method for load
|
2024-04-19 10:23:30 +02:00 |
|
twthorn
|
46ee422b53
|
DBZ-7698 Update config docs
|
2024-04-19 10:23:30 +02:00 |
|
twthorn
|
68cd944dc4
|
DBZ-7698 Add more tests
|
2024-04-19 10:23:30 +02:00 |
|
twthorn
|
993b6e73cc
|
DBZ-7698 Fix variable definition
|
2024-04-19 10:23:30 +02:00 |
|
twthorn
|
261253d9f0
|
DBZ-7698 Refactor to generic transaction block customization
|
2024-04-19 10:23:30 +02:00 |
|
twthorn
|
efdc92a926
|
DBZ-7698 add method for backward compatibility
|
2024-04-19 10:23:30 +02:00 |
|
twthorn
|
24e4e4eb80
|
DBZ-7698 fix some failing tests
|
2024-04-19 10:23:30 +02:00 |
|
twthorn
|
ea8dddade3
|
DBZ-7698 Add ordered transaction metadata
|
2024-04-19 10:23:30 +02:00 |
|
ismail simsek
|
f7c4511432
|
DBZ-7695 add _id field to tombstone rewrite events, for delete events
|
2024-04-18 14:53:02 +02:00 |
|
Chris Cranford
|
440b728020
|
DBZ-7693 Re-enable all test modules
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
531fef359d
|
DBZ-7693 Reduce read-only incremental snapshot test verbosity
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
57384e6196
|
DBZ-7693 Binlog test to MySQL test suite
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
317bd68f10
|
DBZ-7693 Assign binlog field groups
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
72d252d1ac
|
DBZ-7693 Fix MySQL resolution of JDBC_PROTOCOL
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
af990a2c7d
|
DBZ-7693 Remove dependency on MySQL test-jar
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
8a39e04ca6
|
DBZ-7693 Refactor MySQL to use binlog-connector
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
a3007cc6ab
|
DBZ-7693 Additional refactor (binlog/mariadb)
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
c20c91111d
|
DBZ-7693 Add support for NATIONAL CHAR to MariaDB grammar
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
421ecc9c9a
|
DBZ-7693 Enable MySQL tests (verify parser changes)
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
1fa9453b1d
|
DBZ-7693 Introduce MariaDB-specific grammar
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
23677ba2cb
|
DBZ-7693 Move MySQL-specific behavior to MySQL impl
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
1a8cbfc915
|
DBZ-7693 Fix custom snapshotter test failure
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
dc5b496c28
|
DBZ-7693 Correctly enable row-query events
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
0cde7e664e
|
DBZ-7693 Explicitly toggle off binlog compression for MariaDB
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
baf7f93d5a
|
DBZ-7693 Reduce logging back to normal
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
3527fdd320
|
DBZ-7693 Fix running mariadb-ci-gtids profile
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
2181d8b7a3
|
DBZ-7693 Support reading DDL SQL resources from test-jar file
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
9d8cb8e534
|
DBZ-7693 Fix port resolution
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
db58fa6856
|
DBZ-7693 Add missing MariaDB key/trust stores
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
0cfd8f0c78
|
DBZ-7693 Rolled branch forward based on main changes
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
60ac3c00a1
|
DBZ-7693 Add MariaDB connector
|
2024-04-18 10:27:21 +02:00 |
|
Chris Cranford
|
ab306ebba0
|
DBZ-7693 Disable all CI except MariaDB
|
2024-04-18 10:27:21 +02:00 |
|
Ondrej Babec
|
48c7cf4195
|
[ci] Bump TF duration for Oracle
|
2024-04-17 15:57:31 +02:00 |
|
Vojtech Juranek
|
a6a2801b01
|
DBZ-7776 JMH benchmarks for engine processing only
Example output (and yes, very poor async-engine results are not a mistake,
see DBZ-7777):
Benchmark (processingOrder) (recordCount) (threadCount) Mode Cnt Score Error Units
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 1 ss 295.353 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 2 ss 310.652 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 4 ss 305.956 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 8 ss 334.755 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 16 ss 306.477 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 1 ss 257.661 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 2 ss 78.385 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 4 ss 75.899 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 8 ss 81.068 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 16 ss 94.506 s/op
DebeziumEnginePerf.processRecordsEmbeddedEngine N/A 100000 N/A ss 0.857 s/op
|
2024-04-17 09:29:56 +02:00 |
|
dependabot[bot]
|
a948675c4d
|
[ci] Bump tj-actions/changed-files from 43.0.1 to 44.0.1
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 43.0.1 to 44.0.1.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v43.0.1...v44.0.1)
---
updated-dependencies:
- dependency-name: tj-actions/changed-files
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
|
2024-04-16 18:51:41 -04:00 |
|
Chris Cranford
|
083d340f3b
|
DBZ-7762 Document Oracle/MySQL custom converters
|
2024-04-16 18:45:21 -04:00 |
|
ani-sha
|
5fad9e57a7
|
DBZ-7759 Use Testing.print method
|
2024-04-12 13:49:16 +02:00 |
|
ani-sha
|
5401041514
|
DBZ-7759 Modify test to ensure streaming of events smoothly
|
2024-04-12 13:49:16 +02:00 |
|
Jakub Cechacek
|
725041d62f
|
DBZ-7759 Await fetcher thread shutdown when BufferingChangeStreamCursor gets closed
|
2024-04-12 13:49:16 +02:00 |
|
ani-sha
|
6b2f275142
|
DBZ-7759 Add appropriate logging
|
2024-04-12 09:19:05 +02:00 |
|
ani-sha
|
719d2325c5
|
DBZ-7759 Suggestions for code review to simplyfy the error handling
|
2024-04-12 09:19:05 +02:00 |
|
ani-sha
|
aef55a1ccd
|
DBZ-7759 Use MongoException in error handling
|
2024-04-12 09:19:05 +02:00 |
|