Commit Graph

10324 Commits

Author SHA1 Message Date
Chris Cranford
dc5b496c28 DBZ-7693 Correctly enable row-query events 2024-04-18 10:27:21 +02:00
Chris Cranford
0cde7e664e DBZ-7693 Explicitly toggle off binlog compression for MariaDB 2024-04-18 10:27:21 +02:00
Chris Cranford
baf7f93d5a DBZ-7693 Reduce logging back to normal 2024-04-18 10:27:21 +02:00
Chris Cranford
3527fdd320 DBZ-7693 Fix running mariadb-ci-gtids profile 2024-04-18 10:27:21 +02:00
Chris Cranford
2181d8b7a3 DBZ-7693 Support reading DDL SQL resources from test-jar file 2024-04-18 10:27:21 +02:00
Chris Cranford
9d8cb8e534 DBZ-7693 Fix port resolution 2024-04-18 10:27:21 +02:00
Chris Cranford
db58fa6856 DBZ-7693 Add missing MariaDB key/trust stores 2024-04-18 10:27:21 +02:00
Chris Cranford
0cfd8f0c78 DBZ-7693 Rolled branch forward based on main changes 2024-04-18 10:27:21 +02:00
Chris Cranford
60ac3c00a1 DBZ-7693 Add MariaDB connector 2024-04-18 10:27:21 +02:00
Chris Cranford
ab306ebba0 DBZ-7693 Disable all CI except MariaDB 2024-04-18 10:27:21 +02:00
Ondrej Babec
48c7cf4195 [ci] Bump TF duration for Oracle 2024-04-17 15:57:31 +02:00
Vojtech Juranek
a6a2801b01 DBZ-7776 JMH benchmarks for engine processing only
Example output (and yes, very poor async-engine results are not a mistake,
see DBZ-7777):

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt    Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       295.353           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       310.652           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       305.956           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       334.755           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       306.477           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       257.661           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss        78.385           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss        75.899           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss        81.068           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss        94.506           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss         0.857           s/op
2024-04-17 09:29:56 +02:00
dependabot[bot]
a948675c4d [ci] Bump tj-actions/changed-files from 43.0.1 to 44.0.1
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 43.0.1 to 44.0.1.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v43.0.1...v44.0.1)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-04-16 18:51:41 -04:00
Chris Cranford
083d340f3b DBZ-7762 Document Oracle/MySQL custom converters 2024-04-16 18:45:21 -04:00
ani-sha
5fad9e57a7 DBZ-7759 Use Testing.print method 2024-04-12 13:49:16 +02:00
ani-sha
5401041514 DBZ-7759 Modify test to ensure streaming of events smoothly 2024-04-12 13:49:16 +02:00
Jakub Cechacek
725041d62f DBZ-7759 Await fetcher thread shutdown when BufferingChangeStreamCursor gets closed 2024-04-12 13:49:16 +02:00
ani-sha
6b2f275142 DBZ-7759 Add appropriate logging 2024-04-12 09:19:05 +02:00
ani-sha
719d2325c5 DBZ-7759 Suggestions for code review to simplyfy the error handling 2024-04-12 09:19:05 +02:00
ani-sha
aef55a1ccd DBZ-7759 Use MongoException in error handling 2024-04-12 09:19:05 +02:00
ani-sha
1b7481d357 DBZ-7759 Ensure error handling of oversized events swallowed by BufferedChangeStreamCursor thread 2024-04-12 09:19:05 +02:00
Chris Cranford
9467d4ac7d [docs] Include new documentation section on mining strategies 2024-04-11 14:33:44 -04:00
Jakub Cechacek
4061a02f8b DBZ-7770 Added test verifying invalid log position is properly logged for MongoDB 2024-04-11 14:58:07 +02:00
Jakub Cechacek
9242d45240 DBZ-7770 Ability to disable log position validation on startup for MongoDb conenctor 2024-04-11 14:58:07 +02:00
Jakub Cechacek
6e9235215f DBZ-7770 Fixed the return values of MongoDbConnection#isValidResumeToken() 2024-04-11 14:58:07 +02:00
mfvitale
72b3b4c3c0 DBZ-7732 Fix test wait condition 2024-04-11 07:53:48 +02:00
mfvitale
64454cc378 DBZ-7716 Correct IncrementalSnapshotContext dataCollectionsToSnapshot cache update 2024-04-11 07:53:48 +02:00
Vojtech Juranek
a2eaddffcf DBZ-7764 Use cache thread pool as the default for async. engine 2024-04-11 07:46:01 +02:00
Vojtech Juranek
230076205f DBZ-7763 Remove async engine records processing thread cap 2024-04-11 07:46:01 +02:00
Chris Cranford
71b42fff24 DBZ-7662 Upgrade Quarkus Outbox to Quarkus 3.9.2 2024-04-11 07:39:41 +02:00
Fiore Mario Vitale
f37129dded DBZ-7765 Let LOG_POSITION_CHECK_ENABLED property as internal
Co-authored-by: Jiri Pechanec <jpechane@redhat.com>
2024-04-11 07:35:49 +02:00
mfvitale
6f0a56fc6f DBZ-7765 Add property to eventually disable log position validation on startup 2024-04-11 07:35:49 +02:00
mfvitale
717888f6f6 DBZ-7765 Use different query for validating log position for SQLServer 2024-04-11 07:35:49 +02:00
Chris Cranford
8d096e965f DBZ-7761 Add orai18n.jar to improve Oracle NLS character set support 2024-04-11 06:48:12 +02:00
roldanbob
797f531a79 DBZ-6116 Rewrite to comply with style guidelines 2024-04-11 06:45:00 +02:00
Chris Cranford
5fa00a4eeb [ci] Use github.ref_name on pushes for sibling checkouts 2024-04-10 14:07:22 +02:00
Selman Genç
90485dd42d DBZ 7740 Fixed NOAUTH authentication required error while initializing Redis connection 2024-04-09 13:57:44 +02:00
Jiri Novotny
a6f617647a DBZ-7747 Add parallel maven build to testsuite pod 2024-04-09 08:43:09 +02:00
Vojtech Juranek
3a6f1ead03 DBZ-7633 Rename module to microbenchmark engine 2024-04-08 19:27:50 +02:00
Vojtech Juranek
daa0acbd2d DBZ-7633 Run tests with varying number of threads and prossing order 2024-04-08 19:27:50 +02:00
Vojtech Juranek
bb9bef915b DBZ-7633 Add Postgres end-to-end JMH test for Debezium engine
Example output on my localhost:

    Benchmark                                          (eventCount)  Mode  Cnt   Score   Error  Units
    PostgresEndToEndPerf.processRecordsAsyncEngine             1000    ss        0.750           s/op
    PostgresEndToEndPerf.processRecordsAsyncEngine            10000    ss        1.000           s/op
    PostgresEndToEndPerf.processRecordsAsyncEngine           100000    ss        2.248           s/op
    PostgresEndToEndPerf.processRecordsAsyncEngine          1000000    ss       14.941           s/op
    PostgresEndToEndPerf.processRecordsEmbeddedEngine          1000    ss        0.799           s/op
    PostgresEndToEndPerf.processRecordsEmbeddedEngine         10000    ss        0.981           s/op
    PostgresEndToEndPerf.processRecordsEmbeddedEngine        100000    ss        2.636           s/op
    PostgresEndToEndPerf.processRecordsEmbeddedEngine       1000000    ss       19.919           s/op
2024-04-08 19:27:50 +02:00
Vojtech Juranek
750aa24c0a DBZ-7633 Create module for Debezium engine JMH benchmarks 2024-04-08 19:27:50 +02:00
Roman Kudryashov
50c9f042a3 DBZ-7755 Refactor exporting to CloudEvents: remove RecordParser 2024-04-08 13:22:31 +02:00
mfvitale
ffbde888bc DBZ-7732 Support multiple connector testing on Debezium Server 2024-04-08 12:46:53 +02:00
mfvitale
ae7628a732 DBZ-7732 Add ConnectorSpecific annotation to manage multiple SPI connector specific implementation 2024-04-08 12:46:53 +02:00
Chris Cranford
4ca0e7ffb9 DBZ-7753 Oracle converter for RAW to STRING conversion 2024-04-08 12:35:30 +02:00
rajdangwal
3a8421ba4a DBZ-7750: Set default for max.iteration.transactions to 500 2024-04-08 10:32:12 +02:00
Lourens Naude
a00a165bce DBZ-7757 Bump the MySQL binlog client version to 0.29.1 (fixes a bug when deserializing a large gtid transaction's length) 2024-04-07 13:42:26 -04:00
roldanbob
66c1705c79 DBZ-7754 Removes database.names entry from connector yaml example 2024-04-05 15:25:07 -04:00
Jakub Cechacek
1bf9e802f1 DBZ-7744 RS name is not required when cluster type is not REPLICA_SET instead of when cluster type is SHARDED in order to accomodate LOAD_BALANCED clusters 2024-04-05 09:40:35 -04:00