Commit Graph

8437 Commits

Author SHA1 Message Date
mfvitale
7338fde84e DBZ-6424 Emit JMX Notification when Debezium generate its own notification
DBZ-6424 Emit JMX Notification when Debezium generate its own notification

DBZ-6424 Emit JMX Notification when Debezium generate its own notification
2023-06-07 07:36:58 +02:00
mfvitale
769d9361e7 DBZ-6424 Add JMX Notification channel
This channel permits to send Debezium notification to JMX bean

DBZ-6424 Add JMX Signal channel

This channel permits to send signal to Debezium through the JMX operation
2023-06-07 07:36:58 +02:00
mfvitale
537cc50d65 DBZ-6524 Add support for ltree and isbn PostgreSQL data-types in case INCLUDE_UNKNOWN_DATATYPES is set to false 2023-06-06 06:31:00 +02:00
dependabot[bot]
7acdbc7141 [ci] Bump tj-actions/changed-files from 36.0.9 to 36.0.17
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 36.0.9 to 36.0.17.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v36.0.9...v36.0.17)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-06-06 06:21:04 +02:00
mfvitale
f93affc3ca DBZ-6511 Add java docs for SignalProcessor getSignalChannel method 2023-06-05 17:33:07 +02:00
mfvitale
ba8a3e5062 DBZ-6511 Expose reset method on SignalChannelReader to reset processed signals 2023-06-05 17:33:07 +02:00
mfvitale
862180cd0e DBZ-6511 Add test to ReadOnlyIncrementalSnapshotIT to signal through FileSignalChannel 2023-06-05 17:33:07 +02:00
mfvitale
4d56bbd15a DBZ-6511 Restore Kafka signal offset only when KafkaSignalChannel is enabled 2023-06-05 17:33:07 +02:00
Ronak Jain
3f3967c2bb DBZ-6366: Code Improvements for skip.messages.without.change
Addresses/Closes DBZ-6366
2023-06-05 14:50:25 +02:00
Jiri Pechanec
8a1cd95086 DBZ-6515 Add units to the description 2023-06-05 11:27:57 +02:00
dependabot[bot]
03f179a11e [ci] Bump tj-actions/changed-files from 35.9.2 to 36.0.9
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.9.2 to 36.0.9.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.9.2...v36.0.9)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-06-05 07:47:24 +02:00
Jiri Pechanec
5a8821ac81 [docs] Fix formatting 2023-06-05 07:47:01 +02:00
ani-sha
3993f3eaad DBZ-6507 Add MATERIALIZED VIEW LOG clause 2023-06-01 08:42:21 -04:00
Vojtech Juranek
12f31d1be2 [docs] Make clear chunk size is number of rows, not size 2023-06-01 09:03:32 +02:00
mfvitale
155207dc9b DBZ-6509 Add FileSignalChannel to META-INF/services 2023-05-31 14:39:35 +02:00
Fiore Mario Vitale
ed44f2513a DBZ-6408 Improve documentation for notifications and signaling
Co-authored-by: roldanbob <broldan@redhat.com>
2023-05-30 17:17:52 +02:00
Fiore Mario Vitale
450c6df9bf DBZ-6408 Improve documentation for notifications and signaling
Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>

Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>

Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>

Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>
2023-05-30 17:17:52 +02:00
mfvitale
e1c1e65336 DBZ-6408 Add documentation for notifications 2023-05-30 17:17:52 +02:00
mfvitale
6bb4be86af DBZ-6408 Add documentation for custom signaling channel 2023-05-30 17:17:52 +02:00
Debezium Builder
3a6537bf55 [release] Development version for testing module deps 2023-05-26 10:44:30 +00:00
Debezium Builder
aa5b2131fc [maven-release-plugin] prepare for next development iteration 2023-05-26 10:35:20 +00:00
Debezium Builder
9cc9b3c29a [maven-release-plugin] prepare release v2.3.0.Beta1 2023-05-26 10:35:20 +00:00
Debezium Builder
24c2d67040 [release] Stable 2.3.0.Beta1 for testing module deps 2023-05-26 10:32:25 +00:00
Jiri Pechanec
af0de3d3dd [release] Changelog for 2.3.0.Beta1 2023-05-26 12:15:05 +02:00
mfvitale
ed2157bfc9 DBZ-6486 ExtractNewRecordState skip fields that not exists on payload 2023-05-26 11:30:37 +02:00
Jiri Pechanec
b72f084eac DBZ-6486 Check schema fields 2023-05-26 11:30:37 +02:00
mfvitale
08122371eb DBZ-6486 ExtractNewRecordState can now take arbitrary fields from payload 2023-05-26 11:30:37 +02:00
Jiri Pechanec
2fea067cca DBZ-5252 Allow skipping records in test consumer 2023-05-26 05:48:34 +02:00
Chris Cranford
9ed6a3ae97 DBZ-6502 Fix Oracle 23.x JDBC driver compatibility
Solves ORA-18176 error "{} not in any time zone.DATE" error.
2023-05-25 09:29:09 +02:00
Jiri Pechanec
65b46f204a DBZ-6496 Speed-up another incremental snapshot test 2023-05-24 18:51:49 +02:00
mfvitale
e0659f1a0e DBZ-6496 Fix performance issue on testNotification test with Oracle and MS SQL Server connectors 2023-05-24 18:51:49 +02:00
mfvitale
7ba9f57035 DBZ-6496 Fix signal.poll.interval.ms default value 2023-05-24 18:51:49 +02:00
dependabot[bot]
f6fa87ce1f [ci] Bump sqlite-jdbc in /debezium-storage/debezium-storage-jdbc
Bumps [sqlite-jdbc](https://github.com/xerial/sqlite-jdbc) from 3.36.0.3 to 3.41.2.2.
- [Release notes](https://github.com/xerial/sqlite-jdbc/releases)
- [Changelog](https://github.com/xerial/sqlite-jdbc/blob/master/CHANGELOG)
- [Commits](https://github.com/xerial/sqlite-jdbc/compare/3.36.0.3...3.41.2.2)

---
updated-dependencies:
- dependency-name: org.xerial:sqlite-jdbc
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-05-24 07:35:04 +02:00
mfvitale
547ecd02ca DBZ-6447 Fix incremental snapshot notification on MongoDb connector 2023-05-23 09:57:05 +02:00
mfvitale
dc00f64bbf DBZ-6447 Incremental snapshot notification ids are now equal to the id sent in the execute-snapshot signal. 2023-05-23 09:57:05 +02:00
harveyyue
016daf6fd8 DBZ-6490 Convert the field BigDecimal value to bytes failure of ApproximateStructSizeCalculator 2023-05-23 08:38:06 +02:00
ani-sha
f20fe32b4f DBZ-6492 Support logical_replication_clause in Oracle 2023-05-23 08:30:36 +02:00
ani-sha
6d404d242e DBZ-6479 Add missing privileges as per MySQL 8.0.x 2023-05-23 08:25:49 +02:00
Martin Medek
97a6171536 DBZ-3202 Added postgresql replica DB instance and test case for debezium streaming from replica 2023-05-22 09:30:10 +02:00
Kanthi Subramanian
e1fd00b580 DBZ-6476 Change encoding of JDBC offset data from UTF-16 to UTF-8 2023-05-22 08:25:11 +02:00
Jiri Pechanec
d5a3095717 DBZ-6457 Fix formatting 2023-05-19 14:04:14 +02:00
Chris Cranford
d40da4f810 DBZ-6457 Use PDB for parallel snapshot connections 2023-05-19 14:04:14 +02:00
ani-sha
e91f483062 DBZ-5339 Enable Jolokia using DebeziumContainer class 2023-05-18 11:08:03 -04:00
Vojtech Juranek
a58f4b4d4f DBZ-6439 Filter tables only when user want to capture schema for included tables only 2023-05-16 14:48:48 -04:00
angsdey2
80c910c652 DBZ-6470 Refer correctly to the source database
While creating signaling table we need to have privileges to create table in source database not target
2023-05-16 13:16:09 +02:00
Jiri Pechanec
d992ae5f4e DBZ-6461 Rename to delivery timeout; Increase default value 2023-05-16 13:03:49 +02:00
mfvitale
d08e72fda7 DBZ-6461 Document new debezium.sink.pubsub.wait.message.computation.timeout.ms and debezium.sink.pubsublite.wait.message.computation.timeout.ms properties to configure the wait time on message processing by Google PubSub 2023-05-16 13:03:49 +02:00
Ismail Simsek
2683b31394 DBZ-4027 implement FileSignalChannel 2023-05-15 15:34:43 +02:00
Jochen Schalanda
bdb43a2235 DBZ-6459 [MariaDB] Add support for userstat plugin keywords
The MariaDB User Statistics (userstat) plugin adds 4 new keywords:

`USER_STATISTICS`, `CLIENT_STATISTICS`, `INDEX_STATISTICS`, and `TABLE_STATISTICS`

Additionally, it adds unusual variants of the `SHOW` and `FLUSH` statements which aren't covered by the MariaDB SQL grammar yet, for example

```
SHOW TABLE_STATISTICS;
FLUSH USER_STATISTICS;
```

See also:

- https://mariadb.com/kb/en/user-statistics/
- https://mariadb.com/kb/en/show-client-statistics/
- https://mariadb.com/kb/en/show-index-statistics/
- https://mariadb.com/kb/en/show-table-statistics/
- https://mariadb.com/kb/en/show-user-statistics/

Refs https://github.com/antlr/grammars-v4/pull/3400
2023-05-15 14:56:36 +02:00
Vojtech Juranek
ee4ebaa957 DBZ-6439 Don't scan all the tables when loading schema
Currently we scan all the tables, which may result into a substantial
delay in initial snapshot when the database is very large. We need to
filter out tables which we are not interested in.

Add back table filter when loading schema of tables. As per comment of
this block of code, passing all tables and table filter should be faster
than passing only list of tables we are interested in.
2023-05-15 14:11:47 +02:00