Commit Graph

1773 Commits

Author SHA1 Message Date
jcechace
b87f0ec776 DBZ-6592 Documenting database permissions required by the MongoDB connector 2023-07-11 16:13:30 +02:00
Fiore Mario Vitale
ebc438c278 DBZ-6632 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-07-06 17:04:37 +02:00
mfvitale
8669edb64e DBZ-6632 Improve properties description on JDBC connector documentation 2023-07-06 17:04:37 +02:00
Hossein Torabi
78e6baeb31 DBZ-6602: Support record header as primary_key 2023-06-30 13:13:47 -04:00
Fiore Mario Vitale
9ba5e078d0 DBZ-6417 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-06-29 16:40:13 +02:00
Fiore Mario Vitale
3d2b8fc5c5 DBZ-6417 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-06-29 16:40:13 +02:00
mfvitale
cf90802504 DBZ-6417 Document how to implement a custom action 2023-06-29 16:40:13 +02:00
harveyyue
f4c8810107 [docs] Replace the deprecated "database.server.name" to "topic.prefix" 2023-06-28 08:19:31 +02:00
bdbene
6f29ce08ef DBZ-6605 Fix DataCollections for snapshot completion notification
DBZ-6605 Use new 'scanned_collection' field for snapshot completion signal

Updated the docs for fixed snapshot completion notification
2023-06-27 12:01:26 +02:00
mfvitale
d7511930a8 DBZ-6416 Document new initial snapshot notification status 2023-06-22 13:22:34 +02:00
Ant Kutschera
d7e406328e [docs] Link doesnt work in Chrome
in the browser, it uses https://learn.microsoft.com/en-us/samples/azure-samples/azure-sql-db-change-stream-debezium/azure-sql%E2%80%94%E2%80%8Bsql-server-change-stream-with-debezium/ and then returns a 404
2023-06-22 12:29:05 +02:00
Jiri Pechanec
8ae87c2f65 [release] Changelog for 2.3.0.Final 2023-06-20 11:55:05 +02:00
kate
dabb49b020 DBZ-6552 Document new TABLE_SCAN_COMPLETED status property 2023-06-20 05:40:28 +02:00
mfvitale
cf1dbe7249 [docs] Document new status property for incremental snapshot notification about a TABLE_SCAN_COMPLETED event 2023-06-15 15:32:00 +02:00
Bob Roldan
2447fcc520 DBZ-6474 Remove link that requires undefined context attribute 2023-06-13 08:13:12 +02:00
Bob Roldan
e4b428f8b6 DBZ-6474 Fix typo found in ID for log.mining.username.include.list prop 2023-06-13 08:13:12 +02:00
Bob Roldan
eaf4ce9bf8 DBZ-6474 Must set CDB snapshot.include.collection.list regex to PDB name 2023-06-13 08:13:12 +02:00
Chris Cranford
e025230d44 DBZ-6499 Support restarting JDBC connections
Introduces a new configuration option, `log.mining.restart.connection`,
which closes and re-opens the JDBC connection when an Oracle Log switch
occurs or when the optionally configured log mining session max lifetime
is reached.
2023-06-13 07:09:01 +02:00
David Beck
21c1b1f5dc [docs] Add initial to table snapshot.mode in postgresql.adoc
This adds a bit more clarity into the `initial` mode since it was very confusing as a new user to understand that `initial` was the default value but didn't exist in the table.
2023-06-12 13:17:04 +02:00
Fiore Mario Vitale
28366f3809 DBZ-6424 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-06-09 20:10:39 +02:00
mfvitale
86877d6b4e DBZ-6424 Add docs for notification.sink.topic.name and move kafka signal properties section to all connectors 2023-06-09 20:10:39 +02:00
Fiore Mario Vitale
6bf2f292ac DBZ-6424 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-06-09 20:10:39 +02:00
Jiri Pechanec
7ff18cb22c DBZ-6424 Formatting changes 2023-06-09 20:10:39 +02:00
mfvitale
c3d79fcdb1 DBZ-6424 Add docs for new JmxSignalChannel and JmxNotificationChannel 2023-06-09 20:10:39 +02:00
Jiri Pechanec
23b7b7c5dd [release] Changelog for 2.3.0.CR1 2023-06-09 08:23:31 +02:00
Jesse Ehrenzweig
0180eae3f1 [docs] Fixed "SQL Server on Azure" link to examples. 2023-06-09 06:12:35 +02:00
Vojtech Juranek
b795519514 DBZ-6529 Use Murmur hash for PartitionRouting SMT
Add option to use better hash function than default Java Object::hash
function to get better hashes which would be more equally spred over
the hash space and thus more equally over the Kafka partitions.
To preserve backward compatibility, previous Java `hashCode` function
is used a default.

Add Murmur3 hash function for computing hashes of the fields.
Murmur3 implementation is taken from from Infinispan project code base.

To allow users eventually use their own make `computePartition()`
protected so it can be overriden in the subclasses.
2023-06-07 11:48:30 +02:00
Jiri Pechanec
5a8821ac81 [docs] Fix formatting 2023-06-05 07:47:01 +02:00
Vojtech Juranek
12f31d1be2 [docs] Make clear chunk size is number of rows, not size 2023-06-01 09:03:32 +02:00
Fiore Mario Vitale
ed44f2513a DBZ-6408 Improve documentation for notifications and signaling
Co-authored-by: roldanbob <broldan@redhat.com>
2023-05-30 17:17:52 +02:00
Fiore Mario Vitale
450c6df9bf DBZ-6408 Improve documentation for notifications and signaling
Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>

Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>

Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>

Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>
2023-05-30 17:17:52 +02:00
mfvitale
e1c1e65336 DBZ-6408 Add documentation for notifications 2023-05-30 17:17:52 +02:00
mfvitale
6bb4be86af DBZ-6408 Add documentation for custom signaling channel 2023-05-30 17:17:52 +02:00
Jiri Pechanec
af0de3d3dd [release] Changelog for 2.3.0.Beta1 2023-05-26 12:15:05 +02:00
angsdey2
80c910c652 DBZ-6470 Refer correctly to the source database
While creating signaling table we need to have privileges to create table in source database not target
2023-05-16 13:16:09 +02:00
Jiri Pechanec
d992ae5f4e DBZ-6461 Rename to delivery timeout; Increase default value 2023-05-16 13:03:49 +02:00
mfvitale
d08e72fda7 DBZ-6461 Document new debezium.sink.pubsub.wait.message.computation.timeout.ms and debezium.sink.pubsublite.wait.message.computation.timeout.ms properties to configure the wait time on message processing by Google PubSub 2023-05-16 13:03:49 +02:00
Jiri Pechanec
ff85a7839a [release] Changelog for 2.3.0.Alpha1 2023-05-11 12:52:03 +02:00
Chris Cranford
c16df4f2c4 DBZ-6254 Document new configuration options 2023-05-09 11:31:08 +02:00
Stephen Clarkson
4be4f5c874 [docs] resolve grammatical error with note
Property `skip.messages.without.change` in Postgresql Connector documentation has a note with a grammatical error.
2023-05-04 06:11:05 +02:00
Bob Roldan
b0bae55f4b DBZ-6046 Minor edits 2023-05-03 07:26:18 +02:00
Bob Roldan
954623183c DBZ-6046 Adds documentation about upgrading PG DB used by Debezium 2023-05-03 07:26:18 +02:00
roldanbob
789f44043b
[docs] Fix typo
Insert missing character (on -> one)
2023-05-02 09:08:36 -04:00
miguelbirdie
63cc36e9a2 DBZ-6112 Set Replica Identity for PostgreSQL tables
Introduces a new PostgreSQL configuration parameter called `replica.autoset.type`. With this parameter, you can easily specify the Replica Identity value for each table that is captured by the connector
2023-05-02 14:33:46 +02:00
roldanbob
d39db1a567
[docs] (main) Update link in description of the HoursToKeepTransactionInBuffer property
Updates the link in the description of the `HoursToKeepTransactionInBuffer` property so that it points to the entry for the `log.mining.transaction.retention.ms` property,  which supersedes `log.mining.transaction.retention.hours`, the original link target, which was removed in 2.2.
2023-05-01 17:17:45 -04:00
Chris Cranford
1e10253c5e DBZ-6256 Documentation updates 2023-05-01 10:41:05 -04:00
Chris Cranford
3f554645b6 DBZ-6256 Add log.mining.flush.table.name Oracle config option
There is the potential when using multiple connector deployments on Oracle that
there could be some level of lock contention with all connectors using the same
table. This allows users to configure the flush table name themselves, reducing
the lock contention across multiple connector deployments.
2023-05-01 10:41:05 -04:00
RJ Nowling
6c11e4d4ab DBZ-6348 Add documentation for HTTP Client JWT authentication 2023-05-01 10:09:38 -04:00
Ronak Jain
4fcf7ec056 DBZ-6321: chore(Postgres-Document) Document Requirements for multiple connectors on same db host
Addresses/Closes DBZ-6321
2023-05-01 10:06:43 -04:00
Chris Cranford
4664dd6df6 DBZ-6355 Add log.mining.transaction.retention.ms; deprecate log.mining.transaction.retention.hours 2023-04-27 09:28:29 -04:00
Breno Moreira
910394f3c3 DBZ-6372 - Kinesis Sink - AWS Credentials Provider
https://issues.redhat.com/projects/DBZ/issues/DBZ-6372
2023-04-27 08:20:42 +02:00
roldanbob
ef024fb4e6
[docs] Remove incubating note for Cassandra
This change completes the changes called for in DBZ-5922 to remove the incubating note from the Cassandra connector documentation by removing the related note from the `connectors/index.adoc` file.
2023-04-26 18:02:46 -04:00
mfvitale
6eb278d66b [docs] Wrong download link for jdbc connector 2023-04-26 08:51:11 -04:00
Frederic Laurent
d4995f1fab DBZ-6340 Update Postgres connector documentation to reflect new SSL mode values (and default) 2023-04-26 12:48:54 +02:00
Frederic Laurent
84b2e29698 DBZ-6340 Make preferred the new default SSL mode for the MySQL connector 2023-04-26 12:48:04 +02:00
Jiri Pechanec
8c52ccfd0c DBZ-6391 Use incdluded term for consistency 2023-04-26 12:31:15 +02:00
jcechace
62952f44cb DBZ-6342 Documented status of incremental snapshotting for sharded MongoDB Clusters 2023-04-22 08:08:31 +02:00
roldanbob
4a73aac079
[docs] Fix typo in link
Remove extra opening square bracket that results  in broken link
2023-04-21 15:30:37 -04:00
roldanbob
86376ffa48
[docs] Corrects spelling typo 2023-04-21 12:22:58 -04:00
Bob Roldan
9e6da903bb DBZ-6371 Replaces <build_number> references in examples w/ attributes. 2023-04-20 15:58:37 -04:00
Jiri Pechanec
aa6c5a00cf [docs] Use correct version in docs 2023-04-20 13:37:10 +02:00
Chris Cranford
c5a28836e1 DBZ-5859 Finalize edits 2023-04-19 11:25:53 -04:00
Chris Cranford
0365954031 DBZ-5859 Suggested edits 2023-04-19 11:25:53 -04:00
ingmarfjolla
a9189e9c74 DBZ-5859 first draft of reactive outbox docs 2023-04-19 11:25:53 -04:00
Ronak Jain
2c2b87b846 DBZ-2979 If column.include.list/column.exclude.list are used and the target table receives an update for the excluded (or not included) column - such events should be ignored
* [Unstable][Untested] Add config in Oracle Connector

Addresses/Closes DBZ-2979
2023-04-19 09:04:29 +02:00
Ronak Jain
762122ecf5 DBZ-2979 If column.include.list/column.exclude.list are used and the target table receives an update for the excluded (or not included) column - such events should be ignored
* Add Mysql and SqlServer Connector Changes
* Change Docs
* Clean Test Case
* Formatting and Checkstyle

Addresses/Closes DBZ-2979
2023-04-19 09:04:29 +02:00
Bob Roldan
6d796395f9 DBZ-6351 Fixes broken links in deployment instructions 2023-04-18 18:50:25 -04:00
Vojtech Juranek
db4c2fd918 [docs] Mention deprecation of Mysql event.deserialization.failure.handling.mode 2023-04-18 11:56:02 +02:00
Jiri Pechanec
e9db1c4829 DBZ-6260 Reformat text; add injection points 2023-04-18 08:13:12 +02:00
Olivier Boudet
bb5b07e7e1 DBZ-6260 documentation for RabbitMQ sink 2023-04-18 08:13:12 +02:00
Jiri Pechanec
5ed3fa3e0d DBZ-6325 Reformat text flow 2023-04-18 07:25:54 +02:00
RJ Nowling
c9971dedc1 DBZ-6325 Describe example configuration
Also, be consistent about using {prodname} instead of the constant string "Debezium".
2023-04-18 07:25:54 +02:00
Jiri Pechanec
a78610bd7c DBZ-6319 Reformat textflow 2023-04-18 07:17:35 +02:00
Henko
56ec714c58 DBZ-6319 Add documentation for timeout in pulsar sink 2023-04-18 07:17:35 +02:00
Jiri Pechanec
0ff0d087c0 [release] Changelog for 2.2.0.CR1 2023-04-14 09:58:37 +02:00
Fiore Mario Vitale
f6a8970629 DBZ-5902 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-04-13 08:10:09 +02:00
mfvitale
36109b4ca3 DBZ-5902 Change fields configuration from 'partition.payload.field' to 'partition.payload.fields' 2023-04-13 08:10:09 +02:00
Fiore Mario Vitale
1d241283b7 DBZ-5902 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-04-13 08:10:09 +02:00
mfvitale
740d97a0f5 DBZ-5902 Add docs for PartitionRouting SMT that will replace ComputePartition 2023-04-13 08:10:09 +02:00
Chris Cranford
0d0b25e079 DBZ-6318 Removed outdated SYS account usage 2023-04-13 08:08:21 +02:00
Bob Roldan
585b00a5bd DBZ-6330 Edits to fix links in MongoDB event flattening doc 2023-04-12 21:08:31 -04:00
Bob Roldan
311decac20 DBZ-6330 Address review feedback and fix links 2023-04-12 21:08:31 -04:00
Bob Roldan
fe82f5fca0 DBZ-6327 Reformat links 2023-04-12 09:33:35 -04:00
Bob Roldan
37bb294b9b DBZ-6327 Reformat link in NoSQL version of triggering snapshot file 2023-04-12 09:33:35 -04:00
Bob Roldan
5d0e6f2bf6 DBZ-6327 Fix incorrectly formatted inter-file links 2023-04-12 09:33:35 -04:00
Bob Roldan
79d74cf5c0 DBZ-6327 Replace conditionalized files w/ separate SQL/NoSQL versions 2023-04-12 09:33:35 -04:00
Vojtech Juranek
44f2f40c56 DBZ-6216 Update testcontainers to use quay.io images
When needed update also version.
Update also leftovers in readme files.
2023-04-12 14:07:35 +02:00
Chris Cranford
9c8954bb25 DBZ-6310 Applied edits (round 2) 2023-04-11 13:40:06 +02:00
Chris Cranford
ff709a271e DBZ-6310 Add JDBC connector to navigation 2023-04-11 13:40:06 +02:00
Chris Cranford
292e0f4e5d DBZ-6310 Applied edits (round 1) 2023-04-11 13:40:06 +02:00
Chris Cranford
dbb1c4092a DBZ-6310 Document JDBC sink connector 2023-04-11 13:40:06 +02:00
doupengwei
352d616173 DBZ-6155 Adjust LogMiner batch size based on the default batch size rather than current batch size.
Using current batch size for comparison is wrong in case that when currentScn is topScn as described in DBZ-6155.
In the other case (when topScn is behind currentScn) can eventually lead to this situation.
when topScn would fall behind currentScn more and more as we would compare currentScn - topScn with bigger and bigger number (current batch size).

Comapring with logMiningBatchSizeMin could result in very small window which would mean we will send many small queries instead of several bigger ones during mining.
Therefore reverting back to do the adjustments based on the defaultBatchSize.
2023-04-10 16:51:11 -04:00
harveyyue
c525f34cd0 DBZ-6070 DDL events not stored in schema history topic for excluded tables 2023-04-06 12:10:30 +02:00
Chris Cranford
85d7866f3d DBZ-6198 Update Oracle permissions to include statistics tables 2023-04-06 07:04:14 +02:00
roldanbob
ea67433f70
[docs] update format of 2 links in architecture.adoc
QE reports that links to two SMTs from the Architecture  doc are broken. To ensure that links to targets external to the current file continue to  to work downstream, they must use the `{link-prefix}` attribute vs. a simple `xref` macro.
2023-04-03 17:33:59 -04:00
Bob Roldan
1d4cb18ead DBZ-6272 Update shared files for downsream user guide & ocp install doc 2023-04-01 17:38:38 -04:00
roldanbob
af6cc03855
[docs] (main) Conditionalize link to binlog.buffer.size property
The configuration propery `binlog.buffer.size` is conditionalized for community use only. However, a link in the Streaming metrics topic targets the entry for the property in the configuration properties table.  This change conditionalizes the sentence that contains the link.
2023-03-31 11:12:39 -04:00
Jiri Pechanec
a2dc0d337f [release] Changelog for 2.2.0.Beta1 2023-03-31 11:40:12 +02:00
Bob Roldan
d12659f5da DBZ-6267 Further adjusts the MySQL and SQL Server Kafka examples 2023-03-30 17:39:41 -04:00
Bob Roldan
3c8a47bb48 DBZ-6267 updates Kafka version and config props in shared files 2023-03-30 17:39:41 -04:00