alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
8,950 Commits 3 Branches 0 Tags 51 MiB
3672ed6ef5
Commit Graph

1044 Commits

Author SHA1 Message Date
Ronak Jain
317e6d665f DBZ-6455: Document Optimal MongoDB Oplog Config for Resiliency 
Addresses/Closes DBZ-6455
 2023-07-24 12:05:16 +02:00
Ronak Jain
1631193d3e DBZ-6455: Document Optimal MongoDB Oplog Config for Resiliency 
Addresses/Closes DBZ-6455
 2023-07-24 12:05:16 +02:00
roldanbob
a798995c22 DBZ-6591 Add xref to connector property 
Adds link to the `mongodb.connection.string.shard.params` property
 2023-07-24 11:59:09 +02:00
jcechace
2fa02f6c38 DBZ-6591 Documenting read preference changes in 2.4 
Co-authored-by: roldanbob <broldan@redhat.com>
 2023-07-24 11:59:09 +02:00
Chris Cranford
0b0c5d85fc DBZ-6676 Oracle XML/RAW documentation updates 2023-07-18 23:05:00 -04:00
Chris Cranford
d660909fc1 DBZ-3605 Cleanup documentation, dependencies, and SAX requirements 2023-07-17 10:21:11 +02:00
Chris Cranford
7d1a26af9b DBZ-3605 Document Oracle XMLTYPE and RAW support 2023-07-17 10:21:11 +02:00
twthorn
7613cccc58 DBZ-6627 Adjust wording of recovery 2023-07-13 13:19:52 +02:00
twthorn
bef9d7541b DBZ-6627 aka to also known as 2023-07-13 13:19:52 +02:00
twthorn
3aa88ede3e DBZ-6627 Update recovery wording 2023-07-13 13:19:52 +02:00
twthorn
bf8dc05107 DBZ-6627 Update intro docs 2023-07-13 13:19:52 +02:00
twthorn
f8ae919035 DBZ-6627 Update Vitess Connector docs with new shard field; remove trailing whitespace 2023-07-13 13:19:52 +02:00
ani-sha
1e60d3c1d9 DBZ-5518 Document message schema format 2023-07-13 13:18:16 +02:00
harveyyue
aa139203aa DBZ-6603 Update property "custom.metric.tags" to connector docs 2023-07-13 09:52:33 +02:00
Jakub Cechacek
d010252258 DBZ-6592 Additional docs fixes from review 
Co-authored-by: roldanbob <broldan@redhat.com>
 2023-07-11 16:13:30 +02:00
Jakub Cechacek
052ac544c2 DBZ-6592 Apply suggestions from code review 
Co-authored-by: roldanbob <broldan@redhat.com>
 2023-07-11 16:13:30 +02:00
jcechace
b87f0ec776 DBZ-6592 Documenting database permissions required by the MongoDB connector 2023-07-11 16:13:30 +02:00
Fiore Mario Vitale
ebc438c278 DBZ-6632 Apply suggestions from code review 
Co-authored-by: roldanbob <broldan@redhat.com>
 2023-07-06 17:04:37 +02:00
mfvitale
8669edb64e DBZ-6632 Improve properties description on JDBC connector documentation 2023-07-06 17:04:37 +02:00
Hossein Torabi
78e6baeb31 DBZ-6602: Support record header as primary_key 2023-06-30 13:13:47 -04:00
harveyyue
f4c8810107 [docs] Replace the deprecated "database.server.name" to "topic.prefix" 2023-06-28 08:19:31 +02:00
Ant Kutschera
d7e406328e [docs] Link doesnt work in Chrome 
in the browser, it uses https://learn.microsoft.com/en-us/samples/azure-samples/azure-sql-db-change-stream-debezium/azure-sql%E2%80%94%E2%80%8Bsql-server-change-stream-with-debezium/ and then returns a 404
 2023-06-22 12:29:05 +02:00
Bob Roldan
e4b428f8b6 DBZ-6474 Fix typo found in ID for log.mining.username.include.list prop 2023-06-13 08:13:12 +02:00
Bob Roldan
eaf4ce9bf8 DBZ-6474 Must set CDB snapshot.include.collection.list regex to PDB name 2023-06-13 08:13:12 +02:00
Chris Cranford
e025230d44 DBZ-6499 Support restarting JDBC connections 
Introduces a new configuration option, `log.mining.restart.connection`,
which closes and re-opens the JDBC connection when an Oracle Log switch
occurs or when the optionally configured log mining session max lifetime
is reached.
 2023-06-13 07:09:01 +02:00
David Beck
21c1b1f5dc [docs] Add initial to table snapshot.mode in postgresql.adoc 
This adds a bit more clarity into the `initial` mode since it was very confusing as a new user to understand that `initial` was the default value but didn't exist in the table.
 2023-06-12 13:17:04 +02:00
Fiore Mario Vitale
28366f3809 DBZ-6424 Apply suggestions from code review 
Co-authored-by: roldanbob <broldan@redhat.com>
 2023-06-09 20:10:39 +02:00
mfvitale
86877d6b4e DBZ-6424 Add docs for notification.sink.topic.name and move kafka signal properties section to all connectors 2023-06-09 20:10:39 +02:00
Jesse Ehrenzweig
0180eae3f1 [docs] Fixed "SQL Server on Azure" link to examples. 2023-06-09 06:12:35 +02:00
Fiore Mario Vitale
450c6df9bf DBZ-6408 Improve documentation for notifications and signaling 
Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>

Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>

Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>

Apply suggestions from code review

Co-authored-by: roldanbob <broldan@redhat.com>
 2023-05-30 17:17:52 +02:00
mfvitale
e1c1e65336 DBZ-6408 Add documentation for notifications 2023-05-30 17:17:52 +02:00
mfvitale
6bb4be86af DBZ-6408 Add documentation for custom signaling channel 2023-05-30 17:17:52 +02:00
Chris Cranford
c16df4f2c4 DBZ-6254 Document new configuration options 2023-05-09 11:31:08 +02:00
Stephen Clarkson
4be4f5c874 [docs] resolve grammatical error with note 
Property `skip.messages.without.change` in Postgresql Connector documentation has a note with a grammatical error.
 2023-05-04 06:11:05 +02:00
Bob Roldan
b0bae55f4b DBZ-6046 Minor edits 2023-05-03 07:26:18 +02:00
Bob Roldan
954623183c DBZ-6046 Adds documentation about upgrading PG DB used by Debezium 2023-05-03 07:26:18 +02:00
miguelbirdie
63cc36e9a2 DBZ-6112 Set Replica Identity for PostgreSQL tables 
Introduces a new PostgreSQL configuration parameter called `replica.autoset.type`. With this parameter, you can easily specify the Replica Identity value for each table that is captured by the connector
 2023-05-02 14:33:46 +02:00
roldanbob
d39db1a567
[docs] (main) Update link in description of the HoursToKeepTransactionInBuffer property 
Updates the link in the description of the `HoursToKeepTransactionInBuffer` property so that it points to the entry for the `log.mining.transaction.retention.ms` property,  which supersedes `log.mining.transaction.retention.hours`, the original link target, which was removed in 2.2.
 2023-05-01 17:17:45 -04:00
Chris Cranford
1e10253c5e DBZ-6256 Documentation updates 2023-05-01 10:41:05 -04:00
Chris Cranford
3f554645b6 DBZ-6256 Add log.mining.flush.table.name Oracle config option 
There is the potential when using multiple connector deployments on Oracle that
there could be some level of lock contention with all connectors using the same
table. This allows users to configure the flush table name themselves, reducing
the lock contention across multiple connector deployments.
 2023-05-01 10:41:05 -04:00
Ronak Jain
4fcf7ec056 DBZ-6321: chore(Postgres-Document) Document Requirements for multiple connectors on same db host 
Addresses/Closes DBZ-6321
 2023-05-01 10:06:43 -04:00
Chris Cranford
4664dd6df6 DBZ-6355 Add log.mining.transaction.retention.ms; deprecate log.mining.transaction.retention.hours 2023-04-27 09:28:29 -04:00
roldanbob
ef024fb4e6
[docs] Remove incubating note for Cassandra 
This change completes the changes called for in DBZ-5922 to remove the incubating note from the Cassandra connector documentation by removing the related note from the `connectors/index.adoc` file.
 2023-04-26 18:02:46 -04:00
mfvitale
6eb278d66b [docs] Wrong download link for jdbc connector 2023-04-26 08:51:11 -04:00
Frederic Laurent
d4995f1fab DBZ-6340 Update Postgres connector documentation to reflect new SSL mode values (and default) 2023-04-26 12:48:54 +02:00
Frederic Laurent
84b2e29698 DBZ-6340 Make preferred the new default SSL mode for the MySQL connector 2023-04-26 12:48:04 +02:00
Jiri Pechanec
8c52ccfd0c DBZ-6391 Use incdluded term for consistency 2023-04-26 12:31:15 +02:00
jcechace
62952f44cb DBZ-6342 Documented status of incremental snapshotting for sharded MongoDB Clusters 2023-04-22 08:08:31 +02:00
Bob Roldan
9e6da903bb DBZ-6371 Replaces <build_number> references in examples w/ attributes. 2023-04-20 15:58:37 -04:00
Ronak Jain
2c2b87b846 DBZ-2979 If column.include.list/column.exclude.list are used and the target table receives an update for the excluded (or not included) column - such events should be ignored 
* [Unstable][Untested] Add config in Oracle Connector

Addresses/Closes DBZ-2979
 2023-04-19 09:04:29 +02:00
Ronak Jain
762122ecf5 DBZ-2979 If column.include.list/column.exclude.list are used and the target table receives an update for the excluded (or not included) column - such events should be ignored 
* Add Mysql and SqlServer Connector Changes
* Change Docs
* Clean Test Case
* Formatting and Checkstyle

Addresses/Closes DBZ-2979
 2023-04-19 09:04:29 +02:00
Vojtech Juranek
db4c2fd918 [docs] Mention deprecation of Mysql event.deserialization.failure.handling.mode 2023-04-18 11:56:02 +02:00
Chris Cranford
0d0b25e079 DBZ-6318 Removed outdated SYS account usage 2023-04-13 08:08:21 +02:00
Bob Roldan
311decac20 DBZ-6330 Address review feedback and fix links 2023-04-12 21:08:31 -04:00
Bob Roldan
79d74cf5c0 DBZ-6327 Replace conditionalized files w/ separate SQL/NoSQL versions 2023-04-12 09:33:35 -04:00
Chris Cranford
9c8954bb25 DBZ-6310 Applied edits (round 2) 2023-04-11 13:40:06 +02:00
Chris Cranford
292e0f4e5d DBZ-6310 Applied edits (round 1) 2023-04-11 13:40:06 +02:00
Chris Cranford
dbb1c4092a DBZ-6310 Document JDBC sink connector 2023-04-11 13:40:06 +02:00
doupengwei
352d616173 DBZ-6155 Adjust LogMiner batch size based on the default batch size rather than current batch size. 
Using current batch size for comparison is wrong in case that when currentScn is topScn as described in DBZ-6155.
In the other case (when topScn is behind currentScn) can eventually lead to this situation.
when topScn would fall behind currentScn more and more as we would compare currentScn - topScn with bigger and bigger number (current batch size).

Comapring with logMiningBatchSizeMin could result in very small window which would mean we will send many small queries instead of several bigger ones during mining.
Therefore reverting back to do the adjustments based on the defaultBatchSize.
 2023-04-10 16:51:11 -04:00
Chris Cranford
85d7866f3d DBZ-6198 Update Oracle permissions to include statistics tables 2023-04-06 07:04:14 +02:00
roldanbob
af6cc03855
[docs] (main) Conditionalize link to binlog.buffer.size property 
The configuration propery `binlog.buffer.size` is conditionalized for community use only. However, a link in the Streaming metrics topic targets the entry for the property in the configuration properties table.  This change conditionalizes the sentence that contains the link.
 2023-03-31 11:12:39 -04:00
Bob Roldan
d12659f5da DBZ-6267 Further adjusts the MySQL and SQL Server Kafka examples 2023-03-30 17:39:41 -04:00
roldanbob
ef5592e858
[docs] Add missing character to downstream annotation 
A dash omitted from the Nebel annotation  `description-of-how-the-mongodb-connector-uses-change streams-to-capture-event-records`  between `change` and `streams` results in a downstream build parsing error
 2023-03-29 11:06:05 -04:00
roldanbob
b27108bbd9 DBZ-6090 Address feedback from doc technical review 2023-03-29 00:10:54 +02:00
roldanbob
47dc9d39fa DBZ-6090 Apply approved suggestions from doc review 
Awaiting approval from @jcechace before I commit the remaining two updates.
 2023-03-29 00:10:54 +02:00
jcechace
fd01c533f2 DBZ-6090 Added documentation for mongodb.connection.mode 2023-03-29 00:10:54 +02:00
roldanbob
4eabec4ad5 DBZ-6090 Apply edits from documentation review 2023-03-23 13:30:47 +01:00
jcechace
0dbdbcf119 DBZ-6090 Updated connection information in MongoDB documentation 2023-03-23 13:30:47 +01:00
Bob Roldan
df8eb9780b DBZ-6223 Adds upstream anchor 2023-03-22 12:17:30 +01:00
Bob Roldan
76d38e41b4 DBZ-6233 Add metadata; additional edits 2023-03-22 12:17:30 +01:00
Bob Roldan
13b2e7ac1a DBZ-823 Edit description of snapshot.tables.order.by.row.count 2023-03-22 10:18:18 +01:00
Bob Roldan
12a9aa9517 DBZ-823 Update Db2 doc for consistency 2023-03-22 10:18:18 +01:00
Bob Roldan
20b368760b DBZ-823 Conditionally designates parallel snapshots as incubating or TP 2023-03-22 10:18:18 +01:00
Bob Roldan
4138a9898a DBZ-6215 Adds missing annotation comments for Oracle connector FAQ topic 2023-03-16 07:58:55 +01:00
Bob Roldan
405be98721 DBZ-6153 Refactor Streams deployment content to fix errors 2023-03-10 11:47:21 +01:00
PlugaruT
6d32e22549 DBZ-5490 Document the case when message.key.columns is set and REPLICA IDENTITY of the tables is not FULL. 
It breaks tombstone events to have the proper key created because non-primary key columns will be null, and their values in the key will also be null.
 2023-03-10 07:46:40 +01:00
Jiri Pechanec
fef5fa26f3 DBZ-823 Mark parallel snapshotting as incubating in documentation 2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
Bobby Tiernay
fe3135f28d DBZ-6131: Support change stream filtering using MongoDBs aggregation pipeline step. 2023-02-28 20:17:05 +01:00
Bob Roldan
621dae76f2 DBZ-6073 Move note text and eliminate embedded community conditional 2023-02-28 13:40:11 +01:00
Bobby Tiernay
5d80712781 DBZ-5201: Add MongoDB connector support for server-side filtering of replica set change streams. 
This change migrates from doing client-side filtering of streaming
change events to performing it server-side via MongoDB's support
for aggregation pipelines. This can drastically cut down on the amount
of data sent between the client and server. In addition, a new approach
to heartbeating has been added which relies on the `postBatchResumeToken`
to advance the the cursor even when no changes occur on the pipeline.
 2023-02-23 18:14:08 +01:00
Vojtech Juranek
ffc9c2f80d [docs] Fix poll.interval.ms default value 2023-02-22 13:49:40 -05:00
Xinbin Huang
a3d75e798a DBZ-6116: Support String type for key in Mongo incremental snapshot 2023-02-20 13:55:54 +01:00
Mehmet Firat KOMURCU
4c9ab87704 DBZ-6123 fix typo "evemts" to "events" in docs. 
fix typo in sql server docs
 2023-02-20 08:29:54 +01:00
Bob Roldan
bb0f972af4 DBZ-6006 Update MongoDB flattening docs for downstream 2023-02-16 08:27:31 +01:00
Chris Cranford
58f3770ad1 DBZ-6079 Change query.fetch.size default from 0 to 2000 for Oracle 2023-02-16 08:15:22 +01:00
Chris Cranford
7cd7cad094 DBZ-6091 Fix SSN NumericOverflow exception 2023-02-14 09:44:21 +01:00
Gunnar Morling
5ff4df1417 [docs] Adding missing comma in listing 2023-02-13 10:31:01 -05:00
Théophile Helleboid - chtitux
f3417f383f [docs] Fix link to PG mailing List 
https://www.postgresql.org/message-id/CAJ3gD9fE%3D0w50sRagcs%2BjrktBXuJAWGZQdSTMa57CCY%2BDh-xbg%40mail.gmail.com is encoded and works.

The link is currently broken because `@` generate a `mailto:` link.
 2023-02-08 12:37:08 +01:00
Bob Roldan
c853770c86 DBZ-6069 Remove problematic links 2023-02-03 08:49:30 +01:00
harveyyue
0dcf9922f6 DBZ-5743 update the "field.name.adjustment.mode" property to all connector docs 2023-02-02 13:21:45 +01:00
harveyyue
f093d7a6c9 DBZ-5743 Introduce alternative AVRO_UNICODE mode for schema adjuster 2023-02-02 13:21:45 +01:00
TimLoes
c8bfc6562b [docs] Variable name clarified 
It is necessary to query for server_id instead of server-id, which is being used on the config file.
 2023-02-01 06:27:16 +01:00
Henry Cai
a2f15abafd DBZ-6043: Vitess: Support Mapping unsigned bigint mysql column type to long 
Add doc for the new `bigint.unsigned.handling.mode`
 2023-01-31 07:17:33 +01:00
Lokesh Sanapalli
591cef13bb DBZ-4829 : added event.processing.failure.handling.mode configuration to the documentation 2023-01-24 08:51:09 +01:00
yoheimuta
0f01851b05 DBZ-5930 Remove a confusing note about a future release in document 2023-01-17 10:53:28 +01:00
yoheimuta
9346a2e550 DBZ-5930 Fix a typo in document 2023-01-17 10:53:28 +01:00
yohei yoshimuta
d3efd8904f DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc 
Co-authored-by: roldanbob <broldan@redhat.com>
 2023-01-17 10:53:28 +01:00
yohei yoshimuta
c9bf4ac795 DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc 
Co-authored-by: roldanbob <broldan@redhat.com>
 2023-01-17 10:53:28 +01:00
yohei yoshimuta
5069064607 DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc 
Co-authored-by: roldanbob <broldan@redhat.com>
 2023-01-17 10:53:28 +01:00