Commit Graph

940 Commits

Author SHA1 Message Date
Bob Roldan
79d74cf5c0 DBZ-6327 Replace conditionalized files w/ separate SQL/NoSQL versions 2023-04-12 09:33:35 -04:00
Chris Cranford
9c8954bb25 DBZ-6310 Applied edits (round 2) 2023-04-11 13:40:06 +02:00
Chris Cranford
292e0f4e5d DBZ-6310 Applied edits (round 1) 2023-04-11 13:40:06 +02:00
Chris Cranford
dbb1c4092a DBZ-6310 Document JDBC sink connector 2023-04-11 13:40:06 +02:00
doupengwei
352d616173 DBZ-6155 Adjust LogMiner batch size based on the default batch size rather than current batch size.
Using current batch size for comparison is wrong in case that when currentScn is topScn as described in DBZ-6155.
In the other case (when topScn is behind currentScn) can eventually lead to this situation.
when topScn would fall behind currentScn more and more as we would compare currentScn - topScn with bigger and bigger number (current batch size).

Comapring with logMiningBatchSizeMin could result in very small window which would mean we will send many small queries instead of several bigger ones during mining.
Therefore reverting back to do the adjustments based on the defaultBatchSize.
2023-04-10 16:51:11 -04:00
Chris Cranford
85d7866f3d DBZ-6198 Update Oracle permissions to include statistics tables 2023-04-06 07:04:14 +02:00
roldanbob
af6cc03855
[docs] (main) Conditionalize link to binlog.buffer.size property
The configuration propery `binlog.buffer.size` is conditionalized for community use only. However, a link in the Streaming metrics topic targets the entry for the property in the configuration properties table.  This change conditionalizes the sentence that contains the link.
2023-03-31 11:12:39 -04:00
Bob Roldan
d12659f5da DBZ-6267 Further adjusts the MySQL and SQL Server Kafka examples 2023-03-30 17:39:41 -04:00
roldanbob
ef5592e858
[docs] Add missing character to downstream annotation
A dash omitted from the Nebel annotation  `description-of-how-the-mongodb-connector-uses-change streams-to-capture-event-records`  between `change` and `streams` results in a downstream build parsing error
2023-03-29 11:06:05 -04:00
roldanbob
b27108bbd9 DBZ-6090 Address feedback from doc technical review 2023-03-29 00:10:54 +02:00
roldanbob
47dc9d39fa DBZ-6090 Apply approved suggestions from doc review
Awaiting approval from @jcechace before I commit the remaining two updates.
2023-03-29 00:10:54 +02:00
jcechace
fd01c533f2 DBZ-6090 Added documentation for mongodb.connection.mode 2023-03-29 00:10:54 +02:00
roldanbob
4eabec4ad5 DBZ-6090 Apply edits from documentation review 2023-03-23 13:30:47 +01:00
jcechace
0dbdbcf119 DBZ-6090 Updated connection information in MongoDB documentation 2023-03-23 13:30:47 +01:00
Bob Roldan
df8eb9780b DBZ-6223 Adds upstream anchor 2023-03-22 12:17:30 +01:00
Bob Roldan
76d38e41b4 DBZ-6233 Add metadata; additional edits 2023-03-22 12:17:30 +01:00
Bob Roldan
13b2e7ac1a DBZ-823 Edit description of snapshot.tables.order.by.row.count 2023-03-22 10:18:18 +01:00
Bob Roldan
12a9aa9517 DBZ-823 Update Db2 doc for consistency 2023-03-22 10:18:18 +01:00
Bob Roldan
20b368760b DBZ-823 Conditionally designates parallel snapshots as incubating or TP 2023-03-22 10:18:18 +01:00
Bob Roldan
4138a9898a DBZ-6215 Adds missing annotation comments for Oracle connector FAQ topic 2023-03-16 07:58:55 +01:00
Bob Roldan
405be98721 DBZ-6153 Refactor Streams deployment content to fix errors 2023-03-10 11:47:21 +01:00
PlugaruT
6d32e22549 DBZ-5490 Document the case when message.key.columns is set and REPLICA IDENTITY of the tables is not FULL.
It breaks tombstone events to have the proper key created because non-primary key columns will be null, and their values in the key will also be null.
2023-03-10 07:46:40 +01:00
Jiri Pechanec
fef5fa26f3 DBZ-823 Mark parallel snapshotting as incubating in documentation 2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
Bobby Tiernay
fe3135f28d DBZ-6131: Support change stream filtering using MongoDBs aggregation pipeline step. 2023-02-28 20:17:05 +01:00
Bob Roldan
621dae76f2 DBZ-6073 Move note text and eliminate embedded community conditional 2023-02-28 13:40:11 +01:00
Bobby Tiernay
5d80712781 DBZ-5201: Add MongoDB connector support for server-side filtering of replica set change streams.
This change migrates from doing client-side filtering of streaming
change events to performing it server-side via MongoDB's support
for aggregation pipelines. This can drastically cut down on the amount
of data sent between the client and server. In addition, a new approach
to heartbeating has been added which relies on the `postBatchResumeToken`
to advance the the cursor even when no changes occur on the pipeline.
2023-02-23 18:14:08 +01:00
Vojtech Juranek
ffc9c2f80d [docs] Fix poll.interval.ms default value 2023-02-22 13:49:40 -05:00
Xinbin Huang
a3d75e798a DBZ-6116: Support String type for key in Mongo incremental snapshot 2023-02-20 13:55:54 +01:00
Mehmet Firat KOMURCU
4c9ab87704 DBZ-6123 fix typo "evemts" to "events" in docs.
fix typo in sql server docs
2023-02-20 08:29:54 +01:00
Bob Roldan
bb0f972af4 DBZ-6006 Update MongoDB flattening docs for downstream 2023-02-16 08:27:31 +01:00
Chris Cranford
58f3770ad1 DBZ-6079 Change query.fetch.size default from 0 to 2000 for Oracle 2023-02-16 08:15:22 +01:00
Chris Cranford
7cd7cad094 DBZ-6091 Fix SSN NumericOverflow exception 2023-02-14 09:44:21 +01:00
Gunnar Morling
5ff4df1417 [docs] Adding missing comma in listing 2023-02-13 10:31:01 -05:00
Théophile Helleboid - chtitux
f3417f383f [docs] Fix link to PG mailing List
https://www.postgresql.org/message-id/CAJ3gD9fE%3D0w50sRagcs%2BjrktBXuJAWGZQdSTMa57CCY%2BDh-xbg%40mail.gmail.com is encoded and works.

The link is currently broken because `@` generate a `mailto:` link.
2023-02-08 12:37:08 +01:00
Bob Roldan
c853770c86 DBZ-6069 Remove problematic links 2023-02-03 08:49:30 +01:00
harveyyue
0dcf9922f6 DBZ-5743 update the "field.name.adjustment.mode" property to all connector docs 2023-02-02 13:21:45 +01:00
harveyyue
f093d7a6c9 DBZ-5743 Introduce alternative AVRO_UNICODE mode for schema adjuster 2023-02-02 13:21:45 +01:00
TimLoes
c8bfc6562b [docs] Variable name clarified
It is necessary to query for server_id instead of server-id, which is being used on the config file.
2023-02-01 06:27:16 +01:00
Henry Cai
a2f15abafd DBZ-6043: Vitess: Support Mapping unsigned bigint mysql column type to long
Add doc for the new `bigint.unsigned.handling.mode`
2023-01-31 07:17:33 +01:00
Lokesh Sanapalli
591cef13bb DBZ-4829 : added event.processing.failure.handling.mode configuration to the documentation 2023-01-24 08:51:09 +01:00
yoheimuta
0f01851b05 DBZ-5930 Remove a confusing note about a future release in document 2023-01-17 10:53:28 +01:00
yoheimuta
9346a2e550 DBZ-5930 Fix a typo in document 2023-01-17 10:53:28 +01:00
yohei yoshimuta
d3efd8904f DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yohei yoshimuta
c9bf4ac795 DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yohei yoshimuta
5069064607 DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yohei yoshimuta
5faa9cde6c DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yohei yoshimuta
bd812be653 DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yoheimuta
fad1fb157d DBZ-5930 Add the doc for vitess snapshot.mode 2023-01-17 10:53:28 +01:00
Jiri Pechanec
bcd6787cdc DBZ-6008 Revert "DBZ-3653 Introduce incremental.snapshot.isolation.mode config"
This reverts commit 6d8bcd42fd.
2023-01-17 10:40:20 +01:00