Commit Graph

1686 Commits

Author SHA1 Message Date
Chris Cranford
9c8954bb25 DBZ-6310 Applied edits (round 2) 2023-04-11 13:40:06 +02:00
Chris Cranford
ff709a271e DBZ-6310 Add JDBC connector to navigation 2023-04-11 13:40:06 +02:00
Chris Cranford
292e0f4e5d DBZ-6310 Applied edits (round 1) 2023-04-11 13:40:06 +02:00
Chris Cranford
dbb1c4092a DBZ-6310 Document JDBC sink connector 2023-04-11 13:40:06 +02:00
doupengwei
352d616173 DBZ-6155 Adjust LogMiner batch size based on the default batch size rather than current batch size.
Using current batch size for comparison is wrong in case that when currentScn is topScn as described in DBZ-6155.
In the other case (when topScn is behind currentScn) can eventually lead to this situation.
when topScn would fall behind currentScn more and more as we would compare currentScn - topScn with bigger and bigger number (current batch size).

Comapring with logMiningBatchSizeMin could result in very small window which would mean we will send many small queries instead of several bigger ones during mining.
Therefore reverting back to do the adjustments based on the defaultBatchSize.
2023-04-10 16:51:11 -04:00
harveyyue
c525f34cd0 DBZ-6070 DDL events not stored in schema history topic for excluded tables 2023-04-06 12:10:30 +02:00
Chris Cranford
85d7866f3d DBZ-6198 Update Oracle permissions to include statistics tables 2023-04-06 07:04:14 +02:00
roldanbob
ea67433f70
[docs] update format of 2 links in architecture.adoc
QE reports that links to two SMTs from the Architecture  doc are broken. To ensure that links to targets external to the current file continue to  to work downstream, they must use the `{link-prefix}` attribute vs. a simple `xref` macro.
2023-04-03 17:33:59 -04:00
Bob Roldan
1d4cb18ead DBZ-6272 Update shared files for downsream user guide & ocp install doc 2023-04-01 17:38:38 -04:00
roldanbob
af6cc03855
[docs] (main) Conditionalize link to binlog.buffer.size property
The configuration propery `binlog.buffer.size` is conditionalized for community use only. However, a link in the Streaming metrics topic targets the entry for the property in the configuration properties table.  This change conditionalizes the sentence that contains the link.
2023-03-31 11:12:39 -04:00
Jiri Pechanec
a2dc0d337f [release] Changelog for 2.2.0.Beta1 2023-03-31 11:40:12 +02:00
Bob Roldan
d12659f5da DBZ-6267 Further adjusts the MySQL and SQL Server Kafka examples 2023-03-30 17:39:41 -04:00
Bob Roldan
3c8a47bb48 DBZ-6267 updates Kafka version and config props in shared files 2023-03-30 17:39:41 -04:00
Bob Roldan
95c63061f6 DBZ-6263 Update shared deployment content to fix link
(cherry picked from commit cdc8bf532e6eadfd974d5fe10196db3bb4240f62)
2023-03-29 18:40:33 -04:00
roldanbob
ef5592e858
[docs] Add missing character to downstream annotation
A dash omitted from the Nebel annotation  `description-of-how-the-mongodb-connector-uses-change streams-to-capture-event-records`  between `change` and `streams` results in a downstream build parsing error
2023-03-29 11:06:05 -04:00
roldanbob
b27108bbd9 DBZ-6090 Address feedback from doc technical review 2023-03-29 00:10:54 +02:00
roldanbob
47dc9d39fa DBZ-6090 Apply approved suggestions from doc review
Awaiting approval from @jcechace before I commit the remaining two updates.
2023-03-29 00:10:54 +02:00
jcechace
fd01c533f2 DBZ-6090 Added documentation for mongodb.connection.mode 2023-03-29 00:10:54 +02:00
Fiore Mario Vitale
84ab0dc3d2
DBZ-6201: Add docs for HeaderToValue SMT (#4389)
* DBZ-6201: Add docs for HeaderToValue SMT
---------

Co-authored-by: roldanbob <broldan@redhat.com>
2023-03-27 10:44:11 +02:00
Gunnar Morling
d5963f1601 [docs] Adding missing comma 2023-03-24 13:45:39 +01:00
roldanbob
4eabec4ad5 DBZ-6090 Apply edits from documentation review 2023-03-23 13:30:47 +01:00
jcechace
0dbdbcf119 DBZ-6090 Updated connection information in MongoDB documentation 2023-03-23 13:30:47 +01:00
Vojtech Juranek
7376bca551 DBZ-6216 Update documentation to refer to quay.io images 2023-03-23 13:29:19 +01:00
Bob Roldan
df8eb9780b DBZ-6223 Adds upstream anchor 2023-03-22 12:17:30 +01:00
Bob Roldan
76d38e41b4 DBZ-6233 Add metadata; additional edits 2023-03-22 12:17:30 +01:00
Bob Roldan
13b2e7ac1a DBZ-823 Edit description of snapshot.tables.order.by.row.count 2023-03-22 10:18:18 +01:00
Bob Roldan
12a9aa9517 DBZ-823 Update Db2 doc for consistency 2023-03-22 10:18:18 +01:00
Bob Roldan
20b368760b DBZ-823 Conditionally designates parallel snapshots as incubating or TP 2023-03-22 10:18:18 +01:00
Russell Mora
bf3acaa872 [docs] Fix SQL JSON
JSON has an extra closing brace
2023-03-22 10:17:17 +01:00
harveyyue
cd7da5723d DBZ-6235 Remove incubation notice from Debezium Server page 2023-03-22 09:45:26 +01:00
roldanbob
4c18c0340b
[docs] add missing table block terminator
Addresses local antora build warning:

WARN (asciidoctor): unterminated table block
    file: /home/broldan/git/debezium/documentation/modules/ROOT/pages/transformations/event-changes.adoc:137
2023-03-16 17:06:21 -04:00
Bob Roldan
4138a9898a DBZ-6215 Adds missing annotation comments for Oracle connector FAQ topic 2023-03-16 07:58:55 +01:00
Jiri Pechanec
9e7591641a [docs] Fix spelling of RocketMQ 2023-03-13 17:57:01 +01:00
PlugaruT
2f7c60931b DBZ-6023 [doc] Fix missing example of signal with surrogate-key 2023-03-10 10:40:17 -05:00
PlugaruT
5a758fb229 DBZ-6023 [doc] Rephrase a bit the description to be more consistent with others. 2023-03-10 10:40:17 -05:00
PlugaruT
5d1bb1aa80 DBZ-6023 [doc] Documentation for surrogate-key field from execute-snapshot signal record. 2023-03-10 10:40:17 -05:00
Bob Roldan
405be98721 DBZ-6153 Refactor Streams deployment content to fix errors 2023-03-10 11:47:21 +01:00
PlugaruT
6d32e22549 DBZ-5490 Document the case when message.key.columns is set and REPLICA IDENTITY of the tables is not FULL.
It breaks tombstone events to have the proper key created because non-primary key columns will be null, and their values in the key will also be null.
2023-03-10 07:46:40 +01:00
mfvitale
77d9c88ac3 [docs] Add missing Partition Routing to navbar 2023-03-09 15:47:37 +01:00
Jiri Pechanec
a18dd39c87 [release] Changelog for 2.2.0.Alpha3 2023-03-08 12:31:48 +01:00
Jiri Pechanec
fef5fa26f3 DBZ-823 Mark parallel snapshotting as incubating in documentation 2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
Gunnar Morling
e9c6429154 [docs] Removing redundant TX ids from CloudEvents docs 2023-03-03 05:50:00 +01:00
Jeremy Ford
2f44fcc064 [docs] Add additional properites for http sink 2023-03-02 13:28:49 +01:00
Bobby Tiernay
fe3135f28d DBZ-6131: Support change stream filtering using MongoDBs aggregation pipeline step. 2023-02-28 20:17:05 +01:00
Bob Roldan
621dae76f2 DBZ-6073 Move note text and eliminate embedded community conditional 2023-02-28 13:40:11 +01:00
Bob Roldan
e0f2fc4095 DBZ-6130 Remove references to using properties files to configure SMTs 2023-02-27 13:22:01 -05:00
Bobby Tiernay
5d80712781 DBZ-5201: Add MongoDB connector support for server-side filtering of replica set change streams.
This change migrates from doing client-side filtering of streaming
change events to performing it server-side via MongoDB's support
for aggregation pipelines. This can drastically cut down on the amount
of data sent between the client and server. In addition, a new approach
to heartbeating has been added which relies on the `postBatchResumeToken`
to advance the the cursor even when no changes occur on the pipeline.
2023-02-23 18:14:08 +01:00
Vojtech Juranek
ffc9c2f80d [docs] Fix poll.interval.ms default value 2023-02-22 13:49:40 -05:00
Xinbin Huang
a3d75e798a DBZ-6116: Support String type for key in Mongo incremental snapshot 2023-02-20 13:55:54 +01:00
Mehmet Firat KOMURCU
4c9ab87704 DBZ-6123 fix typo "evemts" to "events" in docs.
fix typo in sql server docs
2023-02-20 08:29:54 +01:00
Jiri Pechanec
68a6a32323 [release] Changelog for 2.2.0.Alpha2 2023-02-16 12:09:05 +01:00
Bob Roldan
bb0f972af4 DBZ-6006 Update MongoDB flattening docs for downstream 2023-02-16 08:27:31 +01:00
Chris Cranford
58f3770ad1 DBZ-6079 Change query.fetch.size default from 0 to 2000 for Oracle 2023-02-16 08:15:22 +01:00
Jacob Barrieault
0a868f28c6 DBZ-6111 fix docs link to debezium-server Kinesis sink 2023-02-15 14:43:02 -05:00
Chris Cranford
7cd7cad094 DBZ-6091 Fix SSN NumericOverflow exception 2023-02-14 09:44:21 +01:00
Gunnar Morling
5ff4df1417 [docs] Adding missing comma in listing 2023-02-13 10:31:01 -05:00
Chris Cranford
375be6d61d DBZ-5283 Updated documentation 2023-02-10 13:53:05 +01:00
Chris Cranford
a7d1bb0f86 DBZ-5283 Decoupled changed SMT vs new state SMT, updated docs 2023-02-10 13:53:05 +01:00
Chris Cranford
bf46b298a2 DBZ-5283 Event Changes documentation updates 2023-02-10 13:53:05 +01:00
Chris Cranford
3d5c4328db DBZ-5283 Document unchanged field support to ExtractNewRecordState 2023-02-10 13:53:05 +01:00
Chris Cranford
a330c39f8b DBZ-5283 Document ExtractChangedRecordState SMT 2023-02-10 13:53:05 +01:00
Théophile Helleboid - chtitux
f3417f383f [docs] Fix link to PG mailing List
https://www.postgresql.org/message-id/CAJ3gD9fE%3D0w50sRagcs%2BjrktBXuJAWGZQdSTMa57CCY%2BDh-xbg%40mail.gmail.com is encoded and works.

The link is currently broken because `@` generate a `mailto:` link.
2023-02-08 12:37:08 +01:00
Bob Roldan
c853770c86 DBZ-6069 Remove problematic links 2023-02-03 08:49:30 +01:00
harveyyue
0dcf9922f6 DBZ-5743 update the "field.name.adjustment.mode" property to all connector docs 2023-02-02 13:21:45 +01:00
harveyyue
f093d7a6c9 DBZ-5743 Introduce alternative AVRO_UNICODE mode for schema adjuster 2023-02-02 13:21:45 +01:00
TimLoes
c8bfc6562b [docs] Variable name clarified
It is necessary to query for server_id instead of server-id, which is being used on the config file.
2023-02-01 06:27:16 +01:00
Henry Cai
a2f15abafd DBZ-6043: Vitess: Support Mapping unsigned bigint mysql column type to long
Add doc for the new `bigint.unsigned.handling.mode`
2023-01-31 07:17:33 +01:00
sunxiaojian
64558ea56a DBZ-5997 Debezium Storage add support for Apache RocketMQ 2023-01-30 23:07:45 +08:00
Byron Ruth
8c518ce57e [docs] Note support for NATS JetStream in description 2023-01-26 14:53:32 +01:00
Sergei Morozov
dce5f8eb80 DBZ-6039: Update documentation for kafka.recovery.attempts 2023-01-25 12:20:08 +01:00
Jiri Pechanec
33d27d2468 DBZ-6033 Add docs 2023-01-25 09:11:57 +01:00
Lokesh Sanapalli
591cef13bb DBZ-4829 : added event.processing.failure.handling.mode configuration to the documentation 2023-01-24 08:51:09 +01:00
Jiri Pechanec
6983add0c5 [release] Changelog for 2.2.0.Alpha1 2023-01-19 12:21:28 +01:00
Jeremy Ford
d775104331 DBZ-5926 Add support for Connect Headers to Debezium Server
Add headers support to ChangeEvent
Add SerializationFormat support headers
2023-01-18 10:28:22 +01:00
indraraj
ee059cee73 DBZ-5878 fix review updates 2023-01-17 13:33:32 +01:00
Indra
62886242ae DBZ-5878 Update documentation/modules/ROOT/pages/operations/debezium-ui.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 13:33:32 +01:00
indraraj
cb6670cee2 DBZ-5878 Update the Debezium UI Documentation page to include the latest additional steps and UI screenshots 2023-01-17 13:33:32 +01:00
sunxiaojian
15a19fa8db DBZ-5962 Sink adapter for Apache RocketMQ 2023-01-17 13:17:13 +01:00
yoheimuta
0f01851b05 DBZ-5930 Remove a confusing note about a future release in document 2023-01-17 10:53:28 +01:00
yoheimuta
9346a2e550 DBZ-5930 Fix a typo in document 2023-01-17 10:53:28 +01:00
yohei yoshimuta
d3efd8904f DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yohei yoshimuta
c9bf4ac795 DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yohei yoshimuta
5069064607 DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yohei yoshimuta
5faa9cde6c DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yohei yoshimuta
bd812be653 DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yoheimuta
fad1fb157d DBZ-5930 Add the doc for vitess snapshot.mode 2023-01-17 10:53:28 +01:00
Jiri Pechanec
bcd6787cdc DBZ-6008 Revert "DBZ-3653 Introduce incremental.snapshot.isolation.mode config"
This reverts commit 6d8bcd42fd.
2023-01-17 10:40:20 +01:00
Jiri Pechanec
76ca4cb902 DBZ-6008 Revert "DBZ-3653 Add docs for Db2 and SQL Server"
This reverts commit 0bd5123a81.
2023-01-17 10:40:20 +01:00
Bob Roldan
1f7e374d19 DBZ-5975 Remove note that indicates SMT is under active development. 2023-01-13 10:13:36 +01:00
Vojtech Juranek
f5ff4665aa DBZ-5986 Add documentation for Infinispan sink 2023-01-11 10:05:17 +01:00
Jiri Pechanec
0bd5123a81 DBZ-3653 Add docs for Db2 and SQL Server 2023-01-11 08:55:33 +01:00
govi20
6d8bcd42fd DBZ-3653 Introduce incremental.snapshot.isolation.mode config 2023-01-11 08:55:33 +01:00
Jakub Zalas
4d15c40e89 [docs] Update the postgres container initialisation example
The container needs to be marked as a compatible substitute for the official postgres image. Otherwise, with recent versions of testcontainers, the postgres container will fail to initialise with: `Failed to verify that image 'debezium/postgres:11' is a compatible substitute for 'postgres'.`.
2023-01-10 09:34:19 +01:00
Chris Cranford
af44869385
[docs] Remove duplicate Spanner connector's documentation anchors 2023-01-09 16:29:24 -05:00
Vojtech Juranek
3f7f429c9a [docs] Update Infinispan config example to ISPN 14.0 2023-01-06 09:16:34 -05:00
luca.scannapieco
e07d22faec [docs] Typo fix in Oracle connector documentation 2023-01-03 09:47:29 -05:00
Jiri Pechanec
d3746172b9 [release] Changelog for 2.0.1.Final 2022-12-22 10:45:04 +01:00
nancyxu123
0890227d0e DBZ-5937 formatting fix 2022-12-22 10:44:41 +01:00
nancyxu123
acd7c2cd00 DBZ-5937 Add more configuration options. 2022-12-22 10:44:41 +01:00