Commit Graph

1623 Commits

Author SHA1 Message Date
Vojtech Juranek
db4c2fd918 [docs] Mention deprecation of Mysql event.deserialization.failure.handling.mode 2023-04-18 11:56:02 +02:00
Jiri Pechanec
e9db1c4829 DBZ-6260 Reformat text; add injection points 2023-04-18 08:13:12 +02:00
Olivier Boudet
bb5b07e7e1 DBZ-6260 documentation for RabbitMQ sink 2023-04-18 08:13:12 +02:00
Jiri Pechanec
5ed3fa3e0d DBZ-6325 Reformat text flow 2023-04-18 07:25:54 +02:00
RJ Nowling
c9971dedc1 DBZ-6325 Describe example configuration
Also, be consistent about using {prodname} instead of the constant string "Debezium".
2023-04-18 07:25:54 +02:00
Jiri Pechanec
a78610bd7c DBZ-6319 Reformat textflow 2023-04-18 07:17:35 +02:00
Henko
56ec714c58 DBZ-6319 Add documentation for timeout in pulsar sink 2023-04-18 07:17:35 +02:00
Fiore Mario Vitale
f6a8970629 DBZ-5902 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-04-13 08:10:09 +02:00
mfvitale
36109b4ca3 DBZ-5902 Change fields configuration from 'partition.payload.field' to 'partition.payload.fields' 2023-04-13 08:10:09 +02:00
Fiore Mario Vitale
1d241283b7 DBZ-5902 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-04-13 08:10:09 +02:00
mfvitale
740d97a0f5 DBZ-5902 Add docs for PartitionRouting SMT that will replace ComputePartition 2023-04-13 08:10:09 +02:00
Chris Cranford
0d0b25e079 DBZ-6318 Removed outdated SYS account usage 2023-04-13 08:08:21 +02:00
Bob Roldan
585b00a5bd DBZ-6330 Edits to fix links in MongoDB event flattening doc 2023-04-12 21:08:31 -04:00
Bob Roldan
311decac20 DBZ-6330 Address review feedback and fix links 2023-04-12 21:08:31 -04:00
Bob Roldan
fe82f5fca0 DBZ-6327 Reformat links 2023-04-12 09:33:35 -04:00
Bob Roldan
37bb294b9b DBZ-6327 Reformat link in NoSQL version of triggering snapshot file 2023-04-12 09:33:35 -04:00
Bob Roldan
5d0e6f2bf6 DBZ-6327 Fix incorrectly formatted inter-file links 2023-04-12 09:33:35 -04:00
Bob Roldan
79d74cf5c0 DBZ-6327 Replace conditionalized files w/ separate SQL/NoSQL versions 2023-04-12 09:33:35 -04:00
Vojtech Juranek
44f2f40c56 DBZ-6216 Update testcontainers to use quay.io images
When needed update also version.
Update also leftovers in readme files.
2023-04-12 14:07:35 +02:00
Chris Cranford
9c8954bb25 DBZ-6310 Applied edits (round 2) 2023-04-11 13:40:06 +02:00
Chris Cranford
ff709a271e DBZ-6310 Add JDBC connector to navigation 2023-04-11 13:40:06 +02:00
Chris Cranford
292e0f4e5d DBZ-6310 Applied edits (round 1) 2023-04-11 13:40:06 +02:00
Chris Cranford
dbb1c4092a DBZ-6310 Document JDBC sink connector 2023-04-11 13:40:06 +02:00
doupengwei
352d616173 DBZ-6155 Adjust LogMiner batch size based on the default batch size rather than current batch size.
Using current batch size for comparison is wrong in case that when currentScn is topScn as described in DBZ-6155.
In the other case (when topScn is behind currentScn) can eventually lead to this situation.
when topScn would fall behind currentScn more and more as we would compare currentScn - topScn with bigger and bigger number (current batch size).

Comapring with logMiningBatchSizeMin could result in very small window which would mean we will send many small queries instead of several bigger ones during mining.
Therefore reverting back to do the adjustments based on the defaultBatchSize.
2023-04-10 16:51:11 -04:00
harveyyue
c525f34cd0 DBZ-6070 DDL events not stored in schema history topic for excluded tables 2023-04-06 12:10:30 +02:00
Chris Cranford
85d7866f3d DBZ-6198 Update Oracle permissions to include statistics tables 2023-04-06 07:04:14 +02:00
roldanbob
ea67433f70
[docs] update format of 2 links in architecture.adoc
QE reports that links to two SMTs from the Architecture  doc are broken. To ensure that links to targets external to the current file continue to  to work downstream, they must use the `{link-prefix}` attribute vs. a simple `xref` macro.
2023-04-03 17:33:59 -04:00
Bob Roldan
1d4cb18ead DBZ-6272 Update shared files for downsream user guide & ocp install doc 2023-04-01 17:38:38 -04:00
roldanbob
af6cc03855
[docs] (main) Conditionalize link to binlog.buffer.size property
The configuration propery `binlog.buffer.size` is conditionalized for community use only. However, a link in the Streaming metrics topic targets the entry for the property in the configuration properties table.  This change conditionalizes the sentence that contains the link.
2023-03-31 11:12:39 -04:00
Bob Roldan
d12659f5da DBZ-6267 Further adjusts the MySQL and SQL Server Kafka examples 2023-03-30 17:39:41 -04:00
Bob Roldan
3c8a47bb48 DBZ-6267 updates Kafka version and config props in shared files 2023-03-30 17:39:41 -04:00
Bob Roldan
95c63061f6 DBZ-6263 Update shared deployment content to fix link
(cherry picked from commit cdc8bf532e6eadfd974d5fe10196db3bb4240f62)
2023-03-29 18:40:33 -04:00
roldanbob
ef5592e858
[docs] Add missing character to downstream annotation
A dash omitted from the Nebel annotation  `description-of-how-the-mongodb-connector-uses-change streams-to-capture-event-records`  between `change` and `streams` results in a downstream build parsing error
2023-03-29 11:06:05 -04:00
roldanbob
b27108bbd9 DBZ-6090 Address feedback from doc technical review 2023-03-29 00:10:54 +02:00
roldanbob
47dc9d39fa DBZ-6090 Apply approved suggestions from doc review
Awaiting approval from @jcechace before I commit the remaining two updates.
2023-03-29 00:10:54 +02:00
jcechace
fd01c533f2 DBZ-6090 Added documentation for mongodb.connection.mode 2023-03-29 00:10:54 +02:00
Fiore Mario Vitale
84ab0dc3d2
DBZ-6201: Add docs for HeaderToValue SMT (#4389)
* DBZ-6201: Add docs for HeaderToValue SMT
---------

Co-authored-by: roldanbob <broldan@redhat.com>
2023-03-27 10:44:11 +02:00
Gunnar Morling
d5963f1601 [docs] Adding missing comma 2023-03-24 13:45:39 +01:00
roldanbob
4eabec4ad5 DBZ-6090 Apply edits from documentation review 2023-03-23 13:30:47 +01:00
jcechace
0dbdbcf119 DBZ-6090 Updated connection information in MongoDB documentation 2023-03-23 13:30:47 +01:00
Vojtech Juranek
7376bca551 DBZ-6216 Update documentation to refer to quay.io images 2023-03-23 13:29:19 +01:00
Bob Roldan
df8eb9780b DBZ-6223 Adds upstream anchor 2023-03-22 12:17:30 +01:00
Bob Roldan
76d38e41b4 DBZ-6233 Add metadata; additional edits 2023-03-22 12:17:30 +01:00
Bob Roldan
13b2e7ac1a DBZ-823 Edit description of snapshot.tables.order.by.row.count 2023-03-22 10:18:18 +01:00
Bob Roldan
12a9aa9517 DBZ-823 Update Db2 doc for consistency 2023-03-22 10:18:18 +01:00
Bob Roldan
20b368760b DBZ-823 Conditionally designates parallel snapshots as incubating or TP 2023-03-22 10:18:18 +01:00
Russell Mora
bf3acaa872 [docs] Fix SQL JSON
JSON has an extra closing brace
2023-03-22 10:17:17 +01:00
harveyyue
cd7da5723d DBZ-6235 Remove incubation notice from Debezium Server page 2023-03-22 09:45:26 +01:00
roldanbob
4c18c0340b
[docs] add missing table block terminator
Addresses local antora build warning:

WARN (asciidoctor): unterminated table block
    file: /home/broldan/git/debezium/documentation/modules/ROOT/pages/transformations/event-changes.adoc:137
2023-03-16 17:06:21 -04:00
Bob Roldan
4138a9898a DBZ-6215 Adds missing annotation comments for Oracle connector FAQ topic 2023-03-16 07:58:55 +01:00
Jiri Pechanec
9e7591641a [docs] Fix spelling of RocketMQ 2023-03-13 17:57:01 +01:00
PlugaruT
2f7c60931b DBZ-6023 [doc] Fix missing example of signal with surrogate-key 2023-03-10 10:40:17 -05:00
PlugaruT
5a758fb229 DBZ-6023 [doc] Rephrase a bit the description to be more consistent with others. 2023-03-10 10:40:17 -05:00
PlugaruT
5d1bb1aa80 DBZ-6023 [doc] Documentation for surrogate-key field from execute-snapshot signal record. 2023-03-10 10:40:17 -05:00
Bob Roldan
405be98721 DBZ-6153 Refactor Streams deployment content to fix errors 2023-03-10 11:47:21 +01:00
PlugaruT
6d32e22549 DBZ-5490 Document the case when message.key.columns is set and REPLICA IDENTITY of the tables is not FULL.
It breaks tombstone events to have the proper key created because non-primary key columns will be null, and their values in the key will also be null.
2023-03-10 07:46:40 +01:00
mfvitale
77d9c88ac3 [docs] Add missing Partition Routing to navbar 2023-03-09 15:47:37 +01:00
Jiri Pechanec
fef5fa26f3 DBZ-823 Mark parallel snapshotting as incubating in documentation 2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
Gunnar Morling
e9c6429154 [docs] Removing redundant TX ids from CloudEvents docs 2023-03-03 05:50:00 +01:00
Jeremy Ford
2f44fcc064 [docs] Add additional properites for http sink 2023-03-02 13:28:49 +01:00
Bobby Tiernay
fe3135f28d DBZ-6131: Support change stream filtering using MongoDBs aggregation pipeline step. 2023-02-28 20:17:05 +01:00
Bob Roldan
621dae76f2 DBZ-6073 Move note text and eliminate embedded community conditional 2023-02-28 13:40:11 +01:00
Bob Roldan
e0f2fc4095 DBZ-6130 Remove references to using properties files to configure SMTs 2023-02-27 13:22:01 -05:00
Bobby Tiernay
5d80712781 DBZ-5201: Add MongoDB connector support for server-side filtering of replica set change streams.
This change migrates from doing client-side filtering of streaming
change events to performing it server-side via MongoDB's support
for aggregation pipelines. This can drastically cut down on the amount
of data sent between the client and server. In addition, a new approach
to heartbeating has been added which relies on the `postBatchResumeToken`
to advance the the cursor even when no changes occur on the pipeline.
2023-02-23 18:14:08 +01:00
Vojtech Juranek
ffc9c2f80d [docs] Fix poll.interval.ms default value 2023-02-22 13:49:40 -05:00
Xinbin Huang
a3d75e798a DBZ-6116: Support String type for key in Mongo incremental snapshot 2023-02-20 13:55:54 +01:00
Mehmet Firat KOMURCU
4c9ab87704 DBZ-6123 fix typo "evemts" to "events" in docs.
fix typo in sql server docs
2023-02-20 08:29:54 +01:00
Bob Roldan
bb0f972af4 DBZ-6006 Update MongoDB flattening docs for downstream 2023-02-16 08:27:31 +01:00
Chris Cranford
58f3770ad1 DBZ-6079 Change query.fetch.size default from 0 to 2000 for Oracle 2023-02-16 08:15:22 +01:00
Jacob Barrieault
0a868f28c6 DBZ-6111 fix docs link to debezium-server Kinesis sink 2023-02-15 14:43:02 -05:00
Chris Cranford
7cd7cad094 DBZ-6091 Fix SSN NumericOverflow exception 2023-02-14 09:44:21 +01:00
Gunnar Morling
5ff4df1417 [docs] Adding missing comma in listing 2023-02-13 10:31:01 -05:00
Chris Cranford
375be6d61d DBZ-5283 Updated documentation 2023-02-10 13:53:05 +01:00
Chris Cranford
a7d1bb0f86 DBZ-5283 Decoupled changed SMT vs new state SMT, updated docs 2023-02-10 13:53:05 +01:00
Chris Cranford
bf46b298a2 DBZ-5283 Event Changes documentation updates 2023-02-10 13:53:05 +01:00
Chris Cranford
3d5c4328db DBZ-5283 Document unchanged field support to ExtractNewRecordState 2023-02-10 13:53:05 +01:00
Chris Cranford
a330c39f8b DBZ-5283 Document ExtractChangedRecordState SMT 2023-02-10 13:53:05 +01:00
Théophile Helleboid - chtitux
f3417f383f [docs] Fix link to PG mailing List
https://www.postgresql.org/message-id/CAJ3gD9fE%3D0w50sRagcs%2BjrktBXuJAWGZQdSTMa57CCY%2BDh-xbg%40mail.gmail.com is encoded and works.

The link is currently broken because `@` generate a `mailto:` link.
2023-02-08 12:37:08 +01:00
Bob Roldan
c853770c86 DBZ-6069 Remove problematic links 2023-02-03 08:49:30 +01:00
harveyyue
0dcf9922f6 DBZ-5743 update the "field.name.adjustment.mode" property to all connector docs 2023-02-02 13:21:45 +01:00
harveyyue
f093d7a6c9 DBZ-5743 Introduce alternative AVRO_UNICODE mode for schema adjuster 2023-02-02 13:21:45 +01:00
TimLoes
c8bfc6562b [docs] Variable name clarified
It is necessary to query for server_id instead of server-id, which is being used on the config file.
2023-02-01 06:27:16 +01:00
Henry Cai
a2f15abafd DBZ-6043: Vitess: Support Mapping unsigned bigint mysql column type to long
Add doc for the new `bigint.unsigned.handling.mode`
2023-01-31 07:17:33 +01:00
sunxiaojian
64558ea56a DBZ-5997 Debezium Storage add support for Apache RocketMQ 2023-01-30 23:07:45 +08:00
Byron Ruth
8c518ce57e [docs] Note support for NATS JetStream in description 2023-01-26 14:53:32 +01:00
Sergei Morozov
dce5f8eb80 DBZ-6039: Update documentation for kafka.recovery.attempts 2023-01-25 12:20:08 +01:00
Jiri Pechanec
33d27d2468 DBZ-6033 Add docs 2023-01-25 09:11:57 +01:00
Lokesh Sanapalli
591cef13bb DBZ-4829 : added event.processing.failure.handling.mode configuration to the documentation 2023-01-24 08:51:09 +01:00
Jeremy Ford
d775104331 DBZ-5926 Add support for Connect Headers to Debezium Server
Add headers support to ChangeEvent
Add SerializationFormat support headers
2023-01-18 10:28:22 +01:00
indraraj
ee059cee73 DBZ-5878 fix review updates 2023-01-17 13:33:32 +01:00
Indra
62886242ae DBZ-5878 Update documentation/modules/ROOT/pages/operations/debezium-ui.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 13:33:32 +01:00
indraraj
cb6670cee2 DBZ-5878 Update the Debezium UI Documentation page to include the latest additional steps and UI screenshots 2023-01-17 13:33:32 +01:00
sunxiaojian
15a19fa8db DBZ-5962 Sink adapter for Apache RocketMQ 2023-01-17 13:17:13 +01:00
yoheimuta
0f01851b05 DBZ-5930 Remove a confusing note about a future release in document 2023-01-17 10:53:28 +01:00
yoheimuta
9346a2e550 DBZ-5930 Fix a typo in document 2023-01-17 10:53:28 +01:00
yohei yoshimuta
d3efd8904f DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yohei yoshimuta
c9bf4ac795 DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yohei yoshimuta
5069064607 DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00
yohei yoshimuta
5faa9cde6c DBZ-5930 Update documentation/modules/ROOT/pages/connectors/vitess.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-01-17 10:53:28 +01:00