Commit Graph

236 Commits

Author SHA1 Message Date
Bob Roldan
311decac20 DBZ-6330 Address review feedback and fix links 2023-04-12 21:08:31 -04:00
Bob Roldan
79d74cf5c0 DBZ-6327 Replace conditionalized files w/ separate SQL/NoSQL versions 2023-04-12 09:33:35 -04:00
roldanbob
ef5592e858
[docs] Add missing character to downstream annotation
A dash omitted from the Nebel annotation  `description-of-how-the-mongodb-connector-uses-change streams-to-capture-event-records`  between `change` and `streams` results in a downstream build parsing error
2023-03-29 11:06:05 -04:00
roldanbob
b27108bbd9 DBZ-6090 Address feedback from doc technical review 2023-03-29 00:10:54 +02:00
roldanbob
47dc9d39fa DBZ-6090 Apply approved suggestions from doc review
Awaiting approval from @jcechace before I commit the remaining two updates.
2023-03-29 00:10:54 +02:00
jcechace
fd01c533f2 DBZ-6090 Added documentation for mongodb.connection.mode 2023-03-29 00:10:54 +02:00
roldanbob
4eabec4ad5 DBZ-6090 Apply edits from documentation review 2023-03-23 13:30:47 +01:00
jcechace
0dbdbcf119 DBZ-6090 Updated connection information in MongoDB documentation 2023-03-23 13:30:47 +01:00
Bob Roldan
df8eb9780b DBZ-6223 Adds upstream anchor 2023-03-22 12:17:30 +01:00
Bob Roldan
76d38e41b4 DBZ-6233 Add metadata; additional edits 2023-03-22 12:17:30 +01:00
Bob Roldan
405be98721 DBZ-6153 Refactor Streams deployment content to fix errors 2023-03-10 11:47:21 +01:00
Bobby Tiernay
fe3135f28d DBZ-6131: Support change stream filtering using MongoDBs aggregation pipeline step. 2023-02-28 20:17:05 +01:00
Bobby Tiernay
5d80712781 DBZ-5201: Add MongoDB connector support for server-side filtering of replica set change streams.
This change migrates from doing client-side filtering of streaming
change events to performing it server-side via MongoDB's support
for aggregation pipelines. This can drastically cut down on the amount
of data sent between the client and server. In addition, a new approach
to heartbeating has been added which relies on the `postBatchResumeToken`
to advance the the cursor even when no changes occur on the pipeline.
2023-02-23 18:14:08 +01:00
Vojtech Juranek
ffc9c2f80d [docs] Fix poll.interval.ms default value 2023-02-22 13:49:40 -05:00
Xinbin Huang
a3d75e798a DBZ-6116: Support String type for key in Mongo incremental snapshot 2023-02-20 13:55:54 +01:00
Bob Roldan
bb0f972af4 DBZ-6006 Update MongoDB flattening docs for downstream 2023-02-16 08:27:31 +01:00
harveyyue
0dcf9922f6 DBZ-5743 update the "field.name.adjustment.mode" property to all connector docs 2023-02-02 13:21:45 +01:00
harveyyue
f093d7a6c9 DBZ-5743 Introduce alternative AVRO_UNICODE mode for schema adjuster 2023-02-02 13:21:45 +01:00
Bob Roldan
bb8c2ff89a DBZ-5804 Distinguish between SQL and nosql steps in included content 2022-12-07 09:19:39 +01:00
Bob Roldan
16a9683b75 DBZ-5804 Move procedural content to new files; tag stop snapshot content 2022-12-07 09:19:39 +01:00
Bob Roldan
b2c9678b74 DBZ-5812 Correction in response to review feedback 2022-12-07 09:18:02 +01:00
Bob Roldan
604b73ea37 DBZ-5812 Additional edits for clarity 2022-12-07 09:18:02 +01:00
Bob Roldan
dbdddc2485 DBZ-5812 Update common problems description re: snapshot initial mode 2022-12-07 09:18:02 +01:00
Bob Roldan
980c4be471 DBZ-5812 Update formatting, revise description of initial option 2022-12-07 09:18:02 +01:00
Bob Roldan
c46d467cf1 DBZ-5812 Update snapshot.mode description and extended stoppage topic 2022-12-07 09:18:02 +01:00
jcechace
5ebf22d0c1 DBZ-5817 removing mongodb.name references from docs 2022-11-16 14:34:41 +01:00
Vojtech Juranek
87709cc036 [docs] Replace Docker hub links with Quay.io links 2022-11-16 14:25:38 +01:00
Bob Roldan
4e2734f250 DBZ-5757 Replace callout legend after KafkaConnector examples w/ tables 2022-11-02 14:25:49 +01:00
Bob Roldan
26a4573ff2 DBZ-5757 Updates downstream steps to build KC custom container images 2022-11-02 14:25:49 +01:00
Jiri Pechanec
8a02907576 DBZ-5610 Truncate events are not emitted by every connector 2022-10-20 08:57:28 +02:00
harveyyue
a37d3332df DBZ-5610 MySQL Connector capture TRUNCATE command as message in table topic 2022-10-20 08:57:28 +02:00
Yang Wu
370a6db733 DBZ-5736 Expose heartbeatFrequency to Mongo connector config 2022-10-19 13:58:36 +02:00
Bin Huang
acee02f35b DBZ-5628 Add documentation for pre-image support 2022-10-11 06:01:06 +02:00
Vojtech Juranek
f9992c46ae [docs] Remove oplog capture mode from MongoDB documentation
`oplog` option was removed in 707eeab3d8 and is not available in
2.x any more. Remove it from Mongo connector documentation.
2022-10-04 13:00:42 +02:00
Sergei Morozov
e4d46c81b1 DBZ-5541: Default Debezium schema.name.adjustment.mode to "none" 2022-09-29 09:47:25 +02:00
Bob Roldan
4e292b3e96 DBZ-5625 Specifies that props use anchored regex; consistency edits 2022-09-29 09:09:10 +02:00
Bob Roldan
535a41a76c DBZ-3327 Populates empty cells in connector properties tables 2022-09-20 07:12:52 +02:00
Bob Roldan
1d156553ca DBZ-5542 Rewording based on review comments 2022-09-19 18:08:13 +02:00
Bob Roldan
6d9eaf136a DBZ-5542 Insert break between note paragraphs for readability. 2022-09-19 18:08:13 +02:00
Bob Roldan
080df53652 DBZ-5542 Further clarify description 2022-09-19 18:08:13 +02:00
Bob Roldan
9948971b4c DBZ-5542 Minor rewording 2022-09-19 18:08:13 +02:00
Bob Roldan
1b68eba36d DBZ-5542 Edits property description; populates empty table cells. 2022-09-19 18:08:13 +02:00
Vojtech Juranek
853f43c5de DBZ-5043 Update documentation ot use topic.prefix instead of database.server.name 2022-09-07 12:57:31 +02:00
Bob Roldan
1d1b16c84f DBZ-5555 Adds conditional to hide read.only property in downstream doc 2022-08-25 23:22:58 -04:00
jcechace
4e40c2fd03 DBZ-4733 Listing mongodb.connection.string in MongoDB property docs 2022-08-19 12:55:58 +02:00
harveyyue
daf329bc06 DBZ-5413 Update the topic naming strategy doc to all connectors 2022-07-18 10:18:12 -04:00
roldanbob
dfdcad9d52
[docs] Fix typo in downstream Title annotation
Corrects erroneous reference to Db2 vs. MongoDB
2022-06-28 12:05:37 -04:00
Bob Roldan
5767951893 DBZ-5233 Use tag regions in shared fragment to specify MBean formats 2022-06-13 14:37:54 +02:00
Bob Roldan
d7a3dfbb14 DBZ-5233 Use fragments to specify MBean names vs. ifeval conditionals 2022-06-13 14:37:54 +02:00
Bob Roldan
c64558ae77 DBZ-4392 Update deployment steps to use curl to pull Maven artifacts 2022-04-01 13:17:13 -04:00
Sergei Morozov
b258674782 DBZ-3535: Introduce schema.name.adjustment.mode 2022-03-24 09:37:05 +01:00
Bob Roldan
bf27791fa1 DBZ-4906 Fixes typo in link text 2022-03-23 17:44:17 +01:00
Jiri Pechanec
25346941d4 DBZ-4802 Document requirement for primary in the seed 2022-03-18 11:08:21 +01:00
Bob Roldan
c926412c1b DBZ-4052 Address review comments; normalize property descriptions 2022-03-17 07:26:03 +01:00
Bob Roldan
2533663065 DBZ-4052 align description across connectors;link from metrics topics 2022-03-17 07:26:03 +01:00
Bob Roldan
dbd3447c05 DBZ-4014 Revise warning based on PR review 2022-03-11 10:26:34 +01:00
Bob Roldan
7877f736c5 DBZ-4655 Add DS TP note to signaling and incremental snapshot properties 2022-03-09 12:40:41 +01:00
Bob Roldan
5d63534c4e DBZ-4655 Conditionalize signaling and incremental snapshot properties 2022-03-09 12:40:41 +01:00
Bob Roldan
54ab4018c0 DBZ-4655 Add downstream TP labels for MongoDB connector 2022-03-09 12:40:41 +01:00
Bob Roldan
147725ce32 DBZ-4655 Add signaling and incremental snapshot properties to mongo doc 2022-03-09 12:40:41 +01:00
Bob Roldan
be533046ef DBZ-4655 Expose MongoDB incremental snapshots downstream 2022-03-09 12:40:41 +01:00
Gunnar Morling
4a0baaa231
[docs] Clarifying that MongoDB Atlas requires SSL 2022-03-03 21:08:26 +01:00
Gunnar Morling
d21e37746a DBZ-4606 Dropping superfluous link-prefix attribute 2022-02-18 08:47:06 +01:00
roldanbob
7c5d1c1f92
DBZ-4606 Adding anchor IDs to Avro cross-refs;
* Prefix cross-references w/ `xref` vs. {link-prefix} attribute
* Correct formatting of intra-file xref to topic.regex property

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-02-17 07:47:45 +01:00
Gunnar Morling
b17232416f DBZ-4731 Applying suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2022-02-15 10:04:48 +01:00
Gunnar Morling
aabe0b4f9d DBZ-4731 Adding note on MongoDB Atlas;
Also making set up section titles consistent.
2022-02-15 10:04:48 +01:00
Chris Cranford
48b9d7d7c2 [docs] Fix missing conditional 2022-01-27 09:37:57 -05:00
Gunnar Morling
7dc5e97041
[docs] Fixing broken link 2022-01-18 12:46:16 +01:00
Bob Roldan
16d0e89210 DBZ-3991 Remove sentence that is replaced by shared content 2022-01-17 14:11:16 +01:00
Bob Roldan
8e9786a08a DBZ-3991 Updates to address downstream build issues. 2022-01-17 14:11:16 +01:00
Bob Roldan
b756ed67f6 DBZ-3991 Update connector files to incorporate shared deployment content 2022-01-17 14:11:16 +01:00
Bob Roldan
3fb6cd5902 DBZ-3991 Update based in initial review; replace strings w/ attributes 2022-01-17 14:11:16 +01:00
Bob Roldan
5f8fdf132c DBZ-3991 Create shared files to doc using streams to deploy connectors 2022-01-17 14:11:16 +01:00
Bob Roldan
95223474b4 DBZ-4300 Fix incorrect attribute for link to DBZ supported config pg 2022-01-12 16:44:54 -05:00
Bob Roldan
2beefb9d8f DBZ-4300 Link to up/down-stream pages for info re: supported db versions 2022-01-12 10:10:25 +01:00
Bob Roldan
3db7a20b91 DBZ-3457 Address review comments 2022-01-03 14:21:51 +01:00
Bob Roldan
6d9c285ee9 DBZ-3457 Update reference in MongoDB doc to point to refactored files 2022-01-03 14:21:51 +01:00
Jiri Pechanec
e256c40814 DBZ-4420 Highlight differences between oplog and change streams events format 2021-12-16 09:19:45 +01:00
Jiri Pechanec
632f228581 DBZ-3342 Incremnetal snapshot documentation 2021-12-09 10:03:41 +01:00
Jiri Pechanec
4cd5b092e9 DBZ-4205 Address review comments 2021-12-08 15:48:49 +01:00
Gunnar Morling
72a8662bd3 DBZ-4205 Document fixes and other misc. adjustments 2021-12-08 15:48:49 +01:00
Jiri Pechanec
9901c43c8a DBZ-4205 Switch oplug to change streams is safe 2021-12-08 15:48:49 +01:00
Jiri Pechanec
f037b35954 DBZ-4205 Document change streams capture mode 2021-12-08 15:48:49 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Sungho Hwang
4b8344ccc9 DBZ-4201 Fixed wrong field on change event message example in MongoDB Connector documentation 2021-10-26 13:28:39 +02:00
Sungho Hwang
7ee8c0b60a DBZ-4149 Misc. MongoDB connector docs fixes;
* A field _filter_ doesn't exist in create events, nor payload of the given change event value
* Ensuring consistency with MySQL connector documentation
* The MongoDB connector doesn't have 'before' field, but 'after' and 'patch' field for create events
2021-10-13 15:38:24 +02:00
Bob Roldan
b341811b58 DBZ-3961-specify-when-connectors-begin-to-collect-metadata 2021-09-15 22:48:38 +02:00
Bob Roldan
691bf80cf4 DBZ-3613 Specify when snapshot metrics are available. 2021-08-30 10:03:20 +02:00
Bob Roldan
fe5e70eb5d DBZ-3858 Fix typo 2021-08-16 15:03:30 +02:00
Bob Roldan
519f904276 DBZ-3858 Fix links in topic auto-create, CBR, outbox & connector docs 2021-08-16 15:03:30 +02:00
Chris Cranford
2d066513dd DBZ-3836 Allow configurable execution timeout 2021-08-13 05:58:19 +02:00
pkgonan
5e0ffa28d2 DBZ-3765 Allow dot in database.server.name 2021-08-08 16:25:15 -04:00
roldanbob
f48b6f28d0
[docs] Fix spelling error
`trys` should be `tries`
2021-07-15 12:29:55 -04:00
roldanbob
11821b4832
[docs] Move anchor ID, correct xref link
The inclusion of two consecutive anchor links breaks processing when files are fetched and split for downstream use. Testing downstream shows that rather than deleting the  second anchor ID `[[mongodb-tailing-the-oplog]]` that is associated with the heading *Streaming changes*, move it to follow the heading. 
Also inserted missing `debezium` string into the anchor ID in the downstream xref that links to `default-names-of-kafka-topics-that-receive-debezium-mongodb-change-event-records`
2021-06-01 18:07:23 -04:00
Sergei Morozov
92e0488874 DBZ-3562: Allow hyphen in database.server.name 2021-05-27 11:03:30 +02:00
Bob Roldan
6fd22957c0 DBZ-3525 Fix link, standardize intro and prereqs in Deploying topics. 2021-05-26 16:50:05 -04:00
Olivier Jacquemart
c75c49098e [docs] fix typo in mongodb connector example
Hello,

First, thanks for making this project open source. It is such a great piece of software.
While I was playing with it and try to configure a mongodb connector, I noticed that the json example to configure a mongodb connector is not valid. There is an unnecessary comma at the end of the payload.

Here is a minor contribution that could help and could save some time for the future users.
2021-05-18 21:34:33 +02:00
Gunnar Morling
fe1f71fe30 DBZ-2334 Misc. fixes 2021-05-17 10:54:07 +02:00
Bob Roldan
ccbd8d2a92 DBZ-2334 Add comments to modularize content; minor content tweaks 2021-05-17 10:54:07 +02:00
Anisha Mohanty
98ce954332 DBZ-3427 Change wording in connector field database.server.name 2021-04-28 13:18:52 +02:00