Commit Graph

356 Commits

Author SHA1 Message Date
PlugaruT
6d32e22549 DBZ-5490 Document the case when message.key.columns is set and REPLICA IDENTITY of the tables is not FULL.
It breaks tombstone events to have the proper key created because non-primary key columns will be null, and their values in the key will also be null.
2023-03-10 07:46:40 +01:00
Jiri Pechanec
fef5fa26f3 DBZ-823 Mark parallel snapshotting as incubating in documentation 2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
Gunnar Morling
5ff4df1417 [docs] Adding missing comma in listing 2023-02-13 10:31:01 -05:00
Théophile Helleboid - chtitux
f3417f383f [docs] Fix link to PG mailing List
https://www.postgresql.org/message-id/CAJ3gD9fE%3D0w50sRagcs%2BjrktBXuJAWGZQdSTMa57CCY%2BDh-xbg%40mail.gmail.com is encoded and works.

The link is currently broken because `@` generate a `mailto:` link.
2023-02-08 12:37:08 +01:00
Bob Roldan
c853770c86 DBZ-6069 Remove problematic links 2023-02-03 08:49:30 +01:00
harveyyue
0dcf9922f6 DBZ-5743 update the "field.name.adjustment.mode" property to all connector docs 2023-02-02 13:21:45 +01:00
harveyyue
f093d7a6c9 DBZ-5743 Introduce alternative AVRO_UNICODE mode for schema adjuster 2023-02-02 13:21:45 +01:00
Jiri Pechanec
bcd6787cdc DBZ-6008 Revert "DBZ-3653 Introduce incremental.snapshot.isolation.mode config"
This reverts commit 6d8bcd42fd.
2023-01-17 10:40:20 +01:00
govi20
6d8bcd42fd DBZ-3653 Introduce incremental.snapshot.isolation.mode config 2023-01-11 08:55:33 +01:00
Bob Roldan
ba2d9b9efd DBZ-5804 Fix incremental snapshot include directives for SQL connectors 2022-12-07 09:19:39 +01:00
subodh
66fb51b55a DBZ-5811 Implement support for skipping LSN commit on postgres source based on config 2022-12-06 13:35:52 +01:00
Vojtech Juranek
87709cc036 [docs] Replace Docker hub links with Quay.io links 2022-11-16 14:25:38 +01:00
Bob Roldan
3cb1a8c25a DBZ-5789 Remove obsolete info about PG metadata from doc 2022-11-10 14:00:36 -05:00
Gunnar Morling
e2c5c720ed [docs] Updating default poll.intervall.ms in PG connector docs 2022-11-10 13:14:56 -05:00
Théophile Helleboid - chtitux
16e086b1d5 [docs] Postgresql connector documentation: add a missing word 2022-11-03 08:51:27 +01:00
Bob Roldan
4e2734f250 DBZ-5757 Replace callout legend after KafkaConnector examples w/ tables 2022-11-02 14:25:49 +01:00
Bob Roldan
26a4573ff2 DBZ-5757 Updates downstream steps to build KC custom container images 2022-11-02 14:25:49 +01:00
Vojtech Juranek
0c9bd0f1b1 DBZ-5329 Update tx ID in Postgres documentation 2022-10-11 15:38:33 +02:00
Sergei Morozov
e4d46c81b1 DBZ-5541: Default Debezium schema.name.adjustment.mode to "none" 2022-09-29 09:47:25 +02:00
Bob Roldan
8b9e801b5f DBZ-5625 Corrects punctuation in *.propagate.source.type descriptions 2022-09-29 09:09:10 +02:00
Bob Roldan
9ea5f6b45f DBZ-5625 Updates PostgreSQL message.prefix.*.list properties 2022-09-29 09:09:10 +02:00
Bob Roldan
edc09e8d2b DBZ-5625 Updates *.propagate.source.type properties 2022-09-29 09:09:10 +02:00
Bob Roldan
7b95cd0971 DBZ-5625 Updates to column.mask.* and column.truncate.* properties 2022-09-29 09:09:10 +02:00
Bob Roldan
652ab02372 DBZ-5625 Updates description of column.truncate.to.<length>.chars 2022-09-29 09:09:10 +02:00
Bob Roldan
9e6607bdd3 DBZ-5625 Updates PostgreSQL connector props w/ anchored regex details 2022-09-29 09:09:10 +02:00
Bob Roldan
808f3c9212 DBZ-5625 Updates based on additional input 2022-09-29 09:09:10 +02:00
Bob Roldan
4e292b3e96 DBZ-5625 Specifies that props use anchored regex; consistency edits 2022-09-29 09:09:10 +02:00
moustapha mahfoud
a518b9ca4e [docs] Fixed the max.queue.size default value in the docs for the Postgres connector 2022-09-19 12:18:28 +02:00
roldanbob
1aa0c95cfb
[docs] Fix typo
Removes duplicate word  (`the`) in Setting up permissions
2022-09-08 16:55:56 -04:00
Vojtech Juranek
853f43c5de DBZ-5043 Update documentation ot use topic.prefix instead of database.server.name 2022-09-07 12:57:31 +02:00
Jannik Steinmann
9f811a6f64 [docs] Note about replication in managed cloud providers
I've added a note saying that some managed offerings actually replicate the replication slot.

I found this information very critical when evaluating reliability of Debezium. I'll look for links in the docs tomorrow. [Patroni](https://patroni.readthedocs.io/en/latest/) also seems to support this feature.
2022-09-06 07:15:37 +02:00
Bob Roldan
390d0d3d62 DBZ-5565 Formatting characters no longer render in published doc 2022-08-31 09:17:16 +02:00
roldanbob
2bb9d5263a
[docs] Bad formatting due to missing character
Incorrect formatting of a property name string (trailing `+` omitted).
2022-08-26 22:47:09 -04:00
Bob Roldan
1d1b16c84f DBZ-5555 Adds conditional to hide read.only property in downstream doc 2022-08-25 23:22:58 -04:00
pkgonan
fd309193c6 DBZ-5544 Add document 2022-08-24 09:50:23 +02:00
gongzhongqiang
7000f06aac DBZ-5450 Typo in postgresql document. 2022-07-26 15:45:53 -04:00
Vojtech Juranek
9f35b840fc [docs] Fix defaut values of max.batch.size and poll.interval.ms
Default `max.batch.size` is 2048 [1].
Default `poll.interval.ms` is 500 ms [2] (except Cassandra where it's
still 1000 ms and Mongo which has it's own config)

[1] https://github.com/debezium/debezium/blob/v2.0.0.Alpha3/debezium-core/src/main/java/io/debezium/config/CommonConnectorConfig.java#L300
[2] https://github.com/debezium/debezium/blob/v2.0.0.Alpha3/debezium-core/src/main/java/io/debezium/config/CommonConnectorConfig.java#L302
2022-07-21 08:14:08 -04:00
harveyyue
daf329bc06 DBZ-5413 Update the topic naming strategy doc to all connectors 2022-07-18 10:18:12 -04:00
Vojtech Juranek
5573bb51ed DBZ-5048 Rename GH repo with containes
Besides updating links to renamed GH repo, update also documentation and
replace 'Docker' with 'containers' when possible.
2022-07-12 13:16:53 +02:00
Bob Roldan
a885c03f89 DBZ-5334 Add ts_ms to txn boundary event examples; update description 2022-07-08 08:10:17 +02:00
harveyyue
68a78f73bb DBZ-5170 Update transaction ts_ms field to related doc 2022-06-27 15:50:52 +02:00
Bob Roldan
5767951893 DBZ-5233 Use tag regions in shared fragment to specify MBean formats 2022-06-13 14:37:54 +02:00
Bob Roldan
d7a3dfbb14 DBZ-5233 Use fragments to specify MBean names vs. ifeval conditionals 2022-06-13 14:37:54 +02:00
Vojtech Juranek
7b8cb693ed DBZ-5045 Remove deprecated Postgres TOASTED_VALUE_PLACEHOLDER 2022-06-08 09:11:00 +02:00
Vojtech Juranek
83dfd9f638 DBZ-5045 Remove deprecated Postgres TRUNCATE_HANDLING_MODE 2022-06-08 09:11:00 +02:00
roeselert
f0abcc15b9 DBZ-3921: update documentation 2022-05-17 14:56:05 +02:00
Bob Roldan
1745abf5f8 DBZ-4588 Make converter property descriptions consistent 2022-05-13 13:25:32 +02:00
Bob Roldan
9b897f1120 DBZ-4588 Insert converters property in configuration tables 2022-05-13 13:25:32 +02:00
Bob Roldan
1cadd6a4d7 DBZ-4588 Adds links to converters topic from connector data types topics 2022-05-13 13:25:32 +02:00
Chris Cranford
827620b7a2 DBZ-4734 Document PostgreSQL xmin.fetch.interval.xs 2022-05-10 10:13:35 +02:00
Jiri Pechanec
844094618d DBZ-4156 Documentation clean-up 2022-04-22 09:57:15 +02:00
Bob Roldan
c64558ae77 DBZ-4392 Update deployment steps to use curl to pull Maven artifacts 2022-04-01 13:17:13 -04:00
Sergei Morozov
b258674782 DBZ-3535: Introduce schema.name.adjustment.mode 2022-03-24 09:37:05 +01:00
Bob Roldan
bf27791fa1 DBZ-4906 Fixes typo in link text 2022-03-23 17:44:17 +01:00
Bob Roldan
c926412c1b DBZ-4052 Address review comments; normalize property descriptions 2022-03-17 07:26:03 +01:00
Bob Roldan
2533663065 DBZ-4052 align description across connectors;link from metrics topics 2022-03-17 07:26:03 +01:00
Bob Roldan
dbd3447c05 DBZ-4014 Revise warning based on PR review 2022-03-11 10:26:34 +01:00
Bob Roldan
a8cce84d2e DBZ-4014 Remove extra line before warning note 2022-03-11 10:26:34 +01:00
Bob Roldan
d8ed383118 DBZ-4014 Warne users not to modify database.server.name 2022-03-11 10:26:34 +01:00
Bob Roldan
979af7a606 DBZ-4655 Italics + link + monospace in property desc breaking DS build 2022-03-09 12:40:41 +01:00
Bob Roldan
66363a7d19 DBZ-4655 Remove TP designations for signaling/incremental snapshots 2022-03-09 12:40:41 +01:00
roldanbob
491c8cec83
DBZ-4603 Remove parameters from config example and link to PG doc
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-02-21 12:22:56 +01:00
Gunnar Morling
d21e37746a DBZ-4606 Dropping superfluous link-prefix attribute 2022-02-18 08:47:06 +01:00
roldanbob
7c5d1c1f92
DBZ-4606 Adding anchor IDs to Avro cross-refs;
* Prefix cross-references w/ `xref` vs. {link-prefix} attribute
* Correct formatting of intra-file xref to topic.regex property

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-02-17 07:47:45 +01:00
Gunnar Morling
aabe0b4f9d DBZ-4731 Adding note on MongoDB Atlas;
Also making set up section titles consistent.
2022-02-15 10:04:48 +01:00
Jason Schweier
56c7c23fba [docs] Update documentation/modules/ROOT/pages/connectors/postgresql.adoc
Co-authored-by: Jiri Pechanec <jpechane@redhat.com>
2022-01-27 09:27:20 -05:00
Jason Schweier
042ef87bf9 [docs] Fix reference to Postgres snapshot steps
A step was deleted in 5fbc181b5e
2022-01-27 09:27:20 -05:00
Chris Cranford
68d16c3188 DBZ-4419 Update documentation 2022-01-22 00:33:21 +01:00
Chris Cranford
773debc340 DBZ-4419 Deprecate TruncateHandlingMode, favor skipped.operations 2022-01-22 00:33:21 +01:00
Gunnar Morling
c5c37544ac DBZ-3953 Misc. wording adjustments; avoiding hard-coded version 2022-01-21 11:21:17 +01:00
Jiri Pechanec
f1b03c176e DBZ-3953 Mark wal2json plugin as deprecated 2022-01-21 11:21:17 +01:00
Bob Roldan
f9f00164d1 DBZ-4574 Update description of snapshot.mode property in PG doc 2022-01-21 08:54:26 +01:00
Bob Roldan
dde8c8cdb4 DBZ-3991 Fix include statements, other cleanup. 2022-01-17 14:11:16 +01:00
Bob Roldan
8e9786a08a DBZ-3991 Updates to address downstream build issues. 2022-01-17 14:11:16 +01:00
Bob Roldan
b756ed67f6 DBZ-3991 Update connector files to incorporate shared deployment content 2022-01-17 14:11:16 +01:00
Bob Roldan
3fb6cd5902 DBZ-3991 Update based in initial review; replace strings w/ attributes 2022-01-17 14:11:16 +01:00
Bob Roldan
5f8fdf132c DBZ-3991 Create shared files to doc using streams to deploy connectors 2022-01-17 14:11:16 +01:00
Bob Roldan
95223474b4 DBZ-4300 Fix incorrect attribute for link to DBZ supported config pg 2022-01-12 16:44:54 -05:00
Bob Roldan
2beefb9d8f DBZ-4300 Link to up/down-stream pages for info re: supported db versions 2022-01-12 10:10:25 +01:00
Hady Willi
0e911a91ab
DBZ-4461 Improving documentation for postgres bytea_output 2022-01-04 13:58:14 +01:00
Bob Roldan
edcd133ec0 DBZ-3457 Correct Oracle FQ table format; remove problematic links. 2022-01-03 14:21:51 +01:00
Bob Roldan
413aabccca DBZ-3457 Edits and updates to fix build problems 2022-01-03 14:21:51 +01:00
Bob Roldan
3db7a20b91 DBZ-3457 Address review comments 2022-01-03 14:21:51 +01:00
Bob Roldan
7551d1d077 DBZ-3457 Prep signaling/incremental snapshots for downstream use 2022-01-03 14:21:51 +01:00
Jiri Pechanec
632f228581 DBZ-3342 Incremnetal snapshot documentation 2021-12-09 10:03:41 +01:00
Gunnar Morling
71eb089e4e [docs] Fixing broken listing 2021-11-30 14:59:35 +01:00
Gunnar Morling
8946c28da8 DBZ-2363 Docs fix 2021-11-30 12:00:09 +01:00
Jiri Pechanec
d121b3bf89 DBZ-4272 Document limiations 2021-11-30 09:28:44 +01:00
Chris Cranford
687b79787f DBZ-4127 Document incremental.snapshot.chunk.size 2021-11-30 09:06:43 +01:00
Gunnar Morling
5866056a41 DBZ-2363 Using prefix as message key 2021-11-26 18:15:25 +01:00
Lairen Hightower
450998b49e DBZ-2363 Replace logicalDecodingMessageHandlingMode with a prefix filtering configuration 2021-11-26 14:29:15 +01:00
lairen
a0898ed440 DBZ-2363 Adding support for pg_logical_emit messages in Postgres connector for the pgoutput plugin 2021-11-26 14:29:15 +01:00
Gunnar Morling
f4fb1124f3
[docs] Updating supported Postgres versions 2021-11-17 12:09:23 +01:00
Gunnar Morling
9c41053fcb DBZ-1931 Hyper-linking some options in docs 2021-11-17 10:06:41 +01:00
Vojtech Juranek
5ed669dcd7 DBZ-1931 Document mapping and config option 2021-11-17 09:30:15 +01:00
Chris Cranford
ba525abe97 DBZ-4276 Use xref rather than link-prefix 2021-11-16 20:29:59 +01:00
Chris Cranford
ca17352221 DBZ-4276 Unify unavailable value placeholder handling
Deprecate the `toasted.value.placeholder` option in PostgreSQL in favor
of the new `unavailable.value.placeholder` option that is shared by all
relational connectors.
2021-11-16 20:29:59 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Anisha Mohanty
9f7ede0e06 DBZ-3626 Renaming master branches to main 2021-10-28 09:33:32 +02:00