Commit Graph

328 Commits

Author SHA1 Message Date
Bob Roldan
95223474b4 DBZ-4300 Fix incorrect attribute for link to DBZ supported config pg 2022-01-12 16:44:54 -05:00
Bob Roldan
2beefb9d8f DBZ-4300 Link to up/down-stream pages for info re: supported db versions 2022-01-12 10:10:25 +01:00
Hady Willi
0e911a91ab
DBZ-4461 Improving documentation for postgres bytea_output 2022-01-04 13:58:14 +01:00
Bob Roldan
edcd133ec0 DBZ-3457 Correct Oracle FQ table format; remove problematic links. 2022-01-03 14:21:51 +01:00
Bob Roldan
413aabccca DBZ-3457 Edits and updates to fix build problems 2022-01-03 14:21:51 +01:00
Bob Roldan
3db7a20b91 DBZ-3457 Address review comments 2022-01-03 14:21:51 +01:00
Bob Roldan
7551d1d077 DBZ-3457 Prep signaling/incremental snapshots for downstream use 2022-01-03 14:21:51 +01:00
Jiri Pechanec
632f228581 DBZ-3342 Incremnetal snapshot documentation 2021-12-09 10:03:41 +01:00
Gunnar Morling
71eb089e4e [docs] Fixing broken listing 2021-11-30 14:59:35 +01:00
Gunnar Morling
8946c28da8 DBZ-2363 Docs fix 2021-11-30 12:00:09 +01:00
Jiri Pechanec
d121b3bf89 DBZ-4272 Document limiations 2021-11-30 09:28:44 +01:00
Chris Cranford
687b79787f DBZ-4127 Document incremental.snapshot.chunk.size 2021-11-30 09:06:43 +01:00
Gunnar Morling
5866056a41 DBZ-2363 Using prefix as message key 2021-11-26 18:15:25 +01:00
Lairen Hightower
450998b49e DBZ-2363 Replace logicalDecodingMessageHandlingMode with a prefix filtering configuration 2021-11-26 14:29:15 +01:00
lairen
a0898ed440 DBZ-2363 Adding support for pg_logical_emit messages in Postgres connector for the pgoutput plugin 2021-11-26 14:29:15 +01:00
Gunnar Morling
f4fb1124f3
[docs] Updating supported Postgres versions 2021-11-17 12:09:23 +01:00
Gunnar Morling
9c41053fcb DBZ-1931 Hyper-linking some options in docs 2021-11-17 10:06:41 +01:00
Vojtech Juranek
5ed669dcd7 DBZ-1931 Document mapping and config option 2021-11-17 09:30:15 +01:00
Chris Cranford
ba525abe97 DBZ-4276 Use xref rather than link-prefix 2021-11-16 20:29:59 +01:00
Chris Cranford
ca17352221 DBZ-4276 Unify unavailable value placeholder handling
Deprecate the `toasted.value.placeholder` option in PostgreSQL in favor
of the new `unavailable.value.placeholder` option that is shared by all
relational connectors.
2021-11-16 20:29:59 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Anisha Mohanty
9f7ede0e06 DBZ-3626 Renaming master branches to main 2021-10-28 09:33:32 +02:00
Bob Roldan
dab1887013 DBZ-3974 Add missing content to schema change doc + consistency edits 2021-10-15 15:45:57 +02:00
roldanbob
79fc8ab049
DBZ-3437 Incorrect documentation for message.key.columns;
* Update message.key.columns for all relational connectors
* Update format of variables for consistency
* Correct table name in example text
* Update FQ table name format for consistency

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-10-06 10:23:59 +02:00
Gunnar Morling
62715c4e1d DBZ-4033 Doc update 2021-10-05 10:54:01 +02:00
unalsurmeli
9a13d80074 DBZ-4033 A new hash version has been added so that it can be used to have the same hash value in different places;
In V2, the byte array only has the actual value, unlike the serialization based V1 implementation which exposed Java's internal serialization format.
2021-10-05 10:52:30 +02:00
Bob Roldan
245b9efd3d DBZ-3603 Add example for snapshot.select.statement.overrides property 2021-09-22 17:16:55 +02:00
Bob Roldan
b341811b58 DBZ-3961-specify-when-connectors-begin-to-collect-metadata 2021-09-15 22:48:38 +02:00
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Bob Roldan
691bf80cf4 DBZ-3613 Specify when snapshot metrics are available. 2021-08-30 10:03:20 +02:00
roldanbob
5db43c853e
[docs] Fix malformed link
Removed duplicate colon that preceded link definition.
2021-08-24 18:23:09 -04:00
Ismail Simsek
c5f1568b51 DBZ-3760 fix regexp identifying env vars 2021-08-23 13:26:41 +02:00
roldanbob
32a0869142
[docs] fix typo 2021-08-17 12:59:19 -04:00
roldanbob
bacd0283f9
[docs] fix typo 2021-08-17 12:56:02 -04:00
Bob Roldan
519f904276 DBZ-3858 Fix links in topic auto-create, CBR, outbox & connector docs 2021-08-16 15:03:30 +02:00
Zoran Regvart
c0fb820d97 DBZ-3856 Typo with prodname asciidoc attribute usage 2021-08-11 23:53:18 +02:00
Jiri Pechanec
cb2ae990cf DBZ-3688 Document incremental snapshot metrics 2021-08-11 14:40:15 +02:00
pkgonan
5e0ffa28d2 DBZ-3765 Allow dot in database.server.name 2021-08-08 16:25:15 -04:00
Bob Roldan
580080ed67 DBZ-3802 FQ column name incorrectly refers to databaseName vs schemaName 2021-08-04 15:22:23 +02:00
Bob Roldan
dd1d4f5165 DBZ-3802 Describe column.mask.hash.with.salt property consistently 2021-08-04 15:22:23 +02:00
Jiri Pechanec
51affad619 DBZ-3655 Document status update property 2021-07-27 10:21:54 +02:00
Gunnar Morling
ca528fc34c
DBZ-3747 Misc. doc fixes 2021-07-16 12:27:13 +02:00
Eric Slep
8a659ff8ab DBZ-2790 Docs and one final test edge case 2021-06-08 12:10:26 +02:00
Sergei Morozov
92e0488874 DBZ-3562: Allow hyphen in database.server.name 2021-05-27 11:03:30 +02:00
Bob Roldan
6fd22957c0 DBZ-3525 Fix link, standardize intro and prereqs in Deploying topics. 2021-05-26 16:50:05 -04:00
Jiri Pechanec
5fbc181b5e DBZ-2337 All snapshots using exported mode 2021-05-18 21:44:08 +02:00
Jiri Pechanec
9f66d3e5ff DBZ-3500 Fix typo 2021-05-18 14:08:23 +02:00
Jiri Pechanec
9058e8b3ea DBZ-3500 Convert docs to partial 2021-05-18 14:08:23 +02:00
Jiri Pechanec
32fd1c4ccc DBZ-3500 Fix typo
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-05-18 14:08:23 +02:00
Jiri Pechanec
f50d9f9484 DBZ-3500 Apply suggestions from code review
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-05-18 14:08:23 +02:00
Jiri Pechanec
17f00de04d DBZ-3500 Document incremental and ad-hoc snapshot for Postgres 2021-05-18 14:08:23 +02:00
roldanbob
7066ca7300
[docs] Restore PG properties ModuleID declaration
Restore the downstream comment in postgresql.adoc that specifies the downstream anchor ID for the configuration properties topic. I previously removed the comment while troubleshooting downstream linking errors. A tooling change should address this deficit without requiring us to always use the upstream anchor IDs.

This change is not visible in either the upstream or downstream content and has no effect on the upstream behavior.
2021-05-11 17:57:58 -04:00
Anisha Mohanty
98ce954332 DBZ-3427 Change wording in connector field database.server.name 2021-04-28 13:18:52 +02:00
Gunnar Morling
6eae0daeaa DBZ-3416 Consistent docs for all connectors 2021-04-13 10:47:27 +02:00
Gunnar Morling
35c9e846c5 DBZ-2699 Doc fix 2021-04-08 12:32:25 +02:00
Hossein Torabi
5d6705c3fe DBZ-2699 implement skipped.operation in core 2021-04-08 11:59:08 +02:00
Bob Roldan
e24d54ea37 DBZ-3372 Add missing space and insert missing docker build command 2021-04-06 08:58:58 +02:00
Bob Roldan
1a21f00fdb DBZ-3338 Update link text 2021-04-01 16:10:38 +02:00
Bob Roldan
727a8f89b2 DBZ-3338 Further consistency updates in Deployment topic. 2021-04-01 16:10:38 +02:00
Bob Roldan
3d1dfcb104 DBZ-3338 Remove downstream ModuleID declaration for properties topic 2021-04-01 16:10:38 +02:00
Bob Roldan
e8cd1a820d DBZ-3338 Edits for consistency with other connector docs 2021-04-01 16:10:38 +02:00
Bob Roldan
e161077455 DBZ-3338 Mirror downstream codeblock fix. Other consistency edits. 2021-04-01 16:10:38 +02:00
Jiri Pechanec
a02e530c80 DBZ-2911 Use sequence only when available 2021-03-26 09:19:17 +01:00
JLDLaughlin
06b0475f17 DBZ-2911 Add additional LSN information to all sources
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00
Jiri Pechanec
21f522217c DBZ-3033 Map OID to long value 2021-03-17 18:11:52 +01:00
Bob Roldan
0bdb166193 DBZ-3197 Update release version in PG doc URL to point to current. 2021-03-05 14:50:16 +01:00
Bob Roldan
23d8b36adf DBZ-3197 Clarify SELECT permission requirements; add link to PG doc. 2021-03-05 14:50:16 +01:00
Bob Roldan
6dc3afb890 DBZ-3197 Specify that superuser grants role; SELECT grant also needed 2021-03-05 14:50:16 +01:00
Bob Roldan
55853a691d DBZ-3197 Describe how to grant replication role to non-master account. 2021-03-02 09:03:22 +01:00
Bob Roldan
0311ca38ad DBZ-3192 Per review feedback, update pronoun references to DBZ db user. 2021-02-25 08:21:27 +01:00
Bob Roldan
f9c23dd2c9 DBZ-3195 Correct typo in anchor id for entry in PG properties table 2021-02-25 08:20:20 +01:00
Bob Roldan
ef73aa4254 DBZ-3138 Add content about pgoutput security nuances
Co-authored-by: Dave Cramer <davecramer@gmail.com>
2021-02-24 08:33:04 +01:00
Jiri Pechanec
1edad510ff DBZ-2614 Support for infinite timestamps 2021-02-19 10:44:06 +01:00
Michael Cizmar
a78843a683
DBZ-3149 Clarified the initial snapshot mode literal 2021-02-19 10:30:00 +01:00
Bob Roldan
e27f837b47 DBZ-3087 Remove zero-width spaces from prop names subject to copying 2021-02-17 09:16:37 +01:00
Bob Roldan
567e3d7ae9 DBZ-3111 Remove dup anchors introduced into props tables in DBZ-2918. 2021-02-16 09:44:11 +01:00
Gunnar Morling
65166dabb3
[docs] Broken link formatting 2021-02-08 08:52:15 +01:00
Gunnar Morling
8bf4a85a81 DBZ-2382 Doc update 2021-02-03 13:53:01 +01:00
Dave Cramer
546b2f2da9 [docs] Update docs for PostgreSQL and add CrunchyBridge 2021-02-03 12:27:07 +01:00
Bob Roldan
23e8eeb854 DBZ-2918 Conscious language update: replace black-/white- list strings 2021-01-22 09:32:13 +01:00
Gunnar Morling
8c5b540346 [docs] Typo fix 2020-11-26 14:21:58 +01:00
vanhoale
1f87fc3c85 DBZ-2662 - update docs for DBZ-2662 2020-11-19 06:04:34 +01:00
cooksey
c262238183 DBZ-2608 Add a snapshotComplete lifecycle hook to the Snapshotter 2020-10-30 13:34:38 -04:00
Tova Cohen
4d76c04a10 DBZ-2681 From a new branch, two fixes, and moved one anchor ID into upstream-only content 2020-10-22 06:47:20 +02:00
Tova Cohen
7d513a470a DBZ-2681 PostgreSQL doc tweaks for correct formatting downstream 2020-10-21 14:21:43 +02:00
Tova Cohen
584b059ade DBZ-2497 Add variable to metrics anchor IDs so IDs are unique in each connector's doc 2020-10-19 16:26:58 -04:00
Tova Cohen
d03625f01c DBZ-2621 Make fulfillment the name of the connector. 2020-10-16 14:36:24 +02:00
Tova Cohen
53031f4dff DBZ-2621 Reorganized deployment instructions. Moved monitoring out of deployment section. 2020-10-16 14:36:24 +02:00
Kaushik Iyer
edcfc747ee DBZ-2456 selective snapshot rebase fixes 2020-10-16 10:13:48 +02:00
Travis Elnicky
3bd0758f8e [documentation] Small typo in PG Docs 2020-10-14 16:49:21 +02:00
Tova Cohen
43782498d2 DBZ-2584 PostgreSQL doc additional explanation of ts_ms for update event 2020-10-14 16:41:40 +02:00
Tova Cohen
ee3b74bc9f DBZ-2584 PostgreSQL doc, replaces ts_sec with ts_ms, clarifies source.ts_ms meaning 2020-10-14 16:41:40 +02:00
Tova Cohen
d17861445a DBZ-2610 In downstream-only content, add context directory to podman command example 2020-10-05 09:26:05 -04:00
Jiri Pechanec
6f029921bb DBZ-2605 Postgres uses schemas not databases 2020-09-29 09:08:16 +02:00
matt beary
7393e1ae3b
DBZ-2590 Removing closed wal2json bug from plugin differences 2020-09-24 12:13:01 +02:00
Tova Cohen
db75abe6e3 DBZ-2564 PostgreSQL connector doc format updates for downstream rendering 2020-09-23 10:25:48 +02:00
Tova Cohen
21b12b73c4 DBZ-2049 PostgreSQL connector deploy instructions update based on Gunnar's comments 2020-09-11 12:07:30 -04:00
Tova Cohen
9b0c5bec8b DBZ-2049 Update URL for a blog 2020-09-11 12:03:54 -04:00
Tova Cohen
41aa096f35 DBZ-2501 PostgreSQL event value callouts fixed to render correctly downstream 2020-09-11 11:32:22 -04:00
Tova Cohen
f0b0741e44 DBZ-2501 Update PostgreSQL event descriptions to be consistent with other connectors 2020-09-11 11:07:25 -04:00
Gunnar Morling
9b99370c8a DBZ-2094 Updating docs 2020-09-09 11:18:45 +02:00
Tova Cohen
eae57bfa6e DBZ-2500 Deleted a hyphen, added postgresql qualification, deleted a TBA example ref 2020-09-07 14:23:34 +02:00
Tova Cohen
b4cc6a141e DBZ-2476 Fixes link format for include/exclude list properties for PostgreSQL 2020-09-04 07:42:16 +02:00
Tova Cohen
81a0f94e8d DBZ-2403 Fix conflict resolution mistake and correct a typo. 2020-09-02 17:03:05 -04:00
Tova Cohen
d19bf06730 DBZ-2403 Completed revision of Db2 doc except for some config properties 2020-09-02 17:03:05 -04:00
Tova Cohen
cb434a86bc DBZ-2403 More updates to Db2 doc, and to PostgreSQL for consistency 2020-09-02 17:02:59 -04:00
Tova Cohen
44bd912979 DBZ-2403 Initial commit of updates to Db2 connector doc 2020-09-02 15:30:28 -04:00
rkerner
2c5c093587 DBZ-2171 avoid divisive language 2020-08-21 09:29:04 +02:00
Tova Cohen
0f9b6ac343 DBZ-2399 Edit new Azure content. Change anchor IDs to avoid duplicates 2020-08-07 09:01:10 +02:00
Tova Cohen
10fd7bb49d DBZ-2402 Rename some files and updates references to those files 2020-08-06 12:02:26 +02:00
Gunnar Morling
c33a9f53c2 DBZ-2333 Bringing back Azure docs which had been added in parallel 2020-08-05 10:51:13 +02:00
Gunnar Morling
3cac37ee54 DBZ-2333 Some formatting fixes 2020-08-05 10:51:13 +02:00
Tova Cohen
b0d9b4dc5d DBZ-2333 Rebase and merge of update to mapping for BIT and BIT VARYING 2020-08-04 12:20:08 -04:00
Tova Cohen
f053a24ea1 DBZ-2333 Remove extra J, say you must set pgoutput as plugin.name downstream 2020-08-04 12:20:08 -04:00
Tova Cohen
e1df5402c4 DBZ-2333 Fixes a few small glitches that I noticed 2020-08-04 12:20:08 -04:00
Tova Cohen
c8dcbff4ce DBZ-2333 Updates based on Chris's review comments 2020-08-04 12:20:08 -04:00
Tova Cohen
9787cf17c6 DBZ-2333 Finished edits and annotating PostgreSQL connector doc 2020-08-04 12:20:08 -04:00
Tova Cohen
0f9f98e839 DBZ-2333 Initial updates to modularize content. Not complete. Cannot build yet. 2020-08-04 12:20:08 -04:00
Gunnar Morling
5a115e902c DBZ-2315 Doc clarification 2020-08-03 14:58:31 +02:00
rkerner
cad6cf62d3 DBZ-2315 fix BIT VARYING handling in Postgres connector
* removed little endian padding for BIT types in JdbcValueConverters (only used for Postgres yet)
* removed legacy format handling fot BIT related types in JdbcValueConverters#convertBits which were leftovers from PR #1408
* removed unnecessary zero-ing of a newly created byte array to improve performance for huge byte arrays
* updated Postgres connector docs
2020-08-03 14:58:31 +02:00
Gunnar Morling
05aa3e095c DBZ-2394 Grouping Postgres cloud docs 2020-07-31 15:45:48 +02:00
abhishek
e6f3b6b3d7 DBZ-2394 updated as per feedback 2020-07-31 15:43:23 +02:00
abhishek
90eebe725c DBZ-2394 Added Azure PostgreSQL guidance 2020-07-31 15:43:23 +02:00
Cory Harper
724fc7ac98 DBZ-2362 add configurable restart wait time 2020-07-30 18:08:26 +02:00
Jiri Pechanec
c2a40b7ed4 DBZ-2288 Add documentation 2020-07-16 09:51:00 +02:00
Jos Huiting
da97be7842 DBZ-2307 - Improve logging when primary keys are missing 2020-07-15 11:18:48 -04:00
Tova Cohen
dad8665f24 DBZ-2333 Replaces a broken link with a correct link to doc for Kafka log compaction 2020-07-14 17:16:36 +02:00
Tova Cohen
8b0617ce1a DBZ-2266 Removed link to blog post that was also in postgresql doc 2020-06-23 12:42:50 -04:00
Tova Cohen
af7d89dd7d DBZ-1956 Updates based on Chris's review of MongoDB connector doc 2020-06-22 10:56:00 +02:00
Gunnar Morling
16a4c9a2a3 DBZ-2069 Removing obsolete incubating note;
Also adding connector property to MongoDB connector
2020-06-16 10:39:16 -04:00
Gunnar Morling
02b16e17ac DBZ-1814 Adding tests for exporting unkown column type 2020-06-05 12:13:29 +02:00
Gunnar Morling
c54e377dd2 DBZ-1814 Exporting Hex and Base64 representations as string 2020-06-05 12:13:29 +02:00
Gunnar Morling
023064eedb DBZ-1814 Renaming "raw" to "bytes"; also clarifying that this notion isn't Java-specific 2020-06-05 12:13:29 +02:00
Jeremy Finzel
5db614da21 DBZ-1814 added new binary handling mode option 2020-06-05 12:13:29 +02:00
Brandon Brown
bd64ace7fc DBZ-1813 Adding ability to configure pgoutput publication based on table filters
defined.
2020-06-05 06:24:25 +02:00
Chris Cranford
dc3c5c31e5 DBZ-2020 Remove incubating note for transaction metadata 2020-06-02 11:52:16 -04:00
TovaCohen
978af474b6 DBZ-2129 More updates so downstream user guide can build 2020-06-01 08:58:37 -04:00
TovaCohen
d3408140f0 DBZ-2105 Change column widths in option/properties tables to have wider middle column needed downstream 2020-05-28 11:04:17 -04:00
TovaCohen
2e6e81543b DBZ-2105 Started to replace contractions, instances of "we/our", spelling of behavior. Not exhaustive. 2020-05-28 11:04:17 -04:00
TovaCohen
6c13e8265e DBZ-2105 Updated AsciiDoc markup for tables to be only what is needed 2020-05-28 11:04:17 -04:00
TovaCohen
2a5557b61d DBZ-2105 Replace "Debezium" with "{prodname}" where appropriate 2020-05-28 11:04:17 -04:00
TovaCohen
84e9c91d84 DBZ-2105 Fix a typo in an attribute reference 2020-05-28 11:04:17 -04:00
TovaCohen
964f31dd36 DBZ-2105 Removing includes statements for the _attributes.adoc file and remove that file. 2020-05-28 11:04:16 -04:00
TovaCohen
046ab999dc DBZ-2105 Replaced "xref:" cross references with {link-prefix}:{link-whatever} 2020-05-28 11:04:16 -04:00
TovaCohen
07c0b23051 DBZ-2105 Replace "link:#" formats with formats that use document attributes. 2020-05-28 11:04:16 -04:00
TovaCohen
7012a9c3c7 DBZ-2105 Updates to ensure unique anchor IDs. Updates references to updated IDs. 2020-05-28 11:04:16 -04:00
TovaCohen
4faa4a8534 DBZ-2105 Change conditionalization to use "community" and "product" attributes. 2020-05-28 11:04:16 -04:00
TovaCohen
b099de948b DBZ-2021 Updates to allow downstream UG to build: link updates, anchor ID changes 2020-05-20 10:49:37 -04:00
Chris Cranford
68c07c132a DBZ-775 Update documentation for column mask/truncation and key columns 2020-05-18 17:21:26 +02:00
TovaCohen
0d13f58d3c DBZ-2011 Inserted a space in front of callout numbers. Fixed an xref. 2020-05-05 13:17:57 -04:00