Commit Graph

206 Commits

Author SHA1 Message Date
pkgonan
fd309193c6 DBZ-5544 Add document 2022-08-24 09:50:23 +02:00
Vivek Wassan
d89e71ebeb DBZ-5327 Smart Backfills 2022-08-17 10:05:55 +02:00
Chris Cranford
f8e67e3ff9 DBZ-5453 Add stop-snapshot MySQL read-only Kafka signal 2022-08-04 16:16:42 -04:00
Vojtech Juranek
9f35b840fc [docs] Fix defaut values of max.batch.size and poll.interval.ms
Default `max.batch.size` is 2048 [1].
Default `poll.interval.ms` is 500 ms [2] (except Cassandra where it's
still 1000 ms and Mongo which has it's own config)

[1] https://github.com/debezium/debezium/blob/v2.0.0.Alpha3/debezium-core/src/main/java/io/debezium/config/CommonConnectorConfig.java#L300
[2] https://github.com/debezium/debezium/blob/v2.0.0.Alpha3/debezium-core/src/main/java/io/debezium/config/CommonConnectorConfig.java#L302
2022-07-21 08:14:08 -04:00
Chris Cranford
fdf6fc1fa3 DBZ-5396 Document relational attributes in JSON schema change events 2022-07-19 15:41:02 -04:00
harveyyue
daf329bc06 DBZ-5413 Update the topic naming strategy doc to all connectors 2022-07-18 10:18:12 -04:00
harveyyue
35bd0107ce DBZ-5343 Unsigned tinyint conversion fails for MySQL 8.x 2022-07-11 12:12:26 +02:00
Bob Roldan
a885c03f89 DBZ-5334 Add ts_ms to txn boundary event examples; update description 2022-07-08 08:10:17 +02:00
harveyyue
68a78f73bb DBZ-5170 Update transaction ts_ms field to related doc 2022-06-27 15:50:52 +02:00
harveyyue
f6a04e2db8 DBZ-5236 Cannot convert field type tinyint(1) unsigned to boolean 2022-06-13 14:42:20 +02:00
Bob Roldan
5767951893 DBZ-5233 Use tag regions in shared fragment to specify MBean formats 2022-06-13 14:37:54 +02:00
Bob Roldan
d7a3dfbb14 DBZ-5233 Use fragments to specify MBean names vs. ifeval conditionals 2022-06-13 14:37:54 +02:00
Vojtech Juranek
1edab1d1a5 DBZ-5045 Remove deprecated MySQL GTID_NEW_CHANNEL_POSITION option 2022-06-08 09:11:00 +02:00
harveyyue
3ada04b522 DBZ-3865 Debezium MySql connector does not capture floating point numbers with the right precision 2022-05-25 12:54:42 -04:00
Chris Lee
2a8456d21b DBZ-5123 data-collection regex snapshot signal 2022-05-24 12:46:28 +02:00
Bob Roldan
3160987bc5 DBZ-4713 Update example, remove callouts as text isn't meant for copying 2022-05-24 09:35:03 +02:00
harveyyue
327f9ce6d4 DBZ-5098 Update field "ts_ms" to connector docs 2022-05-18 14:21:39 +02:00
Bob Roldan
1745abf5f8 DBZ-4588 Make converter property descriptions consistent 2022-05-13 13:25:32 +02:00
Bob Roldan
4588e32338 DBZ-4588 Update Oracle and MySQL Boolean types custom converter examples 2022-05-13 13:25:32 +02:00
Bob Roldan
9b897f1120 DBZ-4588 Insert converters property in configuration tables 2022-05-13 13:25:32 +02:00
Bob Roldan
1cadd6a4d7 DBZ-4588 Adds links to converters topic from connector data types topics 2022-05-13 13:25:32 +02:00
Chris Cranford
65017dc2d6 DBZ-5100 Do not default database.server.id 2022-05-09 08:52:24 +02:00
AlexMiroshnikov
25624baa14 DBZ-5040 Fix typo about decimal.handling
decimal.handling VS decimal.handing - "l" was missing
2022-05-09 08:37:10 +02:00
Bob Roldan
c64558ae77 DBZ-4392 Update deployment steps to use curl to pull Maven artifacts 2022-04-01 13:17:13 -04:00
Bob Roldan
cfeac5b0db DBZ-4392 Fix link; restore terminator for community ifdef conditional 2022-04-01 13:17:13 -04:00
Sergei Morozov
b258674782 DBZ-3535: Introduce schema.name.adjustment.mode 2022-03-24 09:37:05 +01:00
Bob Roldan
bf27791fa1 DBZ-4906 Fixes typo in link text 2022-03-23 17:44:17 +01:00
Bob Roldan
c926412c1b DBZ-4052 Address review comments; normalize property descriptions 2022-03-17 07:26:03 +01:00
Bob Roldan
2533663065 DBZ-4052 align description across connectors;link from metrics topics 2022-03-17 07:26:03 +01:00
Jose Luis Sánchez
1240d06b0d [docs] Updating documentation to reflect MySQL 8 changes;
According to https://dev.mysql.com/doc/refman/5.7/en/information-schema-variables-table.html, information_schema.global_variables has been deprecated ( and removed on 8.x ) in favour of performance_schema, so this documentation reflects the new way to achieve this
2022-03-15 12:22:42 +01:00
Bob Roldan
dbd3447c05 DBZ-4014 Revise warning based on PR review 2022-03-11 10:26:34 +01:00
Bob Roldan
d8ed383118 DBZ-4014 Warne users not to modify database.server.name 2022-03-11 10:26:34 +01:00
Bob Roldan
62de805b3a DBZ-4655 Remove old note about new capturing implementation 2022-03-09 12:40:41 +01:00
Bob Roldan
66363a7d19 DBZ-4655 Remove TP designations for signaling/incremental snapshots 2022-03-09 12:40:41 +01:00
Gunnar Morling
d21e37746a DBZ-4606 Dropping superfluous link-prefix attribute 2022-02-18 08:47:06 +01:00
roldanbob
7c5d1c1f92
DBZ-4606 Adding anchor IDs to Avro cross-refs;
* Prefix cross-references w/ `xref` vs. {link-prefix} attribute
* Correct formatting of intra-file xref to topic.regex property

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-02-17 07:47:45 +01:00
Gunnar Morling
aabe0b4f9d DBZ-4731 Adding note on MongoDB Atlas;
Also making set up section titles consistent.
2022-02-15 10:04:48 +01:00
Jiri Pechanec
32ef406e9e DBZ-4171 Connector name is database server name 2022-01-27 11:36:54 +01:00
Jiri Pechanec
4236e3291a DBZ-4583 Workround for columns longer than max int 2022-01-25 15:16:47 +01:00
Bob Roldan
56e0ef581c DBZ-4563 Misc updates to fix build errors and update content. 2022-01-19 09:29:57 +01:00
Chris Cranford
9a30141110
[docs] Fix render bug for MySQL 2022-01-18 13:21:07 -05:00
Bob Roldan
16d0e89210 DBZ-3991 Remove sentence that is replaced by shared content 2022-01-17 14:11:16 +01:00
Bob Roldan
734c35d039 DBZ-3991 Remove redundancy, add line between sections for readability 2022-01-17 14:11:16 +01:00
Bob Roldan
8e9786a08a DBZ-3991 Updates to address downstream build issues. 2022-01-17 14:11:16 +01:00
Bob Roldan
b756ed67f6 DBZ-3991 Update connector files to incorporate shared deployment content 2022-01-17 14:11:16 +01:00
Bob Roldan
3fb6cd5902 DBZ-3991 Update based in initial review; replace strings w/ attributes 2022-01-17 14:11:16 +01:00
Bob Roldan
5f8fdf132c DBZ-3991 Create shared files to doc using streams to deploy connectors 2022-01-17 14:11:16 +01:00
Bob Roldan
95223474b4 DBZ-4300 Fix incorrect attribute for link to DBZ supported config pg 2022-01-12 16:44:54 -05:00
Bob Roldan
2beefb9d8f DBZ-4300 Link to up/down-stream pages for info re: supported db versions 2022-01-12 10:10:25 +01:00
Bob Roldan
edcd133ec0 DBZ-3457 Correct Oracle FQ table format; remove problematic links. 2022-01-03 14:21:51 +01:00
Bob Roldan
413aabccca DBZ-3457 Edits and updates to fix build problems 2022-01-03 14:21:51 +01:00
Bob Roldan
3db7a20b91 DBZ-3457 Address review comments 2022-01-03 14:21:51 +01:00
Bob Roldan
7551d1d077 DBZ-3457 Prep signaling/incremental snapshots for downstream use 2022-01-03 14:21:51 +01:00
Jiri Pechanec
632f228581 DBZ-3342 Incremnetal snapshot documentation 2021-12-09 10:03:41 +01:00
Chris Cranford
687b79787f DBZ-4127 Document incremental.snapshot.chunk.size 2021-11-30 09:06:43 +01:00
Gunnar Morling
5067b30b5b [docs] Fixing rendering issue 2021-11-26 18:15:25 +01:00
Kate
dab6fefce2 DBZ-4196 Document schema changes during incremental snapshot config 2021-11-18 08:41:49 +01:00
Gunnar Morling
1226c3b2ab DBZ-4029 Misc. clean-up;
* Exposing heartbeatInterval() on CommonConnectorConfig
* Closing heartbeat connection
* Making test more resilient
* Correct member ordering and visibility
* Doc fixes
2021-11-05 13:27:09 +01:00
ahodavdekar
91b7ef2c36 DBZ-4029 Adding support for heartbeat action queries to MySQL connector 2021-11-05 13:27:09 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Bob Roldan
94c01bb2a9 DBZ-4199 Specify correct anchor ID in internal link 2021-10-26 11:27:41 +02:00
Jiri Pechanec
a6ae15d0ca DBZ-4000 Add Oracle docs; remove internal names 2021-10-20 16:33:51 +02:00
Jiri Pechanec
1915534fc7 DBZ-4000 Add docs 2021-10-20 15:19:31 +02:00
Bob Roldan
dab1887013 DBZ-3974 Add missing content to schema change doc + consistency edits 2021-10-15 15:45:57 +02:00
roldanbob
79fc8ab049
DBZ-3437 Incorrect documentation for message.key.columns;
* Update message.key.columns for all relational connectors
* Update format of variables for consistency
* Correct table name in example text
* Update FQ table name format for consistency

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-10-06 10:23:59 +02:00
Gunnar Morling
62715c4e1d DBZ-4033 Doc update 2021-10-05 10:54:01 +02:00
Bob Roldan
245b9efd3d DBZ-3603 Add example for snapshot.select.statement.overrides property 2021-09-22 17:16:55 +02:00
Kate
0099a50c53 DBZ-3948 Support kafka topic based signals 2021-09-22 13:08:45 +02:00
Bob Roldan
b341811b58 DBZ-3961-specify-when-connectors-begin-to-collect-metadata 2021-09-15 22:48:38 +02:00
Bob Roldan
691bf80cf4 DBZ-3613 Specify when snapshot metrics are available. 2021-08-30 10:03:20 +02:00
Ismail Simsek
c5f1568b51 DBZ-3760 fix regexp identifying env vars 2021-08-23 13:26:41 +02:00
Jiri Pechanec
f173def3b2 DBZ-3833 Receive timezoned data in server timezone 2021-08-16 13:43:51 +02:00
Jiri Pechanec
cb2ae990cf DBZ-3688 Document incremental snapshot metrics 2021-08-11 14:40:15 +02:00
pkgonan
5e0ffa28d2 DBZ-3765 Allow dot in database.server.name 2021-08-08 16:25:15 -04:00
Bob Roldan
dd1d4f5165 DBZ-3802 Describe column.mask.hash.with.salt property consistently 2021-08-04 15:22:23 +02:00
Kate
9b66ab374a DBZ-3577 Support read-only MySQL incremental snapshots 2021-07-29 07:10:46 +02:00
roldanbob
6cd16cd847 DBZ-3140 fix incorrect value in property example
Co-authored-by: Chris Cranford <ccranfor@redhat.com>
2021-07-21 14:57:07 -04:00
Bob Roldan
7ed87dba9e DBZ-3140 Insert downstream note about new MySQL capturing implementation 2021-07-21 14:57:07 -04:00
Gunnar Morling
20a4d0b845
DBZ-3711 Docs clarification 2021-07-05 16:36:03 +02:00
Bob Roldan
b80eb543c4 DBZ-3459 Moving history properties to shared partial for MySQL, Db2, Oracle, and SQL Server connectors;
* Escape asterisks representing wildcards in property names.
* Update downstream ModuleID for main props topic, fix typos.
* Add anchor ID and link to required properties
* Change language to reflect that db history properties relate to both reading and writing the history
* Update documentation/modules/ROOT/partials/modules/all-connectors/ref-connector-configuration-database-history-properties.adoc

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-06-25 11:58:51 +02:00
Bob Roldan
d0c331617d DBZ-3582 Update downstream MySQL doc to refer to streaming metrics 2021-06-02 20:12:16 -04:00
Jiri Pechanec
31e1e79ede DBZ-3572 Binlog metrics were renamed to streaming 2021-06-01 08:36:00 +02:00
Sergei Morozov
92e0488874 DBZ-3562: Allow hyphen in database.server.name 2021-05-27 11:03:30 +02:00
Bob Roldan
6fd22957c0 DBZ-3525 Fix link, standardize intro and prereqs in Deploying topics. 2021-05-26 16:50:05 -04:00
Chris Cranford
30fd47179e DBZ-1145 Clarify MariaDB support in MySQL documentation 2021-05-20 21:24:40 +02:00
Gunnar Morling
dff403400f
DBZ-3529 Documenting "initial_only" snapshot mode 2021-05-20 11:56:20 +02:00
Jiri Pechanec
9f66d3e5ff DBZ-3500 Fix typo 2021-05-18 14:08:23 +02:00
Jiri Pechanec
9058e8b3ea DBZ-3500 Convert docs to partial 2021-05-18 14:08:23 +02:00
roldanbob
5ef256c2d0
[docs] Restore downstream MySQL ModuleID declaration
In the mysql.adoc, restore the downstream comment that specifies the downstream anchor ID for the snapshots topic. I previously removed the comment, because downstream, links to the topic were not working. A tooling change should address this deficit without requiring us to use the upstream anchor IDs.

This change is not visible in either the upstream or downstream content and it has no effect on the upstream behavior.
2021-05-11 17:16:42 -04:00
roldanbob
015e68d6f4
[docs] fix typo
Localization detected "SQ statement" where "SQL statement" was intended.
2021-05-07 12:32:38 -04:00
roldanbob
40e84cfb79
[docs] Fix typo in downstream annotation
On L557, change the downstream `Title` annotation from `About keys in {prodname} mysql change events` to `... MySQL change events`.
2021-05-03 12:35:52 -04:00
Anisha Mohanty
98ce954332 DBZ-3427 Change wording in connector field database.server.name 2021-04-28 13:18:52 +02:00
Gunnar Morling
91b784c3b6 DBZ-3161 Avoid failing when legacy option is given; also
* adding all public history options on config surface
* adding missing whitespace in field docs
* recommending non-deprecated option in docs
2021-04-26 13:07:23 +02:00
Anisha Mohanty
11fb079582 DBZ-3161 Add database.history.store.only.captured.tables.ddl option & CapturedTables metrics to documentation 2021-04-26 13:07:23 +02:00
roldanbob
62e87e681b
DBZ-3299 User guide corrections for MySQL connector;
* Update MySQL connector doc with common corrections
* Remove downstream ModuleID declaration for properties topic
* Adjust link text
* Modify xrefs in product content
* Add missing space
* Reconfigure conditionals to correct downstream build errors
* Refactor conditional content to get expected downstream results
* Add passage about immutable containers and OpenShift deployment
* Fix incorrect acronym expansion;remove {zwsp} in table entry
2021-04-13 17:04:25 +02:00
Gunnar Morling
6eae0daeaa DBZ-3416 Consistent docs for all connectors 2021-04-13 10:47:27 +02:00
raphaelauv
2b0d74f2ac DBZ-3416 Add missing compaction requirement for tombstones
The tombstones.on.delete is really interesting if compaction is activated on the topic.
2021-04-13 10:47:27 +02:00
Bob Roldan
d67fad4b4c DBZ-3402 Remove duplicate entry in MySQL properties table 2021-04-12 16:53:15 +02:00
Gunnar Morling
35c9e846c5 DBZ-2699 Doc fix 2021-04-08 12:32:25 +02:00
Hossein Torabi
5d6705c3fe DBZ-2699 implement skipped.operation in core 2021-04-08 11:59:08 +02:00