Commit Graph

132 Commits

Author SHA1 Message Date
Vojtech Juranek
b795519514 DBZ-6529 Use Murmur hash for PartitionRouting SMT
Add option to use better hash function than default Java Object::hash
function to get better hashes which would be more equally spred over
the hash space and thus more equally over the Kafka partitions.
To preserve backward compatibility, previous Java `hashCode` function
is used a default.

Add Murmur3 hash function for computing hashes of the fields.
Murmur3 implementation is taken from from Infinispan project code base.

To allow users eventually use their own make `computePartition()`
protected so it can be overriden in the subclasses.
2023-06-07 11:48:30 +02:00
roldanbob
4a73aac079
[docs] Fix typo in link
Remove extra opening square bracket that results  in broken link
2023-04-21 15:30:37 -04:00
Fiore Mario Vitale
f6a8970629 DBZ-5902 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-04-13 08:10:09 +02:00
mfvitale
36109b4ca3 DBZ-5902 Change fields configuration from 'partition.payload.field' to 'partition.payload.fields' 2023-04-13 08:10:09 +02:00
Fiore Mario Vitale
1d241283b7 DBZ-5902 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-04-13 08:10:09 +02:00
mfvitale
740d97a0f5 DBZ-5902 Add docs for PartitionRouting SMT that will replace ComputePartition 2023-04-13 08:10:09 +02:00
Bob Roldan
585b00a5bd DBZ-6330 Edits to fix links in MongoDB event flattening doc 2023-04-12 21:08:31 -04:00
Bob Roldan
311decac20 DBZ-6330 Address review feedback and fix links 2023-04-12 21:08:31 -04:00
Fiore Mario Vitale
84ab0dc3d2
DBZ-6201: Add docs for HeaderToValue SMT (#4389)
* DBZ-6201: Add docs for HeaderToValue SMT
---------

Co-authored-by: roldanbob <broldan@redhat.com>
2023-03-27 10:44:11 +02:00
roldanbob
4c18c0340b
[docs] add missing table block terminator
Addresses local antora build warning:

WARN (asciidoctor): unterminated table block
    file: /home/broldan/git/debezium/documentation/modules/ROOT/pages/transformations/event-changes.adoc:137
2023-03-16 17:06:21 -04:00
Bob Roldan
e0f2fc4095 DBZ-6130 Remove references to using properties files to configure SMTs 2023-02-27 13:22:01 -05:00
Bob Roldan
bb0f972af4 DBZ-6006 Update MongoDB flattening docs for downstream 2023-02-16 08:27:31 +01:00
Chris Cranford
375be6d61d DBZ-5283 Updated documentation 2023-02-10 13:53:05 +01:00
Chris Cranford
a7d1bb0f86 DBZ-5283 Decoupled changed SMT vs new state SMT, updated docs 2023-02-10 13:53:05 +01:00
Chris Cranford
bf46b298a2 DBZ-5283 Event Changes documentation updates 2023-02-10 13:53:05 +01:00
Chris Cranford
3d5c4328db DBZ-5283 Document unchanged field support to ExtractNewRecordState 2023-02-10 13:53:05 +01:00
Chris Cranford
a330c39f8b DBZ-5283 Document ExtractChangedRecordState SMT 2023-02-10 13:53:05 +01:00
harveyyue
0dcf9922f6 DBZ-5743 update the "field.name.adjustment.mode" property to all connector docs 2023-02-02 13:21:45 +01:00
Bob Roldan
1f7e374d19 DBZ-5975 Remove note that indicates SMT is under active development. 2023-01-13 10:13:36 +01:00
mfvitale
4c93ebd3f2 DBZ-5847: Improve ComputePartition SMT documentation 2022-12-12 14:40:56 +01:00
mfvitale
4c941b63ed DBZ-5847: Add support for all connectors
Support for qualified table names
2022-12-12 14:40:56 +01:00
mfvitale
d12811e9aa DBZ-5847: Add documentation 2022-12-12 14:40:56 +01:00
harveyyue
b124d91a93 DBZ-5796 For outbox transformation, when 'table.expand.json.payload' is set to true null values are not correctly deserialized 2022-11-16 14:55:01 +01:00
Bob Roldan
4aeaf264ee DBZ-5835 Replaces references to obsolete downstream docs attribute 2022-11-16 14:32:04 +01:00
Vojtech Juranek
adb5dff784 DBZ-5834 Update MongoDB New Document State Extraction docs 2022-11-16 14:26:51 +01:00
Enzo Cappa
e497fbc564 DBZ-5770 Update documentation regarding the Binary Data Converter
I introduce an error on the documentation by not closing a NOTE
block. Fixing it.
2022-11-14 09:48:13 +01:00
Enzo Cappa
179c359ca6 DBZ-5770 Update documentation regarding the Binary Data Converter
Updated all references from `ByteBufferConverter` to
`BinaryDataConverter`.

Also added special note about changing the settings before upgrading
when running in Kafka Connect (otherwise Kakfa Connect will fail to
start).

chore: add my name to copyright and aliases
2022-11-01 09:28:28 +01:00
Alberto Martino
9e96606eee DBZ-5715 MongoDB router uses collection not table in names
For the MongoDB Outbox Event router the property:
`transforms.outbox.table.fields.additional.placement` doesn't works because the Mongo event router looks to the property
`transforms.outbox.collection.fields.additional.placement` to expose additional fields.
2022-10-13 08:59:26 +02:00
Sergei Morozov
e4d46c81b1 DBZ-5541: Default Debezium schema.name.adjustment.mode to "none" 2022-09-29 09:47:25 +02:00
Bob Roldan
6193e97981 DBZ-4417 Add information about customizing basic SMT configuration 2022-09-21 07:39:41 +02:00
Alexander Schwartz
dd90d76944 DBZ-5618 fix broken anchors in the docs 2022-09-19 09:22:37 +02:00
Vojtech Juranek
5573bb51ed DBZ-5048 Rename GH repo with containes
Besides updating links to renamed GH repo, update also documentation and
replace 'Docker' with 'containers' when possible.
2022-07-12 13:16:53 +02:00
Mikhail Dubrovin
26a167b1e9 DBZ-5296 Correct documentation of Event Router in expand.json mode 2022-06-27 08:43:08 +02:00
Bob Roldan
cd1caf682d DBZ-5227 Specify use of JAR artifact for script engine language 2022-06-24 16:25:44 +02:00
Vojtech Juranek
76c8550e7b DBZ-5045 Remove deprecated Mongo DB OPERATION_HEADER option 2022-06-08 09:11:00 +02:00
Vojtech Juranek
ff5ddd7959 DBZ-5045 Remove deprecated FIELD_PAYLOAD_ID
`table.field.event.payload.id` is replaced by `table.field.event.key`.
Also fix default value of `table.field.event.key` which was missing.
2022-06-08 09:11:00 +02:00
Vojtech Juranek
4e7b30b718 DBZ-5045 Remove deprecated DEBEZIUM_OPERATION_INVALID_BEHAVIOR 2022-06-08 09:11:00 +02:00
Bob Roldan
7a266c5449 DBZ-5219 Restore deleted topic heading 2022-06-07 22:08:20 -04:00
connorszczepaniak-wk
125fddaa01 DBZ-5089: update docs to reflect new additional field placement option 2022-05-27 12:46:39 +02:00
Bob Roldan
3d308da31a DBZ-5128 Assign unique anchor ID to recently added topic routing option 2022-05-13 09:07:33 +02:00
Nathan Bradshaw
94b1746f02 DBZ-4600 - Update MongoDB SMT documentation to point to ByteArrayConverter 2022-05-10 15:08:46 +02:00
harveyyue
d03e555144 DBZ-5072 Update the two properties to topic-routing doc 2022-05-03 13:44:58 +02:00
Sergei Morozov
854186e846 DBZ-3535: Rework ByLogicalTableRouter 2022-03-24 09:37:05 +01:00
Bob Roldan
8d4e50496e DBZ-4652 Replace hard-coded link; add attributes to antora.yml. 2022-03-11 10:14:57 +01:00
Bob Roldan
0bfde4b082 DBZ-4652 Remove TP designations and conditionalization 2022-03-11 10:14:57 +01:00
Bob Roldan
c3825c8d3b DBZ-4655 Conditionalize TIP for downstream use 2022-03-09 12:40:41 +01:00
Bob Roldan
062c433a7e DBZ-4791 Update anchor IDs, titles, ModuleID defs, link formatting 2022-03-01 12:29:55 +01:00
Gunnar Morling
6ac56f8741
DBZ-4301 Formatting 2022-02-24 15:15:16 +01:00
Gunnar Morling
d21e37746a DBZ-4606 Dropping superfluous link-prefix attribute 2022-02-18 08:47:06 +01:00
roldanbob
7c5d1c1f92
DBZ-4606 Adding anchor IDs to Avro cross-refs;
* Prefix cross-references w/ `xref` vs. {link-prefix} attribute
* Correct formatting of intra-file xref to topic.regex property

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-02-17 07:47:45 +01:00
Bob Roldan
960af846c6 DBZ-4573 Conditionalize note about using the MongoDB outbox event router 2022-01-21 08:49:27 +01:00
Bob Roldan
58cae241ea DBZ-4563 Remove redundant list item 2022-01-19 09:29:57 +01:00
Bob Roldan
56e0ef581c DBZ-4563 Misc updates to fix build errors and update content. 2022-01-19 09:29:57 +01:00
Chris Cranford
cf242b02ce DBZ-4457 Clarify Outbox JSON expansion requirements 2022-01-13 05:56:05 +01:00
Gunnar Morling
797b991647 DBZ-4318 Using more concise xref link syntax;
Also improving features page a bit.
2021-11-22 10:54:24 +01:00
Sungho Hwang
64a9c91abb DBZ-4318 Modified default type of aggregateid In outbox collection expected by MongoDB Outbox Event Router for both tests and documentation. 2021-11-21 09:16:58 +01:00
Chris Cranford
2730187a4b DBZ-4012 Deprecate table.field.event.payload.id 2021-11-18 21:45:41 +01:00
Chris Cranford
ab86cd18a9 DBZ-4012 Suggested changes 2021-11-18 21:45:41 +01:00
Chris Cranford
0cab025627 DBZ-4012 Clarify differences between event.id and payload.id 2021-11-18 21:45:41 +01:00
Chris Cranford
970792bc40 DBZ-4012 Deprecate/Rename debezium namespace config options 2021-11-18 21:45:41 +01:00
Gunnar Morling
ca95b424fb DBZ-3528 Misc. clean-up 2021-11-17 16:02:06 +01:00
Gunnar Morling
03433b663b DBZ-3528 Misc. fixes 2021-11-17 16:02:06 +01:00
Sungho Hwang
c9eb0f9157 DBZ-3528 Refactored several parts according to the feedbacks
A delegate class for common logic between two Outbox Event Routers has been created.
Documentation has been fixed.
The configuration properties for MongoDB Outbox Event Router have been changed to use existing Outbox Event Router's.
2021-11-17 16:02:06 +01:00
Sungho Hwang
2c279b07f6 DBZ-3528 Wrote MongoDB Outbox Event Router with documentation and its unit & integration tests 2021-11-17 16:02:06 +01:00
Biel Garau Estarellas
ee5f5ab797
[docs ] Fixing little errors 2021-11-11 16:44:59 +01:00
Alexander Schwartz
dd36fd10b1 DBZ-4254 fixing several anchors in documentation
Also changing listing format from Markdown to AsciiDoc style. All xrefs to files should have the .adoc extension (will be required by Antora v3)
2021-11-08 07:17:45 +01:00
Anisha Mohanty
9f7ede0e06 DBZ-3626 Renaming master branches to main 2021-10-28 09:33:32 +02:00
Bob Roldan
f9db8ee80d DBZ-4153 Fix incorrect classname in SMT predicates doc 2021-10-18 12:59:03 -04:00
Sungho Hwang
767b271cb5
[docs] Typo fix 2021-10-14 16:57:26 +02:00
Sungho Hwang
41bd2318b3 [docs] Fixing typos in documentation 2021-10-10 10:04:11 +02:00
Laurent Broudoux
8fbbe5887a DBZ-1297 Fix documentation 2021-10-01 22:29:53 +02:00
Laurent Broudoux
7b7a1f3064 DBZ-1297 Expand JSON escaped string as JSON 2021-10-01 22:29:53 +02:00
indraraj
2598c50887 DBZ-3873 review suggestiins 2021-08-30 11:56:06 +02:00
indraraj
e48b1a0433 DBZ-3873 Fix server link and change connectors order in menu 2021-08-30 11:56:06 +02:00
Gunnar Morling
1919ed9281
DBZ-3873 Typo fix 2021-08-26 18:26:43 +02:00
Gunnar Morling
cae93bd857 DBZ-3873 Misc. adjustments 2021-08-26 18:24:56 +02:00
indraraj
6e1e78d365 DBZ-3873 Adding overview page to SMTs 2021-08-26 18:24:56 +02:00
Gunnar Morling
8f963fb1bf DBZ-3920 Misc. fixes 2021-08-26 09:42:49 +02:00
Bob Roldan
a8d84abfbf DBZ-3920 Define link targets for cross-references in the options table 2021-08-26 09:29:30 +02:00
Gunnar Morling
a6260fd338
DBZ-3584 Misc. doc fixes;
* Wording fixes
* Don't show ByteBuffer converter in downstream docs


Co-authored-by: Jiri Pechanec <jpechane@redhat.com>
2021-08-25 18:08:42 +02:00
uidoyen
ade15cd8f3 DBZ-3873 Fixing white space issue 2021-08-20 12:22:59 +02:00
uidoyen
cd77cb0bef Extract new top-level menu node for SMTs 2021-08-20 12:16:10 +05:30