alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity

DBZ-3873 Misc. adjustments

Browse Source
This commit is contained in:
Gunnar Morling 2021-08-26 18:24:38 +02:00
parent 6e1e78d365
commit cae93bd857
1 changed files with 10 additions and 11 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

21
documentation/modules/ROOT/pages/transformations/index.adoc
View File

@ -1,6 +1,6 @@
= Transformations
Connectors can be configured with transformations to make lightweight message-at-a-time modifications. {prodname} provides several link:{link-kafka-docs}/#connect_transforms[single message transformations] (SMTs) that you can use to either modify records before they are sent to Kafka (by applying them to the Debezium connectors) or when they are read from Kafka by a sink connector. Also link:https://debezium.io/documentation/reference/operations/debezium-server.html[Debezium Server] supports the usage of SMTs.
Connectors can be configured with transformations to make lightweight message-at-a-time modifications. {prodname} provides several link:{link-kafka-docs}/#connect_transforms[single message transformations] (SMTs) that you can use to either modify records before they are sent to Apache Kafka (by applying them to the Debezium connectors), or when they are read from Kafka by a sink connector. Also xref:operations/debezium-server[Debezium Server] supports the usage of SMTs.
The following SMTs are provided by {prodname}:
@ -10,28 +10,27 @@ The following SMTs are provided by {prodname}:
|Description
|xref:transformations/topic-routing.adoc[Topic Routing]
|Re-route records to topics that you specify before the records reach the Kafka Connect converter.
|Re-routes records to different topics based on a regular expression applied to the original topic name.
|xref:transformations/content-based-routing.adoc[Content-Based Routing]
|Reroute selected events to other topics, based on the event content.
|xref:transformations/event-flattening.adoc[New Record State Extraction]
|Extract the flat structure of field names and values from Debezium change event which has a complex structure and provides a wealth of information.
|Extracts the flat structure of field names and values from Debezium change events, facilitating sink connectors which cannot process Debezium's complex event structure.
|xref:transformations/mongodb-event-flattening.adoc[MongoDB New Document State Extraction]
|This SMT is supported only for the MongoDB connector. xref:transformations/event-flattening.adoc[New Record State Extraction] is relational database equivalent to this SMT.
|The MongoDB-specific counter-part to the xref:transformations/event-flattening.adoc[New Record State Extraction] SMT.
|xref:transformations/outbox-event-router.adoc[Outbox Event Router]
|Provides a way to safely and reliably exchange data between multiple (micro) services.
|xref:transformations/filtering.adoc[Message Filtering]
|Filter in only a subset of the events emitted by the producer. To enable you to process only the records that are relevant to you.
|xref:transformations/content-based-routing.adoc[Content-Based Routing]
|Reroute selected events to other topics, based on the event content.
|xref:transformations/applying-transformations-selectively.adoc[Using SMT Predicates to Selectively Apply Transformations]
|Apply a transformation selectively, so that it modifies only that subset of change event messages that share a common characteristic.
|Applies a filter to the change events emitted by the connectors, based on their content. This lets you propagate only those records that are relevant to you.
|===
By means of |xref:transformations/applying-transformations-selectively.adoc[SMT Predicates] you can apply any of the transformations selectively, so that it modifies only that subset of change event messages that share a common characteristic.
[NOTE]
====
Most of the above SMTs are available by default with the {prodname} container image, but you need to opt-in for the scripting-based ones (Message Filtering or Content-based Routing). See the link:https://github.com/debezium/docker-images/tree/master/connect/1.7#enable_debezium_scripting[README] file of the container image for more details.