From cae93bd857726bb4df7d48806ef11589b988d032 Mon Sep 17 00:00:00 2001 From: Gunnar Morling Date: Thu, 26 Aug 2021 18:24:38 +0200 Subject: [PATCH] DBZ-3873 Misc. adjustments --- .../ROOT/pages/transformations/index.adoc | 21 +++++++++---------- 1 file changed, 10 insertions(+), 11 deletions(-) diff --git a/documentation/modules/ROOT/pages/transformations/index.adoc b/documentation/modules/ROOT/pages/transformations/index.adoc index 5ad81a9ff..40333bb70 100644 --- a/documentation/modules/ROOT/pages/transformations/index.adoc +++ b/documentation/modules/ROOT/pages/transformations/index.adoc @@ -1,6 +1,6 @@ = Transformations -Connectors can be configured with transformations to make lightweight message-at-a-time modifications. {prodname} provides several link:{link-kafka-docs}/#connect_transforms[single message transformations] (SMTs) that you can use to either modify records before they are sent to Kafka (by applying them to the Debezium connectors) or when they are read from Kafka by a sink connector. Also link:https://debezium.io/documentation/reference/operations/debezium-server.html[Debezium Server] supports the usage of SMTs. +Connectors can be configured with transformations to make lightweight message-at-a-time modifications. {prodname} provides several link:{link-kafka-docs}/#connect_transforms[single message transformations] (SMTs) that you can use to either modify records before they are sent to Apache Kafka (by applying them to the Debezium connectors), or when they are read from Kafka by a sink connector. Also xref:operations/debezium-server[Debezium Server] supports the usage of SMTs. The following SMTs are provided by {prodname}: @@ -10,28 +10,27 @@ The following SMTs are provided by {prodname}: |Description |xref:transformations/topic-routing.adoc[Topic Routing] -|Re-route records to topics that you specify before the records reach the Kafka Connect converter. +|Re-routes records to different topics based on a regular expression applied to the original topic name. + +|xref:transformations/content-based-routing.adoc[Content-Based Routing] +|Reroute selected events to other topics, based on the event content. |xref:transformations/event-flattening.adoc[New Record State Extraction] -|Extract the flat structure of field names and values from Debezium change event which has a complex structure and provides a wealth of information. +|Extracts the flat structure of field names and values from Debezium change events, facilitating sink connectors which cannot process Debezium's complex event structure. |xref:transformations/mongodb-event-flattening.adoc[MongoDB New Document State Extraction] -|This SMT is supported only for the MongoDB connector. xref:transformations/event-flattening.adoc[New Record State Extraction] is relational database equivalent to this SMT. +|The MongoDB-specific counter-part to the xref:transformations/event-flattening.adoc[New Record State Extraction] SMT. |xref:transformations/outbox-event-router.adoc[Outbox Event Router] |Provides a way to safely and reliably exchange data between multiple (micro) services. |xref:transformations/filtering.adoc[Message Filtering] -|Filter in only a subset of the events emitted by the producer. To enable you to process only the records that are relevant to you. - -|xref:transformations/content-based-routing.adoc[Content-Based Routing] -|Reroute selected events to other topics, based on the event content. - -|xref:transformations/applying-transformations-selectively.adoc[Using SMT Predicates to Selectively Apply Transformations] -|Apply a transformation selectively, so that it modifies only that subset of change event messages that share a common characteristic. +|Applies a filter to the change events emitted by the connectors, based on their content. This lets you propagate only those records that are relevant to you. |=== +By means of |xref:transformations/applying-transformations-selectively.adoc[SMT Predicates] you can apply any of the transformations selectively, so that it modifies only that subset of change event messages that share a common characteristic. + [NOTE] ==== Most of the above SMTs are available by default with the {prodname} container image, but you need to opt-in for the scripting-based ones (Message Filtering or Content-based Routing). See the link:https://github.com/debezium/docker-images/tree/master/connect/1.7#enable_debezium_scripting[README] file of the container image for more details.