Gunnar Morling
b80f064131
DBZ-2250 Allowing to use CloudEventsConverter with Avro via Apicurio
2020-06-22 14:41:10 +02:00
Gunnar Morling
f2d13238aa
DBZ-2228 Using unique names for admin clients
2020-06-18 14:08:56 +02:00
Chris Cranford
ac0d9ede8a
DBZ-2152 Fix test failure
2020-06-09 17:20:51 +02:00
Balázs Németh
0853940f3d
DBZ-2169 Fix for misuse of ConfigurationDefaults.RETURN_CONTROL_INTERVAL;
...
* Implemented Temporals.min()
* Fixed pollInterval calculation based on the documentation
2020-06-09 10:24:50 +02:00
Gunnar Morling
bfaadcf2dd
DBZ-2149 Starting/stopping Kafka just once in KafkaDatabaseHistoryTest;
...
By using distinct topic names in the tests, the same Kafka instance can
be used for all test methods. This brings down execution time of this
test from ~40sec to ~8sec.
2020-06-09 10:15:47 +02:00
Chris Cranford
c3b36c2417
DBZ-2149 Log begin/end of schema recovery
2020-06-09 10:15:47 +02:00
Gunnar Morling
1fdad23087
Revert "DBZ-2166 Handling error condition where schema field can not be found in"
...
This reverts commit 283740f37e
.
2020-06-08 20:12:50 +02:00
Dave Cumberland
4254e29667
DBZ-2152 Adding fix annotations to new tests
2020-06-08 13:57:35 -04:00
Dave Cumberland
a17e4cbad0
DBZ-2152 Adding another unit test with the key mapping definied
2020-06-08 13:57:35 -04:00
Dave Cumberland
223812def3
DBZ-2152 Updating the EventRouter to allow key types other than String
2020-06-08 13:57:35 -04:00
Fabian Aussems
283740f37e
DBZ-2166 Handling error condition where schema field can not be found in
...
TableSchemaBuilder
2020-06-08 12:55:16 +02:00
Gunnar Morling
1b62036cf4
DBZ-2150 Awaiting coordinator shutdown in embedded engine
2020-06-08 10:26:37 +02:00
Gunnar Morling
c54e377dd2
DBZ-1814 Exporting Hex and Base64 representations as string
2020-06-05 12:13:29 +02:00
Gunnar Morling
023064eedb
DBZ-1814 Renaming "raw" to "bytes"; also clarifying that this notion isn't Java-specific
2020-06-05 12:13:29 +02:00
Jeremy Finzel
5db614da21
DBZ-1814 added new binary handling mode option
2020-06-05 12:13:29 +02:00
Jiri Pechanec
86dac40dae
DBZ-2140 Internal configs must not be validated
2020-06-04 11:47:26 +02:00
Kewei Shang
a963e89704
DBZ-2136 Update ChangeEventQueue Javadoc by fixing typo
2020-06-02 09:38:12 +02:00
Jiri Pechanec
8e7f3d14ca
DBZ-1312 Omit constatnt db name in column and key mappers
2020-06-01 12:43:45 +02:00
Jiri Pechanec
20b45f84f3
DBZ-1657 Remove duplicate option definitions
2020-05-22 12:07:29 +02:00
Gunnar Morling
ed838fb2d4
DBZ-2089 Typo fix
2020-05-22 08:36:57 +02:00
Jiri Pechanec
84851297cb
DBZ-2089 JMX no longer mandatory
2020-05-22 08:36:57 +02:00
Jiri Pechanec
e676d715c3
DBZ-2085 Apply custom converters to default values
2020-05-18 17:27:59 +02:00
Jiri Pechanec
c85546d611
DBZ-2074 Expose topic and headers in scripting SMTs
2020-05-15 11:13:07 +02:00
Gunnar Morling
0b42c8d8c2
DBZ-2024 Adding topic.regex option to routing and filtering SMTs
2020-05-14 08:41:40 +02:00
Jiri Pechanec
c4f975bd0a
DBZ-2061 Handle change of default value
2020-05-14 08:31:27 +02:00
Gunnar Morling
4f020ca6cf
DBZ-1828 Removing deprecated SMT options
2020-05-13 21:36:12 +02:00
Chris Cranford
f449550b2d
DBZ-2068 Skip tests incompatible with Kafka 1.x
2020-05-13 08:22:07 +02:00
Aaron Brady
8b42016f63
DBZ-2034 Make ByLogicalTableRouter SMT unique key enforcement optional
2020-05-08 13:56:18 -04:00
Chris Cranford
c6ba581848
DBZ-2014 Suggested changes
2020-05-05 22:13:25 +02:00
Chris Cranford
cd43c4880f
DBZ-2014 Do not include outbox eventType field by default
2020-05-05 22:13:25 +02:00
Chris Cranford
3c9ad5699b
DBZ-2036 Change logging from warn to debug
2020-05-05 21:58:56 +02:00
Chris Cranford
81c3a808da
DBZ-1963 Suggested changes
2020-05-05 08:45:58 +02:00
Chris Cranford
a1cb06299c
DBZ-1963 Emit outbox events with value schema names
2020-05-05 08:45:58 +02:00
Jiri Pechanec
1b3fba4b8c
DBZ-1904 Add drop table support
2020-05-04 12:31:05 +02:00
Jiri Pechanec
b9fa634968
DBZ-1904 Rename queueing methods
2020-05-04 12:31:05 +02:00
Jiri Pechanec
7f23d74d90
DBZ-1904 Add config param into a group
2020-05-04 12:31:05 +02:00
Jiri Pechanec
e350d74b17
DBZ-1904 Public facing schema history topic
2020-05-04 12:31:05 +02:00
Gunnar Morling
2310d6c792
DBZ-1969 Fixing incorrect assertion and utility which concealed this
2020-04-29 13:06:43 -04:00
Braden Groom
0b429ce880
DBZ-1969 Add support for Postgres enum arrays
2020-04-29 13:06:43 -04:00
Chris Cranford
230ddaebdc
DBZ-1953 Generalized SkipWhenDatabaseVersion functionality
2020-04-29 12:27:38 +02:00
Gunnar Morling
5fb3b7f2a1
DBZ-2027 Removing some unused code
2020-04-29 09:56:59 +02:00
Gunnar Morling
e9632c2227
DBZ-1972 Formatting
2020-04-27 17:54:35 +02:00
Gunnar Morling
8b2448440b
Revert "DBZ-2025 Reduce capture job poll interval"
...
This reverts commit 131063fb2be38f865019e5dcff74b6d78299f6d2; it prove
unstable on CI.
2020-04-27 16:38:01 +02:00
Jiri Pechanec
131063fb2b
DBZ-2025 Reduce capture job poll interval
2020-04-27 13:56:29 +02:00
JanHendrikDolling
33d83731af
DBZ-1972 move static Filed methods as static Filed constant to RelationalDatabaseConnectorConfig instead.
2020-04-27 12:31:19 +02:00
Gunnar Morling
f9bfe26754
DBZ-1753 Typo fix
2020-04-27 11:27:36 +02:00
Chris Cranford
f974f9f4ab
DBZ-1753 Refactor common code between SQL Server and DB2
2020-04-24 13:45:06 -04:00
Jiri Pechanec
7e37237b52
DBZ-2000 Change expression param name; add docs
2020-04-24 15:44:52 +02:00
Gunnar Morling
90d2e24788
DBZ-2000 Misc. clean-up
2020-04-24 15:44:52 +02:00
Jiri Pechanec
3ceb6ced3e
DBZ-2000 Content based router SMT
2020-04-24 15:44:52 +02:00
Gunnar Morling
03ce403972
DBZ-1750 Separating config definition editor and immutable config definitions
2020-04-24 15:35:28 +02:00
Jiri Pechanec
37f0dbcaf8
DBZ-1750 Limit access to parent defs; dont share the parent defs
2020-04-24 15:35:28 +02:00
Jiri Pechanec
0d8d6a41c5
DBZ-1750 Validate Kafka params only for Kafka history
2020-04-24 15:35:28 +02:00
Jiri Pechanec
af90507fa6
DBZ-1750 Centralize shared config definitions
2020-04-24 15:35:28 +02:00
Jiri Pechanec
412f288e88
DBZ-1923 Detect lost database history
2020-04-24 10:22:06 +02:00
Chris Cranford
24abc23f66
DBZ-2007 Upgrade Formatter and Impsort plugins
2020-04-23 11:21:06 +02:00
Gunnar Morling
2d0da37c03
DBZ-1993 Wrapping structs for simpler references in filter SMT;
...
Exposing as ProxyObject allows for simple property-style access. We also can prevent write access that way.
2020-04-23 08:33:30 +02:00
Gunnar Morling
0998fc533a
DBZ-1895 Completing implementation;
...
* Restoring original derserializers; excluding skipped events in event handlers
* Adding test
2020-04-22 15:04:36 +02:00
Gunnar Morling
dae655c78b
DBZ-2006 Misc. fixes to MongoDB connector docs
2020-04-22 11:42:21 +02:00
Gunnar Morling
1a5dd5db98
DBZ-1886 Misc. clean-up
2020-04-20 17:46:03 +02:00
Ivan Klass
75f19239d1
DBZ-1886 Introduce separate storageExists() method to support manual topic creation
2020-04-20 17:46:03 +02:00
Gunnar Morling
bc762f2989
DBZ-1962 Adding option descriptions
2020-04-17 15:24:42 +02:00
Jos Huiting
33fe631674
DBZ-1962 Fix PR feedback
2020-04-17 15:24:42 +02:00
Jos Huiting
8ba21a98ef
DBZ-1962 Introduce column.whitelist for the Postgres connector
2020-04-17 15:24:42 +02:00
Gunnar Morling
786aab37d9
DBZ-1782 JavaDoc improvements;
...
As per Chris's suggestions.
Co-Authored-By: Chris Cranford <ccranfor@redhat.com>
2020-04-15 17:52:35 +02:00
Gunnar Morling
0673aba092
DBZ-1782 Inverting filtering logic, so to be consistent with Stream#filter() and other similar APIs
2020-04-15 17:52:35 +02:00
Gunnar Morling
0775bb1f4f
DBZ-1782 Allowing any JSR 223 implementation for filtering SMT
2020-04-15 17:52:35 +02:00
Gunnar Morling
905629973e
DBZ-1968 Removing SMTs deprecated in 0.10
2020-04-15 15:11:32 +02:00
Chris Cranford
e87bfefdf7
DBZ-1859 Renamed MetadataEvent to ConnectorEvent
2020-04-15 08:04:23 +02:00
Chris Cranford
57af80afd5
DBZ-1859 Enhance MongoDB connector metrics
2020-04-15 08:04:23 +02:00
Gunnar Morling
680f1f73af
DBZ-1782 Misc. fixes
2020-04-09 18:09:56 +02:00
Jiri Pechanec
08d2c9679f
DBZ-1782 Support for Graal JS
2020-04-09 18:09:56 +02:00
Jiri Pechanec
53c8603148
DBZ-1782 Use JSR223 API
2020-04-09 18:09:56 +02:00
Jiri Pechanec
112aeb9d21
DBZ-1782 Groovy based filtering SMT
2020-04-09 18:09:56 +02:00
JanHendrikDolling
1e19270981
DBZ-1692 Added support for hash based column masking mode for string values
2020-04-08 21:21:42 +02:00
Jiri Pechanec
384f62463c
DBZ-1905 Stop checking thread upong completion
2020-04-08 12:18:32 +02:00
Jiri Pechanec
318d1d3cc7
DBZ-1905 Make thread-naming params internal and optional
2020-04-08 12:18:32 +02:00
Jiri Pechanec
e81aec0ed1
DBZ-1905 Validate database history topic
2020-04-08 12:18:32 +02:00
Chris Cranford
65c8564d66
DBZ-1925 Introduced SkipWhenKafkaVersion annotation support
2020-04-07 09:01:20 +02:00
Jiri Pechanec
6338309cea
DBZ-1918 Initialize Metronome when needed
2020-04-01 09:48:24 +02:00
Gunnar Morling
89bb6eba6c
DBZ-1531 Misc. clean-up;
...
* Removing obsolete default impl
* Completing test
* Documention fixes
2020-03-25 12:33:38 +01:00
rk3rn3r
7f36b3c08f
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
rk3rn3r
6310e00675
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
rk3rn3r
fbd8b94e94
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
Jiri Pechanec
32b6a8cb3c
DBZ-1889 Use parker
2020-03-23 13:56:29 +01:00
Jiri Pechanec
d2bdcd1ab3
DBZ-1889 Prevent Connect throttling while connection is down
2020-03-23 13:56:29 +01:00
Jiri Pechanec
224f97e380
DBZ-1857 Support for autorestart for embedded engine
2020-03-23 13:56:29 +01:00
Gunnar Morling
bbaf32fe82
DBZ-1815 Misc. clean-up
2020-03-18 10:27:22 +01:00
trolison
8784b41e22
DBZ-1815 Ading DatabaseHeartbeatImpl to allow for making queries to the DB when a heartbeat happens;
...
* Minor refactor to make DatabaseHeartbeatImpl usable
* Added integration test to verify heartbeat.action.query is being executed properly
2020-03-18 10:27:22 +01:00
Gunnar Morling
e4a1272dff
DBZ-1876 Adding comment
2020-03-13 16:21:33 +01:00
Jiri Pechanec
6e482de3d5
DBZ-1876 Process headers with tombstone
2020-03-13 16:21:33 +01:00
Gunnar Morling
449154beaa
DBZ-1863 Centralizing coordinator shutdown
2020-03-12 11:28:08 +01:00
Gunnar Morling
da1f7efb21
DBZ-1723 Formatting
2020-03-11 13:57:23 +01:00
Gunnar Morling
7e55315f78
DBZ-1723 Encapsulating retriable determination in error handler
2020-03-11 13:57:23 +01:00
Gunnar Morling
c51a5fb597
DBZ-1723 Restarting after connection losses in Postgres
2020-03-11 13:57:23 +01:00
Gunnar Morling
63404e14ca
DBZ-1723 Infrastructure for enabling restarts after retriable errors
2020-03-11 13:57:23 +01:00
Gunnar Morling
3437da00d7
DBZ-1723 Simplifying shutdown handling;
...
doStop() is already called from stop(), no need to do it again via the error handler.
2020-03-11 13:57:23 +01:00
Gunnar Morling
c156d30048
DBZ-1723 Centralizing stopping() logic in BaseSourceTask
2020-03-11 13:57:23 +01:00
Gunnar Morling
8ce69dc597
DBZ-1723 Encapsulating common poll() and stop() logic in BaseSourceTask
2020-03-11 13:57:23 +01:00
Gunnar Morling
6318cf0f2b
DBZ-1831 Pulling up connector option retrieval to CommonConnectorConfig;
...
* Expanding test
* Adding Sayed to COPYRIGHT.txt
2020-03-11 12:43:25 +01:00
Sayed Mohammad Hossein Torabi
63a462dbc0
DBZ-1831 Support MongoDB Oplog operations as config
2020-03-11 12:43:25 +01:00
Jiri Pechanec
082761effc
DBZ-1856 Deprecation process is not necessary
2020-03-11 12:02:07 +01:00
Chris Cranford
dc1d526caa
DBZ-1726 Fix test failure for relational connectors
2020-03-11 10:15:00 +01:00
Chris Cranford
3a4788cc33
DBZ-1726 Introduced AbstractSnapshotChangeEventSource and refactor implementations
2020-03-11 10:15:00 +01:00
Chris Cranford
38cf4ceae1
DBZ-1726 Introduce DataCollectionId#identifier()
2020-03-11 10:15:00 +01:00
Chris Cranford
4e27c90028
DBZ-1726 Move MongoDB connector to common framework
2020-03-11 10:15:00 +01:00
Fabio Cantarini
62b46ae596
DBZ-1830 Enhancement to datatype.propagate.source.type connector property
...
Add support for matching db and table name
Amend documentation accordingly
2020-03-10 14:58:16 +01:00
Fabio Cantarini
61cc791d32
DBZ-1830 Add support for new connector property datatype.propagate.source.type
2020-03-10 14:58:16 +01:00
Jiri Pechanec
0f11f7e6de
DBZ-1834 Support separately quoted schema and table
2020-03-03 10:56:19 +01:00
Jiri Pechanec
c201578d29
DBZ-1834 Support dots in table names
2020-03-03 10:56:19 +01:00
Jiri Pechanec
7d525d4baa
DBZ-1134 Fix tests for new API
2020-02-28 21:58:39 +01:00
Gunnar Morling
0f6d2c54fc
DBZ-1134 Avoiding concrete class in SPI by introducing receiver parameter
2020-02-28 21:58:39 +01:00
Gunnar Morling
e7fd7acab8
DBZ-1134 Making converter registry thread-safe; misc. clean-up
2020-02-28 21:58:39 +01:00
Jiri Pechanec
096d13f266
DBZ-1134 Use OptionalInts
2020-02-28 21:58:39 +01:00
Jiri Pechanec
d13e48cc55
DBZ-1134 Make converted field type parametrized
2020-02-28 21:58:39 +01:00
Jiri Pechanec
06e1eca085
DBZ-1134 Support for user provided converters
2020-02-28 21:58:39 +01:00
Jiri Pechanec
06049a5e9d
DBZ-1826 Rename error handling config field
2020-02-26 15:49:26 +01:00
Jiri Pechanec
91f292a1f2
DBZ-1825 Keep keys for non-matching table
2020-02-26 15:03:03 +01:00
Jiri Pechanec
ae6ee3d458
DBZ-234 Place Incubating into a unique package
2020-02-25 15:31:10 +01:00
Jiri Pechanec
f66fe17989
DBZ-234 Incubating annotation moved to API
2020-02-25 15:31:10 +01:00
Jiri Pechanec
436615934d
DBZ-1760 Align code and docs
2020-02-25 10:43:11 +01:00
Jiri Pechanec
2b6e50daff
DBZ-1760 Allow skipping of invalid events
2020-02-25 10:43:11 +01:00
Gunnar Morling
5650276ba9
DBZ-1805 Removing unused private method parameter
2020-02-18 10:29:45 +01:00
Jiri Pechanec
566efd6a3f
DBZ-1775 Filter out rds_monitor DML events
2020-02-14 14:26:02 +01:00
Gunnar Morling
1e51f112b2
DBZ-1772 Trimming values for add.source.fields option
2020-02-14 12:51:58 +01:00
Gunnar Morling
61c4f834a6
DBZ-1452 Misc. fixes and refactoring;
...
* Adding support for "transaction" struct
* Documentation updates
* Only one "_" as separator between struct and field name
2020-02-12 14:03:19 -05:00
daanroosen-DS
49bbec319b
DBZ-1452 Adding add.fields and add.headers options to flattening SMT
2020-02-12 14:03:19 -05:00
Jiri Pechanec
a998db9caa
DBZ-1767 Support field sanitization for MongoDB unwrap
2020-02-12 18:49:32 +01:00
Gunnar Morling
92fa6039ab
DBZ-1766 Adding Melissa Winstanley to COPYRIGHT.txt
2020-02-12 15:44:45 +01:00
Gunnar Morling
dd5c2b8be9
DBZ-1766 Unifying handling of offset commits
2020-02-12 15:44:45 +01:00
Matthias Wessendorf
bff73e71d0
DBZ-1784 Use "application/avro" as data content type in CloudEvents
...
Signed-off-by: Matthias Wessendorf <mwessend@redhat.com>
2020-02-12 14:26:25 +01:00
Jiri Pechanec
77f9a61b95
DBZ-1751 Centralize envelope schema naming
2020-02-04 20:37:19 +01:00
Gunnar Morling
b66f314b3c
DBZ-1052 Misc. clean-up
...
* Doc updates
* Changed static method to instance
2020-02-03 09:29:10 +01:00
Jiri Pechanec
ba10a229b6
DBZ-1052 CE support for tx metadata in data messages
2020-02-03 09:29:10 +01:00
Jiri Pechanec
0e671d6167
DBZ-1052 Add counts per table to END
2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94
DBZ-1052 Transaction block moved to envelope
2020-02-03 09:29:10 +01:00
Jiri Pechanec
4867c8a298
DBZ-1052 Change TX topic name
2020-02-03 09:29:10 +01:00
Jiri Pechanec
5749acda7e
DBZ-1052 Remove unused fields; added JavaDoc
2020-02-03 09:29:10 +01:00
Jiri Pechanec
c0557b325b
DBZ-1052 Skip CE for transaction struct
2020-02-03 09:29:10 +01:00
Jiri Pechanec
cd6a1f942d
DBZ-1052 Transaction metadata for Postgres/pgoutput
2020-02-03 09:29:10 +01:00
Jiri Pechanec
b0eb571f9f
DBZ-1052 Transaction metadata for SQL Server
2020-02-03 09:29:10 +01:00
Jiri Pechanec
6f7b8d1707
DBZ-1748 Mask JDBC passwords from log messages
2020-01-31 17:26:59 +01:00
Gunnar Morling
2d337133ae
DBZ-1715 Docs clarification; adding Jos to authors list
2020-01-17 14:52:15 +01:00
Jos Huiting
1cd4d4bf19
Add field-based topic routing to Debezium ExtractRecordState
2020-01-17 14:43:03 +01:00
Gunnar Morling
8ca6174d98
DBZ-1292 Applying suggestions from code review
...
Co-Authored-By: Chris Cranford <ccranfor@redhat.com>
2020-01-16 08:02:51 +01:00
Gunnar Morling
8c33a4e147
DBZ-1292 Catering for the differences in data schema;
...
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
2020-01-16 08:01:56 +01:00
Gunnar Morling
8531adbefd
DBZ-1292 Formatting
2020-01-16 08:00:45 +01:00
Gunnar Morling
2ba1d615fb
DBZ-1292 Distinct names for data and envelope schema for Avro/Avro
2020-01-16 08:00:45 +01:00
Gunnar Morling
8591dd669b
DBZ-1292 Avoiding usage of reflection
2020-01-16 08:00:45 +01:00
Gunnar Morling
7c18a6d8d5
DBZ-1292 Removing static state in CloudEventsConverterTest
2020-01-16 08:00:45 +01:00