Jiri Pechanec
b9fa634968
DBZ-1904 Rename queueing methods
2020-05-04 12:31:05 +02:00
Jiri Pechanec
7f23d74d90
DBZ-1904 Add config param into a group
2020-05-04 12:31:05 +02:00
Jiri Pechanec
e350d74b17
DBZ-1904 Public facing schema history topic
2020-05-04 12:31:05 +02:00
Gunnar Morling
2310d6c792
DBZ-1969 Fixing incorrect assertion and utility which concealed this
2020-04-29 13:06:43 -04:00
Braden Groom
0b429ce880
DBZ-1969 Add support for Postgres enum arrays
2020-04-29 13:06:43 -04:00
Chris Cranford
230ddaebdc
DBZ-1953 Generalized SkipWhenDatabaseVersion functionality
2020-04-29 12:27:38 +02:00
Gunnar Morling
5fb3b7f2a1
DBZ-2027 Removing some unused code
2020-04-29 09:56:59 +02:00
Gunnar Morling
e9632c2227
DBZ-1972 Formatting
2020-04-27 17:54:35 +02:00
Gunnar Morling
8b2448440b
Revert "DBZ-2025 Reduce capture job poll interval"
...
This reverts commit 131063fb2be38f865019e5dcff74b6d78299f6d2; it prove
unstable on CI.
2020-04-27 16:38:01 +02:00
Jiri Pechanec
131063fb2b
DBZ-2025 Reduce capture job poll interval
2020-04-27 13:56:29 +02:00
JanHendrikDolling
33d83731af
DBZ-1972 move static Filed methods as static Filed constant to RelationalDatabaseConnectorConfig instead.
2020-04-27 12:31:19 +02:00
Gunnar Morling
f9bfe26754
DBZ-1753 Typo fix
2020-04-27 11:27:36 +02:00
Chris Cranford
f974f9f4ab
DBZ-1753 Refactor common code between SQL Server and DB2
2020-04-24 13:45:06 -04:00
Jiri Pechanec
7e37237b52
DBZ-2000 Change expression param name; add docs
2020-04-24 15:44:52 +02:00
Gunnar Morling
90d2e24788
DBZ-2000 Misc. clean-up
2020-04-24 15:44:52 +02:00
Jiri Pechanec
3ceb6ced3e
DBZ-2000 Content based router SMT
2020-04-24 15:44:52 +02:00
Gunnar Morling
03ce403972
DBZ-1750 Separating config definition editor and immutable config definitions
2020-04-24 15:35:28 +02:00
Jiri Pechanec
37f0dbcaf8
DBZ-1750 Limit access to parent defs; dont share the parent defs
2020-04-24 15:35:28 +02:00
Jiri Pechanec
0d8d6a41c5
DBZ-1750 Validate Kafka params only for Kafka history
2020-04-24 15:35:28 +02:00
Jiri Pechanec
af90507fa6
DBZ-1750 Centralize shared config definitions
2020-04-24 15:35:28 +02:00
Jiri Pechanec
412f288e88
DBZ-1923 Detect lost database history
2020-04-24 10:22:06 +02:00
Chris Cranford
24abc23f66
DBZ-2007 Upgrade Formatter and Impsort plugins
2020-04-23 11:21:06 +02:00
Gunnar Morling
2d0da37c03
DBZ-1993 Wrapping structs for simpler references in filter SMT;
...
Exposing as ProxyObject allows for simple property-style access. We also can prevent write access that way.
2020-04-23 08:33:30 +02:00
Gunnar Morling
0998fc533a
DBZ-1895 Completing implementation;
...
* Restoring original derserializers; excluding skipped events in event handlers
* Adding test
2020-04-22 15:04:36 +02:00
Gunnar Morling
dae655c78b
DBZ-2006 Misc. fixes to MongoDB connector docs
2020-04-22 11:42:21 +02:00
Gunnar Morling
1a5dd5db98
DBZ-1886 Misc. clean-up
2020-04-20 17:46:03 +02:00
Ivan Klass
75f19239d1
DBZ-1886 Introduce separate storageExists() method to support manual topic creation
2020-04-20 17:46:03 +02:00
Gunnar Morling
bc762f2989
DBZ-1962 Adding option descriptions
2020-04-17 15:24:42 +02:00
Jos Huiting
33fe631674
DBZ-1962 Fix PR feedback
2020-04-17 15:24:42 +02:00
Jos Huiting
8ba21a98ef
DBZ-1962 Introduce column.whitelist for the Postgres connector
2020-04-17 15:24:42 +02:00
Debezium Builder
4ca9f92575
[maven-release-plugin] prepare for next development iteration
2020-04-16 02:22:00 -04:00
Debezium Builder
e704bccdaa
[maven-release-plugin] prepare release v1.2.0.Alpha1
2020-04-16 02:22:00 -04:00
Gunnar Morling
786aab37d9
DBZ-1782 JavaDoc improvements;
...
As per Chris's suggestions.
Co-Authored-By: Chris Cranford <ccranfor@redhat.com>
2020-04-15 17:52:35 +02:00
Gunnar Morling
0673aba092
DBZ-1782 Inverting filtering logic, so to be consistent with Stream#filter() and other similar APIs
2020-04-15 17:52:35 +02:00
Gunnar Morling
0775bb1f4f
DBZ-1782 Allowing any JSR 223 implementation for filtering SMT
2020-04-15 17:52:35 +02:00
Gunnar Morling
905629973e
DBZ-1968 Removing SMTs deprecated in 0.10
2020-04-15 15:11:32 +02:00
Chris Cranford
e87bfefdf7
DBZ-1859 Renamed MetadataEvent to ConnectorEvent
2020-04-15 08:04:23 +02:00
Chris Cranford
57af80afd5
DBZ-1859 Enhance MongoDB connector metrics
2020-04-15 08:04:23 +02:00
Gunnar Morling
680f1f73af
DBZ-1782 Misc. fixes
2020-04-09 18:09:56 +02:00
Jiri Pechanec
08d2c9679f
DBZ-1782 Support for Graal JS
2020-04-09 18:09:56 +02:00
Jiri Pechanec
53c8603148
DBZ-1782 Use JSR223 API
2020-04-09 18:09:56 +02:00
Jiri Pechanec
112aeb9d21
DBZ-1782 Groovy based filtering SMT
2020-04-09 18:09:56 +02:00
JanHendrikDolling
1e19270981
DBZ-1692 Added support for hash based column masking mode for string values
2020-04-08 21:21:42 +02:00
Jiri Pechanec
384f62463c
DBZ-1905 Stop checking thread upong completion
2020-04-08 12:18:32 +02:00
Jiri Pechanec
318d1d3cc7
DBZ-1905 Make thread-naming params internal and optional
2020-04-08 12:18:32 +02:00
Jiri Pechanec
e81aec0ed1
DBZ-1905 Validate database history topic
2020-04-08 12:18:32 +02:00
Chris Cranford
65c8564d66
DBZ-1925 Introduced SkipWhenKafkaVersion annotation support
2020-04-07 09:01:20 +02:00
Jiri Pechanec
6338309cea
DBZ-1918 Initialize Metronome when needed
2020-04-01 09:48:24 +02:00
Gunnar Morling
89bb6eba6c
DBZ-1531 Misc. clean-up;
...
* Removing obsolete default impl
* Completing test
* Documention fixes
2020-03-25 12:33:38 +01:00
rk3rn3r
7f36b3c08f
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
rk3rn3r
6310e00675
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
rk3rn3r
fbd8b94e94
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
Debezium Builder
ab54ce062f
[maven-release-plugin] prepare for next development iteration
2020-03-24 01:23:05 -04:00
Debezium Builder
0b5a9117fb
[maven-release-plugin] prepare release v1.1.0.Final
2020-03-24 01:23:05 -04:00
Jiri Pechanec
32b6a8cb3c
DBZ-1889 Use parker
2020-03-23 13:56:29 +01:00
Jiri Pechanec
d2bdcd1ab3
DBZ-1889 Prevent Connect throttling while connection is down
2020-03-23 13:56:29 +01:00
Jiri Pechanec
224f97e380
DBZ-1857 Support for autorestart for embedded engine
2020-03-23 13:56:29 +01:00
Gunnar Morling
bbaf32fe82
DBZ-1815 Misc. clean-up
2020-03-18 10:27:22 +01:00
trolison
8784b41e22
DBZ-1815 Ading DatabaseHeartbeatImpl to allow for making queries to the DB when a heartbeat happens;
...
* Minor refactor to make DatabaseHeartbeatImpl usable
* Added integration test to verify heartbeat.action.query is being executed properly
2020-03-18 10:27:22 +01:00
Gunnar Morling
e4a1272dff
DBZ-1876 Adding comment
2020-03-13 16:21:33 +01:00
Jiri Pechanec
6e482de3d5
DBZ-1876 Process headers with tombstone
2020-03-13 16:21:33 +01:00
Gunnar Morling
449154beaa
DBZ-1863 Centralizing coordinator shutdown
2020-03-12 11:28:08 +01:00
Debezium Builder
86c1ed90ed
[maven-release-plugin] prepare for next development iteration
2020-03-11 09:54:44 -04:00
Debezium Builder
062c6abbe5
[maven-release-plugin] prepare release v1.1.0.CR1
2020-03-11 09:54:44 -04:00
Gunnar Morling
da1f7efb21
DBZ-1723 Formatting
2020-03-11 13:57:23 +01:00
Gunnar Morling
7e55315f78
DBZ-1723 Encapsulating retriable determination in error handler
2020-03-11 13:57:23 +01:00
Gunnar Morling
c51a5fb597
DBZ-1723 Restarting after connection losses in Postgres
2020-03-11 13:57:23 +01:00
Gunnar Morling
63404e14ca
DBZ-1723 Infrastructure for enabling restarts after retriable errors
2020-03-11 13:57:23 +01:00
Gunnar Morling
3437da00d7
DBZ-1723 Simplifying shutdown handling;
...
doStop() is already called from stop(), no need to do it again via the error handler.
2020-03-11 13:57:23 +01:00
Gunnar Morling
c156d30048
DBZ-1723 Centralizing stopping() logic in BaseSourceTask
2020-03-11 13:57:23 +01:00
Gunnar Morling
8ce69dc597
DBZ-1723 Encapsulating common poll() and stop() logic in BaseSourceTask
2020-03-11 13:57:23 +01:00
Gunnar Morling
6318cf0f2b
DBZ-1831 Pulling up connector option retrieval to CommonConnectorConfig;
...
* Expanding test
* Adding Sayed to COPYRIGHT.txt
2020-03-11 12:43:25 +01:00
Sayed Mohammad Hossein Torabi
63a462dbc0
DBZ-1831 Support MongoDB Oplog operations as config
2020-03-11 12:43:25 +01:00
Jiri Pechanec
082761effc
DBZ-1856 Deprecation process is not necessary
2020-03-11 12:02:07 +01:00
Chris Cranford
dc1d526caa
DBZ-1726 Fix test failure for relational connectors
2020-03-11 10:15:00 +01:00
Chris Cranford
3a4788cc33
DBZ-1726 Introduced AbstractSnapshotChangeEventSource and refactor implementations
2020-03-11 10:15:00 +01:00
Chris Cranford
38cf4ceae1
DBZ-1726 Introduce DataCollectionId#identifier()
2020-03-11 10:15:00 +01:00
Chris Cranford
4e27c90028
DBZ-1726 Move MongoDB connector to common framework
2020-03-11 10:15:00 +01:00
Fabio Cantarini
62b46ae596
DBZ-1830 Enhancement to datatype.propagate.source.type connector property
...
Add support for matching db and table name
Amend documentation accordingly
2020-03-10 14:58:16 +01:00
Fabio Cantarini
61cc791d32
DBZ-1830 Add support for new connector property datatype.propagate.source.type
2020-03-10 14:58:16 +01:00
Jiri Pechanec
0f11f7e6de
DBZ-1834 Support separately quoted schema and table
2020-03-03 10:56:19 +01:00
Jiri Pechanec
c201578d29
DBZ-1834 Support dots in table names
2020-03-03 10:56:19 +01:00
Jiri Pechanec
7d525d4baa
DBZ-1134 Fix tests for new API
2020-02-28 21:58:39 +01:00
Gunnar Morling
0f6d2c54fc
DBZ-1134 Avoiding concrete class in SPI by introducing receiver parameter
2020-02-28 21:58:39 +01:00
Gunnar Morling
e7fd7acab8
DBZ-1134 Making converter registry thread-safe; misc. clean-up
2020-02-28 21:58:39 +01:00
Jiri Pechanec
096d13f266
DBZ-1134 Use OptionalInts
2020-02-28 21:58:39 +01:00
Jiri Pechanec
d13e48cc55
DBZ-1134 Make converted field type parametrized
2020-02-28 21:58:39 +01:00
Jiri Pechanec
06e1eca085
DBZ-1134 Support for user provided converters
2020-02-28 21:58:39 +01:00
Jiri Pechanec
06049a5e9d
DBZ-1826 Rename error handling config field
2020-02-26 15:49:26 +01:00
Jiri Pechanec
91f292a1f2
DBZ-1825 Keep keys for non-matching table
2020-02-26 15:03:03 +01:00
Jiri Pechanec
ae6ee3d458
DBZ-234 Place Incubating into a unique package
2020-02-25 15:31:10 +01:00
Jiri Pechanec
f66fe17989
DBZ-234 Incubating annotation moved to API
2020-02-25 15:31:10 +01:00
Jiri Pechanec
38df24a76b
DBZ-234 Create API module with engine API
2020-02-25 15:31:10 +01:00
Jiri Pechanec
436615934d
DBZ-1760 Align code and docs
2020-02-25 10:43:11 +01:00
Jiri Pechanec
2b6e50daff
DBZ-1760 Allow skipping of invalid events
2020-02-25 10:43:11 +01:00
Gunnar Morling
5650276ba9
DBZ-1805 Removing unused private method parameter
2020-02-18 10:29:45 +01:00
Jiri Pechanec
566efd6a3f
DBZ-1775 Filter out rds_monitor DML events
2020-02-14 14:26:02 +01:00
Gunnar Morling
1e51f112b2
DBZ-1772 Trimming values for add.source.fields option
2020-02-14 12:51:58 +01:00
Debezium Builder
f75746fb7b
[maven-release-plugin] prepare for next development iteration
2020-02-13 03:18:20 -05:00
Debezium Builder
1d2df32743
[maven-release-plugin] prepare release v1.1.0.Beta2
2020-02-13 03:18:20 -05:00
Gunnar Morling
61c4f834a6
DBZ-1452 Misc. fixes and refactoring;
...
* Adding support for "transaction" struct
* Documentation updates
* Only one "_" as separator between struct and field name
2020-02-12 14:03:19 -05:00
daanroosen-DS
49bbec319b
DBZ-1452 Adding add.fields and add.headers options to flattening SMT
2020-02-12 14:03:19 -05:00
Jiri Pechanec
a998db9caa
DBZ-1767 Support field sanitization for MongoDB unwrap
2020-02-12 18:49:32 +01:00
Gunnar Morling
92fa6039ab
DBZ-1766 Adding Melissa Winstanley to COPYRIGHT.txt
2020-02-12 15:44:45 +01:00
Gunnar Morling
dd5c2b8be9
DBZ-1766 Unifying handling of offset commits
2020-02-12 15:44:45 +01:00
Matthias Wessendorf
bff73e71d0
DBZ-1784 Use "application/avro" as data content type in CloudEvents
...
Signed-off-by: Matthias Wessendorf <mwessend@redhat.com>
2020-02-12 14:26:25 +01:00
Debezium Builder
9c424b2404
[maven-release-plugin] prepare for next development iteration
2020-02-05 08:54:52 -05:00
Debezium Builder
9f2caa3b7c
[maven-release-plugin] prepare release v1.1.0.Beta1
2020-02-05 08:54:52 -05:00
Jiri Pechanec
77f9a61b95
DBZ-1751 Centralize envelope schema naming
2020-02-04 20:37:19 +01:00
Gunnar Morling
b66f314b3c
DBZ-1052 Misc. clean-up
...
* Doc updates
* Changed static method to instance
2020-02-03 09:29:10 +01:00
Jiri Pechanec
ba10a229b6
DBZ-1052 CE support for tx metadata in data messages
2020-02-03 09:29:10 +01:00
Jiri Pechanec
0e671d6167
DBZ-1052 Add counts per table to END
2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94
DBZ-1052 Transaction block moved to envelope
2020-02-03 09:29:10 +01:00
Jiri Pechanec
4867c8a298
DBZ-1052 Change TX topic name
2020-02-03 09:29:10 +01:00
Jiri Pechanec
5749acda7e
DBZ-1052 Remove unused fields; added JavaDoc
2020-02-03 09:29:10 +01:00
Jiri Pechanec
c0557b325b
DBZ-1052 Skip CE for transaction struct
2020-02-03 09:29:10 +01:00
Jiri Pechanec
cd6a1f942d
DBZ-1052 Transaction metadata for Postgres/pgoutput
2020-02-03 09:29:10 +01:00
Jiri Pechanec
b0eb571f9f
DBZ-1052 Transaction metadata for SQL Server
2020-02-03 09:29:10 +01:00
Jiri Pechanec
6f7b8d1707
DBZ-1748 Mask JDBC passwords from log messages
2020-01-31 17:26:59 +01:00
Gunnar Morling
2d337133ae
DBZ-1715 Docs clarification; adding Jos to authors list
2020-01-17 14:52:15 +01:00
Jos Huiting
1cd4d4bf19
Add field-based topic routing to Debezium ExtractRecordState
2020-01-17 14:43:03 +01:00
Debezium Builder
274bba9dc9
[maven-release-plugin] prepare for next development iteration
2020-01-16 05:40:24 -05:00
Debezium Builder
076df30108
[maven-release-plugin] prepare release v1.1.0.Alpha1
2020-01-16 05:40:24 -05:00
Gunnar Morling
8ca6174d98
DBZ-1292 Applying suggestions from code review
...
Co-Authored-By: Chris Cranford <ccranfor@redhat.com>
2020-01-16 08:02:51 +01:00
Gunnar Morling
8c33a4e147
DBZ-1292 Catering for the differences in data schema;
...
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
2020-01-16 08:01:56 +01:00
Gunnar Morling
8531adbefd
DBZ-1292 Formatting
2020-01-16 08:00:45 +01:00
Gunnar Morling
2ba1d615fb
DBZ-1292 Distinct names for data and envelope schema for Avro/Avro
2020-01-16 08:00:45 +01:00
Gunnar Morling
8591dd669b
DBZ-1292 Avoiding usage of reflection
2020-01-16 08:00:45 +01:00
Gunnar Morling
7c18a6d8d5
DBZ-1292 Removing static state in CloudEventsConverterTest
2020-01-16 08:00:45 +01:00
Gunnar Morling
366382ddad
DBZ-1292 Refactoring of options;
...
* Avoiding hard dependency to Avro
* Passing through all options from JSON and Avro converters by means of "json." and "avro." sub-namespaces
2020-01-16 08:00:45 +01:00
Gunnar Morling
12e43a89f4
DBZ-1292 Always adding "before" and "after"
2020-01-16 08:00:45 +01:00
Gunnar Morling
a861dae432
DBZ-1292 Clean-up around data schema URI
2020-01-16 08:00:45 +01:00
Gunnar Morling
1a18bdbc81
DBZ-1292 Misc. refactorings;
...
* Protecting against Avro as CE format and JSON as data format
* Reducing mutability
* Single Avro client
2020-01-16 08:00:45 +01:00
Gunnar Morling
4e4800cb56
DBZ-1292 Some clean-up in CloudEventsMaker;
...
* Avoiding non-final static fields
* Removing unused methods
* Reducing visibility
2020-01-16 08:00:45 +01:00
Gunnar Morling
fe8c5fe27d
DBZ-1292 Adding schema URI in case of Avro
2020-01-16 08:00:45 +01:00
Gunnar Morling
a25d148a82
DBZ-1292 Adding logical name to CE source attribute value
2020-01-16 08:00:45 +01:00
Gunnar Morling
342a448053
DBZ-1292 Using "iodebezium" prefix for extension attributes;
...
Simplifying implementation a bit.
2020-01-16 08:00:45 +01:00
Gunnar Morling
390c8f8090
DBZ-1292 Wrapping up work on schema and value conversion;
...
* There were a few attributes missing in the schema of the CE event
* Conversion of extension attributes now correctly handles optional attributes
* Removed guards against missing and duplicate fields, as the only caller is this class itself, so it seems superfluous.
2020-01-16 08:00:45 +01:00
GraySmog
de2655a89e
DBZ-1292 promoting op, ts_ms and sub-fields in source to extension attributes
2020-01-16 08:00:45 +01:00
GraySmog
d0e4b3c0af
DBZ-1292 Delete data.schema.registry.url config option
2020-01-16 08:00:45 +01:00
GraySmog
8b7c67cbdd
DBZ-1292 Using formatted timestamp for CE time field
2020-01-16 08:00:45 +01:00
Gunnar Morling
87ffe0c44e
DBZ-1292 Representing data as JSON struct instead of binary
2020-01-16 08:00:45 +01:00
Gunnar Morling
6356784cee
DBZ-1292 dataschema value should not be empty or null if key is present;
...
* CloudEvents spec version is 1.0 now
2020-01-16 08:00:45 +01:00
GraySmog
915c8cafd9
DBZ-1292 CloudEvents converter for JSON and Avro format
2020-01-16 08:00:45 +01:00
Gunnar Morling
07e89de91d
DBZ-1707 Ensuring correct Kafka record timestamp for outbox events;
...
Depending on the width of the configured TIMESTAMP column, a microsecond or nanosecond timestamp could have been returned before, whereas this should always be milliseconds.
2020-01-15 07:32:55 +01:00
Chris Cranford
4a27746dad
DBZ-1703 Fix typo after renaming configuration option
2020-01-14 09:24:53 +01:00
Chris Cranford
4fa0f22ac7
DBZ-1703 Add option to JSON SerDes for ignoring unknown properties
2020-01-14 09:24:53 +01:00
liulangwa
6028d78e76
DBZ-1688 Fix SQLserver type time(4)...time(7) lost nanoseconds
2020-01-02 12:26:28 +01:00
Debezium Builder
9723c93db9
[maven-release-plugin] prepare for next development iteration
2019-12-18 01:44:33 -05:00
Debezium Builder
09049516f2
[maven-release-plugin] prepare release v1.0.0.Final
2019-12-18 01:44:33 -05:00