Gunnar Morling
21c3003187
DBZ-2889 Don't access payload id field if not present
2021-01-06 14:46:58 +01:00
Chris Cranford
d32e4b3720
DBZ-2849 Added test
2021-01-05 12:42:08 +01:00
Chris Cranford
8409282739
DBZ-2849 Fix value converter field lookups with sanitized field names
2021-01-05 12:42:08 +01:00
Jiri Pechanec
d178365529
DBZ-2880 Guava bumped to 30.0
2021-01-05 12:35:32 +01:00
Jiri Pechanec
58713599ba
DBZ-2167 Remove legacy parser completely; tests depending on parser move to MySQL
2020-12-21 16:30:15 +01:00
Jiri Pechanec
00f9e3b261
DBZ-2167 Use legacy parser for testing purposes only
2020-12-21 16:30:15 +01:00
Debezium Builder
b1ab996c3e
[maven-release-plugin] prepare for next development iteration
2020-12-16 14:11:31 -05:00
Debezium Builder
8fc864b278
[maven-release-plugin] prepare release v1.4.0.CR1
2020-12-16 14:11:31 -05:00
Debezium Builder
cf921f56b4
[maven-release-plugin] prepare for next development iteration
2020-12-10 00:27:40 -05:00
Debezium Builder
c49a377487
[maven-release-plugin] prepare release v1.4.0.Beta1
2020-12-10 00:27:39 -05:00
Jiri Pechanec
8e333d9b1d
DBZ-1818 DBZ-559 Changes after review
...
OpenTracing not used in names
Span for event time
Span SMT embedded in outbox
Handling of missing tracing libs in Connect runtime
Aligned tracing tag names with the standard ones
2020-12-08 16:09:09 +01:00
Jiri Pechanec
318340078b
DBZ-1818 DBZ-559 Integration with OpenTracing
2020-12-08 16:09:09 +01:00
Jiri Pechanec
b7fede7d53
DBZ-735 Verify Avro serialization
2020-11-27 17:33:23 +01:00
Debezium Builder
4535549dcd
[maven-release-plugin] prepare for next development iteration
2020-11-16 15:18:43 -05:00
Debezium Builder
3c70c5f7d5
[maven-release-plugin] prepare release v1.4.0.Alpha2
2020-11-16 15:18:43 -05:00
vanhoale
17a424d9ac
DBZ-2662 Handle ChangeEventQueue by the size in bytes
2020-11-16 08:39:33 +01:00
rkerner
a611979268
DBZ-2580 apply PR feedback
2020-11-12 07:42:48 +01:00
rkerner
9c5db0cd2f
DBZ-2580 Fix "The primary key cannot reference a non-existant column" error from MySQL DDL parser when CREATE TABLE statement starts with a primary key definition like "CREATE TABLE Products (PRIMARY KEY (id), ..." where the referenced primary key column is not yet defined
2020-11-12 07:42:48 +01:00
Chris Cranford
aea26a2949
DBZ-2742 Migrate initial.sync.max.threads to snapshot.max.threads
2020-11-11 09:08:05 +01:00
Ganesh Ramasubramanian
4716194ff9
DBZ-2606: Map new name for the fields and headers
...
Added ability to map new name for the fields and headers.
The "new name" mapping is completely optional and we will not
be affecting the existing functionality.
The optional "new name" is case-sensitive.
2020-11-04 08:57:16 +01:00
ani-sha
fd6c8f9502
DBZ-2690 get oracle specific changes into debezium-core
2020-11-04 07:21:10 +01:00
rkerner
c274c2b39b
DBZ-2617 refactor to proper HeartbeatErrorHandler injection
2020-11-03 07:23:02 +01:00
rkerner
2a3f44ebe5
DBZ-2617 failing heartbeats should put Postgres connector into FAILED state to allow proper shutdown of Postgres when shutdown was triggered with shutdown mode "fast"
2020-11-03 07:23:02 +01:00
Sergei Morozov
344acb55c0
DBZ-2682: Mapper converters should leave empty dates as zero
2020-10-27 16:21:53 +01:00
Debezium Builder
26883dad92
[maven-release-plugin] prepare for next development iteration
2020-10-22 03:45:59 -04:00
Debezium Builder
9adbc2d67e
[maven-release-plugin] prepare release v1.4.0.Alpha1
2020-10-22 03:45:59 -04:00
Jiri Pechanec
2cded66d30
DBZ-2632 Minor improvements
2020-10-20 16:28:23 +02:00
Arik Cohen
2e8c43bd60
DBZ-2632: Forcibly abort the JDBC connection if failed to close it gracefully.
2020-10-20 16:28:23 +02:00
Jiri Pechanec
ee5353ef6f
DBZ-2653 Process commits even with tx monitoring
2020-10-20 10:42:10 +02:00
Kaushik Iyer
7d9e8fdc46
DBZ-2456 fixes after rebase
2020-10-16 10:13:48 +02:00
Kaushik Iyer
f752b3ab39
DBZ-2456 updated common connector config with generalized naming
2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932
DBZ-2456 selective snapshot implementation
2020-10-16 10:13:48 +02:00
Debezium Builder
95b8ed3877
[maven-release-plugin] prepare for next development iteration
2020-10-01 09:08:51 -04:00
Debezium Builder
19ad73beb2
[maven-release-plugin] prepare release v1.3.0.Final
2020-10-01 09:08:50 -04:00
Gunnar Morling
b792ac3274
DBZ-2495 Misc. fixes
2020-09-30 12:13:45 +02:00
Gunnar Morling
6b5a3100e9
DBZ-2495 Misc. clean-up
2020-09-30 12:13:45 +02:00
James Gormley
9e780ac481
DBZ-2495 Updating per PR comments
2020-09-30 12:13:45 +02:00
James Gormley
1b845535ab
DBZ-2495 Updating tables to utilize Table.editor for creating new tables
2020-09-30 12:13:45 +02:00
James Gormley
c7b53e1992
DBZ-2495 Updating docs and comments
2020-09-30 12:13:45 +02:00
James Gormley
0d46ec47da
DBZ-2495 Updating to handle captured_column_list without specify column.exclude.list
2020-09-30 12:13:45 +02:00
Gunnar Morling
c1b057f792
DBZ-2588 Introducing dedicated functional interface for key/value generators;
...
Also keys are always KC Struct instead of generic j.l.Object.
2020-09-25 06:01:59 +02:00
Debezium Builder
b146b69154
[maven-release-plugin] prepare for next development iteration
2020-09-24 04:56:42 -04:00
Debezium Builder
c51cfe8eb9
[maven-release-plugin] prepare release v1.3.0.CR1
2020-09-24 04:56:41 -04:00
Chris Cranford
df41cd8bfe
DBZ-2396 Suggested changes
2020-09-24 07:41:36 +02:00
Chris Cranford
0db4997102
DBZ-2396 Support Converter delegation in ByteBufferConverter
...
In the even that the value supplied to the ByteBufferConverter
is not supported, e.g. not BYTES, the converter should then
support delegation to a configured converter.
2020-09-24 07:41:36 +02:00
Jiri Pechanec
73c74189fa
DBZ-2549 Move scripting code into a separate module
2020-09-18 11:17:17 +02:00
Debezium Builder
837669890a
[maven-release-plugin] prepare for next development iteration
2020-09-16 12:18:08 -04:00
Debezium Builder
086dbd960b
[maven-release-plugin] prepare release v1.3.0.Beta2
2020-09-16 12:18:08 -04:00
Ganesh Ramasubramanian
6ca025b1bb
DBZ-2504: Add support for field and header prefix
...
Added support for field and header prefix.
Updated the documentation to include the options
'add.fields.prefix' and 'add.headers.prefix'.
2020-09-16 11:31:05 +02:00
rkerner
011c3be948
DBZ-2527 Add missing ListOfRegex validator to all regex list fields and fix dependent fields to not include @Deprecated whitelist/blacklist fields
2020-09-15 10:05:04 +02:00
rkerner
385a873172
DBZ-2526 add DisplayName for MASK and TRUNCATE COLUMN fields
2020-09-15 10:05:04 +02:00
rkerner
5c5fb5dc2c
DBZ-2516 add config fields for datatype.propagate.source.type
and column.propagate.source.type
properties
2020-09-15 10:05:04 +02:00
Gunnar Morling
73ba6d42a0
DBZ-137 Docs update
2020-09-14 12:33:43 +02:00
Chris Cranford
a686c1c875
DBZ-137 Suggested changes
2020-09-14 12:33:43 +02:00
Chris Cranford
5ca36a84ad
DBZ-137 Reimagine stream.fetch.size as query.fetch.size
2020-09-14 12:33:43 +02:00
Chris Cranford
8584831f51
DBZ-137 Use Duration for CONNECTION_TIMEOUT_MS
2020-09-14 12:33:43 +02:00
Chris Cranford
43440ca76f
DBZ-137 Remove snapshot.skip.locks for SQL Server
2020-09-14 12:33:43 +02:00
Chris Cranford
72d59348ed
DBZ-137 Fix rebase
2020-09-14 12:33:43 +02:00
AndreyIg
77662a0dde
DBZ-137 contribution to the core, Oracle related
2020-09-14 12:33:43 +02:00
cooksey
8bcbdb639d
DBZ-2094 Allow Postgres snapshotter to set streaming start on resume
...
When a connector resumes after previously streaming and takes a
snapshot, through a new method on the snapshotter interface,
shouldStreamEventsStartingFromSnapshot, can choose whether
to resume streaming from the last known streaming position or the
beginning of the snapshot. This is helpful for snapshotters that
may not want to resnapshot every table in the whitelist/blacklist
but not miss event on the tables that are skipped.
2020-09-09 10:54:11 +02:00
Grzegorz Kołakowski
c74579c1df
DBZ-1068 Forward port the work by @grzegorz8 to master
...
Co-authored-by: GuyIEX <gpascarella@ironeaglex.com>
2020-09-04 12:06:57 +02:00
Nathan Mills
6e915b7cfd
DBZ-2473 Decrement remaining for skipped tables
2020-09-04 07:50:34 +02:00
Debezium Builder
9979db648f
[maven-release-plugin] prepare for next development iteration
2020-08-28 05:04:26 -04:00
Debezium Builder
5c58b23756
[maven-release-plugin] prepare release v1.3.0.Beta1
2020-08-28 05:04:26 -04:00
Jiri Pechanec
d9f616caed
DBZ-2303 Set source when new table detected
2020-08-24 13:08:09 +02:00
rkerner
2c5c093587
DBZ-2171 avoid divisive language
2020-08-21 09:29:04 +02:00
Gunnar Morling
4c3cf9f93e
DBZ-2427 Logging inability to unregister metrics MBean as WARN
2020-08-13 14:05:11 -04:00
Gunnar Morling
dac7f3998c
DBZ-2412 Housekeeping;
...
* Static logger
* Protecting against empty topic name
* Removing unused logger
2020-08-13 13:53:50 -04:00
Gunnar Morling
19ae707a18
DBZ-2412 Ignoring non change events in logical router
2020-08-13 13:53:50 -04:00
Gunnar Morling
44efd1bc6b
DBZ-2423 Propagating port default values
2020-08-12 13:50:42 +02:00
Gunnar Morling
26b51e02cb
DBZ-2418 Misc. clean-up
2020-08-12 09:28:35 +02:00
Jiri Pechanec
0b95df28d5
DBZ-2411 Use Scala 2.12
2020-08-11 09:20:53 +02:00
Jiri Pechanec
391d086529
DBZ-2411 Upgrade to Kafka 2.6.0
2020-08-11 09:20:53 +02:00
Debezium Builder
c4c50f5fc6
[maven-release-plugin] prepare for next development iteration
2020-08-06 00:46:18 -04:00
Debezium Builder
94cbeb95fa
[maven-release-plugin] prepare release v1.3.0.Alpha1
2020-08-06 00:46:17 -04:00
rkerner
cad6cf62d3
DBZ-2315 fix BIT VARYING handling in Postgres connector
...
* removed little endian padding for BIT types in JdbcValueConverters (only used for Postgres yet)
* removed legacy format handling fot BIT related types in JdbcValueConverters#convertBits which were leftovers from PR #1408
* removed unnecessary zero-ing of a newly created byte array to improve performance for huge byte arrays
* updated Postgres connector docs
2020-08-03 14:58:31 +02:00
Cory Harper
724fc7ac98
DBZ-2362 add configurable restart wait time
2020-07-30 18:08:26 +02:00
Jiri Pechanec
5fcb221993
DBZ-1491 Database connection provides default value
2020-07-24 09:07:09 +02:00
Jiri Pechanec
45a6f9bef1
DBZ-1491 Refactor after review
2020-07-24 09:07:09 +02:00
Grzegorz Kołakowski
825ffe3848
DBZ-1491 Add SqlServerDefaultValueConverter class
2020-07-24 09:07:07 +02:00
Grzegorz Kołakowski
234341a471
DBZ-1491 Parse temporal values using queries on database
...
* Add tests for altering column default value
* Add end-to-end test
2020-07-24 09:06:30 +02:00
Grzegorz Kołakowski
a8ea5e2256
DBZ-1491 Extract default values from schema
...
The goal is to enrich schema metadata with column default value.
2020-07-24 09:05:58 +02:00
Gunnar Morling
3ebfbcefdb
DBZ-2329 Moving isNewTransaction() to SQL Server implementation
2020-07-24 07:57:50 +02:00
Lukasz Korzeniowski
1ada5c4b23
DBZ-2329 Do not skip events after restart when stream is not monotonic
2020-07-21 14:21:29 +02:00
Debezium Builder
e1ab38de84
[maven-release-plugin] prepare for next development iteration
2020-07-16 04:40:04 -04:00
Debezium Builder
69cf375faa
[maven-release-plugin] prepare release v1.2.1.Final
2020-07-16 04:40:04 -04:00
Jos Huiting
da97be7842
DBZ-2307 - Improve logging when primary keys are missing
2020-07-15 11:18:48 -04:00
Omar Al-Safi
4d2467ca20
DBZ-2302: Allow OffsetCommitPolicy to be initiated with Properties object
2020-07-09 08:38:26 +02:00
Randall Hauch
5860812a63
DBZ-2275 Updated default database history DML filter default to handle additional RDS statements;
...
* Added two more regular expressions to the default database history DML filter. These are intended to catch and filter out `INSERT into mysql.rds_monitor…` statements that RDS may write in the binlog
* Added a new unit test that checks that the regular expressions do catch some example statements
2020-06-25 20:57:49 +02:00
Jiri Pechanec
63a2f6a0ae
DBZ-2255 Document JSON parsing in groovy-based SMTs
2020-06-25 11:08:59 +02:00
Debezium Builder
c0d30b87d9
[maven-release-plugin] prepare for next development iteration
2020-06-24 18:03:11 +02:00
Debezium Builder
0e2ac78301
[maven-release-plugin] prepare release v1.2.0.Final
2020-06-24 18:03:11 +02:00
Jiri Pechanec
87d93d44fd
DBZ-2221 Wait for keepalive thread initialization
2020-06-24 09:14:42 +02:00
Gunnar Morling
b80f064131
DBZ-2250 Allowing to use CloudEventsConverter with Avro via Apicurio
2020-06-22 14:41:10 +02:00
Debezium Builder
b03a4d0e50
[maven-release-plugin] prepare for next development iteration
2020-06-19 00:39:01 -04:00
Debezium Builder
93e60258d5
[maven-release-plugin] prepare release v1.2.0.CR2
2020-06-19 00:39:00 -04:00
Gunnar Morling
f2d13238aa
DBZ-2228 Using unique names for admin clients
2020-06-18 14:08:56 +02:00
Debezium Builder
65c39e9f11
[maven-release-plugin] prepare for next development iteration
2020-06-11 02:00:20 -04:00
Debezium Builder
bce332c900
[maven-release-plugin] prepare release v1.2.0.CR1
2020-06-11 02:00:19 -04:00
Chris Cranford
ac0d9ede8a
DBZ-2152 Fix test failure
2020-06-09 17:20:51 +02:00
Balázs Németh
0853940f3d
DBZ-2169 Fix for misuse of ConfigurationDefaults.RETURN_CONTROL_INTERVAL;
...
* Implemented Temporals.min()
* Fixed pollInterval calculation based on the documentation
2020-06-09 10:24:50 +02:00
Gunnar Morling
bfaadcf2dd
DBZ-2149 Starting/stopping Kafka just once in KafkaDatabaseHistoryTest;
...
By using distinct topic names in the tests, the same Kafka instance can
be used for all test methods. This brings down execution time of this
test from ~40sec to ~8sec.
2020-06-09 10:15:47 +02:00
Chris Cranford
c3b36c2417
DBZ-2149 Log begin/end of schema recovery
2020-06-09 10:15:47 +02:00
Gunnar Morling
1fdad23087
Revert "DBZ-2166 Handling error condition where schema field can not be found in"
...
This reverts commit 283740f37e
.
2020-06-08 20:12:50 +02:00
Dave Cumberland
4254e29667
DBZ-2152 Adding fix annotations to new tests
2020-06-08 13:57:35 -04:00
Dave Cumberland
a17e4cbad0
DBZ-2152 Adding another unit test with the key mapping definied
2020-06-08 13:57:35 -04:00
Dave Cumberland
223812def3
DBZ-2152 Updating the EventRouter to allow key types other than String
2020-06-08 13:57:35 -04:00
Fabian Aussems
283740f37e
DBZ-2166 Handling error condition where schema field can not be found in
...
TableSchemaBuilder
2020-06-08 12:55:16 +02:00
Gunnar Morling
1b62036cf4
DBZ-2150 Awaiting coordinator shutdown in embedded engine
2020-06-08 10:26:37 +02:00
Gunnar Morling
c54e377dd2
DBZ-1814 Exporting Hex and Base64 representations as string
2020-06-05 12:13:29 +02:00
Gunnar Morling
023064eedb
DBZ-1814 Renaming "raw" to "bytes"; also clarifying that this notion isn't Java-specific
2020-06-05 12:13:29 +02:00
Jeremy Finzel
5db614da21
DBZ-1814 added new binary handling mode option
2020-06-05 12:13:29 +02:00
Jiri Pechanec
86dac40dae
DBZ-2140 Internal configs must not be validated
2020-06-04 11:47:26 +02:00
Kewei Shang
a963e89704
DBZ-2136 Update ChangeEventQueue Javadoc by fixing typo
2020-06-02 09:38:12 +02:00
Jiri Pechanec
8e7f3d14ca
DBZ-1312 Omit constatnt db name in column and key mappers
2020-06-01 12:43:45 +02:00
Jiri Pechanec
20b45f84f3
DBZ-1657 Remove duplicate option definitions
2020-05-22 12:07:29 +02:00
Gunnar Morling
ed838fb2d4
DBZ-2089 Typo fix
2020-05-22 08:36:57 +02:00
Jiri Pechanec
84851297cb
DBZ-2089 JMX no longer mandatory
2020-05-22 08:36:57 +02:00
Debezium Builder
dc25c379e5
[maven-release-plugin] prepare for next development iteration
2020-05-19 03:40:25 -04:00
Debezium Builder
ad060181b9
[maven-release-plugin] prepare release v1.2.0.Beta2
2020-05-19 03:40:25 -04:00
Jiri Pechanec
e676d715c3
DBZ-2085 Apply custom converters to default values
2020-05-18 17:27:59 +02:00
Jiri Pechanec
c85546d611
DBZ-2074 Expose topic and headers in scripting SMTs
2020-05-15 11:13:07 +02:00
Gunnar Morling
0b42c8d8c2
DBZ-2024 Adding topic.regex option to routing and filtering SMTs
2020-05-14 08:41:40 +02:00
Jiri Pechanec
c4f975bd0a
DBZ-2061 Handle change of default value
2020-05-14 08:31:27 +02:00
Gunnar Morling
4f020ca6cf
DBZ-1828 Removing deprecated SMT options
2020-05-13 21:36:12 +02:00
Chris Cranford
f449550b2d
DBZ-2068 Skip tests incompatible with Kafka 1.x
2020-05-13 08:22:07 +02:00
Aaron Brady
8b42016f63
DBZ-2034 Make ByLogicalTableRouter SMT unique key enforcement optional
2020-05-08 13:56:18 -04:00
Debezium Builder
8d4203279e
[maven-release-plugin] prepare for next development iteration
2020-05-07 05:03:40 -04:00
Debezium Builder
a4e2c8f36c
[maven-release-plugin] prepare release v1.2.0.Beta1
2020-05-07 05:03:40 -04:00
Chris Cranford
c6ba581848
DBZ-2014 Suggested changes
2020-05-05 22:13:25 +02:00
Chris Cranford
cd43c4880f
DBZ-2014 Do not include outbox eventType field by default
2020-05-05 22:13:25 +02:00
Chris Cranford
3c9ad5699b
DBZ-2036 Change logging from warn to debug
2020-05-05 21:58:56 +02:00
Chris Cranford
81c3a808da
DBZ-1963 Suggested changes
2020-05-05 08:45:58 +02:00
Chris Cranford
a1cb06299c
DBZ-1963 Emit outbox events with value schema names
2020-05-05 08:45:58 +02:00
Jiri Pechanec
1b3fba4b8c
DBZ-1904 Add drop table support
2020-05-04 12:31:05 +02:00
Jiri Pechanec
b9fa634968
DBZ-1904 Rename queueing methods
2020-05-04 12:31:05 +02:00
Jiri Pechanec
7f23d74d90
DBZ-1904 Add config param into a group
2020-05-04 12:31:05 +02:00
Jiri Pechanec
e350d74b17
DBZ-1904 Public facing schema history topic
2020-05-04 12:31:05 +02:00
Gunnar Morling
2310d6c792
DBZ-1969 Fixing incorrect assertion and utility which concealed this
2020-04-29 13:06:43 -04:00
Braden Groom
0b429ce880
DBZ-1969 Add support for Postgres enum arrays
2020-04-29 13:06:43 -04:00
Chris Cranford
230ddaebdc
DBZ-1953 Generalized SkipWhenDatabaseVersion functionality
2020-04-29 12:27:38 +02:00
Gunnar Morling
5fb3b7f2a1
DBZ-2027 Removing some unused code
2020-04-29 09:56:59 +02:00
Gunnar Morling
e9632c2227
DBZ-1972 Formatting
2020-04-27 17:54:35 +02:00
Gunnar Morling
8b2448440b
Revert "DBZ-2025 Reduce capture job poll interval"
...
This reverts commit 131063fb2be38f865019e5dcff74b6d78299f6d2; it prove
unstable on CI.
2020-04-27 16:38:01 +02:00
Jiri Pechanec
131063fb2b
DBZ-2025 Reduce capture job poll interval
2020-04-27 13:56:29 +02:00
JanHendrikDolling
33d83731af
DBZ-1972 move static Filed methods as static Filed constant to RelationalDatabaseConnectorConfig instead.
2020-04-27 12:31:19 +02:00
Gunnar Morling
f9bfe26754
DBZ-1753 Typo fix
2020-04-27 11:27:36 +02:00
Chris Cranford
f974f9f4ab
DBZ-1753 Refactor common code between SQL Server and DB2
2020-04-24 13:45:06 -04:00
Jiri Pechanec
7e37237b52
DBZ-2000 Change expression param name; add docs
2020-04-24 15:44:52 +02:00
Gunnar Morling
90d2e24788
DBZ-2000 Misc. clean-up
2020-04-24 15:44:52 +02:00
Jiri Pechanec
3ceb6ced3e
DBZ-2000 Content based router SMT
2020-04-24 15:44:52 +02:00
Gunnar Morling
03ce403972
DBZ-1750 Separating config definition editor and immutable config definitions
2020-04-24 15:35:28 +02:00
Jiri Pechanec
37f0dbcaf8
DBZ-1750 Limit access to parent defs; dont share the parent defs
2020-04-24 15:35:28 +02:00
Jiri Pechanec
0d8d6a41c5
DBZ-1750 Validate Kafka params only for Kafka history
2020-04-24 15:35:28 +02:00
Jiri Pechanec
af90507fa6
DBZ-1750 Centralize shared config definitions
2020-04-24 15:35:28 +02:00
Jiri Pechanec
412f288e88
DBZ-1923 Detect lost database history
2020-04-24 10:22:06 +02:00
Chris Cranford
24abc23f66
DBZ-2007 Upgrade Formatter and Impsort plugins
2020-04-23 11:21:06 +02:00
Gunnar Morling
2d0da37c03
DBZ-1993 Wrapping structs for simpler references in filter SMT;
...
Exposing as ProxyObject allows for simple property-style access. We also can prevent write access that way.
2020-04-23 08:33:30 +02:00
Gunnar Morling
0998fc533a
DBZ-1895 Completing implementation;
...
* Restoring original derserializers; excluding skipped events in event handlers
* Adding test
2020-04-22 15:04:36 +02:00
Gunnar Morling
dae655c78b
DBZ-2006 Misc. fixes to MongoDB connector docs
2020-04-22 11:42:21 +02:00
Gunnar Morling
1a5dd5db98
DBZ-1886 Misc. clean-up
2020-04-20 17:46:03 +02:00
Ivan Klass
75f19239d1
DBZ-1886 Introduce separate storageExists() method to support manual topic creation
2020-04-20 17:46:03 +02:00
Gunnar Morling
bc762f2989
DBZ-1962 Adding option descriptions
2020-04-17 15:24:42 +02:00
Jos Huiting
33fe631674
DBZ-1962 Fix PR feedback
2020-04-17 15:24:42 +02:00
Jos Huiting
8ba21a98ef
DBZ-1962 Introduce column.whitelist for the Postgres connector
2020-04-17 15:24:42 +02:00
Debezium Builder
4ca9f92575
[maven-release-plugin] prepare for next development iteration
2020-04-16 02:22:00 -04:00
Debezium Builder
e704bccdaa
[maven-release-plugin] prepare release v1.2.0.Alpha1
2020-04-16 02:22:00 -04:00
Gunnar Morling
786aab37d9
DBZ-1782 JavaDoc improvements;
...
As per Chris's suggestions.
Co-Authored-By: Chris Cranford <ccranfor@redhat.com>
2020-04-15 17:52:35 +02:00
Gunnar Morling
0673aba092
DBZ-1782 Inverting filtering logic, so to be consistent with Stream#filter() and other similar APIs
2020-04-15 17:52:35 +02:00
Gunnar Morling
0775bb1f4f
DBZ-1782 Allowing any JSR 223 implementation for filtering SMT
2020-04-15 17:52:35 +02:00
Gunnar Morling
905629973e
DBZ-1968 Removing SMTs deprecated in 0.10
2020-04-15 15:11:32 +02:00
Chris Cranford
e87bfefdf7
DBZ-1859 Renamed MetadataEvent to ConnectorEvent
2020-04-15 08:04:23 +02:00
Chris Cranford
57af80afd5
DBZ-1859 Enhance MongoDB connector metrics
2020-04-15 08:04:23 +02:00
Gunnar Morling
680f1f73af
DBZ-1782 Misc. fixes
2020-04-09 18:09:56 +02:00
Jiri Pechanec
08d2c9679f
DBZ-1782 Support for Graal JS
2020-04-09 18:09:56 +02:00
Jiri Pechanec
53c8603148
DBZ-1782 Use JSR223 API
2020-04-09 18:09:56 +02:00
Jiri Pechanec
112aeb9d21
DBZ-1782 Groovy based filtering SMT
2020-04-09 18:09:56 +02:00
JanHendrikDolling
1e19270981
DBZ-1692 Added support for hash based column masking mode for string values
2020-04-08 21:21:42 +02:00
Jiri Pechanec
384f62463c
DBZ-1905 Stop checking thread upong completion
2020-04-08 12:18:32 +02:00
Jiri Pechanec
318d1d3cc7
DBZ-1905 Make thread-naming params internal and optional
2020-04-08 12:18:32 +02:00
Jiri Pechanec
e81aec0ed1
DBZ-1905 Validate database history topic
2020-04-08 12:18:32 +02:00
Chris Cranford
65c8564d66
DBZ-1925 Introduced SkipWhenKafkaVersion annotation support
2020-04-07 09:01:20 +02:00
Jiri Pechanec
6338309cea
DBZ-1918 Initialize Metronome when needed
2020-04-01 09:48:24 +02:00
Gunnar Morling
89bb6eba6c
DBZ-1531 Misc. clean-up;
...
* Removing obsolete default impl
* Completing test
* Documention fixes
2020-03-25 12:33:38 +01:00
rk3rn3r
7f36b3c08f
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
rk3rn3r
6310e00675
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
rk3rn3r
fbd8b94e94
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
Debezium Builder
ab54ce062f
[maven-release-plugin] prepare for next development iteration
2020-03-24 01:23:05 -04:00
Debezium Builder
0b5a9117fb
[maven-release-plugin] prepare release v1.1.0.Final
2020-03-24 01:23:05 -04:00
Jiri Pechanec
32b6a8cb3c
DBZ-1889 Use parker
2020-03-23 13:56:29 +01:00
Jiri Pechanec
d2bdcd1ab3
DBZ-1889 Prevent Connect throttling while connection is down
2020-03-23 13:56:29 +01:00
Jiri Pechanec
224f97e380
DBZ-1857 Support for autorestart for embedded engine
2020-03-23 13:56:29 +01:00
Gunnar Morling
bbaf32fe82
DBZ-1815 Misc. clean-up
2020-03-18 10:27:22 +01:00
trolison
8784b41e22
DBZ-1815 Ading DatabaseHeartbeatImpl to allow for making queries to the DB when a heartbeat happens;
...
* Minor refactor to make DatabaseHeartbeatImpl usable
* Added integration test to verify heartbeat.action.query is being executed properly
2020-03-18 10:27:22 +01:00
Gunnar Morling
e4a1272dff
DBZ-1876 Adding comment
2020-03-13 16:21:33 +01:00
Jiri Pechanec
6e482de3d5
DBZ-1876 Process headers with tombstone
2020-03-13 16:21:33 +01:00
Gunnar Morling
449154beaa
DBZ-1863 Centralizing coordinator shutdown
2020-03-12 11:28:08 +01:00
Debezium Builder
86c1ed90ed
[maven-release-plugin] prepare for next development iteration
2020-03-11 09:54:44 -04:00
Debezium Builder
062c6abbe5
[maven-release-plugin] prepare release v1.1.0.CR1
2020-03-11 09:54:44 -04:00
Gunnar Morling
da1f7efb21
DBZ-1723 Formatting
2020-03-11 13:57:23 +01:00
Gunnar Morling
7e55315f78
DBZ-1723 Encapsulating retriable determination in error handler
2020-03-11 13:57:23 +01:00
Gunnar Morling
c51a5fb597
DBZ-1723 Restarting after connection losses in Postgres
2020-03-11 13:57:23 +01:00
Gunnar Morling
63404e14ca
DBZ-1723 Infrastructure for enabling restarts after retriable errors
2020-03-11 13:57:23 +01:00
Gunnar Morling
3437da00d7
DBZ-1723 Simplifying shutdown handling;
...
doStop() is already called from stop(), no need to do it again via the error handler.
2020-03-11 13:57:23 +01:00
Gunnar Morling
c156d30048
DBZ-1723 Centralizing stopping() logic in BaseSourceTask
2020-03-11 13:57:23 +01:00
Gunnar Morling
8ce69dc597
DBZ-1723 Encapsulating common poll() and stop() logic in BaseSourceTask
2020-03-11 13:57:23 +01:00
Gunnar Morling
6318cf0f2b
DBZ-1831 Pulling up connector option retrieval to CommonConnectorConfig;
...
* Expanding test
* Adding Sayed to COPYRIGHT.txt
2020-03-11 12:43:25 +01:00
Sayed Mohammad Hossein Torabi
63a462dbc0
DBZ-1831 Support MongoDB Oplog operations as config
2020-03-11 12:43:25 +01:00
Jiri Pechanec
082761effc
DBZ-1856 Deprecation process is not necessary
2020-03-11 12:02:07 +01:00
Chris Cranford
dc1d526caa
DBZ-1726 Fix test failure for relational connectors
2020-03-11 10:15:00 +01:00
Chris Cranford
3a4788cc33
DBZ-1726 Introduced AbstractSnapshotChangeEventSource and refactor implementations
2020-03-11 10:15:00 +01:00
Chris Cranford
38cf4ceae1
DBZ-1726 Introduce DataCollectionId#identifier()
2020-03-11 10:15:00 +01:00
Chris Cranford
4e27c90028
DBZ-1726 Move MongoDB connector to common framework
2020-03-11 10:15:00 +01:00
Fabio Cantarini
62b46ae596
DBZ-1830 Enhancement to datatype.propagate.source.type connector property
...
Add support for matching db and table name
Amend documentation accordingly
2020-03-10 14:58:16 +01:00
Fabio Cantarini
61cc791d32
DBZ-1830 Add support for new connector property datatype.propagate.source.type
2020-03-10 14:58:16 +01:00
Jiri Pechanec
0f11f7e6de
DBZ-1834 Support separately quoted schema and table
2020-03-03 10:56:19 +01:00
Jiri Pechanec
c201578d29
DBZ-1834 Support dots in table names
2020-03-03 10:56:19 +01:00
Jiri Pechanec
7d525d4baa
DBZ-1134 Fix tests for new API
2020-02-28 21:58:39 +01:00
Gunnar Morling
0f6d2c54fc
DBZ-1134 Avoiding concrete class in SPI by introducing receiver parameter
2020-02-28 21:58:39 +01:00
Gunnar Morling
e7fd7acab8
DBZ-1134 Making converter registry thread-safe; misc. clean-up
2020-02-28 21:58:39 +01:00
Jiri Pechanec
096d13f266
DBZ-1134 Use OptionalInts
2020-02-28 21:58:39 +01:00
Jiri Pechanec
d13e48cc55
DBZ-1134 Make converted field type parametrized
2020-02-28 21:58:39 +01:00
Jiri Pechanec
06e1eca085
DBZ-1134 Support for user provided converters
2020-02-28 21:58:39 +01:00
Jiri Pechanec
06049a5e9d
DBZ-1826 Rename error handling config field
2020-02-26 15:49:26 +01:00
Jiri Pechanec
91f292a1f2
DBZ-1825 Keep keys for non-matching table
2020-02-26 15:03:03 +01:00
Jiri Pechanec
ae6ee3d458
DBZ-234 Place Incubating into a unique package
2020-02-25 15:31:10 +01:00
Jiri Pechanec
f66fe17989
DBZ-234 Incubating annotation moved to API
2020-02-25 15:31:10 +01:00
Jiri Pechanec
38df24a76b
DBZ-234 Create API module with engine API
2020-02-25 15:31:10 +01:00
Jiri Pechanec
436615934d
DBZ-1760 Align code and docs
2020-02-25 10:43:11 +01:00
Jiri Pechanec
2b6e50daff
DBZ-1760 Allow skipping of invalid events
2020-02-25 10:43:11 +01:00
Gunnar Morling
5650276ba9
DBZ-1805 Removing unused private method parameter
2020-02-18 10:29:45 +01:00
Jiri Pechanec
566efd6a3f
DBZ-1775 Filter out rds_monitor DML events
2020-02-14 14:26:02 +01:00
Gunnar Morling
1e51f112b2
DBZ-1772 Trimming values for add.source.fields option
2020-02-14 12:51:58 +01:00
Debezium Builder
f75746fb7b
[maven-release-plugin] prepare for next development iteration
2020-02-13 03:18:20 -05:00
Debezium Builder
1d2df32743
[maven-release-plugin] prepare release v1.1.0.Beta2
2020-02-13 03:18:20 -05:00
Gunnar Morling
61c4f834a6
DBZ-1452 Misc. fixes and refactoring;
...
* Adding support for "transaction" struct
* Documentation updates
* Only one "_" as separator between struct and field name
2020-02-12 14:03:19 -05:00
daanroosen-DS
49bbec319b
DBZ-1452 Adding add.fields and add.headers options to flattening SMT
2020-02-12 14:03:19 -05:00
Jiri Pechanec
a998db9caa
DBZ-1767 Support field sanitization for MongoDB unwrap
2020-02-12 18:49:32 +01:00
Gunnar Morling
92fa6039ab
DBZ-1766 Adding Melissa Winstanley to COPYRIGHT.txt
2020-02-12 15:44:45 +01:00
Gunnar Morling
dd5c2b8be9
DBZ-1766 Unifying handling of offset commits
2020-02-12 15:44:45 +01:00
Matthias Wessendorf
bff73e71d0
DBZ-1784 Use "application/avro" as data content type in CloudEvents
...
Signed-off-by: Matthias Wessendorf <mwessend@redhat.com>
2020-02-12 14:26:25 +01:00
Debezium Builder
9c424b2404
[maven-release-plugin] prepare for next development iteration
2020-02-05 08:54:52 -05:00
Debezium Builder
9f2caa3b7c
[maven-release-plugin] prepare release v1.1.0.Beta1
2020-02-05 08:54:52 -05:00
Jiri Pechanec
77f9a61b95
DBZ-1751 Centralize envelope schema naming
2020-02-04 20:37:19 +01:00
Gunnar Morling
b66f314b3c
DBZ-1052 Misc. clean-up
...
* Doc updates
* Changed static method to instance
2020-02-03 09:29:10 +01:00
Jiri Pechanec
ba10a229b6
DBZ-1052 CE support for tx metadata in data messages
2020-02-03 09:29:10 +01:00
Jiri Pechanec
0e671d6167
DBZ-1052 Add counts per table to END
2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94
DBZ-1052 Transaction block moved to envelope
2020-02-03 09:29:10 +01:00
Jiri Pechanec
4867c8a298
DBZ-1052 Change TX topic name
2020-02-03 09:29:10 +01:00
Jiri Pechanec
5749acda7e
DBZ-1052 Remove unused fields; added JavaDoc
2020-02-03 09:29:10 +01:00
Jiri Pechanec
c0557b325b
DBZ-1052 Skip CE for transaction struct
2020-02-03 09:29:10 +01:00
Jiri Pechanec
cd6a1f942d
DBZ-1052 Transaction metadata for Postgres/pgoutput
2020-02-03 09:29:10 +01:00
Jiri Pechanec
b0eb571f9f
DBZ-1052 Transaction metadata for SQL Server
2020-02-03 09:29:10 +01:00
Jiri Pechanec
6f7b8d1707
DBZ-1748 Mask JDBC passwords from log messages
2020-01-31 17:26:59 +01:00
Gunnar Morling
2d337133ae
DBZ-1715 Docs clarification; adding Jos to authors list
2020-01-17 14:52:15 +01:00
Jos Huiting
1cd4d4bf19
Add field-based topic routing to Debezium ExtractRecordState
2020-01-17 14:43:03 +01:00
Debezium Builder
274bba9dc9
[maven-release-plugin] prepare for next development iteration
2020-01-16 05:40:24 -05:00
Debezium Builder
076df30108
[maven-release-plugin] prepare release v1.1.0.Alpha1
2020-01-16 05:40:24 -05:00
Gunnar Morling
8ca6174d98
DBZ-1292 Applying suggestions from code review
...
Co-Authored-By: Chris Cranford <ccranfor@redhat.com>
2020-01-16 08:02:51 +01:00
Gunnar Morling
8c33a4e147
DBZ-1292 Catering for the differences in data schema;
...
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
2020-01-16 08:01:56 +01:00
Gunnar Morling
8531adbefd
DBZ-1292 Formatting
2020-01-16 08:00:45 +01:00
Gunnar Morling
2ba1d615fb
DBZ-1292 Distinct names for data and envelope schema for Avro/Avro
2020-01-16 08:00:45 +01:00
Gunnar Morling
8591dd669b
DBZ-1292 Avoiding usage of reflection
2020-01-16 08:00:45 +01:00
Gunnar Morling
7c18a6d8d5
DBZ-1292 Removing static state in CloudEventsConverterTest
2020-01-16 08:00:45 +01:00
Gunnar Morling
366382ddad
DBZ-1292 Refactoring of options;
...
* Avoiding hard dependency to Avro
* Passing through all options from JSON and Avro converters by means of "json." and "avro." sub-namespaces
2020-01-16 08:00:45 +01:00
Gunnar Morling
12e43a89f4
DBZ-1292 Always adding "before" and "after"
2020-01-16 08:00:45 +01:00
Gunnar Morling
a861dae432
DBZ-1292 Clean-up around data schema URI
2020-01-16 08:00:45 +01:00
Gunnar Morling
1a18bdbc81
DBZ-1292 Misc. refactorings;
...
* Protecting against Avro as CE format and JSON as data format
* Reducing mutability
* Single Avro client
2020-01-16 08:00:45 +01:00
Gunnar Morling
4e4800cb56
DBZ-1292 Some clean-up in CloudEventsMaker;
...
* Avoiding non-final static fields
* Removing unused methods
* Reducing visibility
2020-01-16 08:00:45 +01:00
Gunnar Morling
fe8c5fe27d
DBZ-1292 Adding schema URI in case of Avro
2020-01-16 08:00:45 +01:00
Gunnar Morling
a25d148a82
DBZ-1292 Adding logical name to CE source attribute value
2020-01-16 08:00:45 +01:00
Gunnar Morling
342a448053
DBZ-1292 Using "iodebezium" prefix for extension attributes;
...
Simplifying implementation a bit.
2020-01-16 08:00:45 +01:00
Gunnar Morling
390c8f8090
DBZ-1292 Wrapping up work on schema and value conversion;
...
* There were a few attributes missing in the schema of the CE event
* Conversion of extension attributes now correctly handles optional attributes
* Removed guards against missing and duplicate fields, as the only caller is this class itself, so it seems superfluous.
2020-01-16 08:00:45 +01:00
GraySmog
de2655a89e
DBZ-1292 promoting op, ts_ms and sub-fields in source to extension attributes
2020-01-16 08:00:45 +01:00
GraySmog
d0e4b3c0af
DBZ-1292 Delete data.schema.registry.url config option
2020-01-16 08:00:45 +01:00
GraySmog
8b7c67cbdd
DBZ-1292 Using formatted timestamp for CE time field
2020-01-16 08:00:45 +01:00
Gunnar Morling
87ffe0c44e
DBZ-1292 Representing data as JSON struct instead of binary
2020-01-16 08:00:45 +01:00
Gunnar Morling
6356784cee
DBZ-1292 dataschema value should not be empty or null if key is present;
...
* CloudEvents spec version is 1.0 now
2020-01-16 08:00:45 +01:00
GraySmog
915c8cafd9
DBZ-1292 CloudEvents converter for JSON and Avro format
2020-01-16 08:00:45 +01:00
Gunnar Morling
07e89de91d
DBZ-1707 Ensuring correct Kafka record timestamp for outbox events;
...
Depending on the width of the configured TIMESTAMP column, a microsecond or nanosecond timestamp could have been returned before, whereas this should always be milliseconds.
2020-01-15 07:32:55 +01:00
Chris Cranford
4a27746dad
DBZ-1703 Fix typo after renaming configuration option
2020-01-14 09:24:53 +01:00
Chris Cranford
4fa0f22ac7
DBZ-1703 Add option to JSON SerDes for ignoring unknown properties
2020-01-14 09:24:53 +01:00
liulangwa
6028d78e76
DBZ-1688 Fix SQLserver type time(4)...time(7) lost nanoseconds
2020-01-02 12:26:28 +01:00
Debezium Builder
9723c93db9
[maven-release-plugin] prepare for next development iteration
2019-12-18 01:44:33 -05:00
Debezium Builder
09049516f2
[maven-release-plugin] prepare release v1.0.0.Final
2019-12-18 01:44:33 -05:00
Jiri Pechanec
761e7440cc
DBZ-1670 Rename Serdes to DebeziumSerdes
2019-12-16 15:05:43 +01:00
Cobolbaby
f199988609
DBZ-1642 commit() method in JdbcConnection compatible with non autocommit
2019-12-13 10:34:52 +01:00
Cobolbaby
641e24b483
DBZ-1642 Create method called commit() in JdbcConnection class
2019-12-13 10:34:52 +01:00
Debezium Builder
b1c62fe306
[maven-release-plugin] prepare for next development iteration
2019-12-10 06:39:17 -05:00
Debezium Builder
ad2efdb9a6
[maven-release-plugin] prepare release v1.0.0.CR1
2019-12-10 06:39:17 -05:00
Chris Cranford
19fd8dd1d9
DBZ-1413 Resolve column length/scale when reading table column metadata from TypeRegistry
2019-12-10 10:09:35 +01:00
Chris Cranford
365eb0d76e
DBZ-1413 Suggested Javadoc changes, added/fix tests, changed how Column native/jdbc type resolution happens
2019-12-10 10:09:35 +01:00
Chris Cranford
4bce11f92a
DBZ-1413 Remove some System.out madness
2019-12-10 10:09:35 +01:00
Chris Cranford
547ba8e0db
DBZ-1413 Align domain type support across all 3 decoders
2019-12-10 10:09:35 +01:00
Gunnar Morling
68e7b7a0bb
DBZ-1533 Documentation update
2019-12-10 10:07:55 +01:00
Jiri Pechanec
1805d1d73b
DBZ-1533 Added documentation
2019-12-10 10:07:55 +01:00
Jiri Pechanec
7e4ea91a10
DBZ-1533 Allow keeping envelope
2019-12-10 10:07:55 +01:00
Jiri Pechanec
8a64ce71d2
DBZ-1533 JSON payload serde
2019-12-10 10:07:55 +01:00
Gurnaaz Randhawa
4f60fac367
DBZ-1650 Changing sorting into a HashSet to a LinkedHashSet
2019-12-05 09:50:25 +01:00
Thomas Deblock
17e44d4c0c
DBZ-1648 outbox EventRouter remove topic toLowerCase
...
- kafka topics names are case sensitive. We should not perform
a toLowerCase on the topic name. It can cause some issue if
topic name have a upper case
2019-12-04 21:39:25 +01:00