Vojtech Juranek
6abbcee6a3
DBZ-5045 Remove deprecated TABLE_BLACKLIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
db08e894fc
DBZ-5045 Remove deprecated TABLE_WHITELIST
2022-06-08 09:11:00 +02:00
harveyyue
acb743bd34
DBZ-5206 Remove the deprecated monitored tables metrics
2022-06-07 16:13:29 -04:00
Chris Cranford
3e820c4047
DBZ-4251 Adjust semantics with collection removal
2022-06-02 07:30:07 +02:00
Chris Cranford
187e3250a3
DBZ-4251 Add regex support for stop signal
2022-06-02 07:30:07 +02:00
Chris Cranford
9d71296b5c
DBZ-4251 Support stopping incremental snapshots
2022-06-02 07:30:07 +02:00
Jiri Pechanec
88b7ae2050
DBZ-5136 Move sourceInfo to common class
2022-06-01 16:56:29 +02:00
Mark Bereznitsky
c64b8af31a
DBZ-5136 reintroduce the CommonOffsetContext class and refactor common functionality into it
2022-06-01 16:56:29 +02:00
Mark Bereznitsky
2d72dae649
DBZ-5136 further refining of the algorithm for determining position in snapshot and IT test fixes
2022-06-01 16:56:29 +02:00
Jiri Pechanec
08e8c3d795
DBZ-5136 Move common class to common package
2022-06-01 16:56:29 +02:00
Andrew Walker
d0759461a4
DBZ-5136: Convert RelationalOffsetContext to CommonOffsetContext
2022-06-01 16:56:29 +02:00
Andrew Walker
01a81f8bc1
DBZ-5136: Refactored SnapshotContext setters
2022-06-01 16:56:29 +02:00
Andrew Walker
b6222d42bf
DBZ-5136: Add first flag and refactor OffsetContext
2022-06-01 16:56:29 +02:00
Andrew Walker
593c2769e6
DBZ-5136: Add last in table flag
2022-06-01 16:56:29 +02:00
Chris Cranford
15e9231c30
DBZ-5179 Use LRUCacheMap
to avoid high memory usage
2022-06-01 15:53:55 +02:00
Chris Cranford
9fa5a48274
DBZ-5011 Register MongoDB metrics with task id when more than one task
2022-06-01 09:41:36 +02:00
harveyyue
9a3afac243
DBZ-5180 Put the MysqlPartition values to MDC getting NPE in logging context phase
2022-06-01 09:17:04 +02:00
Vojtech Juranek
5550057034
DBZ-5042 Add abstract partition with DB name
...
DB names is used by logging facilities. As the DB name is required only
for relational DBs, also this abstract class is provided only for
relational DB connectors.
Use this abstract class for SQL server connector, where DB name logging
is already implemented.
2022-05-27 14:20:30 -04:00
Jiri Pechanec
b85cb275b1
DBZ-5089 Use atomic reference
2022-05-27 12:46:39 +02:00
connorszczepaniak-wk
8693b4f008
DBZ-5089: add partition to the outbox event router in additional fields
...
DBZ-5089: undo format change
DBZ-5089: add tests for the partition routing
DBZ-5089: remove nonsensical comment
DBZ-5089: partition fieldname is a string; test properly
DBZ-5089: fix one of the failing tests
DBZ-5089: pass args through
DBZ-5089: fix oracle implementation; add configs for mongo connector
DBZ-5089: put partition in additional placement
DBZ-5089: restore formatting
2022-05-27 12:46:39 +02:00
harveyyue
e45e8bd43b
DBZ-5172 Expose more useful exception info with building the field default value schema
2022-05-27 12:41:12 +02:00
Rotem Adhoh
8ef7224543
DBZ-5166 Fixed ExtractNewRecordState SMT to pass all columns' data as is, i.e: without potential unwanted values manipulation.
...
Prior to this fix, when inserting an explicit NULL value to a nullable column which has a default value, resulted in a record which contains the corresponding field with the default value (instead of NULL) after applying ExtractNewRecordState transformation.
A new unit test was added as well.
2022-05-27 12:33:23 +02:00
harveyyue
3ada04b522
DBZ-3865 Debezium MySql connector does not capture floating point numbers with the right precision
2022-05-25 12:54:42 -04:00
Chris Cranford
7d8c9486d6
DBZ-5119 Move Heartbeat creation to ConnectorConfig & descendants
2022-05-25 09:59:59 +02:00
Chris Cranford
7ff7826743
DBZ-5119 Pull heartbeat.action.query
support into debezium-core
2022-05-24 12:54:40 +02:00
Chris Lee
2a8456d21b
DBZ-5123 data-collection regex snapshot signal
2022-05-24 12:46:28 +02:00
harveyyue
52ba58ccc3
DBZ-5098 Introduce a new field "ts_ms" to identify the process time for schema change event
2022-05-18 14:21:39 +02:00
harveyyue
f66b07cd80
DBZ-5141 Should be sleep with REGISTRATION_RETRY_DELAY when registry MBean failed
2022-05-18 12:19:31 +02:00
Jiri Pechanec
8643ad3a22
DBZ-5138 Unify happy/unhappy common path
2022-05-18 07:42:33 +02:00
Chris Cranford
e075d6b2eb
DBZ-5138 Fix tracking MBean registration
2022-05-17 20:02:11 -04:00
Jiri Pechanec
d56f6ef6e0
DBZ-5138 Retry failed metrics registration; allow starting without metrics
2022-05-17 20:02:11 -04:00
Sergei Morozov
1ad97b9d66
DBZ-5130: Log history recover progress every two seconds
2022-05-16 09:17:24 +02:00
Sergei Morozov
65e97796e7
DBZ-5129: Use buffered reader when reading history from file
2022-05-13 09:38:43 +02:00
Jiri Pechanec
4396fc3ec3
DBZ-4600 Remove deprecated class
2022-05-10 15:25:35 +02:00
Jiri Pechanec
5e94c1d498
DBZ-4600 Fix formatting
2022-05-10 15:08:46 +02:00
Nathan Bradshaw
c76e697f2f
DBZ-4600 - Add BinaryDataConverter to support byte[] and ByteBuffer source data
2022-05-10 15:08:46 +02:00
Nathan Bradshaw
b8b8dffac4
DBZ-4600 - Deprecate ByteBufferConverter from 1.9
2022-05-10 15:08:46 +02:00
Nathan Bradshaw
4bf01a95a2
DBZ-4600 - Start to rough-out ByteArrayConverter
...
- Add delegator support to ByteArrayConverter. Add missing tests
- Add required headers, correct typos
2022-05-10 15:08:46 +02:00
Mark Bereznitsky
ae00729aa2
DBZ-5087 Added a decorator for result sets that can cancel the parent statements
2022-05-06 07:52:00 +02:00
Sergei Morozov
f6546e4d87
DBZ-5075: Remove unused legacy MySQL code
2022-05-03 13:46:23 +02:00
harveyyue
d03e555144
DBZ-5072 Update the two properties to topic-routing doc
2022-05-03 13:44:58 +02:00
harveyyue
25205b233c
DBZ-5072 Config the cache size property for ByLogicalTableRouter caches
2022-05-03 13:44:58 +02:00
Chris Cranford
09e58c5a5c
DBZ-5006 Allow "/" characters in Oracle table names
2022-04-27 08:52:29 -04:00
Sergei Morozov
fd46a670ad
DBZ-5033: Ignore null offsets when recovering database history
2022-04-26 11:40:21 +02:00
Sergei Morozov
e79305cf93
DBZ-5033: Update Javadocs in DatabaseHistory
2022-04-26 11:40:21 +02:00
Vojtech Juranek
da5378d095
DBZ-4949 Adjust one test to use features > Java 11
...
Adjust one test to use multiline strings, which is a feature added in
Java 15 and thus verify Java source level > 11 works for tests.
2022-04-22 05:53:51 +02:00
Brad Morgan
8e25c52585
DBZ-4989 Passthrough payload schema in EventRouterDelegate
2022-04-14 12:17:53 +02:00
Jiri Pechanec
053bf602af
DBZ-4979 Guard against NPE for non-table related DDLs
2022-04-12 09:36:14 -04:00
Sergei Morozov
010f8c9d50
DBZ-3535: Rework CloudEventsConverter
2022-03-24 09:37:05 +01:00
Sergei Morozov
854186e846
DBZ-3535: Rework ByLogicalTableRouter
2022-03-24 09:37:05 +01:00
Sergei Morozov
139b129cf5
DBZ-3535: Rework TransactionMonitor
2022-03-24 09:37:05 +01:00
Sergei Morozov
fccc31c35b
DBZ-3535: Rework ConnectTableChangeSerializer
2022-03-24 09:37:05 +01:00
Sergei Morozov
b258674782
DBZ-3535: Introduce schema.name.adjustment.mode
2022-03-24 09:37:05 +01:00
Sergei Morozov
3a03ff0186
DBZ-3535: Remove unused EventDispatcher constructor parameter
2022-03-24 09:37:05 +01:00
Vojtech Juranek
0163c07800
DBZ-4786 Avoid NPE when removing column which doesn't exists
2022-03-23 07:53:06 +01:00
Vojtech Juranek
fdfc7a6647
DBZ-3762 Filter out MySQL inline comments by default
2022-03-21 16:57:43 +01:00
kate
4b2d5c29be
DBZ-4878 Re-read incremental snapshot chunk on DDL event
2022-03-18 07:55:43 +01:00
harveyyue
044e454e0a
DBZ-4832 Don't set truststore/keystore parameters to system variables
2022-03-15 11:25:28 +01:00
Josh Ribera
020e845f44
DBZ-4809 Add task id and partition to the logging context for
...
multi-partition connectors.
Co-authored-by: Sergei Morozov <morozov@tut.by>
2022-03-09 20:46:38 +01:00
Gunnar Morling
d20a6f00e7
DBZ-4801 Using JdbcConfiguration in JdbcConnection
2022-03-07 17:53:45 +01:00
Gunnar Morling
c1c322ecf0
DBZ-4801 Simplifying JdbcConnection constructors
2022-03-07 17:53:45 +01:00
harveyyue
856ab85cef
DBZ-4824 Expect the null value with snapshot CapturedTables metric when skipping snapshotting
2022-03-07 12:19:13 +01:00
yingyingtang-brex
eb3f02b9c0
DBZ-4813 indicating message id and key in outbox log messages
2022-03-03 10:47:20 +01:00
Josh Ribera
fc6d55e935
DBZ-4783: Add task id label to metrics
2022-03-01 14:21:39 +01:00
Mike Kamornikov
37a67d5dcf
DBZ-4783: Manage change tables per partition
2022-03-01 14:21:39 +01:00
Chris Cranford
e472a06da4
DBZ-4773 Fix formatting
2022-02-23 08:49:31 +01:00
Gunnar Morling
a144d84257
DBZ-4773 Using right constructor signature based on Kafka client version
2022-02-23 08:49:31 +01:00
Chris Cranford
9103a220b7
DBZ-4744 Correctly parse signal table name when using domain name
2022-02-22 15:27:21 +01:00
Jiri Pechanec
d13a1635d7
DBZ-3952 Store schema for tables not in schema collection list
2022-02-17 07:41:00 +01:00
Sergei Morozov
2d14b5b09f
DBZ-4478: Multi-partition metrics for SQL Server
2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c
DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces
2022-02-16 11:31:38 +01:00
Sergei Morozov
af8ea4d73d
DBZ-4478: Move logging from metrics to coordinator
2022-02-16 11:31:38 +01:00
Sergei Morozov
24ff3c9eba
DBZ-4478: Remove throws InterruptedException from DataChangeEventListener::onEvent
2022-02-16 11:31:38 +01:00
Jiri Pechanec
54ba2cd598
DBZ-4736 Handle string NULL default values correctly
2022-02-11 12:06:55 +01:00
harveyyue
8431a614a2
DBZ-4730 Expect plain value instead of scientific exponential notation when using decimal string mode
2022-02-10 17:40:12 +01:00
Farid Uyar
a559e51b08
DBZ-4547 Create History Topic with optional RF
2022-02-08 16:58:13 +01:00
Paweł Malon
7f7e71b36a
DBZ-4704 Replaced hasNotField
with hasField
and negated the result of it
2022-02-07 20:39:52 +01:00
Paweł Malon
abd8c4202f
DBZ-4704 Fixed the problem with expanding JSON payload that contains arrays of objects
2022-02-07 20:39:52 +01:00
Chris Cranford
055d5ba474
DBZ-4701 executeWithoutCommitting throw exception when auto-commit is enabled
2022-02-07 06:21:11 +01:00
Snigdhajyoti Ghosh
0ab45ecab0
DBZ-4518 Make kafka query timeout configurable
2022-02-04 14:08:15 +01:00
Chris Cranford
3980210c0c
DBZ-4648 Relax case requirement for SnapshotType
2022-02-03 18:15:23 +01:00
nathan
d5dcde8f7a
DBZ-4646 Changing exists method for FileDataBaseHistory to test if file is empty.
2022-02-03 16:47:22 +01:00
Mark Drilling
8a5279d304
DBZ-4314 Define Oracle category grouping and ordering ( #3151 )
2022-02-02 15:33:01 -06:00
Jiri Pechanec
74ea147152
DBZ-3679 Clarify log messages
2022-02-02 14:33:41 -05:00
Chris Cranford
088df2db8e
DBZ-4584 Fix test failures
2022-01-31 09:14:46 +01:00
Chris Cranford
dcd8607108
DBZ-4584 Support case-sensitive Oracle incremental snapshots
2022-01-31 09:14:46 +01:00
Jiri Pechanec
55894e57c2
DBZ-4610 Upgrade to Kafka 3.1.0
2022-01-25 15:26:42 +01:00
Chris Cranford
bd604a23cd
DBZ-4419 Add "none" option to skipped.operations
2022-01-22 00:33:21 +01:00
Chris Cranford
773debc340
DBZ-4419 Deprecate TruncateHandlingMode, favor skipped.operations
2022-01-22 00:33:21 +01:00
Jiri Pechanec
664d989e42
DBZ-4577 Provide custom error message handling
2022-01-21 10:24:19 +01:00
Jiri Pechanec
8f5bb31eab
DBZ-3700 Strings a bytes only when converters present
...
When database was used with non-UTF8 charset the snapshot was sending
byte array with UTF-8 bytes but MySQL converter was using database based
charset to convert it to String leading to malformed data.
It is necessary to convert strings using the database charset but it
might be a problem in case of non-charset matching.
The current solution
1) Uses strings by default
2) Switches to byte array only when converters are present to cover
original use case
3) If the conversion fails it switches back to string
2022-01-19 16:20:32 +01:00
Jiri Pechanec
8fd3243a86
DBZ-2224 Test logging based on logback
2022-01-18 11:24:21 +01:00
Sergei Morozov
17fba7258b
DBZ-4541: Promote failure to register metrics to exception
2022-01-14 19:50:57 +01:00
Sergei Morozov
6d97433d18
DBZ-4541: Remove logger from Metrics register/unregister signatures
2022-01-14 19:50:57 +01:00
Chris Cranford
610e8eba73
DBZ-4548 Fix DatabaseVersionResolver comparison logic
2022-01-13 13:29:34 -05:00
Sergei Morozov
0329859cda
DBZ-4459: Introduce interfaces and default implementations for change event source metrics
2022-01-12 14:32:19 +01:00
Gunnar Morling
f0b4a5ba9f
DBZ-4351 Misc. clean-up
2022-01-06 19:03:46 +01:00
harveyyue
291e8ac221
DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation
2022-01-06 19:03:46 +01:00
harveyyue
831217053c
DBZ-4503 Drop the primary key column getting exception
2022-01-03 10:57:07 +01:00
harveyyue
3670b0c6ef
DBZ-4497 Parse multiple signed/unsigned keyword from ddl statement failed
2022-01-03 10:47:03 +01:00