mfvitale
fdf79b0379
DBZ-5902 Add warn log for deprecation
2023-04-06 10:55:19 +02:00
mfvitale
34f021988e
DBZ-5902 Add new PartitionRouting SMT that will replace ComputePartition
2023-04-06 10:55:19 +02:00
mfvitale
6e9528a47d
DBZ-5902 Deprecate ComputePartition SMT
2023-04-06 10:55:19 +02:00
mfvitale
80ac1b362f
DBZ-5902 Moved list validation to CommonConnectorConfig
2023-04-06 10:55:19 +02:00
Debezium Builder
5c650fd054
[maven-release-plugin] prepare for next development iteration
2023-03-31 10:00:16 +00:00
Debezium Builder
68ffc4833b
[maven-release-plugin] prepare release v2.2.0.Beta1
2023-03-31 10:00:16 +00:00
Jiri Pechanec
b6c984e4de
DBZ-6072 Sort imports
2023-03-28 17:06:58 +02:00
Jiri Pechanec
0e42935b35
DBZ-6072 Use more descriptive name
2023-03-28 16:59:05 +02:00
harveyyue
5dd4b53ec3
DBZ-6072 NPE when setting schema.history.internal.store.only.captured.tables.ddl=true
2023-03-28 16:59:05 +02:00
harveyyue
2f46c83b2a
DBZ-6104 java.lang.NullPointerException in MySQL connector with max.queue.size.in.bytes
2023-03-28 14:51:52 +02:00
harveyyue
c9c1ce8a2f
DBZ-6185 Zerofill property failed for different int types
2023-03-28 09:34:58 +02:00
Jiri Pechanec
e3fdd873e1
DBZ-6201 Skip expensive logging
2023-03-22 14:02:44 +01:00
mfvitale
2d70f47c40
DBZ-6201: Add more fail test scenarios
2023-03-22 14:02:44 +01:00
mfvitale
16191a5a35
DBZ-6201: Add logs
2023-03-22 14:02:44 +01:00
mfvitale
039a3f04e8
DBZ-6201: Add support for move and nested fields for HeaderToValue SMT
2023-03-22 14:02:44 +01:00
mfvitale
c45bf39eb0
DBZ-6201: Add new HeaderToValue SMT to copy headers to value
2023-03-22 14:02:44 +01:00
mfvitale
4e544debdc
DBZ-6201: Fix validation message that reports null as value
2023-03-22 14:02:44 +01:00
Chris Cranford
1c5f14f7fd
DBZ-6225 DBZ-6226 DBZ-6231 Introduce CustomConverter for JDBC sink consistency
...
In DBZ-6225, it was identified that the schema type associated with TINYINT(1)
and BOOLEAN data types wasn't consistent. This converter implementation will
always emit BOOLEAN data types as INT16, similar to TINYINT(1).
In DBZ-6226, it was identified that the schema type associated with REAL data
types wasn't consistent, emitted as FLOAT64 during snapshot and FLOAT32 in
the streaming phase. This converter implementation will always emit such types
as FLOAT64 for consistency.
In DBZ-6231, during streaming the DDL parser will get the column type as the
literal type supplied by the user's DDL, i.e. NCHAR or NVARCHAR but when the
DDL is sourced from SHOW CREATE TABLE, MySQL returns these columns as types
of CHAR/VARCHAR but with a character set. By passing the character_set in
the schema consistency, we can deduce nationalized vs non-nationalized.
2023-03-21 14:53:56 +01:00
harveyyue
1877906dd8
DBZ-6197 Remove duplicated createDdlFilter method from historized connector config
2023-03-13 10:56:43 +01:00
Nir Levy
16f460d2d7
DBZ-6190: Fix support for ddl filter
2023-03-09 08:48:43 +01:00
Debezium Builder
55d65e9618
[maven-release-plugin] prepare for next development iteration
2023-03-08 11:38:17 +00:00
Debezium Builder
6d183c3dc1
[maven-release-plugin] prepare release v2.2.0.Alpha3
2023-03-08 11:38:16 +00:00
subodh
b781960019
DBZ-6179 Fix swallowing of exception cause of finally block in RelationalSnapshotChangeEventSource
2023-03-06 10:28:57 +01:00
Jiri Pechanec
98dcdb8f55
DBZ-6023 Remove nnecessary code
2023-03-06 10:25:59 +01:00
PlugaruT
7d0492fee5
DBZ-6023 Unit tests for buildChunkQuery and buildMaxPrimaryKeyQuery methods
2023-03-06 10:25:59 +01:00
PlugaruT
472162e46e
DBZ-6023 Add support for providing a surrogate key when triggering incremental snapshots
...
For tables that have a composite Primary Key, SQL queries for incremental snapshot perform bad. This change allows to provide a surrogate key that will be used for the queries. The key should be unique in order for the snapshot to guarantee consistency.
2023-03-06 10:25:59 +01:00
Jiri Pechanec
0585c6beb8
DBZ-823 Add NULL instance for the class
2023-03-03 12:47:15 +01:00
Jiri Pechanec
d492ec892c
DBZ-823 Use enum for enumeration
2023-03-03 12:47:15 +01:00
Jiri Pechanec
3da2434c6c
DBZ-823 Restrict the type with generics
2023-03-03 12:47:15 +01:00
Jiri Pechanec
5e666f00ee
DBZ-823 Add JavaDoc to new interfaces
2023-03-03 12:47:15 +01:00
Jiri Pechanec
7d92dc0211
DBZ-823 Don't use getter based name
2023-03-03 12:47:15 +01:00
Jiri Pechanec
0f4adb9fe6
DBZ-823 Use better name for CF with main connection
2023-03-03 12:47:15 +01:00
ggaborg
e875e784a0
DBZ-823 CR changes
2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9
DBZ-823 Optionally parallelize initial snapshots
2023-03-03 12:47:15 +01:00
Jiri Pechanec
0656de70c9
DBZ-6156 Add an extra test case
2023-03-03 11:20:21 +01:00
jcechace
7d3cca89bd
DBZ-6032 MongoConnection allways rethrows InterruptedException
2023-03-03 05:46:33 +01:00
jcechace
922191cdd7
DBZ-6032 Connection management refactoring
2023-03-03 05:46:33 +01:00
harveyyue
440192851d
DBZ-6156 Add hostname validator to connector configuration
2023-02-28 13:22:14 +01:00
Vojtech Juranek
0868bfd55e
DBZ-3594 Remove unused deprecated method
2023-02-23 09:26:07 -05:00
Debezium Builder
2245ceda44
[maven-release-plugin] prepare for next development iteration
2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a
[maven-release-plugin] prepare release v2.2.0.Alpha2
2023-02-16 11:28:25 +00:00
Chris Cranford
a7d1bb0f86
DBZ-5283 Decoupled changed SMT vs new state SMT, updated docs
2023-02-10 13:53:05 +01:00
Chris Cranford
297225d141
DBZ-5283 Add unchanged field support to ExtractNewRecordState
2023-02-10 13:53:05 +01:00
Chris Cranford
f8eb32cf6f
DBZ-5283 Move ExtractChangedRecordState tests to own class
2023-02-10 13:53:05 +01:00
harveyyue
4cb6e7c5b3
DBZ-5283 Introduce a new SMT ExtractChangedRecordState to capture the names of changed/unchanged field within headers
2023-02-10 13:53:05 +01:00
Jeremy Ford
517b43b870
DBZ-5827 ActivateTracingSpan wrong timestamps reported
...
Change txLogSpan to use processingTimestamp for span finish.
2023-02-07 13:25:44 +01:00
Ismail Simsek
3548daf8b9
DBZ-6075 Use Instantiator to load ClassLoader
2023-02-07 07:24:03 +01:00
Jiri Pechanec
3a646519de
DBZ-5743 Modify Javadoc
2023-02-02 13:21:45 +01:00
harveyyue
57b902ff8c
DBZ-5743 Introduce alternative AVRO_UNICODE mode for field name selector
2023-02-02 13:21:45 +01:00
harveyyue
f093d7a6c9
DBZ-5743 Introduce alternative AVRO_UNICODE mode for schema adjuster
2023-02-02 13:21:45 +01:00
harveyyue
003bef0736
DBZ-5743 Introduce a new unicode topic naming strategy
2023-02-02 13:21:45 +01:00
Jiri Pechanec
795014e040
DBZ-6037 Data no longer logged on error
2023-01-26 13:30:20 +01:00
Jiri Pechanec
ad3c6981bd
DBZ-5879 Remove duplicate dependency
2023-01-24 14:29:00 +01:00
Jiri Pechanec
8f3ca36e23
DBZ-6026 Don't update last offsets in statistics
2023-01-24 14:26:05 +01:00
Vojtech Juranek
f00f2a8735
DBZ-5917 Fix querying column metadata for tables with back slash in the name
...
If the table contains back slash, which is ANSI SQL escape chracter,
in its name, querying column metadata would fail in some cases (*)
which would result into NPE. Fix table name before the query and
escape escape character if the table name contains it.
Default backslash works for all currently supported databases as it's
ANSI SQL standard,
(*) everything works when we collect column metadata for all tables,
i.e. when there are no excluded tables
2023-01-20 00:01:11 +01:00
Debezium Builder
04f5291a2d
[maven-release-plugin] prepare for next development iteration
2023-01-19 11:32:10 +00:00
Debezium Builder
027527963e
[maven-release-plugin] prepare release v2.2.0.Alpha1
2023-01-19 11:32:10 +00:00
Anil Dasari
e1f9d64fbb
DBZ-5852:Snapshotter#snapshotCompleted is invoked regardless of snapshot result
2023-01-19 09:24:02 +01:00
Jiri Pechanec
1ec41fa120
DBZ-5879 Added logging; removed commented out code
2023-01-18 14:46:14 +01:00
Jeremy Ford
553cb9b1dd
DBZ-5879 Add wait to tests in order to maintain expectations of existing integration tests
2023-01-18 14:46:14 +01:00
Jeremy Ford
f2a6f0b8db
DBZ-5879 Support retrying database connection failures during connector start
...
Reworked when task requests start from subclasses
Add support for restarting
2023-01-18 14:46:14 +01:00
Jiri Pechanec
e8729bb0eb
DBZ-5996 Properly handle zoned timestamp width in Oracle
2023-01-18 10:42:36 +01:00
Jiri Pechanec
bcd6787cdc
DBZ-6008 Revert "DBZ-3653 Introduce incremental.snapshot.isolation.mode config"
...
This reverts commit 6d8bcd42fd
.
2023-01-17 10:40:20 +01:00
Jiri Pechanec
8738e62459
DBZ-6008 Revert "DBZ-3653 Remove extra modifiers"
...
This reverts commit bdfc1e6861
.
2023-01-17 10:40:20 +01:00
Jiri Pechanec
0c5e4f0051
DBZ-6002 Fix tests now requiring fractions
2023-01-13 12:00:00 +01:00
harveyyue
bea65acc0e
DBZ-6002 Run PostgresConnectorIT.shouldReceiveChangesForChangeColumnDefault() failed
2023-01-13 12:00:00 +01:00
akshansh
444dab3ffa
DBZ-5996 Handled case where fractionalWidth was -1
2023-01-11 12:09:26 +01:00
akshansh
b87d80f462
DBZ-5996 Implemented custom DateTimeFormatter to parse ZonedDateTime while preserving length of column.
2023-01-11 12:09:26 +01:00
harveyyue
5e56ad75f8
DBZ-5985 Disable to print invalid estimated row count when config "snapshot.select.statement.overrides"
2023-01-11 09:20:15 +01:00
Jiri Pechanec
bdfc1e6861
DBZ-3653 Remove extra modifiers
2023-01-11 08:55:33 +01:00
govi20
6d8bcd42fd
DBZ-3653 Introduce incremental.snapshot.isolation.mode config
2023-01-11 08:55:33 +01:00
Jiri Pechanec
8ca5e0a9b5
DBZ-4669 Reformat after plugin version consolidation
2023-01-11 06:44:53 +01:00
Mark Lambert
f0a1fa8a67
DBZ-4669 Use the newer version of plugins to consolidate remaining duplicates plugin versions
2023-01-11 06:44:53 +01:00
Mark Lambert
e5d16b14a6
DBZ-2439 Remove redundant modifiers
2023-01-11 06:44:53 +01:00
harveyyue
d941bc928b
DBZ-5966 Truncate records incompatible with ExtractNewRecordState
2023-01-05 13:51:35 +01:00
Jiri Pechanec
26bcb67cdc
DBZ-5967 Provide additional checks
2023-01-05 08:12:21 +01:00
mfvitale
c2d7d82d30
DBZ-5967: Fix negative partition number in ComputePartition SMT
...
Also improved check on configuration consistency to avoid 0 as partition number.
2023-01-05 08:12:21 +01:00
Debezium Builder
cf1720e4cb
[maven-release-plugin] prepare for next development iteration
2022-12-22 10:11:54 +00:00
Debezium Builder
b4ea9b46cd
[maven-release-plugin] prepare release v2.1.0.Final
2022-12-22 10:11:53 +00:00
harveyyue
6d70bf7b9d
DBZ-5344 Add complex json array test case to EventRouterTest
2022-12-19 12:24:24 +01:00
harveyyue
348e77d334
DBZ-5946 Print the readable data class name in JdbcValueConverters.handleUnknownData
2022-12-19 11:02:38 +01:00
Debezium Builder
177a60a9d3
[maven-release-plugin] prepare for next development iteration
2022-12-16 09:33:38 +00:00
Debezium Builder
f805db8c3c
[maven-release-plugin] prepare release v2.1.0.Beta1
2022-12-16 09:33:38 +00:00
Vojtech Juranek
1c0300cf2a
DBZ-5838 Disable schema caching
...
While documentation says that schema caching is disabled by default,
which would everyone sane assume anyway, it's actually turned of and
clean result in very strange test failures.
See also https://github.com/Apicurio/apicurio-registry/issues/2997
2022-12-12 14:44:05 +01:00
mfvitale
4c941b63ed
DBZ-5847: Add support for all connectors
...
Support for qualified table names
2022-12-12 14:40:56 +01:00
Marcelo Avancini
7754163c5d
DBZ-2432: Fixing misuse of assertj
...
- Some usages of assertj was not callig the actual assert of the DSL, fixing it
- Changing the Assertions to be staticlly imported
2022-12-08 13:10:26 +01:00
Jiri Pechanec
97ea30f25d
DBZ-5893 Mask connection string in connector option logging
2022-12-07 08:41:34 +01:00
jcechace
2468d73783
DBZ-5893 Masking credentials in connection string when logging
2022-12-07 05:45:58 +01:00
Debezium Builder
81896ed334
[maven-release-plugin] prepare for next development iteration
2022-11-30 07:52:24 +00:00
Debezium Builder
1aac97b87c
[maven-release-plugin] prepare release v2.1.0.Alpha2
2022-11-30 07:52:23 +00:00
Jiri Pechanec
f50ed10377
DBZ-5796 Fix typo in test description
2022-11-16 14:55:01 +01:00
harveyyue
b124d91a93
DBZ-5796 For outbox transformation, when 'table.expand.json.payload' is set to true null values are not correctly deserialized
2022-11-16 14:55:01 +01:00
Debezium Builder
e311dd1a67
[maven-release-plugin] prepare for next development iteration
2022-11-10 13:29:06 +00:00
Debezium Builder
e3bf53440a
[maven-release-plugin] prepare release v2.1.0.Alpha1
2022-11-10 13:29:05 +00:00
Anil Dasari
c781832f41
DBZ-5822 Change visibility of BaseSourceTask#logStatistics method to protected
2022-11-10 08:02:48 +01:00
Chris Cranford
1d9a21bb85
DBZ-5759 Log per topic record counts
2022-11-10 07:31:28 +01:00
Vojtech Juranek
96e4326d35
DBZ-2131 Use system property to determine if Apicurio should be used
2022-11-09 08:44:45 +01:00
Vojtech Juranek
41d3d7d155
DBZ-2131 Run tests with Apicurio registry
...
When Apicurio profile is used and container with Apicurio started, use
Apicurio registry in the tests. Fall back to in-memory Confluent
registry otherwise.
2022-11-09 08:44:45 +01:00
harveyyue
e6f0551451
DBZ-5801 The merge method of configuration is not work
2022-11-08 14:19:51 +01:00
jcechace
f46c127d11
DBZ-5779 Migrated debezium-core to AssertJ
2022-11-02 08:50:26 +01:00