alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
8,400 Commits 3 Branches 0 Tags 51 MiB
6d404d242e
Commit Graph

1673 Commits

Author SHA1 Message Date
harveyyue
c9c1ce8a2f DBZ-6185 Zerofill property failed for different int types 2023-03-28 09:34:58 +02:00
Jiri Pechanec
e3fdd873e1 DBZ-6201 Skip expensive logging 2023-03-22 14:02:44 +01:00
mfvitale
2d70f47c40 DBZ-6201: Add more fail test scenarios 2023-03-22 14:02:44 +01:00
mfvitale
16191a5a35 DBZ-6201: Add logs 2023-03-22 14:02:44 +01:00
mfvitale
039a3f04e8 DBZ-6201: Add support for move and nested fields for HeaderToValue SMT 2023-03-22 14:02:44 +01:00
mfvitale
c45bf39eb0 DBZ-6201: Add new HeaderToValue SMT to copy headers to value 2023-03-22 14:02:44 +01:00
mfvitale
4e544debdc DBZ-6201: Fix validation message that reports null as value 2023-03-22 14:02:44 +01:00
Chris Cranford
1c5f14f7fd DBZ-6225 DBZ-6226 DBZ-6231 Introduce CustomConverter for JDBC sink consistency 
In DBZ-6225, it was identified that the schema type associated with TINYINT(1)
and BOOLEAN data types wasn't consistent. This converter implementation will
always emit BOOLEAN data types as INT16, similar to TINYINT(1).

In DBZ-6226, it was identified that the schema type associated with REAL data
types wasn't consistent, emitted as FLOAT64 during snapshot and FLOAT32 in
the streaming phase. This converter implementation will always emit such types
as FLOAT64 for consistency.

In DBZ-6231, during streaming the DDL parser will get the column type as the
literal type supplied by the user's DDL, i.e. NCHAR or NVARCHAR but when the
DDL is sourced from SHOW CREATE TABLE, MySQL returns these columns as types
of CHAR/VARCHAR but with a character set.  By passing the character_set in
the schema consistency, we can deduce nationalized vs non-nationalized.
 2023-03-21 14:53:56 +01:00
harveyyue
1877906dd8 DBZ-6197 Remove duplicated createDdlFilter method from historized connector config 2023-03-13 10:56:43 +01:00
Nir Levy
16f460d2d7 DBZ-6190: Fix support for ddl filter 2023-03-09 08:48:43 +01:00
Debezium Builder
55d65e9618 [maven-release-plugin] prepare for next development iteration 2023-03-08 11:38:17 +00:00
Debezium Builder
6d183c3dc1 [maven-release-plugin] prepare release v2.2.0.Alpha3 2023-03-08 11:38:16 +00:00
subodh
b781960019 DBZ-6179 Fix swallowing of exception cause of finally block in RelationalSnapshotChangeEventSource 2023-03-06 10:28:57 +01:00
Jiri Pechanec
98dcdb8f55 DBZ-6023 Remove nnecessary code 2023-03-06 10:25:59 +01:00
PlugaruT
7d0492fee5 DBZ-6023 Unit tests for buildChunkQuery and buildMaxPrimaryKeyQuery methods 2023-03-06 10:25:59 +01:00
PlugaruT
472162e46e DBZ-6023 Add support for providing a surrogate key when triggering incremental snapshots 
For tables that have a composite Primary Key, SQL queries for incremental snapshot perform bad. This change allows to provide a surrogate key that will be used for the queries. The key should be unique in order for the snapshot to guarantee consistency.
 2023-03-06 10:25:59 +01:00
Jiri Pechanec
0585c6beb8 DBZ-823 Add NULL instance for the class 2023-03-03 12:47:15 +01:00
Jiri Pechanec
d492ec892c DBZ-823 Use enum for enumeration 2023-03-03 12:47:15 +01:00
Jiri Pechanec
3da2434c6c DBZ-823 Restrict the type with generics 2023-03-03 12:47:15 +01:00
Jiri Pechanec
5e666f00ee DBZ-823 Add JavaDoc to new interfaces 2023-03-03 12:47:15 +01:00
Jiri Pechanec
7d92dc0211 DBZ-823 Don't use getter based name 2023-03-03 12:47:15 +01:00
Jiri Pechanec
0f4adb9fe6 DBZ-823 Use better name for CF with main connection 2023-03-03 12:47:15 +01:00
ggaborg
e875e784a0 DBZ-823 CR changes 2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
Jiri Pechanec
0656de70c9 DBZ-6156 Add an extra test case 2023-03-03 11:20:21 +01:00
jcechace
7d3cca89bd DBZ-6032 MongoConnection allways rethrows InterruptedException 2023-03-03 05:46:33 +01:00
jcechace
922191cdd7 DBZ-6032 Connection management refactoring 2023-03-03 05:46:33 +01:00
harveyyue
440192851d DBZ-6156 Add hostname validator to connector configuration 2023-02-28 13:22:14 +01:00
Vojtech Juranek
0868bfd55e DBZ-3594 Remove unused deprecated method 2023-02-23 09:26:07 -05:00
Debezium Builder
2245ceda44 [maven-release-plugin] prepare for next development iteration 2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a [maven-release-plugin] prepare release v2.2.0.Alpha2 2023-02-16 11:28:25 +00:00
Chris Cranford
a7d1bb0f86 DBZ-5283 Decoupled changed SMT vs new state SMT, updated docs 2023-02-10 13:53:05 +01:00
Chris Cranford
297225d141 DBZ-5283 Add unchanged field support to ExtractNewRecordState 2023-02-10 13:53:05 +01:00
Chris Cranford
f8eb32cf6f DBZ-5283 Move ExtractChangedRecordState tests to own class 2023-02-10 13:53:05 +01:00
harveyyue
4cb6e7c5b3 DBZ-5283 Introduce a new SMT ExtractChangedRecordState to capture the names of changed/unchanged field within headers 2023-02-10 13:53:05 +01:00
Jeremy Ford
517b43b870 DBZ-5827 ActivateTracingSpan wrong timestamps reported 
Change txLogSpan to use processingTimestamp for span finish.
 2023-02-07 13:25:44 +01:00
Ismail Simsek
3548daf8b9 DBZ-6075 Use Instantiator to load ClassLoader 2023-02-07 07:24:03 +01:00
Jiri Pechanec
3a646519de DBZ-5743 Modify Javadoc 2023-02-02 13:21:45 +01:00
harveyyue
57b902ff8c DBZ-5743 Introduce alternative AVRO_UNICODE mode for field name selector 2023-02-02 13:21:45 +01:00
harveyyue
f093d7a6c9 DBZ-5743 Introduce alternative AVRO_UNICODE mode for schema adjuster 2023-02-02 13:21:45 +01:00
harveyyue
003bef0736 DBZ-5743 Introduce a new unicode topic naming strategy 2023-02-02 13:21:45 +01:00
Jiri Pechanec
795014e040 DBZ-6037 Data no longer logged on error 2023-01-26 13:30:20 +01:00
Jiri Pechanec
ad3c6981bd DBZ-5879 Remove duplicate dependency 2023-01-24 14:29:00 +01:00
Jiri Pechanec
8f3ca36e23 DBZ-6026 Don't update last offsets in statistics 2023-01-24 14:26:05 +01:00
Vojtech Juranek
f00f2a8735 DBZ-5917 Fix querying column metadata for tables with back slash in the name 
If the table contains back slash, which is ANSI SQL escape chracter,
in its name, querying column metadata would fail in some cases (*)
which would result into NPE. Fix table name before the query and
escape escape character if the table name contains it.

Default backslash works for all currently supported databases as it's
ANSI SQL standard,

(*) everything works when we collect column metadata for all tables,
i.e. when there are no excluded tables
 2023-01-20 00:01:11 +01:00
Debezium Builder
04f5291a2d [maven-release-plugin] prepare for next development iteration 2023-01-19 11:32:10 +00:00
Debezium Builder
027527963e [maven-release-plugin] prepare release v2.2.0.Alpha1 2023-01-19 11:32:10 +00:00
Anil Dasari
e1f9d64fbb DBZ-5852:Snapshotter#snapshotCompleted is invoked regardless of snapshot result 2023-01-19 09:24:02 +01:00
Jiri Pechanec
1ec41fa120 DBZ-5879 Added logging; removed commented out code 2023-01-18 14:46:14 +01:00
Jeremy Ford
553cb9b1dd DBZ-5879 Add wait to tests in order to maintain expectations of existing integration tests 2023-01-18 14:46:14 +01:00
Jeremy Ford
f2a6f0b8db DBZ-5879 Support retrying database connection failures during connector start 
Reworked when task requests start from subclasses
Add support for restarting
 2023-01-18 14:46:14 +01:00
Jiri Pechanec
e8729bb0eb DBZ-5996 Properly handle zoned timestamp width in Oracle 2023-01-18 10:42:36 +01:00
Jiri Pechanec
bcd6787cdc DBZ-6008 Revert "DBZ-3653 Introduce incremental.snapshot.isolation.mode config" 
This reverts commit 6d8bcd42fd.
 2023-01-17 10:40:20 +01:00
Jiri Pechanec
8738e62459 DBZ-6008 Revert "DBZ-3653 Remove extra modifiers" 
This reverts commit bdfc1e6861.
 2023-01-17 10:40:20 +01:00
Jiri Pechanec
0c5e4f0051 DBZ-6002 Fix tests now requiring fractions 2023-01-13 12:00:00 +01:00
harveyyue
bea65acc0e DBZ-6002 Run PostgresConnectorIT.shouldReceiveChangesForChangeColumnDefault() failed 2023-01-13 12:00:00 +01:00
akshansh
444dab3ffa DBZ-5996 Handled case where fractionalWidth was -1 2023-01-11 12:09:26 +01:00
akshansh
b87d80f462 DBZ-5996 Implemented custom DateTimeFormatter to parse ZonedDateTime while preserving length of column. 2023-01-11 12:09:26 +01:00
harveyyue
5e56ad75f8 DBZ-5985 Disable to print invalid estimated row count when config "snapshot.select.statement.overrides" 2023-01-11 09:20:15 +01:00
Jiri Pechanec
bdfc1e6861 DBZ-3653 Remove extra modifiers 2023-01-11 08:55:33 +01:00
govi20
6d8bcd42fd DBZ-3653 Introduce incremental.snapshot.isolation.mode config 2023-01-11 08:55:33 +01:00
Jiri Pechanec
8ca5e0a9b5 DBZ-4669 Reformat after plugin version consolidation 2023-01-11 06:44:53 +01:00
Mark Lambert
f0a1fa8a67 DBZ-4669 Use the newer version of plugins to consolidate remaining duplicates plugin versions 2023-01-11 06:44:53 +01:00
Mark Lambert
e5d16b14a6 DBZ-2439 Remove redundant modifiers 2023-01-11 06:44:53 +01:00
harveyyue
d941bc928b DBZ-5966 Truncate records incompatible with ExtractNewRecordState 2023-01-05 13:51:35 +01:00
Jiri Pechanec
26bcb67cdc DBZ-5967 Provide additional checks 2023-01-05 08:12:21 +01:00
mfvitale
c2d7d82d30 DBZ-5967: Fix negative partition number in ComputePartition SMT 
Also improved check on configuration consistency to avoid 0 as partition number.
 2023-01-05 08:12:21 +01:00
Debezium Builder
cf1720e4cb [maven-release-plugin] prepare for next development iteration 2022-12-22 10:11:54 +00:00
Debezium Builder
b4ea9b46cd [maven-release-plugin] prepare release v2.1.0.Final 2022-12-22 10:11:53 +00:00
harveyyue
6d70bf7b9d DBZ-5344 Add complex json array test case to EventRouterTest 2022-12-19 12:24:24 +01:00
harveyyue
348e77d334 DBZ-5946 Print the readable data class name in JdbcValueConverters.handleUnknownData 2022-12-19 11:02:38 +01:00
Debezium Builder
177a60a9d3 [maven-release-plugin] prepare for next development iteration 2022-12-16 09:33:38 +00:00
Debezium Builder
f805db8c3c [maven-release-plugin] prepare release v2.1.0.Beta1 2022-12-16 09:33:38 +00:00
Vojtech Juranek
1c0300cf2a DBZ-5838 Disable schema caching 
While documentation says that schema caching is disabled by default,
which would everyone sane assume anyway, it's actually turned of and
clean result in very strange test failures.

See also https://github.com/Apicurio/apicurio-registry/issues/2997
 2022-12-12 14:44:05 +01:00
mfvitale
4c941b63ed DBZ-5847: Add support for all connectors 
Support for qualified table names
 2022-12-12 14:40:56 +01:00
Marcelo Avancini
7754163c5d DBZ-2432: Fixing misuse of assertj 
- Some usages of assertj was not callig the actual assert of the DSL, fixing it
- Changing the Assertions to be staticlly imported
 2022-12-08 13:10:26 +01:00
Jiri Pechanec
97ea30f25d DBZ-5893 Mask connection string in connector option logging 2022-12-07 08:41:34 +01:00
jcechace
2468d73783 DBZ-5893 Masking credentials in connection string when logging 2022-12-07 05:45:58 +01:00
Debezium Builder
81896ed334 [maven-release-plugin] prepare for next development iteration 2022-11-30 07:52:24 +00:00
Debezium Builder
1aac97b87c [maven-release-plugin] prepare release v2.1.0.Alpha2 2022-11-30 07:52:23 +00:00
Jiri Pechanec
f50ed10377 DBZ-5796 Fix typo in test description 2022-11-16 14:55:01 +01:00
harveyyue
b124d91a93 DBZ-5796 For outbox transformation, when 'table.expand.json.payload' is set to true null values are not correctly deserialized 2022-11-16 14:55:01 +01:00
Debezium Builder
e311dd1a67 [maven-release-plugin] prepare for next development iteration 2022-11-10 13:29:06 +00:00
Debezium Builder
e3bf53440a [maven-release-plugin] prepare release v2.1.0.Alpha1 2022-11-10 13:29:05 +00:00
Anil Dasari
c781832f41 DBZ-5822 Change visibility of BaseSourceTask#logStatistics method to protected 2022-11-10 08:02:48 +01:00
Chris Cranford
1d9a21bb85 DBZ-5759 Log per topic record counts 2022-11-10 07:31:28 +01:00
Vojtech Juranek
96e4326d35 DBZ-2131 Use system property to determine if Apicurio should be used 2022-11-09 08:44:45 +01:00
Vojtech Juranek
41d3d7d155 DBZ-2131 Run tests with Apicurio registry 
When Apicurio profile is used and container with Apicurio started, use
Apicurio registry in the tests. Fall back to in-memory Confluent
registry otherwise.
 2022-11-09 08:44:45 +01:00
harveyyue
e6f0551451 DBZ-5801 The merge method of configuration is not work 2022-11-08 14:19:51 +01:00
jcechace
f46c127d11 DBZ-5779 Migrated debezium-core to AssertJ 2022-11-02 08:50:26 +01:00
Chris Cranford
dc5de5ae87 DBZ-5760 Only log full row data at TRACE level 2022-10-26 08:13:34 +02:00
Chris Cranford
c9084dd3f7 DBZ-5615 Mask apicurio registry credentials 2022-10-25 05:48:54 +02:00
Chris Cranford
a0299ec594 DBZ-5615 Mask schema registry credentials 2022-10-25 05:48:54 +02:00
Jiri Pechanec
ad2733eb1a DBZ-5727 Simplify checking of column filter presence 2022-10-20 12:47:47 +02:00
harveyyue
0e9bd53629 DBZ-5727 Columns are not excluded when doing incremental snapshots 2022-10-20 12:47:47 +02:00
Jiri Pechanec
8a02907576 DBZ-5610 Truncate events are not emitted by every connector 2022-10-20 08:57:28 +02:00
harveyyue
a37d3332df DBZ-5610 MySQL Connector capture TRUNCATE command as message in table topic 2022-10-20 08:57:28 +02:00
Debezium Builder
4d35fb8011 [maven-release-plugin] prepare for next development iteration 2022-10-14 11:26:32 +00:00
Debezium Builder
7bd1551c99 [maven-release-plugin] prepare release v2.0.0.Final 2022-10-14 11:26:32 +00:00
harveyyue
299f93afd7 DBZ-5709 The DDL_FILTER of SchemaHistory doesn't work for including break lines ddl statement 2022-10-14 09:21:40 +02:00