Commit Graph

780 Commits

Author SHA1 Message Date
Kate
992ae537c8 DBZ-4244 Quote signal table name in MySQL connector 2021-11-10 10:18:26 +01:00
Chris Cranford
5ec9381702 DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL) 2021-11-10 09:43:25 +01:00
Sergei Morozov
b2df15cf39 DBZ-4245: Handle SQL Server connection errors during database state transition 2021-11-05 20:20:15 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Juan Fiallo
63367c614a DBZ-4231 Remove SqlServerConnector database.user Required Validator 2021-11-02 14:48:51 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4 DBZ-2975 Using Offsets in recover() contract;
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
Mike Kamornikov
16c07e915b DBZ-2975: Recover database schema from multiple partitions 2021-11-01 10:17:49 +01:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
Gunnar Morling
c8d6a39c79 DBZ-4125 Removing some redundant code 2021-10-19 15:29:56 +02:00
Gunnar Morling
adba67a2c5 DBZ-4125 Asserting database name in change events;
Using assertThat() statically imported.
2021-10-19 15:29:56 +02:00
Gunnar Morling
e5ceddca2f DBZ-4125 Dropping correct database 2021-10-19 15:29:56 +02:00
cburch824
5209fbc9bb DBZ-4125 update testDB variable value 2021-10-19 15:29:56 +02:00
cburch824
1de72deafa DBZ-4125 Add test covering special characters in database name
DBZ-4125 Remove unused import

DBZ-4125 Clean up variable usage
2021-10-19 15:29:56 +02:00
cburch824
766139ab05 DBZ-4125 Fix sqlserver connection database name placeholder
Add copyright name and alias name
2021-10-19 15:29:56 +02:00
Juan Fiallo
346e0f3af2 DBZ-3517 Making database.user optional for SQL Server.
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Juan Fiallo
5ac93ac20e DBZ-3517 Making database.user optional for SQL Server.
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Juan Fiallo
e041b599d8 DBZ-3517 Making database.user optional for SQL Server.
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Gunnar Morling
ae1ba98591 DBZ-4082 Logging debug info 2021-10-14 15:42:09 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Gunnar Morling
ea75b5b12b DBZ-4082 Awaiting connector start-up 2021-10-04 13:16:42 +02:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00
Gunnar Morling
3671c3f4d6 DBZ-3346 Expanding SQL Server connector error handler 2021-09-29 10:11:30 +02:00
Debezium Builder
bec0b6b67e [maven-release-plugin] prepare for next development iteration 2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725 [maven-release-plugin] prepare release v1.7.0.CR2 2021-09-23 06:31:25 +00:00
Jiri Pechanec
26d0e78023 DBZ-4013 Skip invalid table 2021-09-17 14:20:42 +02:00
Debezium Builder
c15e0b303b [maven-release-plugin] prepare for next development iteration 2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121 [maven-release-plugin] prepare release v1.7.0.CR1 2021-09-16 08:10:44 +00:00
Gunnar Morling
18a23b19c3 DBZ-4001 Removing constructor only required for tests 2021-09-15 14:21:02 +02:00
Yuan Zhang
fbf56a976d DBZ-4001 Using connection factory when validating SQL Server connector config 2021-09-15 14:16:39 +02:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Debezium Builder
2ce6bcb2ab [maven-release-plugin] prepare for next development iteration 2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423 [maven-release-plugin] prepare release v1.7.0.Beta1 2021-08-25 05:20:56 -04:00
Jiri Pechanec
2c49b0277e DBZ-3229 Increase wait time; do not rely on record delivery in case of failure 2021-08-24 16:34:58 +02:00
Jiri Pechanec
12c20fad53 DBZ-2398 Handle more than one transaction in the list 2021-08-24 16:33:57 +02:00
Gunnar Morling
9a88011718 DBZ-2975 Avoiding redundant log message 2021-08-23 12:01:11 +02:00
Mike Kamornikov
37a4523685 DBZ-2975: Use fully-qualified table and procedure names
Co-authored-by: Sergei Morozov <morozov@tut.by>
2021-08-23 12:01:11 +02:00
Sergei Morozov
3f9b5b5e17 DBZ-2975: Remove unused SqlServerConnection methods 2021-08-23 12:01:11 +02:00
Sergei Morozov
b06b5aecbc DBZ-2975: Introduce opt-in configuration for multi-partition mode 2021-08-23 12:01:11 +02:00
Sergei Morozov
680b6438f5
DBZ-3823 Avoid connectivity errors during task start in SQL Server connector;
* Deferring DB-related logic to poll() (so to benefit from retries) or the connector itself
* Removeing dependency of SourceTimestampMode on SqlServerConnection
* More generic connection error handling
2021-08-18 23:05:30 +02:00
Sergei Morozov
8252b19abc DBZ-3479: Rework handling timezones in SQL Server connector 2021-08-17 22:16:56 +02:00
Jiri Pechanec
11e3ef4325 DBZ-3857 Exclude database name in snapshot tables filtering 2021-08-16 14:12:53 +02:00
Jiri Pechanec
60900290f1 DBZ-3228 Make sure to change db in streaming 2021-08-11 17:09:22 +02:00
Sergei Morozov
a40ad7132d DBZ-2975: Remove partition from offset context 2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12 DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets 2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52 DBZ-2975: Move Partition to io.debezium.pipeline.spi 2021-08-11 07:34:37 +02:00
Debezium Builder
d3c4482d06 [maven-release-plugin] prepare for next development iteration 2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426 [maven-release-plugin] prepare release v1.7.0.Alpha1 2021-07-30 02:39:08 -04:00
Kate
9b66ab374a DBZ-3577 Support read-only MySQL incremental snapshots 2021-07-29 07:10:46 +02:00
Chris Cranford
ed31ea9ffb DBZ-3668 Adjust ServiceLoader for SPI change 2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d DBZ-3668 Extracting SPI package 2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110 DBZ-3668 Add ServiceLoader hook CloudEvents converter 2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba DBZ-2975: Add partition awareness to source task components
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Debezium Builder
9d3f6b2a86 [maven-release-plugin] prepare for next development iteration 2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56 [maven-release-plugin] prepare release v1.6.0.Final 2021-06-30 03:45:06 -04:00
Debezium Builder
ae053414ac [maven-release-plugin] prepare for next development iteration 2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74 [maven-release-plugin] prepare release v1.6.0.CR1 2021-06-24 01:50:07 -04:00
Hossein Torabi
cbf2abaaf2 DBZ-2697 Optimisation on SQLServer connector for skipped.operations 2021-06-21 15:52:35 +02:00
Jiri Pechanec
02640df975 DBZ-3597 Re-use the CDC wait test code 2021-06-10 17:55:50 +02:00
Jiri Pechanec
c2086d7104 DBZ-3597 Remove non-captured colmuns from PK 2021-06-10 17:55:50 +02:00
Debezium Builder
48ca58a609 [maven-release-plugin] prepare for next development iteration 2021-06-10 06:03:12 -04:00
Debezium Builder
0961517859 [maven-release-plugin] prepare release v1.6.0.Beta2 2021-06-10 06:03:12 -04:00
Gunnar Morling
1ce65fa628 DBZ-2975 Avoiding raw types in some places;
Also parameterizing offset loader contract, so to avoid casts later on.
2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542 DBZ-2975: Extract offset context from object states to method signatures 2021-06-09 16:02:33 +02:00
Jiri Pechanec
5fbebf7593
DBZ-3515 Execute periodic TX commits
* DBZ-3515 Execute periodic TX commits

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-05-26 12:52:25 +02:00
Sergei Morozov
dd23e0faad DBZ-3486: Limit number of processed transactions per iteration 2021-05-25 07:19:43 +02:00
Sergei Morozov
3b72e5149c DBZ-3486: Replace @see with @link where a URL is referenced 2021-05-25 07:19:43 +02:00
Debezium Builder
ead4ee7226 [maven-release-plugin] prepare for next development iteration 2021-05-20 19:07:44 +02:00
Debezium Builder
9e16df7d4b [maven-release-plugin] prepare release v1.6.0.Beta1 2021-05-20 19:07:44 +02:00
Jiri Pechanec
90738f53a6 DBZ-3500 Incremental snapshots for SQL Server 2021-05-20 08:06:37 +02:00
Sergei Morozov
ec252a787d DBZ-3452: Deprecate source.timestamp.mode=processing 2021-05-18 20:57:25 +02:00
Vadzim Ramanenka
7adfaba483 DBZ-3452: source.timestamp.mode=commit imposes a significant performance penalty
Fetch LSN's timestamps along with the CDC data.
2021-05-18 20:57:25 +02:00
SiuFay
d96c3138d6 DBZ-3339 Allow retry for transient error in SqlServerConnection.retrieveRealDatabaseName() 2021-05-17 14:06:47 +02:00
Jiri Pechanec
95ed8149c1 DBZ-3339 Connection refused can be retried 2021-05-13 08:06:00 -04:00
Sergei Morozov
e90196989b DBZ-3505: Better handling of invalid SQL Server connector configuration 2021-05-12 06:03:22 +02:00
Debezium Builder
4dd3a146ca [maven-release-plugin] prepare for next development iteration 2021-05-06 02:40:15 -04:00
Debezium Builder
b3c5bb281c [maven-release-plugin] prepare release v1.6.0.Alpha1 2021-05-06 02:40:15 -04:00
Jiri Pechanec
8b0428404b DBZ-3473 SQL Server field moved reading to connection 2021-05-06 05:37:36 +02:00
Gunnar Morling
dc02b896cd DBZ-3449 Moving QA releated plug-ins to separate profile, so to avoid loading them at all 2021-04-28 15:14:05 +02:00
Gunnar Morling
8f891248ad DBZ-3429 Making option retrieval lenient towards trailing/leading whitespace 2021-04-28 11:01:27 +02:00
Anisha Mohanty
f0f8d5d180 DBZ-3161 Refactor/Rename all references of MonitoredTables to CapturedTables 2021-04-26 13:07:23 +02:00
Gunnar Morling
2088c035b1 DBZ-3449 Adding "quick" profile 2021-04-26 06:09:14 +02:00
Anisha Mohanty
1e9630b19d DBZ-3379 Use current SQL Server container image 2021-04-08 15:07:25 +02:00
Hossein Torabi
5d6705c3fe DBZ-2699 implement skipped.operation in core 2021-04-08 11:59:08 +02:00
Debezium Builder
8a88ba9b45 [maven-release-plugin] prepare for next development iteration 2021-04-08 04:04:00 -04:00
Debezium Builder
74152afe74 [maven-release-plugin] prepare release v1.5.0.Final 2021-04-08 04:04:00 -04:00
Chris Cranford
776180a0df DBZ-3347 Emit schema change events with correct source partition 2021-03-30 07:26:06 +02:00
JLDLaughlin
06b0475f17 DBZ-2911 Add additional LSN information to all sources
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00
Debezium Builder
6b4d88bb51 [maven-release-plugin] prepare for next development iteration 2021-03-24 06:35:02 -04:00
Debezium Builder
c578715233 [maven-release-plugin] prepare release v1.5.0.CR1 2021-03-24 06:35:02 -04:00
Jiri Pechanec
495be2659b DBZ-2511 Dedicated logger for schema name adjuster 2021-03-18 14:42:34 +01:00
Gunnar Morling
911b5e9a3b DBZ-3271 Unifying filter handling across relational connectors 2021-03-17 09:54:25 +01:00
Debezium Builder
f57057421b [maven-release-plugin] prepare for next development iteration 2021-03-12 04:38:17 -05:00
Debezium Builder
b57293013a [maven-release-plugin] prepare release v1.5.0.Beta2 2021-03-12 04:38:16 -05:00
Jiri Pechanec
123d9ef4eb DBZ-3213 Refactor Maven structure to deploy support modules 2021-03-11 16:14:15 +01:00
Gunnar Morling
4d61c57206 DBZ-3157 Adding test 2021-03-11 16:10:08 +01:00
Jiri Pechanec
9a5c605a7f DBZ-2417 Order returned values for clustered index cases 2021-03-08 11:24:53 +01:00
Debezium Builder
b4c260da50 [maven-release-plugin] prepare for next development iteration 2021-02-23 14:04:01 -05:00
Debezium Builder
123a711a6d [maven-release-plugin] prepare release v1.5.0.Beta1 2021-02-23 14:04:01 -05:00
Chris Cranford
85f7688527 DBZ-3151 Add filter hook for table unique index resolution 2021-02-22 15:19:25 +01:00
Fahim Farook
194258d87b
DBZ-3164 Log database connection validation failures consistently 2021-02-22 14:52:22 +01:00
Yilong Chang
a0b3704832 DBZ-3056 Validate all fields in subclasses. 2021-02-16 12:34:06 +01:00
Yilong Chang
76c7e0d426 DBZ-3056 Extract basic valdiation in parent class. 2021-02-16 12:34:06 +01:00
Yilong Chang
938aa48ac2 DBZ-3056 Change log level to debug for validation success/error. 2021-02-16 12:34:06 +01:00
Yilong Chang
c004663418 DBZ-3056 Fix format. 2021-02-16 12:34:06 +01:00
Yilong Chang
d98488b376 DBZ-3056 Add validation for SQL Server connector. 2021-02-16 12:34:06 +01:00
Debezium Builder
e08df0a177 [maven-release-plugin] prepare for next development iteration 2021-02-06 01:25:23 -05:00
Debezium Builder
da0411bf70 [maven-release-plugin] prepare release v1.5.0.Alpha1 2021-02-06 01:25:23 -05:00
Jiri Pechanec
2374b6b045 DBZ-1865 First draft of MySQL rewrite 2021-02-04 09:07:55 +01:00
ani-sha
d4003c9172 DBZ-2420 Define database configs under RelationalDatabaseConnectorConfig 2021-02-03 08:05:42 +01:00
Debezium Builder
237b4ac0f1 [maven-release-plugin] prepare for next development iteration 2021-01-28 07:38:55 -05:00
Debezium Builder
06b1d0cbad [maven-release-plugin] prepare release v1.4.1.Final 2021-01-28 07:38:55 -05:00
siufay325
3d02eb47ac DBZ-2959 Retry on "The server failed to resume the transaction" 2021-01-25 12:30:34 +01:00
ani-sha
040ec49e90 DBZ-2945 Rename local vars 2021-01-19 16:27:35 +01:00
Gunnar Morling
e342158fa0 DBZ-2698 Using char instead of String 2021-01-19 08:50:31 +01:00
Giovanni De Stefano
8cd2da3bfb DBZ-2698 Added support for null default value for types int, bigint, smallint, tinyint, float, real 2021-01-18 18:04:34 +01:00
zxxz
1875826d3a DBZ-2698 Added support for null default value for types int, bigint, smallint, tinyint, float, real 2021-01-18 17:55:56 +01:00
Sergei Morozov
fa1ad8065d DBZ-2912: Add support for binary.handling.mode to the SQL Server connector 2021-01-16 10:58:06 +01:00
Debezium Builder
3010f99c32 [maven-release-plugin] prepare for next development iteration 2021-01-07 03:38:13 -05:00
Debezium Builder
54534538d9 [maven-release-plugin] prepare release v1.4.0.Final 2021-01-07 03:38:13 -05:00
Debezium Builder
b1ab996c3e [maven-release-plugin] prepare for next development iteration 2020-12-16 14:11:31 -05:00
Debezium Builder
8fc864b278 [maven-release-plugin] prepare release v1.4.0.CR1 2020-12-16 14:11:31 -05:00
Debezium Builder
cf921f56b4 [maven-release-plugin] prepare for next development iteration 2020-12-10 00:27:40 -05:00
Debezium Builder
c49a377487 [maven-release-plugin] prepare release v1.4.0.Beta1 2020-12-10 00:27:39 -05:00
Thierry De Leeuw
82077bbbb6 DBZ-2767 - MS SQL Decimal with default value not matching the scale of the column definition cause exception 2020-11-20 08:50:29 +01:00
Debezium Builder
4535549dcd [maven-release-plugin] prepare for next development iteration 2020-11-16 15:18:43 -05:00
Debezium Builder
3c70c5f7d5 [maven-release-plugin] prepare release v1.4.0.Alpha2 2020-11-16 15:18:43 -05:00
vanhoale
17a424d9ac DBZ-2662 Handle ChangeEventQueue by the size in bytes 2020-11-16 08:39:33 +01:00
Jiri Pechanec
6d6d0a3888 DBZ-2747 Disable unstable corner case test 2020-11-12 18:48:17 +01:00
Jiri Pechanec
3b1f3e7454 DBZ-2625 Retry on transaction deadlock
When CDC is reconfigured while connector is running it is possbile to
end up in tx deadlock. Such situation is only temporary and connector
could recover from it upon restart.
2020-11-10 10:01:51 -05:00
Jiri Pechanec
c41aa0e70f DBZ-2625 Make out-of-sync LSN retriable
When the CDC is disabled and enabled during the connector runtime then
the LSNs obtained by connector from min/max queries can get out of sync
with CDCs stored in the table. This issue is solved when connector is
restarted.
2020-11-10 10:01:51 -05:00
Jiri Pechanec
9001946073 DBZ-2716 Guard against missing position mapping 2020-11-10 09:59:41 -05:00
Hussain
c58b3123fc DBZ-2727: Added exceptio to retry when there is Write failed 2020-11-05 10:07:55 +01:00
Chris Cranford
6bc01a1660 DBZ-2625 Fix intermittent failures in SqlServerConnectorIT 2020-10-28 14:31:53 +01:00
Debezium Builder
26883dad92 [maven-release-plugin] prepare for next development iteration 2020-10-22 03:45:59 -04:00
Debezium Builder
9adbc2d67e [maven-release-plugin] prepare release v1.4.0.Alpha1 2020-10-22 03:45:59 -04:00
Jiri Pechanec
ee5353ef6f DBZ-2653 Process commits even with tx monitoring 2020-10-20 10:42:10 +02:00
James Gormley
bea46a3059 DBZ-2582 Fixing LSN casing 2020-10-19 09:19:54 +02:00
James Gormley
3d8714d6dd DBZ-2582 Adding boolean check and removing TODO as no changes are necessary 2020-10-19 09:19:54 +02:00
James Gormley
da03b4b5b6 DBZ-2582 Updating test for consistency 2020-10-19 09:19:54 +02:00
James Gormley
55e68df708 DBZ-2582 Updating configuration to be feature flag and using prepared statements 2020-10-19 09:19:54 +02:00
James Gormley
67ff06df95 DBZ-2582 Apply suggestions from code review
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2020-10-19 09:19:54 +02:00
James Gormley
f4b76a79c6 DBZ-2582 Adding copyright 2020-10-19 09:19:54 +02:00
James Gormley
bac39cf55a DBZ-2582 Fixing tests and adding pause back 2020-10-19 09:19:54 +02:00
James Gormley
6d68bb02de DBZ-2582-lsn-changes revert log change 2020-10-19 09:19:54 +02:00
James Gormley
4637425598 DBZ-2582 Updating LSN handling 2020-10-19 09:19:54 +02:00
Kaushik Iyer
7d9e8fdc46 DBZ-2456 fixes after rebase 2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932 DBZ-2456 selective snapshot implementation 2020-10-16 10:13:48 +02:00
Jiri Pechanec
c5a595c0f1 DBZ-2642 Hide scary stacktrace 2020-10-08 15:04:51 +02:00
Debezium Builder
95b8ed3877 [maven-release-plugin] prepare for next development iteration 2020-10-01 09:08:51 -04:00
Debezium Builder
19ad73beb2 [maven-release-plugin] prepare release v1.3.0.Final 2020-10-01 09:08:50 -04:00
Gunnar Morling
b792ac3274 DBZ-2495 Misc. fixes 2020-09-30 12:13:45 +02:00
James Gormley
b0a4a8b5ba DBZ-2495 Making test slightly more stable 2020-09-30 12:13:45 +02:00
Gunnar Morling
6b5a3100e9 DBZ-2495 Misc. clean-up 2020-09-30 12:13:45 +02:00
James Gormley
9e780ac481 DBZ-2495 Updating per PR comments 2020-09-30 12:13:45 +02:00
James Gormley
ede29fd8d6 DBZ-2495 Moving string splitting logic out of constructor 2020-09-30 12:13:45 +02:00
James Gormley
1b845535ab DBZ-2495 Updating tables to utilize Table.editor for creating new tables 2020-09-30 12:13:45 +02:00
James Gormley
ad2273e9f6 DBZ-2495 Updating per PR comments 2020-09-30 12:13:45 +02:00
James Gormley
c7b53e1992 DBZ-2495 Updating docs and comments 2020-09-30 12:13:45 +02:00
James Gormley
0d46ec47da DBZ-2495 Updating to handle captured_column_list without specify column.exclude.list 2020-09-30 12:13:45 +02:00
Chris Cranford
500d197d94 DBZ-2474 Fix test failure - DatatypesFromSnapshotIT#stringTypes 2020-09-28 22:54:34 +02:00
Chris Cranford
c4d1772aee DBZ-2599 Fix test failure - SQLServerConnectorIT#verifyOffsets 2020-09-24 22:36:32 +02:00
Debezium Builder
b146b69154 [maven-release-plugin] prepare for next development iteration 2020-09-24 04:56:42 -04:00
Debezium Builder
c51cfe8eb9 [maven-release-plugin] prepare release v1.3.0.CR1 2020-09-24 04:56:41 -04:00
Debezium Builder
837669890a [maven-release-plugin] prepare for next development iteration 2020-09-16 12:18:08 -04:00
Debezium Builder
086dbd960b [maven-release-plugin] prepare release v1.3.0.Beta2 2020-09-16 12:18:08 -04:00
James Gormley
6d0d60a326 DBZ-2522 Implementing column.include.list for sql server 2020-09-16 07:54:46 +02:00
James Gormley
45e44a2a1b DBZ-2522 Using updated terminology in test cases 2020-09-16 07:54:46 +02:00
James Gormley
b658375a3d DBZ-2522 Fixing EventProcessingFailureHandlingIT 2020-09-16 07:54:46 +02:00
James Gormley
5d1ef9a03d DBZ-2522 Fixing index out of bounds for columns excluded from cdc tables 2020-09-16 07:54:46 +02:00
Chris Cranford
8a12245c94 DBZ-137 DBZ-2283 Exclude filtered columns in SQL Server snapshot 2020-09-14 12:33:43 +02:00
Chris Cranford
a686c1c875 DBZ-137 Suggested changes 2020-09-14 12:33:43 +02:00
Chris Cranford
5ca36a84ad DBZ-137 Reimagine stream.fetch.size as query.fetch.size 2020-09-14 12:33:43 +02:00
Chris Cranford
974eca52af DBZ-137 Fix SQL Server test failures 2020-09-14 12:33:43 +02:00
Chris Cranford
43440ca76f DBZ-137 Remove snapshot.skip.locks for SQL Server 2020-09-14 12:33:43 +02:00
Chris Cranford
3f78f40fb4 DBZ-137 Introduce streaming.fetch.size for SQL Server. 2020-09-14 12:33:43 +02:00
AndreyIg
77662a0dde DBZ-137 contribution to the core, Oracle related 2020-09-14 12:33:43 +02:00
Gunnar Morling
a3dffc1df5 DBZ-1068 Doc updates, adjusting to renamed option name 2020-09-04 12:11:51 +02:00
Gunnar Morling
98615e5d40 DBZ-1068 Removing commented code 2020-09-04 12:06:57 +02:00
Guy
f91ffddd8b DBZ-1068 Fix for Error Handling ITs 2020-09-04 12:06:57 +02:00
Grzegorz Kołakowski
c74579c1df DBZ-1068 Forward port the work by @grzegorz8 to master
Co-authored-by: GuyIEX <gpascarella@ironeaglex.com>
2020-09-04 12:06:57 +02:00
Debezium Builder
9979db648f [maven-release-plugin] prepare for next development iteration 2020-08-28 05:04:26 -04:00
Debezium Builder
5c58b23756 [maven-release-plugin] prepare release v1.3.0.Beta1 2020-08-28 05:04:26 -04:00
Jiri Pechanec
d9f616caed DBZ-2303 Set source when new table detected 2020-08-24 13:08:09 +02:00
rkerner
2c5c093587 DBZ-2171 avoid divisive language 2020-08-21 09:29:04 +02:00
Gunnar Morling
dac7f3998c DBZ-2412 Housekeeping;
* Static logger
* Protecting against empty topic name
* Removing unused logger
2020-08-13 13:53:50 -04:00
Gunnar Morling
44efd1bc6b DBZ-2423 Propagating port default values 2020-08-12 13:50:42 +02:00
Debezium Builder
c4c50f5fc6 [maven-release-plugin] prepare for next development iteration 2020-08-06 00:46:18 -04:00
Debezium Builder
94cbeb95fa [maven-release-plugin] prepare release v1.3.0.Alpha1 2020-08-06 00:46:17 -04:00
Chris Cranford
00463e10c0 DBZ-2332 Fix test failures with Kafka 1.x CI
MySqlDecimalIT#testPreciseDecimalHandlingMode
SqlServerConnectorIT#restartInTheMiddleOfTx
2020-08-04 23:21:23 +02:00
Gunnar Morling
e12cf2db5b DBZ-2389 Using Testing.Debug instead of System.out.println() 2020-08-03 11:05:48 +02:00
Chris Cranford
a2dfd00586 DBZ-2389 Fix test failure - TablesWithoutPrimaryKeyIT#shouldProcessFromStreaming 2020-08-03 11:00:17 +02:00
Chris Cranford
66ff56f5eb DBZ-2389 Fix test failure - SqlServerChangeTableSetIT#addDefaultValue 2020-08-03 11:00:17 +02:00
Chris Cranford
6285540d60 DBZ-2379 SnapshodeMode.INITIAL_ONLY support 2020-07-28 12:32:30 +02:00
Jiri Pechanec
5fcb221993 DBZ-1491 Database connection provides default value 2020-07-24 09:07:09 +02:00
Jiri Pechanec
45a6f9bef1 DBZ-1491 Refactor after review 2020-07-24 09:07:09 +02:00
Grzegorz Kołakowski
825ffe3848 DBZ-1491 Add SqlServerDefaultValueConverter class 2020-07-24 09:07:07 +02:00
Grzegorz Kołakowski
234341a471 DBZ-1491 Parse temporal values using queries on database
* Add tests for altering column default value
 * Add end-to-end test
2020-07-24 09:06:30 +02:00
Grzegorz Kołakowski
a8ea5e2256 DBZ-1491 Extract default values from schema
The goal is to enrich schema metadata with column default value.
2020-07-24 09:05:58 +02:00
Gunnar Morling
3ebfbcefdb DBZ-2329 Moving isNewTransaction() to SQL Server implementation 2020-07-24 07:57:50 +02:00
Jiri Pechanec
8b0125e429 DBZ-2373 Azure product name breaks version check 2020-07-23 16:38:33 +02:00
Lukasz Korzeniowski
1ada5c4b23 DBZ-2329 Do not skip events after restart when stream is not monotonic 2020-07-21 14:21:29 +02:00
Debezium Builder
e1ab38de84 [maven-release-plugin] prepare for next development iteration 2020-07-16 04:40:04 -04:00
Debezium Builder
69cf375faa [maven-release-plugin] prepare release v1.2.1.Final 2020-07-16 04:40:04 -04:00
Chris Cranford
25e1b1e4f2 DBZ-2331 Fix test failure - SnapshotIT#takeSnapshotWithOldStructAndStartStreaming 2020-07-14 17:22:11 +02:00
Chris Cranford
95f3562857 DBZ-2324 Suggested changes 2020-07-10 17:30:11 +02:00
Chris Cranford
207276800b DBZ-2324 Fix test failure - TablesWithoutPrimaryKeyIT#shouldProcessFromStreaming 2020-07-10 17:30:11 +02:00
Chris Cranford
2f71e92a82 DBZ-2325 Fix test failure - SqlServerConnectorIT#readOnlyApplicationIntent 2020-07-10 17:00:22 +02:00
Chris Cranford
5affa8cbab DBZ-2231 Use Awaitility in waitForXXX helper methods 2020-07-09 08:21:00 +02:00
Chris Cranford
0486b40540 DBZ-2231 Fix test failure - SqlServerChangeTableSetIT#readHistoryAfterRestart 2020-07-09 08:21:00 +02:00
Chris Cranford
4b64791a01 DBZ-2220 Fix test failure - SqlServerConnectorIT#verifyOffsets 2020-07-03 05:51:27 +02:00
Chris Cranford
61aa659116 DBZ-2217 Fix test failure - TransactionMetadataIT#restartInTheMiddleOfTxAfterSnapshot 2020-07-02 22:23:09 +02:00
Debezium Builder
c0d30b87d9 [maven-release-plugin] prepare for next development iteration 2020-06-24 18:03:11 +02:00
Debezium Builder
0e2ac78301 [maven-release-plugin] prepare release v1.2.0.Final 2020-06-24 18:03:11 +02:00
Jiri Pechanec
98c270a79e DBZ-2211 Harden test against potential extra schema event 2020-06-23 17:13:26 +02:00
Jiri Pechanec
3477290e80 DBZ-2261 Prolong waiting for tx to change 2020-06-23 09:21:56 +02:00
Debezium Builder
b03a4d0e50 [maven-release-plugin] prepare for next development iteration 2020-06-19 00:39:01 -04:00
Debezium Builder
93e60258d5 [maven-release-plugin] prepare release v1.2.0.CR2 2020-06-19 00:39:00 -04:00
Gunnar Morling
f3b07a1374 DBZ-1916 Formatting 2020-06-16 13:28:49 +02:00
Chris Cranford
64bff85ad2 DBZ-1916 Add tests for datatype.propagate.source.type 2020-06-16 13:28:49 +02:00
Jiri Pechanec
3b5b850327 DBZ-2120 Apply to refactored change table 2020-06-16 08:19:29 +02:00
linhnh
39ccfeb013 DBZ-2120 move check null logic in query to java code 2020-06-16 08:19:29 +02:00
Debezium Builder
65c39e9f11 [maven-release-plugin] prepare for next development iteration 2020-06-11 02:00:20 -04:00
Debezium Builder
bce332c900 [maven-release-plugin] prepare release v1.2.0.CR1 2020-06-11 02:00:19 -04:00
Chris Cranford
845a790593 DBZ-2060 Fix intermittent test failures (sqlserver & postgres) 2020-06-05 20:02:14 +02:00
Jeremy Finzel
5db614da21 DBZ-1814 added new binary handling mode option 2020-06-05 12:13:29 +02:00
Jiri Pechanec
8e7f3d14ca DBZ-1312 Omit constatnt db name in column and key mappers 2020-06-01 12:43:45 +02:00
Chris Cranford
a19d3960f0 DBZ-2106 Fix formatting 2020-05-21 14:08:01 -04:00
cobolbaby
0139441b09 DBZ-2106 Improve SQL Server reconnect exception handling 2020-05-21 12:51:37 -04:00
Debezium Builder
dc25c379e5 [maven-release-plugin] prepare for next development iteration 2020-05-19 03:40:25 -04:00
Debezium Builder
ad060181b9 [maven-release-plugin] prepare release v1.2.0.Beta2 2020-05-19 03:40:25 -04:00
Jiri Pechanec
fd2d7a1988 DBZ-1988 Stabilize test 2020-05-19 08:24:16 +02:00
Gunnar Morling
f1cfb3313f DBZ-1988 Misc clean-up;
* Adding integration test
* Actually applying option
2020-05-18 16:41:37 +02:00
Juan Antonio Pedraza
5f7ba1da5d DBZ-1988: Skip LSN timestamp query when using Oracle CDC jobs 2020-05-18 16:41:37 +02:00
Jiri Pechanec
97c3d3b6e9 DBZ-2088 Use POSIX tar 2020-05-18 14:29:38 +02:00
Gunnar Morling
043f1c4101 DBZ-2078 Making EventProcessingFailureHandlingIT resilient against timing issues 2020-05-15 17:43:28 +02:00
Chris Cranford
f449550b2d DBZ-2068 Skip tests incompatible with Kafka 1.x 2020-05-13 08:22:07 +02:00
Debezium Builder
8d4203279e [maven-release-plugin] prepare for next development iteration 2020-05-07 05:03:40 -04:00
Debezium Builder
a4e2c8f36c [maven-release-plugin] prepare release v1.2.0.Beta1 2020-05-07 05:03:40 -04:00
Gunnar Morling
9235732681 DBZ-1904 Typo and wording fixes 2020-05-04 12:31:05 +02:00
Jiri Pechanec
1b3fba4b8c DBZ-1904 Add drop table support 2020-05-04 12:31:05 +02:00
Jiri Pechanec
e350d74b17 DBZ-1904 Public facing schema history topic 2020-05-04 12:31:05 +02:00
Chris Cranford
a6d1383122 DBZ-2030 Use Awaitility to manage database drops 2020-04-29 08:44:43 +02:00
Gunnar Morling
8b2448440b Revert "DBZ-2025 Reduce capture job poll interval"
This reverts commit 131063fb2be38f865019e5dcff74b6d78299f6d2; it prove
unstable on CI.
2020-04-27 16:38:01 +02:00
Jiri Pechanec
131063fb2b DBZ-2025 Reduce capture job poll interval 2020-04-27 13:56:29 +02:00
JanHendrikDolling
33d83731af DBZ-1972 move static Filed methods as static Filed constant to RelationalDatabaseConnectorConfig instead. 2020-04-27 12:31:19 +02:00
Chris Cranford
f974f9f4ab DBZ-1753 Refactor common code between SQL Server and DB2 2020-04-24 13:45:06 -04:00
Gunnar Morling
03ce403972 DBZ-1750 Separating config definition editor and immutable config definitions 2020-04-24 15:35:28 +02:00
Jiri Pechanec
37f0dbcaf8 DBZ-1750 Limit access to parent defs; dont share the parent defs 2020-04-24 15:35:28 +02:00
Jiri Pechanec
af90507fa6 DBZ-1750 Centralize shared config definitions 2020-04-24 15:35:28 +02:00
Gunnar Morling
391fdf1231 DBZ-1923 Using Awaitility to wait for CDC being enablement 2020-04-24 12:10:17 +02:00
Jiri Pechanec
412f288e88 DBZ-1923 Detect lost database history 2020-04-24 10:22:06 +02:00
Debezium Builder
4ca9f92575 [maven-release-plugin] prepare for next development iteration 2020-04-16 02:22:00 -04:00
Debezium Builder
e704bccdaa [maven-release-plugin] prepare release v1.2.0.Alpha1 2020-04-16 02:22:00 -04:00
Chris Cranford
57af80afd5 DBZ-1859 Enhance MongoDB connector metrics 2020-04-15 08:04:23 +02:00
JanHendrikDolling
1e19270981 DBZ-1692 Added support for hash based column masking mode for string values 2020-04-08 21:21:42 +02:00
Jiri Pechanec
e81aec0ed1 DBZ-1905 Validate database history topic 2020-04-08 12:18:32 +02:00
Chris Cranford
6df5e60efd DBZ-1945 Remove deprecated connector option "initial_schema_only" 2020-04-07 17:23:48 +02:00
Chris Cranford
af42f5b03c DBZ-1882 Added additional retry error conditions 2020-04-07 08:52:57 +02:00
Chris Cranford
91d38a0b68 DBZ-1882 Restarting after connection losses in SQL Server 2020-04-07 08:52:57 +02:00
Debezium Builder
ab54ce062f [maven-release-plugin] prepare for next development iteration 2020-03-24 01:23:05 -04:00
Debezium Builder
0b5a9117fb [maven-release-plugin] prepare release v1.1.0.Final 2020-03-24 01:23:05 -04:00
Gunnar Morling
449154beaa DBZ-1863 Centralizing coordinator shutdown 2020-03-12 11:28:08 +01:00
Debezium Builder
86c1ed90ed [maven-release-plugin] prepare for next development iteration 2020-03-11 09:54:44 -04:00
Debezium Builder
062c6abbe5 [maven-release-plugin] prepare release v1.1.0.CR1 2020-03-11 09:54:44 -04:00
Gunnar Morling
3437da00d7 DBZ-1723 Simplifying shutdown handling;
doStop() is already called from stop(), no need to do it again via the error handler.
2020-03-11 13:57:23 +01:00
Gunnar Morling
c156d30048 DBZ-1723 Centralizing stopping() logic in BaseSourceTask 2020-03-11 13:57:23 +01:00
Gunnar Morling
8ce69dc597 DBZ-1723 Encapsulating common poll() and stop() logic in BaseSourceTask 2020-03-11 13:57:23 +01:00
Chris Cranford
6f1eb49b32 DBZ-1726 Fix formatting failures 2020-03-11 10:15:00 +01:00
Chris Cranford
3a4788cc33 DBZ-1726 Introduced AbstractSnapshotChangeEventSource and refactor implementations 2020-03-11 10:15:00 +01:00
Jiri Pechanec
06e1eca085 DBZ-1134 Support for user provided converters 2020-02-28 21:58:39 +01:00
Jiri Pechanec
be77831e7d DBZ-1778 Trigger migration only for change tables planned to discontinue 2020-02-28 07:56:44 +01:00
Jiri Pechanec
436615934d DBZ-1760 Align code and docs 2020-02-25 10:43:11 +01:00
Jiri Pechanec
2b6e50daff DBZ-1760 Allow skipping of invalid events 2020-02-25 10:43:11 +01:00
jcechace
3209de3e5f DBZ-924 Adding integration tests for OpenShift and Strimzi 2020-02-20 12:48:08 +01:00
Debezium Builder
f75746fb7b [maven-release-plugin] prepare for next development iteration 2020-02-13 03:18:20 -05:00
Debezium Builder
1d2df32743 [maven-release-plugin] prepare release v1.1.0.Beta2 2020-02-13 03:18:20 -05:00
Jiri Pechanec
c512929097 DBZ-1764 Reorg test code for stabilization 2020-02-12 18:46:08 +01:00
Gunnar Morling
dd5c2b8be9 DBZ-1766 Unifying handling of offset commits 2020-02-12 15:44:45 +01:00
Debezium Builder
9c424b2404 [maven-release-plugin] prepare for next development iteration 2020-02-05 08:54:52 -05:00
Debezium Builder
9f2caa3b7c [maven-release-plugin] prepare release v1.1.0.Beta1 2020-02-05 08:54:52 -05:00
Jiri Pechanec
4fdda6c101 DBZ-1052 Add tx enable option to connector definitions 2020-02-03 09:29:10 +01:00
Jiri Pechanec
ba10a229b6 DBZ-1052 CE support for tx metadata in data messages 2020-02-03 09:29:10 +01:00
Jiri Pechanec
0e671d6167 DBZ-1052 Add counts per table to END 2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94 DBZ-1052 Transaction block moved to envelope 2020-02-03 09:29:10 +01:00
Jiri Pechanec
0d7ce9b20e DBZ-1052 Remove suprfluous test 2020-02-03 09:29:10 +01:00
Jiri Pechanec
4867c8a298 DBZ-1052 Change TX topic name 2020-02-03 09:29:10 +01:00
Jiri Pechanec
e198cb0f45 DBZ-1052 Fix test for offset size 2020-02-03 09:29:10 +01:00
Jiri Pechanec
cd6a1f942d DBZ-1052 Transaction metadata for Postgres/pgoutput 2020-02-03 09:29:10 +01:00
Jiri Pechanec
b0eb571f9f DBZ-1052 Transaction metadata for SQL Server 2020-02-03 09:29:10 +01:00
Debezium Builder
274bba9dc9 [maven-release-plugin] prepare for next development iteration 2020-01-16 05:40:24 -05:00
Debezium Builder
076df30108 [maven-release-plugin] prepare release v1.1.0.Alpha1 2020-01-16 05:40:24 -05:00
Gunnar Morling
8c33a4e147 DBZ-1292 Catering for the differences in data schema;
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
2020-01-16 08:01:56 +01:00
Gunnar Morling
7c18a6d8d5 DBZ-1292 Removing static state in CloudEventsConverterTest 2020-01-16 08:00:45 +01:00
GraySmog
d0e4b3c0af DBZ-1292 Delete data.schema.registry.url config option 2020-01-16 08:00:45 +01:00