Commit Graph

624 Commits

Author SHA1 Message Date
Sergei Morozov
b258674782 DBZ-3535: Introduce schema.name.adjustment.mode 2022-03-24 09:37:05 +01:00
kate
4b2d5c29be DBZ-4878 Re-read incremental snapshot chunk on DDL event 2022-03-18 07:55:43 +01:00
Josh Ribera
020e845f44 DBZ-4809 Add task id and partition to the logging context for
multi-partition connectors.

Co-authored-by: Sergei Morozov <morozov@tut.by>
2022-03-09 20:46:38 +01:00
Gunnar Morling
d20a6f00e7 DBZ-4801 Using JdbcConfiguration in JdbcConnection 2022-03-07 17:53:45 +01:00
Debezium Builder
fece16039c [maven-release-plugin] prepare for next development iteration 2022-03-03 17:00:08 +00:00
Debezium Builder
e0d8a0d809 [maven-release-plugin] prepare release v1.9.0.Beta1 2022-03-03 17:00:08 +00:00
Sergei Morozov
2952b7a90f DBZ-4783: Add a multi-partition integration test 2022-03-01 14:21:39 +01:00
Sergei Morozov
d6e96a5108 DBZ-4783: Refactoring and cleanup 2022-03-01 14:21:39 +01:00
Jacob Gminder
cc11ac193a DBZ-4783: Support for multiple databases and tasks in the SQL Server connector
Co-authored-by: Sergei Morozov <morozov@tut.by>
2022-03-01 14:21:39 +01:00
Josh Ribera
fc6d55e935 DBZ-4783: Add task id label to metrics 2022-03-01 14:21:39 +01:00
Mike Kamornikov
37a67d5dcf DBZ-4783: Manage change tables per partition 2022-03-01 14:21:39 +01:00
Sergei Morozov
2d14b5b09f DBZ-4478: Multi-partition metrics for SQL Server 2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces 2022-02-16 11:31:38 +01:00
Debezium Builder
7a47f478a4 [maven-release-plugin] prepare for next development iteration 2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e [maven-release-plugin] prepare release v1.9.0.Alpha2 2022-02-09 07:23:10 +00:00
Debezium Builder
33e2f5cd0f [maven-release-plugin] prepare for next development iteration 2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e [maven-release-plugin] prepare release v1.9.0.Alpha1 2022-01-26 19:00:20 +00:00
Jiri Pechanec
664d989e42 DBZ-4577 Provide custom error message handling 2022-01-21 10:24:19 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Anisha Mohanty
d6c5ad2e7c DBZ-4460 Renaming all openapi occurrences to schema 2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f DBZ-4460 Set default values for format & output directory 2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691 DBZ-4460 Apply the plug-in to all connector modules 2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221 DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation 2022-01-06 19:03:46 +01:00
harveyyue
792187f669 DBZ-4472 Make connector task partition readability for log 2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98 [maven-release-plugin] prepare for next development iteration 2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f [maven-release-plugin] prepare release v1.8.0.Final 2021-12-16 10:11:28 +00:00
Chris Cranford
882bb9c4d4 DBZ-3306 Only emit schema changes if table schema actual changed 2021-12-11 20:39:46 +01:00
Debezium Builder
f53e6c00df [maven-release-plugin] prepare for next development iteration 2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a [maven-release-plugin] prepare release v1.8.0.CR1 2021-12-09 20:16:04 +00:00
Mark Drilling
b922e34b30 DBZ-3697 Adding metadata to fields for SQLServerConnector 2021-12-02 11:07:22 +01:00
Debezium Builder
b5439b54bf [maven-release-plugin] prepare for next development iteration 2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2 [maven-release-plugin] prepare release v1.8.0.Beta1 2021-11-30 09:38:47 +00:00
Sergei Morozov
437fe0e7bf DBZ-4273: Filter out capture instances with the same start_lsn 2021-11-24 22:08:31 +01:00
Mike Kamornikov
a7c573676f DBZ-3992: List change tables within captured LSN interval
Co-authored-by: Sergei Morozov <morozov@tut.by>
2021-11-24 22:08:31 +01:00
Vadzim Ramanenka
860f0da198 DBZ-3992: Use a query for listing change tables 2021-11-24 22:08:31 +01:00
Sergei Morozov
56d77c9b7a DBZ-4273: Rename symbols related to change tables 2021-11-24 22:08:31 +01:00
Sergei Morozov
3d0cb2f6d1 DBZ-4273: Do not source stopLsn from end_lsn 2021-11-24 22:08:31 +01:00
Jacob Gminder
f7f8748062 DBZ-2975: Move the poll interval logic to the ChangeEventSourceCoordinator. 2021-11-22 12:30:31 +01:00
Sergei Morozov
0e04204443 DBZ-4285: Handle login failure during instance upgrade as retriable 2021-11-16 20:31:26 +01:00
Kate
44073cf7d8 DBZ-4196 Support schema changes during incremental snapshot 2021-11-16 14:56:06 +01:00
Chris Cranford
20627bd14a DBZ-4082 Fix test failure SchemaHistoryTopicIT::schemaChangeAfterSnapshot 2021-11-15 17:03:22 -05:00
Thiago Dantas
39ecc4e732 DBZ-4249 Creates the incremental.snapshot.option.recompile connector configuration for SQL Server
This includes OPTION(RECOMPILE) query option for every SELECT statement during the incremental snapshot process, which can help with parameter sniffing problems.
2021-11-12 11:56:06 +01:00
Debezium Builder
f93e901dce [maven-release-plugin] prepare for next development iteration 2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19 [maven-release-plugin] prepare release v1.8.0.Alpha2 2021-11-11 09:21:59 +00:00
Kate
992ae537c8 DBZ-4244 Quote signal table name in MySQL connector 2021-11-10 10:18:26 +01:00
Chris Cranford
5ec9381702 DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL) 2021-11-10 09:43:25 +01:00
Sergei Morozov
b2df15cf39 DBZ-4245: Handle SQL Server connection errors during database state transition 2021-11-05 20:20:15 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Juan Fiallo
63367c614a DBZ-4231 Remove SqlServerConnector database.user Required Validator 2021-11-02 14:48:51 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4 DBZ-2975 Using Offsets in recover() contract;
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
Mike Kamornikov
16c07e915b DBZ-2975: Recover database schema from multiple partitions 2021-11-01 10:17:49 +01:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
Gunnar Morling
c8d6a39c79 DBZ-4125 Removing some redundant code 2021-10-19 15:29:56 +02:00
Gunnar Morling
adba67a2c5 DBZ-4125 Asserting database name in change events;
Using assertThat() statically imported.
2021-10-19 15:29:56 +02:00
Gunnar Morling
e5ceddca2f DBZ-4125 Dropping correct database 2021-10-19 15:29:56 +02:00
cburch824
5209fbc9bb DBZ-4125 update testDB variable value 2021-10-19 15:29:56 +02:00
cburch824
1de72deafa DBZ-4125 Add test covering special characters in database name
DBZ-4125 Remove unused import

DBZ-4125 Clean up variable usage
2021-10-19 15:29:56 +02:00
cburch824
766139ab05 DBZ-4125 Fix sqlserver connection database name placeholder
Add copyright name and alias name
2021-10-19 15:29:56 +02:00
Juan Fiallo
346e0f3af2 DBZ-3517 Making database.user optional for SQL Server.
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Juan Fiallo
5ac93ac20e DBZ-3517 Making database.user optional for SQL Server.
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Juan Fiallo
e041b599d8 DBZ-3517 Making database.user optional for SQL Server.
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Gunnar Morling
ae1ba98591 DBZ-4082 Logging debug info 2021-10-14 15:42:09 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Gunnar Morling
ea75b5b12b DBZ-4082 Awaiting connector start-up 2021-10-04 13:16:42 +02:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00
Gunnar Morling
3671c3f4d6 DBZ-3346 Expanding SQL Server connector error handler 2021-09-29 10:11:30 +02:00
Debezium Builder
bec0b6b67e [maven-release-plugin] prepare for next development iteration 2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725 [maven-release-plugin] prepare release v1.7.0.CR2 2021-09-23 06:31:25 +00:00
Jiri Pechanec
26d0e78023 DBZ-4013 Skip invalid table 2021-09-17 14:20:42 +02:00
Debezium Builder
c15e0b303b [maven-release-plugin] prepare for next development iteration 2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121 [maven-release-plugin] prepare release v1.7.0.CR1 2021-09-16 08:10:44 +00:00
Gunnar Morling
18a23b19c3 DBZ-4001 Removing constructor only required for tests 2021-09-15 14:21:02 +02:00
Yuan Zhang
fbf56a976d DBZ-4001 Using connection factory when validating SQL Server connector config 2021-09-15 14:16:39 +02:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Debezium Builder
2ce6bcb2ab [maven-release-plugin] prepare for next development iteration 2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423 [maven-release-plugin] prepare release v1.7.0.Beta1 2021-08-25 05:20:56 -04:00
Jiri Pechanec
2c49b0277e DBZ-3229 Increase wait time; do not rely on record delivery in case of failure 2021-08-24 16:34:58 +02:00
Jiri Pechanec
12c20fad53 DBZ-2398 Handle more than one transaction in the list 2021-08-24 16:33:57 +02:00
Gunnar Morling
9a88011718 DBZ-2975 Avoiding redundant log message 2021-08-23 12:01:11 +02:00
Mike Kamornikov
37a4523685 DBZ-2975: Use fully-qualified table and procedure names
Co-authored-by: Sergei Morozov <morozov@tut.by>
2021-08-23 12:01:11 +02:00
Sergei Morozov
3f9b5b5e17 DBZ-2975: Remove unused SqlServerConnection methods 2021-08-23 12:01:11 +02:00
Sergei Morozov
b06b5aecbc DBZ-2975: Introduce opt-in configuration for multi-partition mode 2021-08-23 12:01:11 +02:00
Sergei Morozov
680b6438f5
DBZ-3823 Avoid connectivity errors during task start in SQL Server connector;
* Deferring DB-related logic to poll() (so to benefit from retries) or the connector itself
* Removeing dependency of SourceTimestampMode on SqlServerConnection
* More generic connection error handling
2021-08-18 23:05:30 +02:00
Sergei Morozov
8252b19abc DBZ-3479: Rework handling timezones in SQL Server connector 2021-08-17 22:16:56 +02:00
Jiri Pechanec
11e3ef4325 DBZ-3857 Exclude database name in snapshot tables filtering 2021-08-16 14:12:53 +02:00
Jiri Pechanec
60900290f1 DBZ-3228 Make sure to change db in streaming 2021-08-11 17:09:22 +02:00
Sergei Morozov
a40ad7132d DBZ-2975: Remove partition from offset context 2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12 DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets 2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52 DBZ-2975: Move Partition to io.debezium.pipeline.spi 2021-08-11 07:34:37 +02:00
Debezium Builder
d3c4482d06 [maven-release-plugin] prepare for next development iteration 2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426 [maven-release-plugin] prepare release v1.7.0.Alpha1 2021-07-30 02:39:08 -04:00
Kate
9b66ab374a DBZ-3577 Support read-only MySQL incremental snapshots 2021-07-29 07:10:46 +02:00
Chris Cranford
ed31ea9ffb DBZ-3668 Adjust ServiceLoader for SPI change 2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d DBZ-3668 Extracting SPI package 2021-07-03 16:31:52 +07:00