Commit Graph

787 Commits

Author SHA1 Message Date
ggaborg
a9d0736c75 DBZ-4631 formatting 2022-08-19 11:09:15 +02:00
ggaborg
9676af7a93 DBZ-4631 fix compilation error "text blocks are not supported in -source 11" 2022-08-19 11:09:15 +02:00
ggaborg
0181122274 DBZ-4631 Fix "No maximum LSN recorded" log message can be spammed on low-activity databases 2022-08-19 11:09:15 +02:00
Sergei Morozov
1c99437890 DBZ-5470: Remove the dependency of JdbcConnection on DatabaseSchema 2022-08-19 11:06:59 +02:00
Chris Cranford
b25dae6a0a DBZ-5497 Fix skipped operations logic for SQL Server 2022-08-19 11:05:29 +02:00
Chris Cranford
b7e2112603 DBZ-5497 Align test behavior 2022-08-19 11:05:29 +02:00
Chris Cranford
304e9b7b47 DBZ-5527 Mark verifyOffsets test as ignored 2022-08-18 16:01:35 -04:00
Chris Cranford
08566262c2 DBZ-5525 Fix test failures - EventProcessingFailureHandlingIT 2022-08-18 16:01:35 -04:00
Vivek Wassan
d89e71ebeb DBZ-5327 Smart Backfills 2022-08-17 10:05:55 +02:00
Chris Cranford
8f91e0874e DBZ-5290 Use SSL for SQL Server tests 2022-08-11 13:28:45 +02:00
Sergei Morozov
8f0f9fe3ed DBZ-5477: Remove SQL Server connector SourceTimestampMode 2022-08-05 12:26:39 -04:00
Sergei Morozov
fc7910e1a4 DBZ-5478: Restart SQL Server task on "Socket closed" exception 2022-08-05 10:16:27 -04:00
Vojtech Juranek
c7d8353d7b DBZ-4727 Add snapshot paused JXM metrics
Add two JXM objects:
* `snapshotPaused` - detemines if the incremental snapshot is paused
  or not
* `snapshotPausedDurationInSeconds` - overall time when the incremental
  snapshot was paused. The time adds up - if the snapshot was paused
  e.g. two times, the `snapshotPausedDurationInSeconds` is the sum of
  these two paused times.
2022-07-29 12:41:58 -04:00
harveyyue
5f430f1a8e DBZ-5457 Deprecate legacy topic selector for all connectors 2022-07-28 12:58:59 -04:00
Debezium Builder
1ab51ae8d0 [maven-release-plugin] prepare for next development iteration 2022-07-26 18:13:10 +00:00
Debezium Builder
d247a48b79 [maven-release-plugin] prepare release v2.0.0.Beta1 2022-07-26 18:13:09 +00:00
harveyyue
6534385a1c DBZ-5292 Treat SQLServerException with "Broken pipe (Write failed)" exception message as a retriable exception 2022-07-25 13:09:41 -04:00
Chris Cranford
b7a4bbb183 DBZ-4004 Fix SQL Server test EventProcessingFailureHandlingIT 2022-07-20 16:38:24 -04:00
Chris Cranford
f412c2e6a4 DBZ-5396 Add support for connector-specific relational model attributes 2022-07-19 15:41:02 -04:00
Sergei Morozov
77f853f936 DBZ-4726: Remove SQL Server single-partition mode 2022-07-19 09:20:40 +02:00
harveyyue
6ea7abc8fc DBZ-4180 Pluggable topic selector 2022-07-13 14:45:25 +02:00
Jiri Pechanec
d8baac7c46 DBZ-5229 Reorganize code for inheritance use 2022-07-12 17:31:19 +02:00
Hossein Torabi
1ea02be9c2 DBZ-5229 define centralized and modular aproach for debezium storage 2022-07-12 17:31:19 +02:00
Debezium Builder
6fd1441af3 [maven-release-plugin] prepare for next development iteration 2022-07-01 09:21:49 +00:00
Debezium Builder
99402af634 [maven-release-plugin] prepare release v2.0.0.Alpha3 2022-07-01 09:21:48 +00:00
Mickael Maison
5ff71aa992 DBZ-5335 Fix formatting issues in the connectors configdefs 2022-06-30 09:35:54 +02:00
Chris Cranford
3fb5bf1339 DBZ-4451 Introduce SchemaChangeEvent factory methods 2022-06-16 09:19:41 +02:00
Chris Cranford
863abcd081 DBZ-4451 Store previous table id in alter schema change events
When a table is renamed with the ALTER TABLE statement, the schema
history record not only will reference the current table's unique id
in the "id" metadata, but will also refer to the old table name in
the "previousId" metadata field.
2022-06-16 09:19:41 +02:00
Chris Cranford
20bb2adea5 DBZ-4834 Fix incremental snapshot of table added to include list 2022-06-16 08:39:16 +02:00
Vojtech Juranek
25eba9749d DBZ-5198 Add support for SQL server specific table delimiters
Add suppoprt for `TableId` delimiters and provide implementation for
SQL server. SQL server allows to use reserved words in table names or
names with spaces, but they have to wrapped by `[]` characters, e.g.
`[dbname].[table name]`.

Debezium can handle spaces e.g. in table include list, but fails when
parsing snapshot select, therefore the parsing with predicates is used
only for parsing spanshot select for now. If useful, it can be used
later on on other places as well.
2022-06-13 10:57:15 +02:00
Debezium Builder
6fff3a2876 [maven-release-plugin] prepare for next development iteration 2022-06-09 11:49:26 +00:00
Debezium Builder
b2e2e351df [maven-release-plugin] prepare release v2.0.0.Alpha2 2022-06-09 11:49:26 +00:00
Vojtech Juranek
4a48eb33df DBZ-5045 Remove legacy V1 source info 2022-06-08 09:11:00 +02:00
Vojtech Juranek
6af67f33d3 DBZ-5045 Remove deprecated SQL server SourceTimestampMode.PROCESSING option
Although not same as COMMIT, as mentioned in [1], it was just
a workaround for COMMIT as by that time it was slow, see also [2].
Now, COMMIT being fast enough, there's no need to have this option any
more.

[1] https://github.com/debezium/debezium/pull/2382#issuecomment-843073262
[2] https://issues.redhat.com/browse/DBZ-1988
2022-06-08 09:11:00 +02:00
Vojtech Juranek
f40706eb25 DBZ-5045 Remove deprecated SQL server SERVER_TIMEZONE 2022-06-08 09:11:00 +02:00
Vojtech Juranek
b0b3066ed5 DBZ-5045 Remove deprecated COLUMN_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
f84893a8b4 DBZ-5045 Remove deprecated SCHEMA_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
261188482f DBZ-5045 Remove deprecated SCHEMA_WHITELIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
6abbcee6a3 DBZ-5045 Remove deprecated TABLE_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
db08e894fc DBZ-5045 Remove deprecated TABLE_WHITELIST 2022-06-08 09:11:00 +02:00
harveyyue
acb743bd34 DBZ-5206 Remove the deprecated monitored tables metrics 2022-06-07 16:13:29 -04:00
Chris Cranford
9d71296b5c DBZ-4251 Support stopping incremental snapshots 2022-06-02 07:30:07 +02:00
Jiri Pechanec
88b7ae2050 DBZ-5136 Move sourceInfo to common class 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
c64b8af31a DBZ-5136 reintroduce the CommonOffsetContext class and refactor common functionality into it 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
2d72dae649 DBZ-5136 further refining of the algorithm for determining position in snapshot and IT test fixes 2022-06-01 16:56:29 +02:00
Jiri Pechanec
08e8c3d795 DBZ-5136 Move common class to common package 2022-06-01 16:56:29 +02:00
Andrew Walker
d0759461a4 DBZ-5136: Convert RelationalOffsetContext to CommonOffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
b6222d42bf DBZ-5136: Add first flag and refactor OffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
593c2769e6 DBZ-5136: Add last in table flag 2022-06-01 16:56:29 +02:00
Vojtech Juranek
5550057034 DBZ-5042 Add abstract partition with DB name
DB names is used by logging facilities. As the DB name is required only
for relational DBs, also this abstract class is provided only for
relational DB connectors.

Use this abstract class for SQL server connector, where DB name logging
is already implemented.
2022-05-27 14:20:30 -04:00
harveyyue
52ba58ccc3 DBZ-5098 Introduce a new field "ts_ms" to identify the process time for schema change event 2022-05-18 14:21:39 +02:00
Vadzim Ramanenka
0069c3e360 DBZ-5137: MilliSecondsBehindSource is not reported by SQL Server connector
Call StreamingMeter.onEvent for every event so that it reports the
metrics correctly.
2022-05-17 14:42:51 +02:00
Sagar Rao
e4b1486353 DBZ-4346 Adding validation to SQL Server connector to fail when a user not having access to CDC table is used with modes other than INITIAL_ONLY mode
Removing unwanted commits
2022-05-06 10:00:09 -04:00
Debezium Builder
901825810a [maven-release-plugin] prepare for next development iteration 2022-04-28 13:51:13 +00:00
Debezium Builder
05dcb45647 [maven-release-plugin] prepare release v2.0.0.Alpha1 2022-04-28 13:51:12 +00:00
rkerner
e2ccb91664 DBZ-4460 Fix ConnectorDescriptor name for SQL Server connector metadata
relates to https://issues.redhat.com/browse/DBZ-4460
2022-04-26 16:15:49 +02:00
Sergei Morozov
fd46a670ad DBZ-5033: Ignore null offsets when recovering database history 2022-04-26 11:40:21 +02:00
Debezium Builder
4a6de64c25 [maven-release-plugin] prepare for next development iteration 2022-04-05 14:49:52 +00:00
Debezium Builder
683851fd90 [maven-release-plugin] prepare release v1.9.0.Final 2022-04-05 14:49:51 +00:00
Vojtech Juranek
581365e461 DBZ-2793 Add test for SQL server schema filters 2022-03-29 07:13:00 +02:00
Vojtech Juranek
cacd731f33 DBZ-2793 Allow enable CDC for non-default schema 2022-03-29 07:13:00 +02:00
Debezium Builder
ab7fe3b96a [maven-release-plugin] prepare for next development iteration 2022-03-25 16:45:06 +00:00
Debezium Builder
d19fc234ee [maven-release-plugin] prepare release v1.9.0.CR1 2022-03-25 16:45:06 +00:00
Sergei Morozov
b258674782 DBZ-3535: Introduce schema.name.adjustment.mode 2022-03-24 09:37:05 +01:00
kate
4b2d5c29be DBZ-4878 Re-read incremental snapshot chunk on DDL event 2022-03-18 07:55:43 +01:00
Josh Ribera
020e845f44 DBZ-4809 Add task id and partition to the logging context for
multi-partition connectors.

Co-authored-by: Sergei Morozov <morozov@tut.by>
2022-03-09 20:46:38 +01:00
Gunnar Morling
d20a6f00e7 DBZ-4801 Using JdbcConfiguration in JdbcConnection 2022-03-07 17:53:45 +01:00
Debezium Builder
fece16039c [maven-release-plugin] prepare for next development iteration 2022-03-03 17:00:08 +00:00
Debezium Builder
e0d8a0d809 [maven-release-plugin] prepare release v1.9.0.Beta1 2022-03-03 17:00:08 +00:00
Sergei Morozov
2952b7a90f DBZ-4783: Add a multi-partition integration test 2022-03-01 14:21:39 +01:00
Sergei Morozov
d6e96a5108 DBZ-4783: Refactoring and cleanup 2022-03-01 14:21:39 +01:00
Jacob Gminder
cc11ac193a DBZ-4783: Support for multiple databases and tasks in the SQL Server connector
Co-authored-by: Sergei Morozov <morozov@tut.by>
2022-03-01 14:21:39 +01:00
Josh Ribera
fc6d55e935 DBZ-4783: Add task id label to metrics 2022-03-01 14:21:39 +01:00
Mike Kamornikov
37a67d5dcf DBZ-4783: Manage change tables per partition 2022-03-01 14:21:39 +01:00
Sergei Morozov
2d14b5b09f DBZ-4478: Multi-partition metrics for SQL Server 2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces 2022-02-16 11:31:38 +01:00
Debezium Builder
7a47f478a4 [maven-release-plugin] prepare for next development iteration 2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e [maven-release-plugin] prepare release v1.9.0.Alpha2 2022-02-09 07:23:10 +00:00
Debezium Builder
33e2f5cd0f [maven-release-plugin] prepare for next development iteration 2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e [maven-release-plugin] prepare release v1.9.0.Alpha1 2022-01-26 19:00:20 +00:00
Jiri Pechanec
664d989e42 DBZ-4577 Provide custom error message handling 2022-01-21 10:24:19 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Anisha Mohanty
d6c5ad2e7c DBZ-4460 Renaming all openapi occurrences to schema 2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f DBZ-4460 Set default values for format & output directory 2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691 DBZ-4460 Apply the plug-in to all connector modules 2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221 DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation 2022-01-06 19:03:46 +01:00
harveyyue
792187f669 DBZ-4472 Make connector task partition readability for log 2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98 [maven-release-plugin] prepare for next development iteration 2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f [maven-release-plugin] prepare release v1.8.0.Final 2021-12-16 10:11:28 +00:00
Chris Cranford
882bb9c4d4 DBZ-3306 Only emit schema changes if table schema actual changed 2021-12-11 20:39:46 +01:00
Debezium Builder
f53e6c00df [maven-release-plugin] prepare for next development iteration 2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a [maven-release-plugin] prepare release v1.8.0.CR1 2021-12-09 20:16:04 +00:00
Mark Drilling
b922e34b30 DBZ-3697 Adding metadata to fields for SQLServerConnector 2021-12-02 11:07:22 +01:00
Debezium Builder
b5439b54bf [maven-release-plugin] prepare for next development iteration 2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2 [maven-release-plugin] prepare release v1.8.0.Beta1 2021-11-30 09:38:47 +00:00
Sergei Morozov
437fe0e7bf DBZ-4273: Filter out capture instances with the same start_lsn 2021-11-24 22:08:31 +01:00
Mike Kamornikov
a7c573676f DBZ-3992: List change tables within captured LSN interval
Co-authored-by: Sergei Morozov <morozov@tut.by>
2021-11-24 22:08:31 +01:00
Vadzim Ramanenka
860f0da198 DBZ-3992: Use a query for listing change tables 2021-11-24 22:08:31 +01:00
Sergei Morozov
56d77c9b7a DBZ-4273: Rename symbols related to change tables 2021-11-24 22:08:31 +01:00
Sergei Morozov
3d0cb2f6d1 DBZ-4273: Do not source stopLsn from end_lsn 2021-11-24 22:08:31 +01:00
Jacob Gminder
f7f8748062 DBZ-2975: Move the poll interval logic to the ChangeEventSourceCoordinator. 2021-11-22 12:30:31 +01:00
Sergei Morozov
0e04204443 DBZ-4285: Handle login failure during instance upgrade as retriable 2021-11-16 20:31:26 +01:00
Kate
44073cf7d8 DBZ-4196 Support schema changes during incremental snapshot 2021-11-16 14:56:06 +01:00
Chris Cranford
20627bd14a DBZ-4082 Fix test failure SchemaHistoryTopicIT::schemaChangeAfterSnapshot 2021-11-15 17:03:22 -05:00
Thiago Dantas
39ecc4e732 DBZ-4249 Creates the incremental.snapshot.option.recompile connector configuration for SQL Server
This includes OPTION(RECOMPILE) query option for every SELECT statement during the incremental snapshot process, which can help with parameter sniffing problems.
2021-11-12 11:56:06 +01:00
Debezium Builder
f93e901dce [maven-release-plugin] prepare for next development iteration 2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19 [maven-release-plugin] prepare release v1.8.0.Alpha2 2021-11-11 09:21:59 +00:00
Kate
992ae537c8 DBZ-4244 Quote signal table name in MySQL connector 2021-11-10 10:18:26 +01:00
Chris Cranford
5ec9381702 DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL) 2021-11-10 09:43:25 +01:00
Sergei Morozov
b2df15cf39 DBZ-4245: Handle SQL Server connection errors during database state transition 2021-11-05 20:20:15 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Juan Fiallo
63367c614a DBZ-4231 Remove SqlServerConnector database.user Required Validator 2021-11-02 14:48:51 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4 DBZ-2975 Using Offsets in recover() contract;
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
Mike Kamornikov
16c07e915b DBZ-2975: Recover database schema from multiple partitions 2021-11-01 10:17:49 +01:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
Gunnar Morling
c8d6a39c79 DBZ-4125 Removing some redundant code 2021-10-19 15:29:56 +02:00
Gunnar Morling
adba67a2c5 DBZ-4125 Asserting database name in change events;
Using assertThat() statically imported.
2021-10-19 15:29:56 +02:00
Gunnar Morling
e5ceddca2f DBZ-4125 Dropping correct database 2021-10-19 15:29:56 +02:00
cburch824
5209fbc9bb DBZ-4125 update testDB variable value 2021-10-19 15:29:56 +02:00
cburch824
1de72deafa DBZ-4125 Add test covering special characters in database name
DBZ-4125 Remove unused import

DBZ-4125 Clean up variable usage
2021-10-19 15:29:56 +02:00
cburch824
766139ab05 DBZ-4125 Fix sqlserver connection database name placeholder
Add copyright name and alias name
2021-10-19 15:29:56 +02:00
Juan Fiallo
346e0f3af2 DBZ-3517 Making database.user optional for SQL Server.
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Juan Fiallo
5ac93ac20e DBZ-3517 Making database.user optional for SQL Server.
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Juan Fiallo
e041b599d8 DBZ-3517 Making database.user optional for SQL Server.
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Gunnar Morling
ae1ba98591 DBZ-4082 Logging debug info 2021-10-14 15:42:09 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Gunnar Morling
ea75b5b12b DBZ-4082 Awaiting connector start-up 2021-10-04 13:16:42 +02:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00
Gunnar Morling
3671c3f4d6 DBZ-3346 Expanding SQL Server connector error handler 2021-09-29 10:11:30 +02:00
Debezium Builder
bec0b6b67e [maven-release-plugin] prepare for next development iteration 2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725 [maven-release-plugin] prepare release v1.7.0.CR2 2021-09-23 06:31:25 +00:00
Jiri Pechanec
26d0e78023 DBZ-4013 Skip invalid table 2021-09-17 14:20:42 +02:00
Debezium Builder
c15e0b303b [maven-release-plugin] prepare for next development iteration 2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121 [maven-release-plugin] prepare release v1.7.0.CR1 2021-09-16 08:10:44 +00:00
Gunnar Morling
18a23b19c3 DBZ-4001 Removing constructor only required for tests 2021-09-15 14:21:02 +02:00
Yuan Zhang
fbf56a976d DBZ-4001 Using connection factory when validating SQL Server connector config 2021-09-15 14:16:39 +02:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Debezium Builder
2ce6bcb2ab [maven-release-plugin] prepare for next development iteration 2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423 [maven-release-plugin] prepare release v1.7.0.Beta1 2021-08-25 05:20:56 -04:00
Jiri Pechanec
2c49b0277e DBZ-3229 Increase wait time; do not rely on record delivery in case of failure 2021-08-24 16:34:58 +02:00
Jiri Pechanec
12c20fad53 DBZ-2398 Handle more than one transaction in the list 2021-08-24 16:33:57 +02:00
Gunnar Morling
9a88011718 DBZ-2975 Avoiding redundant log message 2021-08-23 12:01:11 +02:00
Mike Kamornikov
37a4523685 DBZ-2975: Use fully-qualified table and procedure names
Co-authored-by: Sergei Morozov <morozov@tut.by>
2021-08-23 12:01:11 +02:00
Sergei Morozov
3f9b5b5e17 DBZ-2975: Remove unused SqlServerConnection methods 2021-08-23 12:01:11 +02:00
Sergei Morozov
b06b5aecbc DBZ-2975: Introduce opt-in configuration for multi-partition mode 2021-08-23 12:01:11 +02:00
Sergei Morozov
680b6438f5
DBZ-3823 Avoid connectivity errors during task start in SQL Server connector;
* Deferring DB-related logic to poll() (so to benefit from retries) or the connector itself
* Removeing dependency of SourceTimestampMode on SqlServerConnection
* More generic connection error handling
2021-08-18 23:05:30 +02:00
Sergei Morozov
8252b19abc DBZ-3479: Rework handling timezones in SQL Server connector 2021-08-17 22:16:56 +02:00
Jiri Pechanec
11e3ef4325 DBZ-3857 Exclude database name in snapshot tables filtering 2021-08-16 14:12:53 +02:00
Jiri Pechanec
60900290f1 DBZ-3228 Make sure to change db in streaming 2021-08-11 17:09:22 +02:00
Sergei Morozov
a40ad7132d DBZ-2975: Remove partition from offset context 2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12 DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets 2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52 DBZ-2975: Move Partition to io.debezium.pipeline.spi 2021-08-11 07:34:37 +02:00
Debezium Builder
d3c4482d06 [maven-release-plugin] prepare for next development iteration 2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426 [maven-release-plugin] prepare release v1.7.0.Alpha1 2021-07-30 02:39:08 -04:00
Kate
9b66ab374a DBZ-3577 Support read-only MySQL incremental snapshots 2021-07-29 07:10:46 +02:00
Chris Cranford
ed31ea9ffb DBZ-3668 Adjust ServiceLoader for SPI change 2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d DBZ-3668 Extracting SPI package 2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110 DBZ-3668 Add ServiceLoader hook CloudEvents converter 2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba DBZ-2975: Add partition awareness to source task components
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Debezium Builder
9d3f6b2a86 [maven-release-plugin] prepare for next development iteration 2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56 [maven-release-plugin] prepare release v1.6.0.Final 2021-06-30 03:45:06 -04:00
Debezium Builder
ae053414ac [maven-release-plugin] prepare for next development iteration 2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74 [maven-release-plugin] prepare release v1.6.0.CR1 2021-06-24 01:50:07 -04:00
Hossein Torabi
cbf2abaaf2 DBZ-2697 Optimisation on SQLServer connector for skipped.operations 2021-06-21 15:52:35 +02:00
Jiri Pechanec
02640df975 DBZ-3597 Re-use the CDC wait test code 2021-06-10 17:55:50 +02:00
Jiri Pechanec
c2086d7104 DBZ-3597 Remove non-captured colmuns from PK 2021-06-10 17:55:50 +02:00
Debezium Builder
48ca58a609 [maven-release-plugin] prepare for next development iteration 2021-06-10 06:03:12 -04:00
Debezium Builder
0961517859 [maven-release-plugin] prepare release v1.6.0.Beta2 2021-06-10 06:03:12 -04:00
Gunnar Morling
1ce65fa628 DBZ-2975 Avoiding raw types in some places;
Also parameterizing offset loader contract, so to avoid casts later on.
2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542 DBZ-2975: Extract offset context from object states to method signatures 2021-06-09 16:02:33 +02:00
Jiri Pechanec
5fbebf7593
DBZ-3515 Execute periodic TX commits
* DBZ-3515 Execute periodic TX commits

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-05-26 12:52:25 +02:00
Sergei Morozov
dd23e0faad DBZ-3486: Limit number of processed transactions per iteration 2021-05-25 07:19:43 +02:00
Sergei Morozov
3b72e5149c DBZ-3486: Replace @see with @link where a URL is referenced 2021-05-25 07:19:43 +02:00
Debezium Builder
ead4ee7226 [maven-release-plugin] prepare for next development iteration 2021-05-20 19:07:44 +02:00
Debezium Builder
9e16df7d4b [maven-release-plugin] prepare release v1.6.0.Beta1 2021-05-20 19:07:44 +02:00
Jiri Pechanec
90738f53a6 DBZ-3500 Incremental snapshots for SQL Server 2021-05-20 08:06:37 +02:00
Sergei Morozov
ec252a787d DBZ-3452: Deprecate source.timestamp.mode=processing 2021-05-18 20:57:25 +02:00
Vadzim Ramanenka
7adfaba483 DBZ-3452: source.timestamp.mode=commit imposes a significant performance penalty
Fetch LSN's timestamps along with the CDC data.
2021-05-18 20:57:25 +02:00
SiuFay
d96c3138d6 DBZ-3339 Allow retry for transient error in SqlServerConnection.retrieveRealDatabaseName() 2021-05-17 14:06:47 +02:00
Jiri Pechanec
95ed8149c1 DBZ-3339 Connection refused can be retried 2021-05-13 08:06:00 -04:00
Sergei Morozov
e90196989b DBZ-3505: Better handling of invalid SQL Server connector configuration 2021-05-12 06:03:22 +02:00
Debezium Builder
4dd3a146ca [maven-release-plugin] prepare for next development iteration 2021-05-06 02:40:15 -04:00
Debezium Builder
b3c5bb281c [maven-release-plugin] prepare release v1.6.0.Alpha1 2021-05-06 02:40:15 -04:00
Jiri Pechanec
8b0428404b DBZ-3473 SQL Server field moved reading to connection 2021-05-06 05:37:36 +02:00
Gunnar Morling
dc02b896cd DBZ-3449 Moving QA releated plug-ins to separate profile, so to avoid loading them at all 2021-04-28 15:14:05 +02:00
Gunnar Morling
8f891248ad DBZ-3429 Making option retrieval lenient towards trailing/leading whitespace 2021-04-28 11:01:27 +02:00
Anisha Mohanty
f0f8d5d180 DBZ-3161 Refactor/Rename all references of MonitoredTables to CapturedTables 2021-04-26 13:07:23 +02:00
Gunnar Morling
2088c035b1 DBZ-3449 Adding "quick" profile 2021-04-26 06:09:14 +02:00
Anisha Mohanty
1e9630b19d DBZ-3379 Use current SQL Server container image 2021-04-08 15:07:25 +02:00
Hossein Torabi
5d6705c3fe DBZ-2699 implement skipped.operation in core 2021-04-08 11:59:08 +02:00
Debezium Builder
8a88ba9b45 [maven-release-plugin] prepare for next development iteration 2021-04-08 04:04:00 -04:00
Debezium Builder
74152afe74 [maven-release-plugin] prepare release v1.5.0.Final 2021-04-08 04:04:00 -04:00
Chris Cranford
776180a0df DBZ-3347 Emit schema change events with correct source partition 2021-03-30 07:26:06 +02:00
JLDLaughlin
06b0475f17 DBZ-2911 Add additional LSN information to all sources
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00