Sergei Morozov
39f3358747
DBZ-5496: Improve compatibility with Azure SQL
...
If the SQL Server connector is configured to capture changes from a
single database, pass it to the JDBC connection string in order to
bypass the limitation of Azure SQL which does not allow switchiing
between databases.
See: https://docs.microsoft.com/en-us/sql/t-sql/language-elements/use-transact-sql?view=sql-server-ver15#arguments
2022-09-20 06:29:39 +02:00
harveyyue
288c93434f
DBZ-5585 Remove classloader parameter from JdbcConnection
2022-09-19 17:15:29 +02:00
Debezium Builder
218d414552
[maven-release-plugin] prepare for next development iteration
2022-09-16 06:36:40 +00:00
Debezium Builder
567f57c47b
[maven-release-plugin] prepare release v2.0.0.Beta2
2022-09-16 06:36:39 +00:00
Vojtech Juranek
acc6be6df3
DBZ-5043 Move TOPIC_PREFIX into CommonConnectorConfig
...
`TOPIC_PREFIX` is now mandatory to all connectors therefore it make
sense to have it in common config. Beside that, it also makes it more
easy to use it in Debezium UI without any workarounds - if the field is
not member of the given connector config, the field has to be
explicitely added into known fields otherwise is invisible for UI.
2022-09-13 09:25:54 +02:00
Anisha Mohanty
9fd204b383
DBZ-5044 Introduce respective SchemaFactory for all connectors
2022-09-08 10:35:20 +02:00
Vojtech Juranek
b797201263
DBZ-5043 Rename DB_HISTORY_PATH to SCHEMA_HISTORY_PATH
2022-09-07 12:57:31 +02:00
Vojtech Juranek
b6c31f3da5
DBZ-5043 Replace 'database history' with 'database schema history'
...
Reflect renaming database history to schema history in comments,
configuration descriptions and log and error messages.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
0494a16a79
DBZ-5043 Rename DatabaseHistory to SchemaHistory
...
Rename also all related classes and varibales.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
0823cedf25
DBZ-5043 Replace database.server.name with topic.prefix
2022-09-07 12:57:31 +02:00
Vojtech Juranek
161a7229b6
DBZ-5043 Use topic prefix as the logical name
...
With this change the user cannot direcly set connector logical name and
thus in the future it can be remove without breaking user config.
If the turn out that the logical name is useful and user should be able
to configure it, dedicated config option can be added.
Originally it was prposed in the Jira to replace it with connector name,
but it turned out that logical name defaults to `database.server.name`
and is heavily used in the tests and JMX, so it would require another
big refactoring. Thus, use topic prefix for now. Once we know further
direction (remove logical name or add new option), do this refactoring.
2022-09-07 12:57:31 +02:00
ggaborg
244de2bd96
DBZ-3293 Add signal table automatically to include list
2022-09-01 20:16:47 +02:00
Jiri Pechanec
de53591dba
DBZ-5244 Retry all communication exceptions by default
2022-08-31 09:45:09 -04:00
pkgonan
b031770300
DBZ-5544 Support BASE64_URL_SAFE in BinaryHandlingMode
2022-08-24 09:50:23 +02:00
ggaborg
41ebaa871c
DBZ-4631 check SQLServer Agent status only once
2022-08-19 11:09:15 +02:00
ggaborg
a9d0736c75
DBZ-4631 formatting
2022-08-19 11:09:15 +02:00
ggaborg
9676af7a93
DBZ-4631 fix compilation error "text blocks are not supported in -source 11"
2022-08-19 11:09:15 +02:00
ggaborg
0181122274
DBZ-4631 Fix "No maximum LSN recorded" log message can be spammed on low-activity databases
2022-08-19 11:09:15 +02:00
Sergei Morozov
1c99437890
DBZ-5470: Remove the dependency of JdbcConnection on DatabaseSchema
2022-08-19 11:06:59 +02:00
Chris Cranford
b25dae6a0a
DBZ-5497 Fix skipped operations logic for SQL Server
2022-08-19 11:05:29 +02:00
Chris Cranford
b7e2112603
DBZ-5497 Align test behavior
2022-08-19 11:05:29 +02:00
Chris Cranford
304e9b7b47
DBZ-5527 Mark verifyOffsets test as ignored
2022-08-18 16:01:35 -04:00
Chris Cranford
08566262c2
DBZ-5525 Fix test failures - EventProcessingFailureHandlingIT
2022-08-18 16:01:35 -04:00
Vivek Wassan
d89e71ebeb
DBZ-5327 Smart Backfills
2022-08-17 10:05:55 +02:00
Chris Cranford
8f91e0874e
DBZ-5290 Use SSL for SQL Server tests
2022-08-11 13:28:45 +02:00
Sergei Morozov
8f0f9fe3ed
DBZ-5477: Remove SQL Server connector SourceTimestampMode
2022-08-05 12:26:39 -04:00
Sergei Morozov
fc7910e1a4
DBZ-5478: Restart SQL Server task on "Socket closed" exception
2022-08-05 10:16:27 -04:00
Vojtech Juranek
c7d8353d7b
DBZ-4727 Add snapshot paused JXM metrics
...
Add two JXM objects:
* `snapshotPaused` - detemines if the incremental snapshot is paused
or not
* `snapshotPausedDurationInSeconds` - overall time when the incremental
snapshot was paused. The time adds up - if the snapshot was paused
e.g. two times, the `snapshotPausedDurationInSeconds` is the sum of
these two paused times.
2022-07-29 12:41:58 -04:00
harveyyue
5f430f1a8e
DBZ-5457 Deprecate legacy topic selector for all connectors
2022-07-28 12:58:59 -04:00
Debezium Builder
1ab51ae8d0
[maven-release-plugin] prepare for next development iteration
2022-07-26 18:13:10 +00:00
Debezium Builder
d247a48b79
[maven-release-plugin] prepare release v2.0.0.Beta1
2022-07-26 18:13:09 +00:00
harveyyue
6534385a1c
DBZ-5292 Treat SQLServerException with "Broken pipe (Write failed)" exception message as a retriable exception
2022-07-25 13:09:41 -04:00
Chris Cranford
b7a4bbb183
DBZ-4004 Fix SQL Server test EventProcessingFailureHandlingIT
2022-07-20 16:38:24 -04:00
Chris Cranford
f412c2e6a4
DBZ-5396 Add support for connector-specific relational model attributes
2022-07-19 15:41:02 -04:00
Sergei Morozov
77f853f936
DBZ-4726: Remove SQL Server single-partition mode
2022-07-19 09:20:40 +02:00
harveyyue
6ea7abc8fc
DBZ-4180 Pluggable topic selector
2022-07-13 14:45:25 +02:00
Jiri Pechanec
d8baac7c46
DBZ-5229 Reorganize code for inheritance use
2022-07-12 17:31:19 +02:00
Hossein Torabi
1ea02be9c2
DBZ-5229 define centralized and modular aproach for debezium storage
2022-07-12 17:31:19 +02:00
Debezium Builder
6fd1441af3
[maven-release-plugin] prepare for next development iteration
2022-07-01 09:21:49 +00:00
Debezium Builder
99402af634
[maven-release-plugin] prepare release v2.0.0.Alpha3
2022-07-01 09:21:48 +00:00
Mickael Maison
5ff71aa992
DBZ-5335 Fix formatting issues in the connectors configdefs
2022-06-30 09:35:54 +02:00
Chris Cranford
3fb5bf1339
DBZ-4451 Introduce SchemaChangeEvent factory methods
2022-06-16 09:19:41 +02:00
Chris Cranford
863abcd081
DBZ-4451 Store previous table id in alter schema change events
...
When a table is renamed with the ALTER TABLE statement, the schema
history record not only will reference the current table's unique id
in the "id" metadata, but will also refer to the old table name in
the "previousId" metadata field.
2022-06-16 09:19:41 +02:00
Chris Cranford
20bb2adea5
DBZ-4834 Fix incremental snapshot of table added to include list
2022-06-16 08:39:16 +02:00
Vojtech Juranek
25eba9749d
DBZ-5198 Add support for SQL server specific table delimiters
...
Add suppoprt for `TableId` delimiters and provide implementation for
SQL server. SQL server allows to use reserved words in table names or
names with spaces, but they have to wrapped by `[]` characters, e.g.
`[dbname].[table name]`.
Debezium can handle spaces e.g. in table include list, but fails when
parsing snapshot select, therefore the parsing with predicates is used
only for parsing spanshot select for now. If useful, it can be used
later on on other places as well.
2022-06-13 10:57:15 +02:00
Debezium Builder
6fff3a2876
[maven-release-plugin] prepare for next development iteration
2022-06-09 11:49:26 +00:00
Debezium Builder
b2e2e351df
[maven-release-plugin] prepare release v2.0.0.Alpha2
2022-06-09 11:49:26 +00:00
Vojtech Juranek
4a48eb33df
DBZ-5045 Remove legacy V1 source info
2022-06-08 09:11:00 +02:00
Vojtech Juranek
6af67f33d3
DBZ-5045 Remove deprecated SQL server SourceTimestampMode.PROCESSING option
...
Although not same as COMMIT, as mentioned in [1], it was just
a workaround for COMMIT as by that time it was slow, see also [2].
Now, COMMIT being fast enough, there's no need to have this option any
more.
[1] https://github.com/debezium/debezium/pull/2382#issuecomment-843073262
[2] https://issues.redhat.com/browse/DBZ-1988
2022-06-08 09:11:00 +02:00
Vojtech Juranek
f40706eb25
DBZ-5045 Remove deprecated SQL server SERVER_TIMEZONE
2022-06-08 09:11:00 +02:00
Vojtech Juranek
b0b3066ed5
DBZ-5045 Remove deprecated COLUMN_BLACKLIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
f84893a8b4
DBZ-5045 Remove deprecated SCHEMA_BLACKLIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
261188482f
DBZ-5045 Remove deprecated SCHEMA_WHITELIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
6abbcee6a3
DBZ-5045 Remove deprecated TABLE_BLACKLIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
db08e894fc
DBZ-5045 Remove deprecated TABLE_WHITELIST
2022-06-08 09:11:00 +02:00
harveyyue
acb743bd34
DBZ-5206 Remove the deprecated monitored tables metrics
2022-06-07 16:13:29 -04:00
Chris Cranford
9d71296b5c
DBZ-4251 Support stopping incremental snapshots
2022-06-02 07:30:07 +02:00
Jiri Pechanec
88b7ae2050
DBZ-5136 Move sourceInfo to common class
2022-06-01 16:56:29 +02:00
Mark Bereznitsky
c64b8af31a
DBZ-5136 reintroduce the CommonOffsetContext class and refactor common functionality into it
2022-06-01 16:56:29 +02:00
Mark Bereznitsky
2d72dae649
DBZ-5136 further refining of the algorithm for determining position in snapshot and IT test fixes
2022-06-01 16:56:29 +02:00
Jiri Pechanec
08e8c3d795
DBZ-5136 Move common class to common package
2022-06-01 16:56:29 +02:00
Andrew Walker
d0759461a4
DBZ-5136: Convert RelationalOffsetContext to CommonOffsetContext
2022-06-01 16:56:29 +02:00
Andrew Walker
b6222d42bf
DBZ-5136: Add first flag and refactor OffsetContext
2022-06-01 16:56:29 +02:00
Andrew Walker
593c2769e6
DBZ-5136: Add last in table flag
2022-06-01 16:56:29 +02:00
Vojtech Juranek
5550057034
DBZ-5042 Add abstract partition with DB name
...
DB names is used by logging facilities. As the DB name is required only
for relational DBs, also this abstract class is provided only for
relational DB connectors.
Use this abstract class for SQL server connector, where DB name logging
is already implemented.
2022-05-27 14:20:30 -04:00
harveyyue
52ba58ccc3
DBZ-5098 Introduce a new field "ts_ms" to identify the process time for schema change event
2022-05-18 14:21:39 +02:00
Vadzim Ramanenka
0069c3e360
DBZ-5137: MilliSecondsBehindSource is not reported by SQL Server connector
...
Call StreamingMeter.onEvent for every event so that it reports the
metrics correctly.
2022-05-17 14:42:51 +02:00
Sagar Rao
e4b1486353
DBZ-4346 Adding validation to SQL Server connector to fail when a user not having access to CDC table is used with modes other than INITIAL_ONLY mode
...
Removing unwanted commits
2022-05-06 10:00:09 -04:00
Debezium Builder
901825810a
[maven-release-plugin] prepare for next development iteration
2022-04-28 13:51:13 +00:00
Debezium Builder
05dcb45647
[maven-release-plugin] prepare release v2.0.0.Alpha1
2022-04-28 13:51:12 +00:00
rkerner
e2ccb91664
DBZ-4460 Fix ConnectorDescriptor name for SQL Server connector metadata
...
relates to https://issues.redhat.com/browse/DBZ-4460
2022-04-26 16:15:49 +02:00
Sergei Morozov
fd46a670ad
DBZ-5033: Ignore null offsets when recovering database history
2022-04-26 11:40:21 +02:00
Debezium Builder
4a6de64c25
[maven-release-plugin] prepare for next development iteration
2022-04-05 14:49:52 +00:00
Debezium Builder
683851fd90
[maven-release-plugin] prepare release v1.9.0.Final
2022-04-05 14:49:51 +00:00
Vojtech Juranek
581365e461
DBZ-2793 Add test for SQL server schema filters
2022-03-29 07:13:00 +02:00
Vojtech Juranek
cacd731f33
DBZ-2793 Allow enable CDC for non-default schema
2022-03-29 07:13:00 +02:00
Debezium Builder
ab7fe3b96a
[maven-release-plugin] prepare for next development iteration
2022-03-25 16:45:06 +00:00
Debezium Builder
d19fc234ee
[maven-release-plugin] prepare release v1.9.0.CR1
2022-03-25 16:45:06 +00:00
Sergei Morozov
b258674782
DBZ-3535: Introduce schema.name.adjustment.mode
2022-03-24 09:37:05 +01:00
kate
4b2d5c29be
DBZ-4878 Re-read incremental snapshot chunk on DDL event
2022-03-18 07:55:43 +01:00
Josh Ribera
020e845f44
DBZ-4809 Add task id and partition to the logging context for
...
multi-partition connectors.
Co-authored-by: Sergei Morozov <morozov@tut.by>
2022-03-09 20:46:38 +01:00
Gunnar Morling
d20a6f00e7
DBZ-4801 Using JdbcConfiguration in JdbcConnection
2022-03-07 17:53:45 +01:00
Debezium Builder
fece16039c
[maven-release-plugin] prepare for next development iteration
2022-03-03 17:00:08 +00:00
Debezium Builder
e0d8a0d809
[maven-release-plugin] prepare release v1.9.0.Beta1
2022-03-03 17:00:08 +00:00
Sergei Morozov
2952b7a90f
DBZ-4783: Add a multi-partition integration test
2022-03-01 14:21:39 +01:00
Sergei Morozov
d6e96a5108
DBZ-4783: Refactoring and cleanup
2022-03-01 14:21:39 +01:00
Jacob Gminder
cc11ac193a
DBZ-4783: Support for multiple databases and tasks in the SQL Server connector
...
Co-authored-by: Sergei Morozov <morozov@tut.by>
2022-03-01 14:21:39 +01:00
Josh Ribera
fc6d55e935
DBZ-4783: Add task id label to metrics
2022-03-01 14:21:39 +01:00
Mike Kamornikov
37a67d5dcf
DBZ-4783: Manage change tables per partition
2022-03-01 14:21:39 +01:00
Sergei Morozov
2d14b5b09f
DBZ-4478: Multi-partition metrics for SQL Server
2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c
DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces
2022-02-16 11:31:38 +01:00
Debezium Builder
7a47f478a4
[maven-release-plugin] prepare for next development iteration
2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e
[maven-release-plugin] prepare release v1.9.0.Alpha2
2022-02-09 07:23:10 +00:00
Debezium Builder
33e2f5cd0f
[maven-release-plugin] prepare for next development iteration
2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e
[maven-release-plugin] prepare release v1.9.0.Alpha1
2022-01-26 19:00:20 +00:00
Jiri Pechanec
664d989e42
DBZ-4577 Provide custom error message handling
2022-01-21 10:24:19 +01:00
Jiri Pechanec
8fd3243a86
DBZ-2224 Test logging based on logback
2022-01-18 11:24:21 +01:00
Anisha Mohanty
d6c5ad2e7c
DBZ-4460 Renaming all openapi occurrences to schema
2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f
DBZ-4460 Set default values for format & output directory
2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691
DBZ-4460 Apply the plug-in to all connector modules
2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221
DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation
2022-01-06 19:03:46 +01:00
harveyyue
792187f669
DBZ-4472 Make connector task partition readability for log
2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98
[maven-release-plugin] prepare for next development iteration
2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f
[maven-release-plugin] prepare release v1.8.0.Final
2021-12-16 10:11:28 +00:00
Chris Cranford
882bb9c4d4
DBZ-3306 Only emit schema changes if table schema actual changed
2021-12-11 20:39:46 +01:00
Debezium Builder
f53e6c00df
[maven-release-plugin] prepare for next development iteration
2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a
[maven-release-plugin] prepare release v1.8.0.CR1
2021-12-09 20:16:04 +00:00
Mark Drilling
b922e34b30
DBZ-3697 Adding metadata to fields for SQLServerConnector
2021-12-02 11:07:22 +01:00
Debezium Builder
b5439b54bf
[maven-release-plugin] prepare for next development iteration
2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2
[maven-release-plugin] prepare release v1.8.0.Beta1
2021-11-30 09:38:47 +00:00
Sergei Morozov
437fe0e7bf
DBZ-4273: Filter out capture instances with the same start_lsn
2021-11-24 22:08:31 +01:00
Mike Kamornikov
a7c573676f
DBZ-3992: List change tables within captured LSN interval
...
Co-authored-by: Sergei Morozov <morozov@tut.by>
2021-11-24 22:08:31 +01:00
Vadzim Ramanenka
860f0da198
DBZ-3992: Use a query for listing change tables
2021-11-24 22:08:31 +01:00
Sergei Morozov
56d77c9b7a
DBZ-4273: Rename symbols related to change tables
2021-11-24 22:08:31 +01:00
Sergei Morozov
3d0cb2f6d1
DBZ-4273: Do not source stopLsn from end_lsn
2021-11-24 22:08:31 +01:00
Jacob Gminder
f7f8748062
DBZ-2975: Move the poll interval logic to the ChangeEventSourceCoordinator.
2021-11-22 12:30:31 +01:00
Sergei Morozov
0e04204443
DBZ-4285: Handle login failure during instance upgrade as retriable
2021-11-16 20:31:26 +01:00
Kate
44073cf7d8
DBZ-4196 Support schema changes during incremental snapshot
2021-11-16 14:56:06 +01:00
Chris Cranford
20627bd14a
DBZ-4082 Fix test failure SchemaHistoryTopicIT::schemaChangeAfterSnapshot
2021-11-15 17:03:22 -05:00
Thiago Dantas
39ecc4e732
DBZ-4249 Creates the incremental.snapshot.option.recompile connector configuration for SQL Server
...
This includes OPTION(RECOMPILE) query option for every SELECT statement during the incremental snapshot process, which can help with parameter sniffing problems.
2021-11-12 11:56:06 +01:00
Debezium Builder
f93e901dce
[maven-release-plugin] prepare for next development iteration
2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19
[maven-release-plugin] prepare release v1.8.0.Alpha2
2021-11-11 09:21:59 +00:00
Kate
992ae537c8
DBZ-4244 Quote signal table name in MySQL connector
2021-11-10 10:18:26 +01:00
Chris Cranford
5ec9381702
DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL)
2021-11-10 09:43:25 +01:00
Sergei Morozov
b2df15cf39
DBZ-4245: Handle SQL Server connection errors during database state transition
2021-11-05 20:20:15 +01:00
jiabao.sun
24ead16c24
DBZ-3966 Remove defaultValue and keep defaultValueExpression
2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697
DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues
2021-11-04 10:47:17 +01:00
Juan Fiallo
63367c614a
DBZ-4231 Remove SqlServerConnector database.user Required Validator
2021-11-02 14:48:51 +01:00
ahodavdekar
1d81b6db19
DBZ-4077 Exposing the transaction metadata topic name as a config option
2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4
DBZ-2975 Using Offsets in recover() contract;
...
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
Mike Kamornikov
16c07e915b
DBZ-2975: Recover database schema from multiple partitions
2021-11-01 10:17:49 +01:00
Debezium Builder
2026a48302
[maven-release-plugin] prepare for next development iteration
2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9
[maven-release-plugin] prepare release v1.8.0.Alpha1
2021-10-27 06:47:26 +00:00
Gunnar Morling
c8d6a39c79
DBZ-4125 Removing some redundant code
2021-10-19 15:29:56 +02:00
Gunnar Morling
adba67a2c5
DBZ-4125 Asserting database name in change events;
...
Using assertThat() statically imported.
2021-10-19 15:29:56 +02:00
Gunnar Morling
e5ceddca2f
DBZ-4125 Dropping correct database
2021-10-19 15:29:56 +02:00
cburch824
5209fbc9bb
DBZ-4125 update testDB variable value
2021-10-19 15:29:56 +02:00
cburch824
1de72deafa
DBZ-4125 Add test covering special characters in database name
...
DBZ-4125 Remove unused import
DBZ-4125 Clean up variable usage
2021-10-19 15:29:56 +02:00
cburch824
766139ab05
DBZ-4125 Fix sqlserver connection database name placeholder
...
Add copyright name and alias name
2021-10-19 15:29:56 +02:00
Juan Fiallo
346e0f3af2
DBZ-3517 Making database.user optional for SQL Server.
...
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Juan Fiallo
5ac93ac20e
DBZ-3517 Making database.user optional for SQL Server.
...
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Juan Fiallo
e041b599d8
DBZ-3517 Making database.user optional for SQL Server.
...
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Gunnar Morling
ae1ba98591
DBZ-4082 Logging debug info
2021-10-14 15:42:09 +02:00
Sergei Morozov
4a03c5df17
DBZ-2975: Include database name into topic and schema names
...
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Gunnar Morling
ea75b5b12b
DBZ-4082 Awaiting connector start-up
2021-10-04 13:16:42 +02:00
Jiri Pechanec
f910fc930b
[release] Switch to 1.8 snapshot
2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046
[maven-release-plugin] prepare for next development iteration
2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85
[maven-release-plugin] prepare release v1.7.0.Final
2021-10-01 13:26:33 +02:00
Gunnar Morling
3671c3f4d6
DBZ-3346 Expanding SQL Server connector error handler
2021-09-29 10:11:30 +02:00
Debezium Builder
bec0b6b67e
[maven-release-plugin] prepare for next development iteration
2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725
[maven-release-plugin] prepare release v1.7.0.CR2
2021-09-23 06:31:25 +00:00
Jiri Pechanec
26d0e78023
DBZ-4013 Skip invalid table
2021-09-17 14:20:42 +02:00
Debezium Builder
c15e0b303b
[maven-release-plugin] prepare for next development iteration
2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121
[maven-release-plugin] prepare release v1.7.0.CR1
2021-09-16 08:10:44 +00:00
Gunnar Morling
18a23b19c3
DBZ-4001 Removing constructor only required for tests
2021-09-15 14:21:02 +02:00
Yuan Zhang
fbf56a976d
DBZ-4001 Using connection factory when validating SQL Server connector config
2021-09-15 14:16:39 +02:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
...
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Anisha Mohanty
153e0920e1
DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
...
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Debezium Builder
2ce6bcb2ab
[maven-release-plugin] prepare for next development iteration
2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423
[maven-release-plugin] prepare release v1.7.0.Beta1
2021-08-25 05:20:56 -04:00
Jiri Pechanec
2c49b0277e
DBZ-3229 Increase wait time; do not rely on record delivery in case of failure
2021-08-24 16:34:58 +02:00
Jiri Pechanec
12c20fad53
DBZ-2398 Handle more than one transaction in the list
2021-08-24 16:33:57 +02:00
Gunnar Morling
9a88011718
DBZ-2975 Avoiding redundant log message
2021-08-23 12:01:11 +02:00
Mike Kamornikov
37a4523685
DBZ-2975: Use fully-qualified table and procedure names
...
Co-authored-by: Sergei Morozov <morozov@tut.by>
2021-08-23 12:01:11 +02:00
Sergei Morozov
3f9b5b5e17
DBZ-2975: Remove unused SqlServerConnection methods
2021-08-23 12:01:11 +02:00
Sergei Morozov
b06b5aecbc
DBZ-2975: Introduce opt-in configuration for multi-partition mode
2021-08-23 12:01:11 +02:00
Sergei Morozov
680b6438f5
DBZ-3823 Avoid connectivity errors during task start in SQL Server connector;
...
* Deferring DB-related logic to poll() (so to benefit from retries) or the connector itself
* Removeing dependency of SourceTimestampMode on SqlServerConnection
* More generic connection error handling
2021-08-18 23:05:30 +02:00
Sergei Morozov
8252b19abc
DBZ-3479: Rework handling timezones in SQL Server connector
2021-08-17 22:16:56 +02:00
Jiri Pechanec
11e3ef4325
DBZ-3857 Exclude database name in snapshot tables filtering
2021-08-16 14:12:53 +02:00
Jiri Pechanec
60900290f1
DBZ-3228 Make sure to change db in streaming
2021-08-11 17:09:22 +02:00
Sergei Morozov
a40ad7132d
DBZ-2975: Remove partition from offset context
2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12
DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets
2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52
DBZ-2975: Move Partition to io.debezium.pipeline.spi
2021-08-11 07:34:37 +02:00
Debezium Builder
d3c4482d06
[maven-release-plugin] prepare for next development iteration
2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426
[maven-release-plugin] prepare release v1.7.0.Alpha1
2021-07-30 02:39:08 -04:00
Kate
9b66ab374a
DBZ-3577 Support read-only MySQL incremental snapshots
2021-07-29 07:10:46 +02:00
Chris Cranford
ed31ea9ffb
DBZ-3668 Adjust ServiceLoader for SPI change
2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d
DBZ-3668 Extracting SPI package
2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110
DBZ-3668 Add ServiceLoader hook CloudEvents converter
2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba
DBZ-2975: Add partition awareness to source task components
...
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Debezium Builder
9d3f6b2a86
[maven-release-plugin] prepare for next development iteration
2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56
[maven-release-plugin] prepare release v1.6.0.Final
2021-06-30 03:45:06 -04:00
Debezium Builder
ae053414ac
[maven-release-plugin] prepare for next development iteration
2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74
[maven-release-plugin] prepare release v1.6.0.CR1
2021-06-24 01:50:07 -04:00
Hossein Torabi
cbf2abaaf2
DBZ-2697 Optimisation on SQLServer connector for skipped.operations
2021-06-21 15:52:35 +02:00
Jiri Pechanec
02640df975
DBZ-3597 Re-use the CDC wait test code
2021-06-10 17:55:50 +02:00
Jiri Pechanec
c2086d7104
DBZ-3597 Remove non-captured colmuns from PK
2021-06-10 17:55:50 +02:00
Debezium Builder
48ca58a609
[maven-release-plugin] prepare for next development iteration
2021-06-10 06:03:12 -04:00
Debezium Builder
0961517859
[maven-release-plugin] prepare release v1.6.0.Beta2
2021-06-10 06:03:12 -04:00
Gunnar Morling
1ce65fa628
DBZ-2975 Avoiding raw types in some places;
...
Also parameterizing offset loader contract, so to avoid casts later on.
2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542
DBZ-2975: Extract offset context from object states to method signatures
2021-06-09 16:02:33 +02:00
Jiri Pechanec
5fbebf7593
DBZ-3515 Execute periodic TX commits
...
* DBZ-3515 Execute periodic TX commits
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-05-26 12:52:25 +02:00
Sergei Morozov
dd23e0faad
DBZ-3486: Limit number of processed transactions per iteration
2021-05-25 07:19:43 +02:00
Sergei Morozov
3b72e5149c
DBZ-3486: Replace @see with @link where a URL is referenced
2021-05-25 07:19:43 +02:00
Debezium Builder
ead4ee7226
[maven-release-plugin] prepare for next development iteration
2021-05-20 19:07:44 +02:00
Debezium Builder
9e16df7d4b
[maven-release-plugin] prepare release v1.6.0.Beta1
2021-05-20 19:07:44 +02:00
Jiri Pechanec
90738f53a6
DBZ-3500 Incremental snapshots for SQL Server
2021-05-20 08:06:37 +02:00
Sergei Morozov
ec252a787d
DBZ-3452: Deprecate source.timestamp.mode=processing
2021-05-18 20:57:25 +02:00
Vadzim Ramanenka
7adfaba483
DBZ-3452: source.timestamp.mode=commit imposes a significant performance penalty
...
Fetch LSN's timestamps along with the CDC data.
2021-05-18 20:57:25 +02:00
SiuFay
d96c3138d6
DBZ-3339 Allow retry for transient error in SqlServerConnection.retrieveRealDatabaseName()
2021-05-17 14:06:47 +02:00
Jiri Pechanec
95ed8149c1
DBZ-3339 Connection refused can be retried
2021-05-13 08:06:00 -04:00
Sergei Morozov
e90196989b
DBZ-3505: Better handling of invalid SQL Server connector configuration
2021-05-12 06:03:22 +02:00
Debezium Builder
4dd3a146ca
[maven-release-plugin] prepare for next development iteration
2021-05-06 02:40:15 -04:00
Debezium Builder
b3c5bb281c
[maven-release-plugin] prepare release v1.6.0.Alpha1
2021-05-06 02:40:15 -04:00
Jiri Pechanec
8b0428404b
DBZ-3473 SQL Server field moved reading to connection
2021-05-06 05:37:36 +02:00
Gunnar Morling
dc02b896cd
DBZ-3449 Moving QA releated plug-ins to separate profile, so to avoid loading them at all
2021-04-28 15:14:05 +02:00
Gunnar Morling
8f891248ad
DBZ-3429 Making option retrieval lenient towards trailing/leading whitespace
2021-04-28 11:01:27 +02:00
Anisha Mohanty
f0f8d5d180
DBZ-3161 Refactor/Rename all references of MonitoredTables to CapturedTables
2021-04-26 13:07:23 +02:00
Gunnar Morling
2088c035b1
DBZ-3449 Adding "quick" profile
2021-04-26 06:09:14 +02:00
Anisha Mohanty
1e9630b19d
DBZ-3379 Use current SQL Server container image
2021-04-08 15:07:25 +02:00
Hossein Torabi
5d6705c3fe
DBZ-2699 implement skipped.operation in core
2021-04-08 11:59:08 +02:00
Debezium Builder
8a88ba9b45
[maven-release-plugin] prepare for next development iteration
2021-04-08 04:04:00 -04:00
Debezium Builder
74152afe74
[maven-release-plugin] prepare release v1.5.0.Final
2021-04-08 04:04:00 -04:00
Chris Cranford
776180a0df
DBZ-3347 Emit schema change events with correct source partition
2021-03-30 07:26:06 +02:00
JLDLaughlin
06b0475f17
DBZ-2911 Add additional LSN information to all sources
...
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00
Debezium Builder
6b4d88bb51
[maven-release-plugin] prepare for next development iteration
2021-03-24 06:35:02 -04:00
Debezium Builder
c578715233
[maven-release-plugin] prepare release v1.5.0.CR1
2021-03-24 06:35:02 -04:00
Jiri Pechanec
495be2659b
DBZ-2511 Dedicated logger for schema name adjuster
2021-03-18 14:42:34 +01:00
Gunnar Morling
911b5e9a3b
DBZ-3271 Unifying filter handling across relational connectors
2021-03-17 09:54:25 +01:00
Debezium Builder
f57057421b
[maven-release-plugin] prepare for next development iteration
2021-03-12 04:38:17 -05:00
Debezium Builder
b57293013a
[maven-release-plugin] prepare release v1.5.0.Beta2
2021-03-12 04:38:16 -05:00
Jiri Pechanec
123d9ef4eb
DBZ-3213 Refactor Maven structure to deploy support modules
2021-03-11 16:14:15 +01:00
Gunnar Morling
4d61c57206
DBZ-3157 Adding test
2021-03-11 16:10:08 +01:00
Jiri Pechanec
9a5c605a7f
DBZ-2417 Order returned values for clustered index cases
2021-03-08 11:24:53 +01:00
Debezium Builder
b4c260da50
[maven-release-plugin] prepare for next development iteration
2021-02-23 14:04:01 -05:00
Debezium Builder
123a711a6d
[maven-release-plugin] prepare release v1.5.0.Beta1
2021-02-23 14:04:01 -05:00
Chris Cranford
85f7688527
DBZ-3151 Add filter hook for table unique index resolution
2021-02-22 15:19:25 +01:00
Fahim Farook
194258d87b
DBZ-3164 Log database connection validation failures consistently
2021-02-22 14:52:22 +01:00
Yilong Chang
a0b3704832
DBZ-3056 Validate all fields in subclasses.
2021-02-16 12:34:06 +01:00
Yilong Chang
76c7e0d426
DBZ-3056 Extract basic valdiation in parent class.
2021-02-16 12:34:06 +01:00
Yilong Chang
938aa48ac2
DBZ-3056 Change log level to debug for validation success/error.
2021-02-16 12:34:06 +01:00
Yilong Chang
c004663418
DBZ-3056 Fix format.
2021-02-16 12:34:06 +01:00
Yilong Chang
d98488b376
DBZ-3056 Add validation for SQL Server connector.
2021-02-16 12:34:06 +01:00
Debezium Builder
e08df0a177
[maven-release-plugin] prepare for next development iteration
2021-02-06 01:25:23 -05:00
Debezium Builder
da0411bf70
[maven-release-plugin] prepare release v1.5.0.Alpha1
2021-02-06 01:25:23 -05:00
Jiri Pechanec
2374b6b045
DBZ-1865 First draft of MySQL rewrite
2021-02-04 09:07:55 +01:00
ani-sha
d4003c9172
DBZ-2420 Define database configs under RelationalDatabaseConnectorConfig
2021-02-03 08:05:42 +01:00
Debezium Builder
237b4ac0f1
[maven-release-plugin] prepare for next development iteration
2021-01-28 07:38:55 -05:00
Debezium Builder
06b1d0cbad
[maven-release-plugin] prepare release v1.4.1.Final
2021-01-28 07:38:55 -05:00
siufay325
3d02eb47ac
DBZ-2959 Retry on "The server failed to resume the transaction"
2021-01-25 12:30:34 +01:00
ani-sha
040ec49e90
DBZ-2945 Rename local vars
2021-01-19 16:27:35 +01:00
Gunnar Morling
e342158fa0
DBZ-2698 Using char instead of String
2021-01-19 08:50:31 +01:00
Giovanni De Stefano
8cd2da3bfb
DBZ-2698 Added support for null default value for types int, bigint, smallint, tinyint, float, real
2021-01-18 18:04:34 +01:00
zxxz
1875826d3a
DBZ-2698 Added support for null default value for types int, bigint, smallint, tinyint, float, real
2021-01-18 17:55:56 +01:00
Sergei Morozov
fa1ad8065d
DBZ-2912: Add support for binary.handling.mode to the SQL Server connector
2021-01-16 10:58:06 +01:00
Debezium Builder
3010f99c32
[maven-release-plugin] prepare for next development iteration
2021-01-07 03:38:13 -05:00
Debezium Builder
54534538d9
[maven-release-plugin] prepare release v1.4.0.Final
2021-01-07 03:38:13 -05:00
Debezium Builder
b1ab996c3e
[maven-release-plugin] prepare for next development iteration
2020-12-16 14:11:31 -05:00
Debezium Builder
8fc864b278
[maven-release-plugin] prepare release v1.4.0.CR1
2020-12-16 14:11:31 -05:00
Debezium Builder
cf921f56b4
[maven-release-plugin] prepare for next development iteration
2020-12-10 00:27:40 -05:00
Debezium Builder
c49a377487
[maven-release-plugin] prepare release v1.4.0.Beta1
2020-12-10 00:27:39 -05:00
Thierry De Leeuw
82077bbbb6
DBZ-2767 - MS SQL Decimal with default value not matching the scale of the column definition cause exception
2020-11-20 08:50:29 +01:00
Debezium Builder
4535549dcd
[maven-release-plugin] prepare for next development iteration
2020-11-16 15:18:43 -05:00
Debezium Builder
3c70c5f7d5
[maven-release-plugin] prepare release v1.4.0.Alpha2
2020-11-16 15:18:43 -05:00
vanhoale
17a424d9ac
DBZ-2662 Handle ChangeEventQueue by the size in bytes
2020-11-16 08:39:33 +01:00
Jiri Pechanec
6d6d0a3888
DBZ-2747 Disable unstable corner case test
2020-11-12 18:48:17 +01:00
Jiri Pechanec
3b1f3e7454
DBZ-2625 Retry on transaction deadlock
...
When CDC is reconfigured while connector is running it is possbile to
end up in tx deadlock. Such situation is only temporary and connector
could recover from it upon restart.
2020-11-10 10:01:51 -05:00
Jiri Pechanec
c41aa0e70f
DBZ-2625 Make out-of-sync LSN retriable
...
When the CDC is disabled and enabled during the connector runtime then
the LSNs obtained by connector from min/max queries can get out of sync
with CDCs stored in the table. This issue is solved when connector is
restarted.
2020-11-10 10:01:51 -05:00
Jiri Pechanec
9001946073
DBZ-2716 Guard against missing position mapping
2020-11-10 09:59:41 -05:00
Hussain
c58b3123fc
DBZ-2727: Added exceptio to retry when there is Write failed
2020-11-05 10:07:55 +01:00
Chris Cranford
6bc01a1660
DBZ-2625 Fix intermittent failures in SqlServerConnectorIT
2020-10-28 14:31:53 +01:00
Debezium Builder
26883dad92
[maven-release-plugin] prepare for next development iteration
2020-10-22 03:45:59 -04:00
Debezium Builder
9adbc2d67e
[maven-release-plugin] prepare release v1.4.0.Alpha1
2020-10-22 03:45:59 -04:00
Jiri Pechanec
ee5353ef6f
DBZ-2653 Process commits even with tx monitoring
2020-10-20 10:42:10 +02:00
James Gormley
bea46a3059
DBZ-2582 Fixing LSN casing
2020-10-19 09:19:54 +02:00
James Gormley
3d8714d6dd
DBZ-2582 Adding boolean check and removing TODO as no changes are necessary
2020-10-19 09:19:54 +02:00
James Gormley
da03b4b5b6
DBZ-2582 Updating test for consistency
2020-10-19 09:19:54 +02:00
James Gormley
55e68df708
DBZ-2582 Updating configuration to be feature flag and using prepared statements
2020-10-19 09:19:54 +02:00
James Gormley
67ff06df95
DBZ-2582 Apply suggestions from code review
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2020-10-19 09:19:54 +02:00
James Gormley
f4b76a79c6
DBZ-2582 Adding copyright
2020-10-19 09:19:54 +02:00
James Gormley
bac39cf55a
DBZ-2582 Fixing tests and adding pause back
2020-10-19 09:19:54 +02:00
James Gormley
6d68bb02de
DBZ-2582-lsn-changes revert log change
2020-10-19 09:19:54 +02:00
James Gormley
4637425598
DBZ-2582 Updating LSN handling
2020-10-19 09:19:54 +02:00
Kaushik Iyer
7d9e8fdc46
DBZ-2456 fixes after rebase
2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932
DBZ-2456 selective snapshot implementation
2020-10-16 10:13:48 +02:00
Jiri Pechanec
c5a595c0f1
DBZ-2642 Hide scary stacktrace
2020-10-08 15:04:51 +02:00
Debezium Builder
95b8ed3877
[maven-release-plugin] prepare for next development iteration
2020-10-01 09:08:51 -04:00
Debezium Builder
19ad73beb2
[maven-release-plugin] prepare release v1.3.0.Final
2020-10-01 09:08:50 -04:00
Gunnar Morling
b792ac3274
DBZ-2495 Misc. fixes
2020-09-30 12:13:45 +02:00
James Gormley
b0a4a8b5ba
DBZ-2495 Making test slightly more stable
2020-09-30 12:13:45 +02:00
Gunnar Morling
6b5a3100e9
DBZ-2495 Misc. clean-up
2020-09-30 12:13:45 +02:00
James Gormley
9e780ac481
DBZ-2495 Updating per PR comments
2020-09-30 12:13:45 +02:00
James Gormley
ede29fd8d6
DBZ-2495 Moving string splitting logic out of constructor
2020-09-30 12:13:45 +02:00
James Gormley
1b845535ab
DBZ-2495 Updating tables to utilize Table.editor for creating new tables
2020-09-30 12:13:45 +02:00
James Gormley
ad2273e9f6
DBZ-2495 Updating per PR comments
2020-09-30 12:13:45 +02:00
James Gormley
c7b53e1992
DBZ-2495 Updating docs and comments
2020-09-30 12:13:45 +02:00
James Gormley
0d46ec47da
DBZ-2495 Updating to handle captured_column_list without specify column.exclude.list
2020-09-30 12:13:45 +02:00
Chris Cranford
500d197d94
DBZ-2474 Fix test failure - DatatypesFromSnapshotIT#stringTypes
2020-09-28 22:54:34 +02:00
Chris Cranford
c4d1772aee
DBZ-2599 Fix test failure - SQLServerConnectorIT#verifyOffsets
2020-09-24 22:36:32 +02:00
Debezium Builder
b146b69154
[maven-release-plugin] prepare for next development iteration
2020-09-24 04:56:42 -04:00
Debezium Builder
c51cfe8eb9
[maven-release-plugin] prepare release v1.3.0.CR1
2020-09-24 04:56:41 -04:00
Debezium Builder
837669890a
[maven-release-plugin] prepare for next development iteration
2020-09-16 12:18:08 -04:00
Debezium Builder
086dbd960b
[maven-release-plugin] prepare release v1.3.0.Beta2
2020-09-16 12:18:08 -04:00
James Gormley
6d0d60a326
DBZ-2522 Implementing column.include.list for sql server
2020-09-16 07:54:46 +02:00
James Gormley
45e44a2a1b
DBZ-2522 Using updated terminology in test cases
2020-09-16 07:54:46 +02:00
James Gormley
b658375a3d
DBZ-2522 Fixing EventProcessingFailureHandlingIT
2020-09-16 07:54:46 +02:00
James Gormley
5d1ef9a03d
DBZ-2522 Fixing index out of bounds for columns excluded from cdc tables
2020-09-16 07:54:46 +02:00
Chris Cranford
8a12245c94
DBZ-137 DBZ-2283 Exclude filtered columns in SQL Server snapshot
2020-09-14 12:33:43 +02:00
Chris Cranford
a686c1c875
DBZ-137 Suggested changes
2020-09-14 12:33:43 +02:00
Chris Cranford
5ca36a84ad
DBZ-137 Reimagine stream.fetch.size as query.fetch.size
2020-09-14 12:33:43 +02:00