Chris Cranford
5ec9381702
DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL)
2021-11-10 09:43:25 +01:00
Chris Cranford
343318b5d4
DBZ-3710 Support Oracle column default values
2021-11-10 09:43:25 +01:00
harveyyue
aa3ae05e22
DBZ-4107 Incremental snapshot doesn't work without primary key
2021-11-05 13:31:26 +01:00
Gunnar Morling
1226c3b2ab
DBZ-4029 Misc. clean-up;
...
* Exposing heartbeatInterval() on CommonConnectorConfig
* Closing heartbeat connection
* Making test more resilient
* Correct member ordering and visibility
* Doc fixes
2021-11-05 13:27:09 +01:00
ahodavdekar
91b7ef2c36
DBZ-4029 Adding support for heartbeat action queries to MySQL connector
2021-11-05 13:27:09 +01:00
Gunnar Morling
b78e318399
DBZ-3966 Expanding test
2021-11-04 10:47:24 +01:00
jiabao.sun
2987e96c44
DBZ-3966 Serializing hasDefaultValue in JsonTableChangeSerializer
2021-11-04 10:47:17 +01:00
Gunnar Morling
d1cae3f3b7
DBZ-3966 Making defaultValueExpression() return Optional<String> from editor too
2021-11-04 10:47:17 +01:00
jiabao.sun
24ead16c24
DBZ-3966 Remove defaultValue and keep defaultValueExpression
2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697
DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues
2021-11-04 10:47:17 +01:00
Kate
a645d0bc7e
DBZ-4197 Process transaction started/committed in R/O snapshot
2021-11-04 06:19:58 +01:00
ahodavdekar
1d81b6db19
DBZ-4077 Exposing the transaction metadata topic name as a config option
2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4
DBZ-2975 Using Offsets in recover() contract;
...
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
Mike Kamornikov
16c07e915b
DBZ-2975: Recover database schema from multiple partitions
2021-11-01 10:17:49 +01:00
Debezium Builder
2026a48302
[maven-release-plugin] prepare for next development iteration
2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9
[maven-release-plugin] prepare release v1.8.0.Alpha1
2021-10-27 06:47:26 +00:00
Jiri Pechanec
a1084360da
DBZ-435 Too fast delete can prevent from obtaining the full document
2021-10-26 18:13:16 +02:00
Jiri Pechanec
cb36b575db
DBZ-435 Support for Change Streams capture
2021-10-26 18:13:16 +02:00
Sungho Hwang
54d5c16b69
DBZ-4191 Fixed a variable name in an unit test of Outbox Event Router to enhance readability.
2021-10-22 07:57:24 +02:00
harveyyue
90e9bea93f
DBZ-4000 Support parse table and columns comment
2021-10-20 15:19:31 +02:00
Anisha Mohanty
2eae7a742c
DBZ-4045 Use listener props for deprecated host & port props
2021-10-20 11:51:34 +02:00
Gunnar Morling
3d093e2a3b
DBZ-4164 Import ordering
2021-10-18 14:45:00 +02:00
lujiefsi
12ccc24e17
DBZ-4164 Fixing resource leak due to Files::lines
2021-10-18 14:31:39 +02:00
Juan Fiallo
346e0f3af2
DBZ-3517 Making database.user optional for SQL Server.
...
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Juan Fiallo
5ac93ac20e
DBZ-3517 Making database.user optional for SQL Server.
...
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Juan Fiallo
e041b599d8
DBZ-3517 Making database.user optional for SQL Server.
...
SQL Server doesn't require username/password when using Kerberos authentication, which can be configured using pass-through database properties. Changing the database.user config to be optional for SQL Server Connector to reflect that.
2021-10-18 12:06:56 +02:00
Jiri Pechanec
0ccc83db21
DBZ-3860 Provide correct boundaries for multi PK tables
2021-10-14 17:26:50 +02:00
Gunnar Morling
26f13d83d5
DBZ-3993 Reflectively invoking Runtime.version();
...
As that API is only available from Java 9 onwards, calling it will cause
a compilation failure when compiling with --release.
2021-10-14 09:46:06 -04:00
Gunnar Morling
6b3d2c3b76
DBZ-3993 Formatting fix
2021-10-13 10:59:23 +02:00
Gunnar Morling
c3eed6051b
DBZ-3993 Skipping object size based test on Java 16+
2021-10-13 10:59:23 +02:00
Sergei Morozov
4a03c5df17
DBZ-2975: Include database name into topic and schema names
...
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Jiri Pechanec
657c5540b3
DBZ-4083 Add filter to MongoDB cloud converter
2021-10-11 11:19:30 +02:00
Jiri Pechanec
aec2080415
DBZ-3895 Config returns Patterns not Strings
2021-10-11 10:57:33 +02:00
Jiri Pechanec
68f148c3f3
DBZ-3895 Make snapshot collection list matching case insensitive
2021-10-11 10:57:33 +02:00
Chris Cranford
abc3bb42d6
DBZ-4106 Don't continuously reconfigure DatabaseHistory
2021-10-05 20:15:58 +02:00
Gunnar Morling
62715c4e1d
DBZ-4033 Doc update
2021-10-05 10:54:01 +02:00
unalsurmeli
9a13d80074
DBZ-4033 A new hash version has been added so that it can be used to have the same hash value in different places;
...
In V2, the byte array only has the actual value, unlike the serialization based V1 implementation which exposed Java's internal serialization format.
2021-10-05 10:52:30 +02:00
Vivek Wassan
82dad32e2a
DBZ-4078 Checking connection is valid before commit in readChunk()
2021-10-04 10:00:27 +02:00
Laurent Broudoux
77eaa0a293
DBZ-1297 Add boolean type in test
2021-10-01 22:29:53 +02:00
Laurent Broudoux
7b7a1f3064
DBZ-1297 Expand JSON escaped string as JSON
2021-10-01 22:29:53 +02:00
Jiri Pechanec
f910fc930b
[release] Switch to 1.8 snapshot
2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046
[maven-release-plugin] prepare for next development iteration
2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85
[maven-release-plugin] prepare release v1.7.0.Final
2021-10-01 13:26:33 +02:00
Jiri Pechanec
a2c6058404
DBZ-4057 Initialize Postgres schema before incremental snapshot restart
2021-09-30 09:10:49 +02:00
Debezium Builder
bec0b6b67e
[maven-release-plugin] prepare for next development iteration
2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725
[maven-release-plugin] prepare release v1.7.0.CR2
2021-09-23 06:31:25 +00:00
Naveen Kumar KR
62045f6430
DBZ-3887 1) Replace notifyAll with notify as atmost only one thread would be in wait state at any time
...
2) Remove synchronized from jmh metric methods as it doesn't strictly require lock due to nature of metrics
3) Always wait by predefined timeout to gurantee that thread would never stuck
2021-09-22 19:12:21 +02:00
Naveen Kumar KR
858557d184
DBZ-3887 Major improvements for Throughput Bottleneck and Inefficient Batching in ChangeEventQueue
...
* Replaced naive metronome.pause and Thread.sleep with efficient wait() and notifyAll()
* Replaced LinkedBlockingDeque with ArrayDeque for better performance
* Replaced Atomic and Map operation related to maxQueueSize with primitive long and ArrayDeque for better performance
* x10 - x100 Improvements in overall throughput
* Efficient batching based on maxBatchSize
2021-09-22 19:12:21 +02:00
Kate
0099a50c53
DBZ-3948 Support kafka topic based signals
2021-09-22 13:08:45 +02:00
Vivek Wassan
b6e891ec7d
DBZ-3951 Moving preReadChunk() to AbstractIncrementalSnapshotChangeEventSource
2021-09-22 07:01:29 +02:00
Vivek Wassan
65ac2387dc
DBZ-3951 Adding a separate isValid method
2021-09-22 07:01:29 +02:00
Vivek Wassan
5f37e6630f
DBZ-3951 Adding a safety check, isValid, for connection
2021-09-22 07:01:29 +02:00
Naveen Kumar KR
b5ccd249c9
DBZ-4015 1) TableIdParser - Initialize ArrayList with optimal capacity of 3 (at max three parts in an identifier - catalog.schema.table)
...
2) TableId - Replace .stream().toArray() with .toArray() to eliminate stream overhead
2021-09-21 10:35:08 +02:00
Naveen Kumar KR
4c5264f7d2
DBZ-4015 Efficient String Replacement using String.replace in TableIdParser (improvement of x4-x5 times)
...
(https://medium.com/javarevisited/micro-optimizations-in-java-string-replaceall-c6d0edf2ef6 )
2021-09-21 10:35:08 +02:00
Jiri Pechanec
26d0e78023
DBZ-4013 Skip invalid table
2021-09-17 14:20:42 +02:00
Debezium Builder
c15e0b303b
[maven-release-plugin] prepare for next development iteration
2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121
[maven-release-plugin] prepare release v1.7.0.CR1
2021-09-16 08:10:44 +00:00
Anisha Mohanty
f57545d7b1
DBZ-3787 Add tests for invisible & visible columns using testcontainers
...
*Using user "debezium" to have right grants provided
2021-09-15 15:13:18 +02:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
...
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Gunnar Morling
6f1577a70b
DBZ-3958 Gracefully handling history file in sym-linked directory;
...
Also removing redundant test method definition.
2021-09-09 12:18:21 +02:00
Gunnar Morling
7c150de943
DBZ-2525 Don't qualify selected columns with table name;
...
It shouldn't be needed as we select from a single table, and it caused the columns to not be found for the Db2 connector.
2021-08-31 17:39:36 +05:30
Anisha Mohanty
153e0920e1
DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
...
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Jiri Pechanec
a36eb45dff
DBZ-3912 Added Binary padding for hex/base64 handling mode
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-08-27 09:48:19 +02:00
Debezium Builder
2ce6bcb2ab
[maven-release-plugin] prepare for next development iteration
2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423
[maven-release-plugin] prepare release v1.7.0.Beta1
2021-08-25 05:20:56 -04:00
Jiri Pechanec
4396513795
DBZ-3901 Guard against chunk signal coming when none expected
2021-08-24 10:26:32 +02:00
rkerner
52333596de
DBZ-3364 add additional metadata to fields for API spec generator for the Debezium UI
...
part of https://issues.redhat.com/browse/DBZ-3364
DBZ-2653 User rollback from parent class
2021-08-23 17:57:38 +02:00
Chris Cranford
973fa248ed
DBZ-3902 Fix test failure shouldNotEmitDdlEventsForNonTableObjects
2021-08-23 11:44:14 -04:00
Gunnar Morling
36af61b789
DBZ-3889 Moving ContainerImageVersions to core for broader re-use and using it in two more places
2021-08-23 12:34:03 +02:00
Sergei Morozov
b06b5aecbc
DBZ-2975: Introduce opt-in configuration for multi-partition mode
2021-08-23 12:01:11 +02:00
Jiri Pechanec
11e3ef4325
DBZ-3857 Exclude database name in snapshot tables filtering
2021-08-16 14:12:53 +02:00
Gunnar Morling
c2b13037fb
DBZ-3444 Upgrading to Apache Kafka 2.8
2021-08-12 11:57:57 +02:00
Gunnar Morling
9b0f784fcd
DBZ-3444 Removing unused dependency to Apache Curator
2021-08-12 11:57:57 +02:00
Jiri Pechanec
a4fba49184
DBZ-3688 Expose min/max key for incrementally snapshotted table
2021-08-11 14:40:15 +02:00
Chris Cranford
46590a3bc6
DBZ-3839 Simplify version checks
2021-08-11 07:35:57 +02:00
Chris Cranford
c15cf81e18
DBZ-3839 Correctly skip tests with minor/patch not specified
2021-08-11 07:35:57 +02:00
Sergei Morozov
a40ad7132d
DBZ-2975: Remove partition from offset context
2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12
DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets
2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52
DBZ-2975: Move Partition to io.debezium.pipeline.spi
2021-08-11 07:34:37 +02:00
Chris Cranford
85a732d7dc
DBZ-3842 Validate keySchema is null and not valueSchema
2021-08-10 11:15:55 +02:00
pkgonan
fae4f45acc
DBZ-3765 Add dot pattern test code for database.server.name
2021-08-08 16:25:15 -04:00
pkgonan
5e0ffa28d2
DBZ-3765 Allow dot in database.server.name
2021-08-08 16:25:15 -04:00
Debezium Builder
d3c4482d06
[maven-release-plugin] prepare for next development iteration
2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426
[maven-release-plugin] prepare release v1.7.0.Alpha1
2021-07-30 02:39:08 -04:00
Chris Cranford
26461bc07d
DBZ-3692 Introduce completion callback for incremental snapshots
2021-07-29 13:51:42 +02:00
Chris Cranford
393a44a55f
DBZ-3692 Oracle incremental snapshot support
2021-07-29 13:51:42 +02:00
Kate
9b66ab374a
DBZ-3577 Support read-only MySQL incremental snapshots
2021-07-29 07:10:46 +02:00
Gunnar Morling
09ebc833f3
DBZ-3655 Gracefully handling DB shutdown
2021-07-27 10:21:54 +02:00
Anisha Mohanty
bd47fecdbd
DBZ-3717 Throw MultipleParsingExceptions to handle multiple parsing errors & smooth running of database history
2021-07-22 14:12:38 -04:00
Hossein Torabi
0ad8ededa3
DBZ-3725 Validate table before start incemental processing
2021-07-21 14:53:22 -04:00
Gunnar Morling
b84c3c870d
DBZ-3668 Extracting SPI package
2021-07-03 16:31:52 +07:00
Gunnar Morling
dcb7336902
DBZ-3668 Making provoiders map unmodifiable
2021-07-03 16:31:52 +07:00
Chris Cranford
2e84427603
DBZ-3668 Consolidate ServiceLoader lookup
2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110
DBZ-3668 Add ServiceLoader hook CloudEvents converter
2021-07-03 16:31:52 +07:00
Chris Cranford
219ed17a28
DBZ-3668 Add CloudEventsConverter support for Vitess connector
2021-07-03 16:31:52 +07:00
Chris Cranford
80a4e003d8
DBZ-3668 Add CloudEventsConverter support for Db2 connector
2021-07-03 16:31:52 +07:00
Chris Cranford
3f759a8daa
DBZ-3668 Add CloudEventsConverter support for Oracle connector
2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba
DBZ-2975: Add partition awareness to source task components
...
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Sergei Morozov
0c0c4f5e33
DBZ-2975: Introduce partition-aware API components
2021-07-03 10:56:34 +02:00
Gunnar Morling
5b76bf1b71
DBZ-3632 Pulling up getJdbcConfig() to RelationalDatabaseConnectorConfig
2021-07-01 15:11:01 +02:00