Commit Graph

1073 Commits

Author SHA1 Message Date
Debezium Builder
b5439b54bf [maven-release-plugin] prepare for next development iteration 2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2 [maven-release-plugin] prepare release v1.8.0.Beta1 2021-11-30 09:38:47 +00:00
Chris Cranford
2347b58250 DBZ-4272 Added javadoc 2021-11-30 09:28:44 +01:00
Chris Cranford
0a10d5b484 DBZ-4272 Trigger schema refresh before snapshot; only for PostgreSQL 2021-11-30 09:28:44 +01:00
Chris Cranford
652f41f7fb DBZ-4272 Add drop column schema change to test 2021-11-30 09:28:44 +01:00
Gunnar Morling
74bb80aae7 DBZ-2363 Removing unused methods 2021-11-29 14:55:49 +01:00
Gunnar Morling
a8cda23ef2 DBZ-4370 Only setting "messages" option on PG 14+;
Also avoiding setting stream options repeatedly.
2021-11-29 14:55:49 +01:00
Gunnar Morling
2157256398 DBZ-4364 Awaiting table metadata to become queryable 2021-11-29 09:23:18 +01:00
Gunnar Morling
a041a6bd5c DBZ-4364 Removing unused methods 2021-11-29 09:23:18 +01:00
Gunnar Morling
5866056a41 DBZ-2363 Using prefix as message key 2021-11-26 18:15:25 +01:00
Gunnar Morling
560ef2babd DBZ-2363 Misc. adjustments;
* Adding Strings::isBlank()
* Simplifying test
* Using long in cases where we know it's present
* Removing some unused code
* Testing binary handling mode
* Avoiding TX id value overflow
* Assigning names to schemas to avoid issues as in DBZ-650
2021-11-26 14:29:15 +01:00
Gunnar Morling
b85a9d2f20 DBZ-2363 Extracting separate test class for logical decoding message tests 2021-11-26 14:29:15 +01:00
Lairen Hightower
450998b49e DBZ-2363 Replace logicalDecodingMessageHandlingMode with a prefix filtering configuration 2021-11-26 14:29:15 +01:00
Gunnar Morling
fcfc9bc785 DBZ-2363 Misc. adjustments;
* Removing unused method
* Unifying update() handling
* Member ordering
* Avoiding NPE in error handler
2021-11-26 14:29:15 +01:00
lairen
a0898ed440 DBZ-2363 Adding support for pg_logical_emit messages in Postgres connector for the pgoutput plugin 2021-11-26 14:29:15 +01:00
Jiri Pechanec
dc3ee488f1 DBZ-4343 Use schema component for incremental snapshot TableId 2021-11-24 10:25:33 +01:00
Andrey Yegorov
b6d2c41fb0 DBZ-4309 Avoid calling 'LoggerFactory.getLogger(getClass())' for each new instance of the RelationalChangeRecordEmitter 2021-11-18 22:37:51 +01:00
Vojtech Juranek
c0a65743f8 DBZ-1042 Allow Postgres connector to use numeric slot names
To be able to use numeric slot names, the slot name has to be quoted.
This may be consider as s bug in Postgres driver as Debezium passes the
slot name as string. To workaround this issue, quote the slot name on
the Debezium side.
2021-11-18 10:27:48 +01:00
Vojtech Juranek
1ca917a428 DBZ-1042 Allow numeric slot names 2021-11-18 10:27:48 +01:00
Vojtech Juranek
50da5e31dc DBZ-1931 Allow to specify number of fraction digits for the money type 2021-11-17 09:30:15 +01:00
Vojtech Juranek
6f286fe50c DBZ-1931 Reflect decimal.handling.mode in money conversion 2021-11-17 09:30:15 +01:00
Chris Cranford
e3da449303 DBZ-4276 Expose unavailable value placeholder for PG and Oracle only 2021-11-16 20:29:59 +01:00
Chris Cranford
ca17352221 DBZ-4276 Unify unavailable value placeholder handling
Deprecate the `toasted.value.placeholder` option in PostgreSQL in favor
of the new `unavailable.value.placeholder` option that is shared by all
relational connectors.
2021-11-16 20:29:59 +01:00
Kate
44073cf7d8 DBZ-4196 Support schema changes during incremental snapshot 2021-11-16 14:56:06 +01:00
Debezium Builder
f93e901dce [maven-release-plugin] prepare for next development iteration 2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19 [maven-release-plugin] prepare release v1.8.0.Alpha2 2021-11-11 09:21:59 +00:00
Kate
992ae537c8 DBZ-4244 Quote signal table name in MySQL connector 2021-11-10 10:18:26 +01:00
Chris Cranford
5ec9381702 DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL) 2021-11-10 09:43:25 +01:00
harveyyue
aa3ae05e22 DBZ-4107 Incremental snapshot doesn't work without primary key 2021-11-05 13:31:26 +01:00
Gunnar Morling
1226c3b2ab DBZ-4029 Misc. clean-up;
* Exposing heartbeatInterval() on CommonConnectorConfig
* Closing heartbeat connection
* Making test more resilient
* Correct member ordering and visibility
* Doc fixes
2021-11-05 13:27:09 +01:00
ahodavdekar
91b7ef2c36 DBZ-4029 Adding support for heartbeat action queries to MySQL connector 2021-11-05 13:27:09 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Gunnar Morling
9a4d0ad363 DBZ-4137 Test clean-up 2021-11-02 16:50:26 +01:00
Andrey Yegorov
b174927a52 DBZ-4137 Postgres defaults handling misses decimal mode configuration and cannot handle numerics with default NULL values 2021-11-02 16:50:26 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Anisha Mohanty
9f7ede0e06 DBZ-3626 Renaming master branches to main 2021-10-28 09:33:32 +02:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
Gunnar Morling
33764b2adc DBZ-4150 Using set instead of list 2021-10-19 12:32:16 +02:00
Hossein Torabi
6027d762a6 DBZ-4150 Trim numerical defaultValue before converting postgres-connector 2021-10-19 12:27:26 +02:00
Jiri Pechanec
0ccc83db21 DBZ-3860 Provide correct boundaries for multi PK tables 2021-10-14 17:26:50 +02:00
Anisha Mohanty
310a0b6ef3 DBZ-4145 Skip failing test for wal2json 2021-10-14 13:17:08 +02:00
Gunnar Morling
c3eed6051b DBZ-3993 Skipping object size based test on Java 16+ 2021-10-13 10:59:23 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Gunnar Morling
015b219c58 DBZ-4046 Some testing clean-up;
* Fixing mixed up order of expected and actual value
* Using more expressive var names
2021-10-11 06:04:42 +02:00
Judah Rand
5d23b30f67 DBZ-4046 Update isVariableScaleDecimal
This puts the method in line with
https://github.com/pgjdbc/pgjdbc/issues/2188
where expected value was changed from `131089` to `0`.
However, for numeric arrays the issue remains and so
`131089` remains the correct value for them.
2021-10-08 10:42:21 +02:00
Jiri Pechanec
d5eafd3ecf DBZ-3919 Add logs to test 2021-10-06 09:36:21 +02:00
Jiri Pechanec
dae384baf4 DBZ-4081 Close leaking connections 2021-10-05 12:52:03 +02:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00
Jiri Pechanec
6d0760df45 DBZ-4060 Remove race condition 2021-10-01 11:25:14 +02:00
Judah Rand
6ad791bedc DBZ-4060 Add default value mapper for smallserial 2021-10-01 11:25:14 +02:00
Jiri Pechanec
a2c6058404 DBZ-4057 Initialize Postgres schema before incremental snapshot restart 2021-09-30 09:10:49 +02:00
Debezium Builder
bec0b6b67e [maven-release-plugin] prepare for next development iteration 2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725 [maven-release-plugin] prepare release v1.7.0.CR2 2021-09-23 06:31:25 +00:00
Naveen Kumar KR
d07643d60f DBZ-3887 PostgresMetricsIT Test fix
* Remove redundant oneRecordInQueue test
* Rename test method from twoRecordsInQueue -> oneRecordInQueue to reflect the actual assertion done
2021-09-22 19:12:21 +02:00
Debezium Builder
c15e0b303b [maven-release-plugin] prepare for next development iteration 2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121 [maven-release-plugin] prepare release v1.7.0.CR1 2021-09-16 08:10:44 +00:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Gunnar Morling
7c150de943 DBZ-2525 Don't qualify selected columns with table name;
It shouldn't be needed as we select from a single table, and it caused the columns to not be found for the Db2 connector.
2021-08-31 17:39:36 +05:30
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Gunnar Morling
11ed86a807 DBZ-3889 Reducing logging of serializers 2021-08-30 12:20:55 +02:00
Jiri Pechanec
82b151d0b9 DBZ-3935 Invalid validation of truncate handling mode 2021-08-30 09:47:55 +02:00
Debezium Builder
2ce6bcb2ab [maven-release-plugin] prepare for next development iteration 2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423 [maven-release-plugin] prepare release v1.7.0.Beta1 2021-08-25 05:20:56 -04:00
rkerner
52333596de DBZ-3364 add additional metadata to fields for API spec generator for the Debezium UI
part of https://issues.redhat.com/browse/DBZ-3364
DBZ-2653 User rollback from parent class
2021-08-23 17:57:38 +02:00
Gunnar Morling
36af61b789 DBZ-3889 Moving ContainerImageVersions to core for broader re-use and using it in two more places 2021-08-23 12:34:03 +02:00
Gunnar Morling
0fedadd77e DBZ-3889 Avoiding some log noise 2021-08-23 12:34:03 +02:00
Naveen Kumar KR
9527843974 DBZ-3870 Performance Improvements in PostgresChangeRecordEmitter
1) Reuse parsed TableId to avoid expensive PostgresSchema.parse() call
2) Immediate conditional return in synchronizeTableSchema() call
2021-08-13 22:11:48 +02:00
Sergei Morozov
a40ad7132d DBZ-2975: Remove partition from offset context 2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12 DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets 2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52 DBZ-2975: Move Partition to io.debezium.pipeline.spi 2021-08-11 07:34:37 +02:00
Jiri Pechanec
b0e0052a9c DBZ-3828 Update event LSN for commits 2021-08-10 20:41:37 +02:00
Gunnar Morling
85e6d262ea DBZ-3816 Wording changes 2021-08-09 10:08:47 +02:00
Jiri Pechanec
305c15132f DBZ-3816 Workaround for Kafka Connect bug 2021-08-09 10:08:47 +02:00
Gunnar Morling
bf9f7f5596 DBZ-3801 Allocating sequence list with correct size 2021-08-04 10:25:09 +02:00
Brennan Vincent
b03d9d1fa6 DBZ-3801: Address code review comments 2021-08-04 10:25:09 +02:00
Brennan Vincent
975f1690f2 DBZ-3801 Fix calculation of sequence numbers for Postgres 2021-08-04 10:25:09 +02:00
Debezium Builder
d3c4482d06 [maven-release-plugin] prepare for next development iteration 2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426 [maven-release-plugin] prepare release v1.7.0.Alpha1 2021-07-30 02:39:08 -04:00
Kate
9b66ab374a DBZ-3577 Support read-only MySQL incremental snapshots 2021-07-29 07:10:46 +02:00
Jiri Pechanec
b387775448 DBZ-3655 Connection liveness check triggers replication earlier 2021-07-27 11:07:52 -04:00
Jiri Pechanec
f46e0ca9a6 DBZ-3655 Commit check connection query 2021-07-27 15:32:35 +02:00
Gunnar Morling
09ebc833f3 DBZ-3655 Gracefully handling DB shutdown 2021-07-27 10:21:54 +02:00
Chris Cranford
9f5c49246f DBZ-3769 Remove TODO and change log message level 2021-07-27 09:31:51 +02:00
bep7520
9e9c2fc2ab DBZ-3769 Throw sqlexception from postgres message decoder 2021-07-27 09:31:51 +02:00
Naveen Kumar KR
7844b59c2f DBZ-3770 Optimize ObjectMapper initialization by replacing repeated initialization with one time initilization
- Performance Improvement of approx 5% - 15%
2021-07-21 14:44:09 -04:00
Chris Cranford
ed31ea9ffb DBZ-3668 Adjust ServiceLoader for SPI change 2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d DBZ-3668 Extracting SPI package 2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110 DBZ-3668 Add ServiceLoader hook CloudEvents converter 2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba DBZ-2975: Add partition awareness to source task components
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Gunnar Morling
5b76bf1b71 DBZ-3632 Pulling up getJdbcConfig() to RelationalDatabaseConnectorConfig 2021-07-01 15:11:01 +02:00
Jiri Pechanec
ee0bd2f7da DBZ-3685 Postgres keepalive thread uses correct name 2021-07-01 11:40:59 +02:00
Debezium Builder
9d3f6b2a86 [maven-release-plugin] prepare for next development iteration 2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56 [maven-release-plugin] prepare release v1.6.0.Final 2021-06-30 03:45:06 -04:00
Debezium Builder
ae053414ac [maven-release-plugin] prepare for next development iteration 2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74 [maven-release-plugin] prepare release v1.6.0.CR1 2021-06-24 01:50:07 -04:00
Debezium Builder
48ca58a609 [maven-release-plugin] prepare for next development iteration 2021-06-10 06:03:12 -04:00