sarumont
edbee2e8f6
DBZ-3657: add null check when building array converters
2022-01-06 20:23:08 +01:00
harveyyue
291e8ac221
DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation
2022-01-06 19:03:46 +01:00
harveyyue
792187f669
DBZ-4472 Make connector task partition readability for log
2021-12-20 15:58:14 +01:00
Jiri Pechanec
967432ad08
DBZ-4469 Test should run with any Postgres version
2021-12-17 13:57:53 +01:00
Debezium Builder
67c9663c98
[maven-release-plugin] prepare for next development iteration
2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f
[maven-release-plugin] prepare release v1.8.0.Final
2021-12-16 10:11:28 +00:00
Chris Cranford
63731a2a09
DBZ-3940 Unify EventRouter tests for connectors
2021-12-13 13:52:31 +01:00
Jiri Pechanec
740b6b21f6
DBZ-4298 Support non-JDBC logical values in keys for incremental snapshots
...
Incremental snapshot source gets the PK values after they are processed
by value converter. This is usally correct solution. The values are
passed to chunk queries. There are few datatypes like unconstrained
NUMERIC in PostgreSQL that must be converted to a Debezium specific
class to keep and enrich the value. Such class is not known to JDBC
driver. This commit intorduce a marker interface that enables the code
to identify the value not recognized by JDBC and provides a method to
obtain the original value.
2021-12-13 12:29:21 +01:00
Gunnar Morling
0023cb10a5
DBZ-4393 Create a Debezium Schema Generator for Debezium connectors
...
* added an API generator for Debezium connectors and static API definitions for connectors in a separate module
* added Maven plug-in
* added GH workflow for debezium-schema-generator
Co-authored-by: rkerner <rkerner.mobil@gmail.com>
Co-authored-by: Anisha Mohanty <anishamohanty23@gmail.com>
2021-12-10 12:35:09 +01:00
Debezium Builder
f53e6c00df
[maven-release-plugin] prepare for next development iteration
2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a
[maven-release-plugin] prepare release v1.8.0.CR1
2021-12-09 20:16:04 +00:00
Chris Cranford
c095cb7090
DBZ-2792 Remove test
2021-12-07 14:57:23 +01:00
Debezium Builder
b5439b54bf
[maven-release-plugin] prepare for next development iteration
2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2
[maven-release-plugin] prepare release v1.8.0.Beta1
2021-11-30 09:38:47 +00:00
Chris Cranford
2347b58250
DBZ-4272 Added javadoc
2021-11-30 09:28:44 +01:00
Chris Cranford
0a10d5b484
DBZ-4272 Trigger schema refresh before snapshot; only for PostgreSQL
2021-11-30 09:28:44 +01:00
Chris Cranford
652f41f7fb
DBZ-4272 Add drop column schema change to test
2021-11-30 09:28:44 +01:00
Gunnar Morling
74bb80aae7
DBZ-2363 Removing unused methods
2021-11-29 14:55:49 +01:00
Gunnar Morling
a8cda23ef2
DBZ-4370 Only setting "messages" option on PG 14+;
...
Also avoiding setting stream options repeatedly.
2021-11-29 14:55:49 +01:00
Gunnar Morling
2157256398
DBZ-4364 Awaiting table metadata to become queryable
2021-11-29 09:23:18 +01:00
Gunnar Morling
a041a6bd5c
DBZ-4364 Removing unused methods
2021-11-29 09:23:18 +01:00
Gunnar Morling
5866056a41
DBZ-2363 Using prefix as message key
2021-11-26 18:15:25 +01:00
Gunnar Morling
560ef2babd
DBZ-2363 Misc. adjustments;
...
* Adding Strings::isBlank()
* Simplifying test
* Using long in cases where we know it's present
* Removing some unused code
* Testing binary handling mode
* Avoiding TX id value overflow
* Assigning names to schemas to avoid issues as in DBZ-650
2021-11-26 14:29:15 +01:00
Gunnar Morling
b85a9d2f20
DBZ-2363 Extracting separate test class for logical decoding message tests
2021-11-26 14:29:15 +01:00
Lairen Hightower
450998b49e
DBZ-2363 Replace logicalDecodingMessageHandlingMode with a prefix filtering configuration
2021-11-26 14:29:15 +01:00
Gunnar Morling
fcfc9bc785
DBZ-2363 Misc. adjustments;
...
* Removing unused method
* Unifying update() handling
* Member ordering
* Avoiding NPE in error handler
2021-11-26 14:29:15 +01:00
lairen
a0898ed440
DBZ-2363 Adding support for pg_logical_emit messages in Postgres connector for the pgoutput plugin
2021-11-26 14:29:15 +01:00
Jiri Pechanec
dc3ee488f1
DBZ-4343 Use schema component for incremental snapshot TableId
2021-11-24 10:25:33 +01:00
Andrey Yegorov
b6d2c41fb0
DBZ-4309 Avoid calling 'LoggerFactory.getLogger(getClass())' for each new instance of the RelationalChangeRecordEmitter
2021-11-18 22:37:51 +01:00
Vojtech Juranek
c0a65743f8
DBZ-1042 Allow Postgres connector to use numeric slot names
...
To be able to use numeric slot names, the slot name has to be quoted.
This may be consider as s bug in Postgres driver as Debezium passes the
slot name as string. To workaround this issue, quote the slot name on
the Debezium side.
2021-11-18 10:27:48 +01:00
Vojtech Juranek
1ca917a428
DBZ-1042 Allow numeric slot names
2021-11-18 10:27:48 +01:00
Vojtech Juranek
50da5e31dc
DBZ-1931 Allow to specify number of fraction digits for the money type
2021-11-17 09:30:15 +01:00
Vojtech Juranek
6f286fe50c
DBZ-1931 Reflect decimal.handling.mode in money conversion
2021-11-17 09:30:15 +01:00
Chris Cranford
e3da449303
DBZ-4276 Expose unavailable value placeholder for PG and Oracle only
2021-11-16 20:29:59 +01:00
Chris Cranford
ca17352221
DBZ-4276 Unify unavailable value placeholder handling
...
Deprecate the `toasted.value.placeholder` option in PostgreSQL in favor
of the new `unavailable.value.placeholder` option that is shared by all
relational connectors.
2021-11-16 20:29:59 +01:00
Kate
44073cf7d8
DBZ-4196 Support schema changes during incremental snapshot
2021-11-16 14:56:06 +01:00
Debezium Builder
f93e901dce
[maven-release-plugin] prepare for next development iteration
2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19
[maven-release-plugin] prepare release v1.8.0.Alpha2
2021-11-11 09:21:59 +00:00
Kate
992ae537c8
DBZ-4244 Quote signal table name in MySQL connector
2021-11-10 10:18:26 +01:00
Chris Cranford
5ec9381702
DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL)
2021-11-10 09:43:25 +01:00
harveyyue
aa3ae05e22
DBZ-4107 Incremental snapshot doesn't work without primary key
2021-11-05 13:31:26 +01:00
Gunnar Morling
1226c3b2ab
DBZ-4029 Misc. clean-up;
...
* Exposing heartbeatInterval() on CommonConnectorConfig
* Closing heartbeat connection
* Making test more resilient
* Correct member ordering and visibility
* Doc fixes
2021-11-05 13:27:09 +01:00
ahodavdekar
91b7ef2c36
DBZ-4029 Adding support for heartbeat action queries to MySQL connector
2021-11-05 13:27:09 +01:00
jiabao.sun
24ead16c24
DBZ-3966 Remove defaultValue and keep defaultValueExpression
2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697
DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues
2021-11-04 10:47:17 +01:00
Gunnar Morling
9a4d0ad363
DBZ-4137 Test clean-up
2021-11-02 16:50:26 +01:00
Andrey Yegorov
b174927a52
DBZ-4137 Postgres defaults handling misses decimal mode configuration and cannot handle numerics with default NULL values
2021-11-02 16:50:26 +01:00
ahodavdekar
1d81b6db19
DBZ-4077 Exposing the transaction metadata topic name as a config option
2021-11-02 06:07:05 +01:00
Anisha Mohanty
9f7ede0e06
DBZ-3626 Renaming master branches to main
2021-10-28 09:33:32 +02:00
Debezium Builder
2026a48302
[maven-release-plugin] prepare for next development iteration
2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9
[maven-release-plugin] prepare release v1.8.0.Alpha1
2021-10-27 06:47:26 +00:00
Gunnar Morling
33764b2adc
DBZ-4150 Using set instead of list
2021-10-19 12:32:16 +02:00
Hossein Torabi
6027d762a6
DBZ-4150 Trim numerical defaultValue before converting postgres-connector
2021-10-19 12:27:26 +02:00
Jiri Pechanec
0ccc83db21
DBZ-3860 Provide correct boundaries for multi PK tables
2021-10-14 17:26:50 +02:00
Anisha Mohanty
310a0b6ef3
DBZ-4145 Skip failing test for wal2json
2021-10-14 13:17:08 +02:00
Gunnar Morling
c3eed6051b
DBZ-3993 Skipping object size based test on Java 16+
2021-10-13 10:59:23 +02:00
Sergei Morozov
4a03c5df17
DBZ-2975: Include database name into topic and schema names
...
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Gunnar Morling
015b219c58
DBZ-4046 Some testing clean-up;
...
* Fixing mixed up order of expected and actual value
* Using more expressive var names
2021-10-11 06:04:42 +02:00
Judah Rand
5d23b30f67
DBZ-4046 Update isVariableScaleDecimal
...
This puts the method in line with
https://github.com/pgjdbc/pgjdbc/issues/2188
where expected value was changed from `131089` to `0`.
However, for numeric arrays the issue remains and so
`131089` remains the correct value for them.
2021-10-08 10:42:21 +02:00
Jiri Pechanec
d5eafd3ecf
DBZ-3919 Add logs to test
2021-10-06 09:36:21 +02:00
Jiri Pechanec
dae384baf4
DBZ-4081 Close leaking connections
2021-10-05 12:52:03 +02:00
Jiri Pechanec
f910fc930b
[release] Switch to 1.8 snapshot
2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046
[maven-release-plugin] prepare for next development iteration
2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85
[maven-release-plugin] prepare release v1.7.0.Final
2021-10-01 13:26:33 +02:00
Jiri Pechanec
6d0760df45
DBZ-4060 Remove race condition
2021-10-01 11:25:14 +02:00
Judah Rand
6ad791bedc
DBZ-4060 Add default value mapper for smallserial
2021-10-01 11:25:14 +02:00
Jiri Pechanec
a2c6058404
DBZ-4057 Initialize Postgres schema before incremental snapshot restart
2021-09-30 09:10:49 +02:00
Debezium Builder
bec0b6b67e
[maven-release-plugin] prepare for next development iteration
2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725
[maven-release-plugin] prepare release v1.7.0.CR2
2021-09-23 06:31:25 +00:00
Naveen Kumar KR
d07643d60f
DBZ-3887 PostgresMetricsIT Test fix
...
* Remove redundant oneRecordInQueue test
* Rename test method from twoRecordsInQueue -> oneRecordInQueue to reflect the actual assertion done
2021-09-22 19:12:21 +02:00
Debezium Builder
c15e0b303b
[maven-release-plugin] prepare for next development iteration
2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121
[maven-release-plugin] prepare release v1.7.0.CR1
2021-09-16 08:10:44 +00:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
...
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Gunnar Morling
7c150de943
DBZ-2525 Don't qualify selected columns with table name;
...
It shouldn't be needed as we select from a single table, and it caused the columns to not be found for the Db2 connector.
2021-08-31 17:39:36 +05:30
Anisha Mohanty
153e0920e1
DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
...
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Gunnar Morling
11ed86a807
DBZ-3889 Reducing logging of serializers
2021-08-30 12:20:55 +02:00
Jiri Pechanec
82b151d0b9
DBZ-3935 Invalid validation of truncate handling mode
2021-08-30 09:47:55 +02:00
Debezium Builder
2ce6bcb2ab
[maven-release-plugin] prepare for next development iteration
2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423
[maven-release-plugin] prepare release v1.7.0.Beta1
2021-08-25 05:20:56 -04:00
rkerner
52333596de
DBZ-3364 add additional metadata to fields for API spec generator for the Debezium UI
...
part of https://issues.redhat.com/browse/DBZ-3364
DBZ-2653 User rollback from parent class
2021-08-23 17:57:38 +02:00
Gunnar Morling
36af61b789
DBZ-3889 Moving ContainerImageVersions to core for broader re-use and using it in two more places
2021-08-23 12:34:03 +02:00
Gunnar Morling
0fedadd77e
DBZ-3889 Avoiding some log noise
2021-08-23 12:34:03 +02:00
Naveen Kumar KR
9527843974
DBZ-3870 Performance Improvements in PostgresChangeRecordEmitter
...
1) Reuse parsed TableId to avoid expensive PostgresSchema.parse() call
2) Immediate conditional return in synchronizeTableSchema() call
2021-08-13 22:11:48 +02:00
Sergei Morozov
a40ad7132d
DBZ-2975: Remove partition from offset context
2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12
DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets
2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52
DBZ-2975: Move Partition to io.debezium.pipeline.spi
2021-08-11 07:34:37 +02:00
Jiri Pechanec
b0e0052a9c
DBZ-3828 Update event LSN for commits
2021-08-10 20:41:37 +02:00
Gunnar Morling
85e6d262ea
DBZ-3816 Wording changes
2021-08-09 10:08:47 +02:00
Jiri Pechanec
305c15132f
DBZ-3816 Workaround for Kafka Connect bug
2021-08-09 10:08:47 +02:00
Gunnar Morling
bf9f7f5596
DBZ-3801 Allocating sequence list with correct size
2021-08-04 10:25:09 +02:00
Brennan Vincent
b03d9d1fa6
DBZ-3801: Address code review comments
2021-08-04 10:25:09 +02:00
Brennan Vincent
975f1690f2
DBZ-3801 Fix calculation of sequence numbers for Postgres
2021-08-04 10:25:09 +02:00
Debezium Builder
d3c4482d06
[maven-release-plugin] prepare for next development iteration
2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426
[maven-release-plugin] prepare release v1.7.0.Alpha1
2021-07-30 02:39:08 -04:00
Kate
9b66ab374a
DBZ-3577 Support read-only MySQL incremental snapshots
2021-07-29 07:10:46 +02:00
Jiri Pechanec
b387775448
DBZ-3655 Connection liveness check triggers replication earlier
2021-07-27 11:07:52 -04:00
Jiri Pechanec
f46e0ca9a6
DBZ-3655 Commit check connection query
2021-07-27 15:32:35 +02:00
Gunnar Morling
09ebc833f3
DBZ-3655 Gracefully handling DB shutdown
2021-07-27 10:21:54 +02:00
Chris Cranford
9f5c49246f
DBZ-3769 Remove TODO and change log message level
2021-07-27 09:31:51 +02:00
bep7520
9e9c2fc2ab
DBZ-3769 Throw sqlexception from postgres message decoder
2021-07-27 09:31:51 +02:00
Naveen Kumar KR
7844b59c2f
DBZ-3770 Optimize ObjectMapper initialization by replacing repeated initialization with one time initilization
...
- Performance Improvement of approx 5% - 15%
2021-07-21 14:44:09 -04:00
Chris Cranford
ed31ea9ffb
DBZ-3668 Adjust ServiceLoader for SPI change
2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d
DBZ-3668 Extracting SPI package
2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110
DBZ-3668 Add ServiceLoader hook CloudEvents converter
2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba
DBZ-2975: Add partition awareness to source task components
...
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Gunnar Morling
5b76bf1b71
DBZ-3632 Pulling up getJdbcConfig() to RelationalDatabaseConnectorConfig
2021-07-01 15:11:01 +02:00
Jiri Pechanec
ee0bd2f7da
DBZ-3685 Postgres keepalive thread uses correct name
2021-07-01 11:40:59 +02:00
Debezium Builder
9d3f6b2a86
[maven-release-plugin] prepare for next development iteration
2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56
[maven-release-plugin] prepare release v1.6.0.Final
2021-06-30 03:45:06 -04:00
Debezium Builder
ae053414ac
[maven-release-plugin] prepare for next development iteration
2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74
[maven-release-plugin] prepare release v1.6.0.CR1
2021-06-24 01:50:07 -04:00
Debezium Builder
48ca58a609
[maven-release-plugin] prepare for next development iteration
2021-06-10 06:03:12 -04:00
Debezium Builder
0961517859
[maven-release-plugin] prepare release v1.6.0.Beta2
2021-06-10 06:03:12 -04:00
Gunnar Morling
a2f927c2db
DBZ-3608 Avoiding repeated closing actions
2021-06-10 07:39:49 +02:00
Gunnar Morling
205c63a56a
DBZ-3608 Fixing version handling;
...
- wrong minor version for Postgres
- minor/patch versions of -1 were not actually ignored in comparison
2021-06-10 07:39:49 +02:00
Gunnar Morling
dc865cd82d
DBZ-2975 Formatting
2021-06-09 16:02:33 +02:00
Gunnar Morling
1ce65fa628
DBZ-2975 Avoiding raw types in some places;
...
Also parameterizing offset loader contract, so to avoid casts later on.
2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542
DBZ-2975: Extract offset context from object states to method signatures
2021-06-09 16:02:33 +02:00
Gunnar Morling
2c5e10b848
DBZ-3596 Using single connection in PgOutputMessageDecoder
2021-06-09 13:41:43 +02:00
Gunnar Morling
4aef8669fb
DBZ-3596 Removing unused "exported" flag
2021-06-09 13:41:43 +02:00
Gunnar Morling
7e664b18e5
DBZ-3596 Removing unused field AbstractMessageDecoder#filterBasedOnLsn and code leading to it
2021-06-09 13:41:43 +02:00
Jiri Pechanec
b59f6daac9
DBZ-3550 Use selected test containers deps
2021-06-08 14:49:04 +02:00
Gunnar Morling
41e93e6ce1
DBZ-2790 Avoiding function usage
2021-06-08 12:10:26 +02:00
Eric Slep
8a659ff8ab
DBZ-2790 Docs and one final test edge case
2021-06-08 12:10:26 +02:00
Eric Slep
5dde3062b0
DBZ-2790 Handle pgoutput streaming refresh
2021-06-08 12:10:26 +02:00
Eric Slep
13ebeade71
DBZ-2790 Add default values to existing tests
2021-06-08 12:10:26 +02:00
Eric Slep
436b4697ba
DBZ-2790 Tests for refresh behaviour, ensure defaults are not cleared on in-mem refresh
2021-06-08 12:10:26 +02:00
Eric Slep
d1917eeff6
DBZ-2790 Handle default values for date & time types
2021-06-08 12:10:26 +02:00
Eric Slep
f88f135c43
DBZ-2790 Add simple placeholders to schema for generated defaults
2021-06-08 12:10:26 +02:00
Eric Slep
de5fe2a520
DBZ-2790 Move TypeRegistry construction back to connection
2021-06-08 12:10:26 +02:00
Kevin Pullin
0462804467
DBZ-2790 Update debezium-connector-postgres/src/main/java/io/debezium/connector/postgresql/connection/PostgresDefaultValueConverter.java
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-06-08 12:10:26 +02:00
Kevin Pullin
4b62e59400
DBZ-2790 Update debezium-connector-postgres/src/main/java/io/debezium/connector/postgresql/connection/PostgresDefaultValueConverter.java
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-06-08 12:10:26 +02:00
Kevin Pullin
d2ab8baddf
DBZ-2790 Implement default values for postgres
...
Using the `SqlServerDefaultValueConverter` class as a starting point,
this commit implements default value support for postgres.
2021-06-08 12:10:26 +02:00
gvaquez-ubi
03cb907d85
DBZ-3068 Allow several tries on createReplicationStream to get replication slot
2021-06-04 15:11:57 +02:00
Debezium Builder
ead4ee7226
[maven-release-plugin] prepare for next development iteration
2021-05-20 19:07:44 +02:00
Debezium Builder
9e16df7d4b
[maven-release-plugin] prepare release v1.6.0.Beta1
2021-05-20 19:07:44 +02:00
Jiri Pechanec
a879b7b3e1
DBZ-3500 Re-use ResultSet to Object code
2021-05-20 08:06:37 +02:00
Jiri Pechanec
a626dc149f
DBZ-3500 Provide common test for incremental snapshot testing
2021-05-20 08:06:37 +02:00
Gunnar Morling
a362760429
DBZ-2337 Removing superfluous log statement
2021-05-18 21:47:16 +02:00
Jiri Pechanec
5fbc181b5e
DBZ-2337 All snapshots using exported mode
2021-05-18 21:44:08 +02:00
Jiri Pechanec
2a716d1b86
DBZ-3519 Avoid NPE in autoboxing
2021-05-18 10:32:18 +02:00
Debezium Builder
4dd3a146ca
[maven-release-plugin] prepare for next development iteration
2021-05-06 02:40:15 -04:00
Debezium Builder
b3c5bb281c
[maven-release-plugin] prepare release v1.6.0.Alpha1
2021-05-06 02:40:15 -04:00
Jiri Pechanec
5c722341e2
DBZ-3473 Extract incremental snapshot contract
2021-05-06 05:37:36 +02:00
Jiri Pechanec
7daae11600
DBZ-3473 Postgres has its own schema instance
2021-05-06 05:37:36 +02:00
Jiri Pechanec
39d21806eb
DBZ-3473 Metrics enabled
2021-05-06 05:37:36 +02:00
Jiri Pechanec
c53785dde7
DBZ-3473 Incremental Snapshot support for MySQL
2021-05-06 05:37:36 +02:00
Jiri Pechanec
4e95056ddd
DBZ-3473 Test stabilization
2021-05-06 05:37:36 +02:00
Jiri Pechanec
49c5a00bbf
DBZ-3473 Share read JDBC value between regular and incremental snapshot
2021-05-06 05:37:36 +02:00
Jiri Pechanec
dd2bc6354b
DBZ-3473 Pass the main clock form connector
2021-05-06 05:37:36 +02:00
Jiri Pechanec
260c32cf0e
DBZ-3473 Resume parallel snapshot after connector restart
2021-05-06 05:37:36 +02:00
Jiri Pechanec
37626c0dfe
DBZ-3473 Extract incremental snapshot context
2021-05-06 05:37:36 +02:00
Jiri Pechanec
07371c085b
DBZ-3473 Watermark signals must be in separate tx
2021-05-06 05:37:36 +02:00
Jiri Pechanec
a52c536a68
DBZ-3473 First prototype of incremental snapshotting
2021-05-06 05:37:36 +02:00
Gunnar Morling
dc02b896cd
DBZ-3449 Moving QA releated plug-ins to separate profile, so to avoid loading them at all
2021-04-28 15:14:05 +02:00
Gunnar Morling
2088c035b1
DBZ-3449 Adding "quick" profile
2021-04-26 06:09:14 +02:00
Hossein Torabi
5d6705c3fe
DBZ-2699 implement skipped.operation in core
2021-04-08 11:59:08 +02:00
Debezium Builder
8a88ba9b45
[maven-release-plugin] prepare for next development iteration
2021-04-08 04:04:00 -04:00
Debezium Builder
74152afe74
[maven-release-plugin] prepare release v1.5.0.Final
2021-04-08 04:04:00 -04:00
Gunnar Morling
5425e6c5dc
DBZ-3343 Re-using single shared SqlTypeMapper instance
2021-04-06 14:59:55 +02:00
JLDLaughlin
06b0475f17
DBZ-2911 Add additional LSN information to all sources
...
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00
Debezium Builder
6b4d88bb51
[maven-release-plugin] prepare for next development iteration
2021-03-24 06:35:02 -04:00
Debezium Builder
c578715233
[maven-release-plugin] prepare release v1.5.0.CR1
2021-03-24 06:35:02 -04:00
Jiri Pechanec
495be2659b
DBZ-2511 Dedicated logger for schema name adjuster
2021-03-18 14:42:34 +01:00
Jiri Pechanec
21f522217c
DBZ-3033 Map OID to long value
2021-03-17 18:11:52 +01:00
Gunnar Morling
911b5e9a3b
DBZ-3271 Unifying filter handling across relational connectors
2021-03-17 09:54:25 +01:00
Debezium Builder
f57057421b
[maven-release-plugin] prepare for next development iteration
2021-03-12 04:38:17 -05:00
Debezium Builder
b57293013a
[maven-release-plugin] prepare release v1.5.0.Beta2
2021-03-12 04:38:16 -05:00
Jiri Pechanec
123d9ef4eb
DBZ-3213 Refactor Maven structure to deploy support modules
2021-03-11 16:14:15 +01:00
Jiri Pechanec
f23421920b
DBZ-2919 Remove race condition
2021-03-10 19:12:34 +01:00
Jiri Pechanec
15c7b11a1f
DBZ-3141 Change schema signal tested for Postgres
2021-03-10 19:12:34 +01:00
Jiri Pechanec
ff7cb44801
DBZ-3141 Offsets are propagated to signal actions
2021-03-10 19:12:34 +01:00
Jiri Pechanec
7fdad2ed49
DBZ-3141 Support for signalling table
2021-03-10 19:12:34 +01:00
Jiri Pechanec
9f2cffa21e
DBZ-2885 Fix test
2021-03-09 17:32:01 +01:00
Anisha Mohanty
895d704d82
DBZ-2885 Handle misleading error message for filtered publication
2021-03-09 08:39:15 +01:00
Chris Cranford
04849734b3
DBZ-3030 Do not execute initial statements on connector validation
2021-03-05 11:59:22 +01:00
Debezium Builder
b4c260da50
[maven-release-plugin] prepare for next development iteration
2021-02-23 14:04:01 -05:00
Debezium Builder
123a711a6d
[maven-release-plugin] prepare release v1.5.0.Beta1
2021-02-23 14:04:01 -05:00
Fahim Farook
194258d87b
DBZ-3164 Log database connection validation failures consistently
2021-02-22 14:52:22 +01:00
Gunnar Morling
62ad3969c1
DBZ-3107 Typo fixes
2021-02-22 09:08:47 +01:00
Jiri Pechanec
a97b86db43
DBZ-3107 Workaround for DBZ-3158
2021-02-22 09:08:47 +01:00
Jiri Pechanec
1edad510ff
DBZ-2614 Support for infinite timestamps
2021-02-19 10:44:06 +01:00
Jiri Pechanec
1f79c15a48
DBZ-2616 Fix negative years conversion
2021-02-19 10:44:06 +01:00
Jiri Pechanec
a17e7cee44
DBZ-2865 Regression in warning message cleanup
2021-02-19 10:40:15 +01:00
Yilong Chang
a0b3704832
DBZ-3056 Validate all fields in subclasses.
2021-02-16 12:34:06 +01:00
Yilong Chang
76c7e0d426
DBZ-3056 Extract basic valdiation in parent class.
2021-02-16 12:34:06 +01:00
ani-sha
5f8a22a5df
DBZ-2858 Make field descriptions consistent for time values
2021-02-16 09:55:35 +01:00
Kevin Pullin
db5dd54c20
DBZ-3074 Split shouldReceiveChangesForInsertsIndependentOfReplicaIdentity
...
Split shouldReceiveChangesForInsertsIndependentOfReplicaIdentity into two tests,
one that works with the PGOUTPUT decoder and one that works with the other decoders
(due to differences between schema update handling).
2021-02-10 10:58:26 +01:00
Kevin Pullin
2426de849a
DBZ-3074 PgOutputMessageDecoder - Fix unordered keys
...
Fix issue where `PgOutputMessageDecoder` does not define primary key metadata in key-order.
`PgOutputMessageDecoder.getTablePrimaryKeyColumnNamesFromDatabase()` returns a `Set`, leading to unordered
primary keys in the metadata. Switch the logic to call `JdbcConnection.readPrimaryKeyNames()` which
_does_ correctly return an ordered primary key list.
2021-02-10 10:58:26 +01:00
Debezium Builder
e08df0a177
[maven-release-plugin] prepare for next development iteration
2021-02-06 01:25:23 -05:00
Debezium Builder
da0411bf70
[maven-release-plugin] prepare release v1.5.0.Alpha1
2021-02-06 01:25:23 -05:00
Naveen Kumar KR
75882f35ac
DBZ-2382 Support emitting TRUNCATE events in PG11+ PGOUTPUT plugin
...
default - TruncateHandlingMode.SKIP
supported configs - TruncateHandlingMode.SKIP / TruncateHandlingMode.INCLUDE
2021-02-03 13:53:01 +01:00
ani-sha
d4003c9172
DBZ-2420 Define database configs under RelationalDatabaseConnectorConfig
2021-02-03 08:05:42 +01:00
Debezium Builder
237b4ac0f1
[maven-release-plugin] prepare for next development iteration
2021-01-28 07:38:55 -05:00
Debezium Builder
06b1d0cbad
[maven-release-plugin] prepare release v1.4.1.Final
2021-01-28 07:38:55 -05:00
rkerner
6aa13e756a
DBZ-2952 Remove Postgres replication slot validation (maybe part 1 to fix user's issues)
2021-01-27 10:31:00 +01:00
Gunnar Morling
aa674842a3
DBZ-2923 Improving test stability
2021-01-14 17:02:04 +01:00
Gunnar Morling
b5b8ef358b
DBZ-2764 Misc. clean-up
2021-01-08 13:19:57 +01:00
ani-sha
bd427786e9
DBZ-2764 Centralize Postgres image for Testcontainers
2021-01-08 13:19:57 +01:00
Debezium Builder
3010f99c32
[maven-release-plugin] prepare for next development iteration
2021-01-07 03:38:13 -05:00
Debezium Builder
54534538d9
[maven-release-plugin] prepare release v1.4.0.Final
2021-01-07 03:38:13 -05:00
rkerner
752454e83d
DBZ-2800 fix AWS user roles validation
2021-01-07 07:22:37 +01:00
Debezium Builder
b1ab996c3e
[maven-release-plugin] prepare for next development iteration
2020-12-16 14:11:31 -05:00
Debezium Builder
8fc864b278
[maven-release-plugin] prepare release v1.4.0.CR1
2020-12-16 14:11:31 -05:00
Debezium Builder
cf921f56b4
[maven-release-plugin] prepare for next development iteration
2020-12-10 00:27:40 -05:00
Debezium Builder
c49a377487
[maven-release-plugin] prepare release v1.4.0.Beta1
2020-12-10 00:27:39 -05:00
Jiri Pechanec
d1a7aae736
DBZ-2772 wal2json needs db write to complete catch-up phase
2020-11-30 10:06:43 +01:00
Debezium Builder
4535549dcd
[maven-release-plugin] prepare for next development iteration
2020-11-16 15:18:43 -05:00
Debezium Builder
3c70c5f7d5
[maven-release-plugin] prepare release v1.4.0.Alpha2
2020-11-16 15:18:43 -05:00
Jiri Pechanec
af91d7d2bf
DBZ-2662 Increase wait time for metrics
2020-11-16 09:44:52 +01:00
vanhoale
17a424d9ac
DBZ-2662 Handle ChangeEventQueue by the size in bytes
2020-11-16 08:39:33 +01:00
rkerner
4faf13d0c9
DBZ-2637 apply feedback
2020-11-16 07:47:25 +01:00
rkerner
aff1df7573
DBZ-2637 fix unit test timeouts
2020-11-16 07:47:25 +01:00
rkerner
77eee964a1
DBZ-2637 unrelated cleanup
2020-11-16 07:47:25 +01:00
rkerner
c59e00c65a
DBZ-2637 Enhance Postgres validation checks
...
+ add wal_level config check
+ add LOGIN and REPLICATION roles check
+ add replication slot is already in use check
2020-11-16 07:47:25 +01:00
rkerner
f291b07b6b
DBZ-2724 cleanup code and apply PR feedback
2020-11-10 10:44:41 +01:00
rkerner
890bf217dc
DBZ-2724 unrelated cleanup
2020-11-10 10:44:41 +01:00
rkerner
0015d628d5
DBZ-2724 Add integration tests for DBZ-2617 (fix Postgres was not able to shutdown with shutdown mode "fast")
...
DBZ-2602 Migrate Testcontainers related changes on DebeziumContainer from UI PoC backend to Debezium main repo
2020-11-10 10:44:41 +01:00
Chris Cranford
4e6b3b1268
DBZ-2704 Fix test failure - PostgresConnectorIT#shouldRegularlyFlushLsnWithTxMonitoring
2020-11-04 06:15:16 +01:00
rkerner
c274c2b39b
DBZ-2617 refactor to proper HeartbeatErrorHandler injection
2020-11-03 07:23:02 +01:00
cooksey
c262238183
DBZ-2608 Add a snapshotComplete lifecycle hook to the Snapshotter
2020-10-30 13:34:38 -04:00
Debezium Builder
26883dad92
[maven-release-plugin] prepare for next development iteration
2020-10-22 03:45:59 -04:00
Debezium Builder
9adbc2d67e
[maven-release-plugin] prepare release v1.4.0.Alpha1
2020-10-22 03:45:59 -04:00
Jiri Pechanec
ee5353ef6f
DBZ-2653 Process commits even with tx monitoring
2020-10-20 10:42:10 +02:00
Kaushik Iyer
7d9e8fdc46
DBZ-2456 fixes after rebase
2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932
DBZ-2456 selective snapshot implementation
2020-10-16 10:13:48 +02:00
Chris Cranford
17039df7ce
DBZ-2344 Fix test failure - RecordsStreamProducerIT - shouldReceiveHeartbeatAlsoWhenChangingNonWhitelistedTable
2020-10-06 09:07:42 +02:00
Debezium Builder
95b8ed3877
[maven-release-plugin] prepare for next development iteration
2020-10-01 09:08:51 -04:00
Debezium Builder
19ad73beb2
[maven-release-plugin] prepare release v1.3.0.Final
2020-10-01 09:08:50 -04:00
Jiri Pechanec
12be0d8428
DBZ-2565 Disable test failing for snapshots
2020-10-01 14:27:13 +02:00
Jiri Pechanec
45d683724f
DBZ-2565 Fail on unsupported infinite timestamps
2020-10-01 14:27:13 +02:00
Chris Cranford
4fe6813179
DBZ-2435 - Fix test failure - ReplicationConnectionIT#shouldResumeFromLastReceivedLSN
2020-09-30 20:19:50 +02:00
Chris Cranford
155dd44dab
DBZ-2544 Fix formatting
2020-09-30 19:42:10 +02:00
Chris Cranford
1fd6fbb1fa
DBZ-2544 Fix test failure - PostgresConnectorIT#customSnapshotterSkipsTablesOnRestart
2020-09-30 19:42:10 +02:00
Chris Cranford
bb0b3fd158
DBZ-2468 Fix test failure - PostgresConnectorIT#shouldExecuteOnConnectStatements
2020-09-24 23:06:55 +02:00
Debezium Builder
b146b69154
[maven-release-plugin] prepare for next development iteration
2020-09-24 04:56:42 -04:00
Debezium Builder
c51cfe8eb9
[maven-release-plugin] prepare release v1.3.0.CR1
2020-09-24 04:56:41 -04:00
cooksey
ba074abe4c
DBZ-2550 Prevent duplicate events using catch up streaming
...
Normally when a connector gracefully shuts down, the connect framework attempts to commit offsets so the latest committed state gets acked on the replication stream. While the connector is running, the framework periodically commits offsets. Debezium does not manage triggering an offset commit. When the catch up streaming phase ends, there may be uncommitted state and the connector is unable to determine when the next commit will occur because the commit timing is externally managed. If a commit is not triggered between the end of the catch up streaming phase and the normal streaming phase after the snapshot, the connector may produce some duplicated messages.
Although the replication stream may be out of date, the internal OffsetContext is aware of the latest committed offset. When the snapshot phase recreates a new offset after catch up streaming, the previous offset has access to the latest state. Use the previous offset to forward known state to the new offset.
2020-09-21 09:28:15 +02:00
Debezium Builder
837669890a
[maven-release-plugin] prepare for next development iteration
2020-09-16 12:18:08 -04:00
Debezium Builder
086dbd960b
[maven-release-plugin] prepare release v1.3.0.Beta2
2020-09-16 12:18:08 -04:00
Jiri Pechanec
eed321d485
DBZ-2461 LSN must not be flushed after connection close
2020-09-16 11:40:52 +02:00
Chris Cranford
e5c01c6b09
DBZ-137 Fix compilation problems
2020-09-14 12:33:43 +02:00
AndreyIg
77662a0dde
DBZ-137 contribution to the core, Oracle related
2020-09-14 12:33:43 +02:00
cooksey
8bcbdb639d
DBZ-2094 Allow Postgres snapshotter to set streaming start on resume
...
When a connector resumes after previously streaming and takes a
snapshot, through a new method on the snapshotter interface,
shouldStreamEventsStartingFromSnapshot, can choose whether
to resume streaming from the last known streaming position or the
beginning of the snapshot. This is helpful for snapshotters that
may not want to resnapshot every table in the whitelist/blacklist
but not miss event on the tables that are skipped.
2020-09-09 10:54:11 +02:00
Debezium Builder
9979db648f
[maven-release-plugin] prepare for next development iteration
2020-08-28 05:04:26 -04:00
Debezium Builder
5c58b23756
[maven-release-plugin] prepare release v1.3.0.Beta1
2020-08-28 05:04:26 -04:00
Jiri Pechanec
03a11efd8e
DBZ-2338 Atomic is not necessary
2020-08-24 21:16:37 +02:00
Jiri Pechanec
cf0db85436
DBZ-2338 Flush LSNs on tx boundaries
2020-08-24 21:16:37 +02:00
Jiri Pechanec
483a483569
DBZ-2338 Log exception; restart keepalive
2020-08-24 21:16:37 +02:00
Jiri Pechanec
f01ab234a4
DBZ-2338 Skip initial statements on reconnect
2020-08-24 21:16:37 +02:00
Jiri Pechanec
4d0ec1f848
DBZ-2397 Test for restart in tx
2020-08-24 21:16:37 +02:00
Jiri Pechanec
aead9a6612
DBZ-2338 Minor corrections
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2020-08-24 21:16:37 +02:00
Jiri Pechanec
b5c2ed17ed
DBZ-2338 Support for pgoutput
2020-08-24 21:16:37 +02:00
Jiri Pechanec
39623aa799
DBZ-2338 Base WAL position detection on commit LSNs
2020-08-24 21:16:37 +02:00
Jiri Pechanec
31721c247b
DBZ-2200 Introduce LLSN domain type
2020-08-24 21:16:37 +02:00
rkerner
2c5c093587
DBZ-2171 avoid divisive language
2020-08-21 09:29:04 +02:00
Gunnar Morling
e89b65238f
DBZ-2423 Increasing visibility of some methods for UI PoC usage
2020-08-12 13:50:42 +02:00
Gunnar Morling
44efd1bc6b
DBZ-2423 Propagating port default values
2020-08-12 13:50:42 +02:00
Gunnar Morling
26b51e02cb
DBZ-2418 Misc. clean-up
2020-08-12 09:28:35 +02:00
Gunnar Morling
ebe5169a66
DBZ-2418 Delaying retrieval of DB charset;
...
This is called only once anyways, so there's no need for storing the info
in a field in PostgresConnection. This allows PostgresConnector#validate()
bring up a more meaningful error message in case of incorrect credentials
and other incorrect connection configuration.
2020-08-12 09:28:35 +02:00
Debezium Builder
c4c50f5fc6
[maven-release-plugin] prepare for next development iteration
2020-08-06 00:46:18 -04:00
Debezium Builder
94cbeb95fa
[maven-release-plugin] prepare release v1.3.0.Alpha1
2020-08-06 00:46:17 -04:00
rkerner
cad6cf62d3
DBZ-2315 fix BIT VARYING handling in Postgres connector
...
* removed little endian padding for BIT types in JdbcValueConverters (only used for Postgres yet)
* removed legacy format handling fot BIT related types in JdbcValueConverters#convertBits which were leftovers from PR #1408
* removed unnecessary zero-ing of a newly created byte array to improve performance for huge byte arrays
* updated Postgres connector docs
2020-08-03 14:58:31 +02:00
Björn Häuser
04254e3fe7
DBZ-2310: Return true when messages are skipped
...
See https://issues.redhat.com/browse/DBZ-2310 for more explanation.
Short summary: Whenever LSNs are skipped return back that messages have
been processed, which will cause two things:
* The replication can be advanced properly
* The connector does not fallback to the poll timeout waiting interval
I also think its more correct to say, "yes I have read messages, but
still skipped all of them".
2020-07-21 15:53:06 +02:00
Debezium Builder
e1ab38de84
[maven-release-plugin] prepare for next development iteration
2020-07-16 04:40:04 -04:00
Debezium Builder
69cf375faa
[maven-release-plugin] prepare release v1.2.1.Final
2020-07-16 04:40:04 -04:00
Jiri Pechanec
f06a14f1da
DBZ-2288 Rethrow exception in test
2020-07-16 09:51:00 +02:00
Jiri Pechanec
55ba8b8b89
DBZ-2288 Fix copy/paste errors
2020-07-16 09:51:00 +02:00
Jiri Pechanec
ea942a4268
DBZ-2288 Test for pgoutput
2020-07-16 09:51:00 +02:00
Jiri Pechanec
8b0b252eb9
DBZ-2288 Events in exported snapshot no longer filtered by LSN
2020-07-16 09:51:00 +02:00
Jos Huiting
da97be7842
DBZ-2307 - Improve logging when primary keys are missing
2020-07-15 11:18:48 -04:00
Chris Cranford
94f2932e95
DBZ-2271 Fix test failure - RecordsStreamProducerIT#testEmptyChangesProducesHeartbeat
...
This fixes a race condition with heartbeat emitted messages with empty DDLs
2020-07-14 17:25:44 +02:00
Chris Cranford
0e5122c69d
DBZ-2319 Fix test failure - PostgresConnectorIT#shouldOutputRecordsInCloudEventsFormat
2020-07-09 08:22:13 +02:00
Chris Cranford
4c6351e5e3
DBZ-2271 Fix test failure - RecordsStreamProducerIT#testEmptyChangesProducesHeartbeat
2020-07-08 17:23:58 +02:00
Debezium Builder
c0d30b87d9
[maven-release-plugin] prepare for next development iteration
2020-06-24 18:03:11 +02:00
Debezium Builder
0e2ac78301
[maven-release-plugin] prepare release v1.2.0.Final
2020-06-24 18:03:11 +02:00
Chris Cranford
41bfac49a3
DBZ-2230 Fix intermittent CI test failure - Postgres
2020-06-22 18:27:43 +02:00
Debezium Builder
b03a4d0e50
[maven-release-plugin] prepare for next development iteration
2020-06-19 00:39:01 -04:00
Debezium Builder
93e60258d5
[maven-release-plugin] prepare release v1.2.0.CR2
2020-06-19 00:39:00 -04:00
Gunnar Morling
f3b07a1374
DBZ-1916 Formatting
2020-06-16 13:28:49 +02:00
Chris Cranford
64bff85ad2
DBZ-1916 Add tests for datatype.propagate.source.type
2020-06-16 13:28:49 +02:00
cooksey
1282403c44
DBZ-2176 Open transaction test are more reliable
...
Checking pg_stat_activity for transactions with a state of "idle in transaction"
should be more reliable to find open abandoned transaction than looking for
a non-null backend_xmin. For example, an autovaccum process will have a
backend_xmin but will not have a stat of "idle in transaction"
2020-06-15 11:15:51 +02:00
Debezium Builder
65c39e9f11
[maven-release-plugin] prepare for next development iteration
2020-06-11 02:00:20 -04:00
Debezium Builder
bce332c900
[maven-release-plugin] prepare release v1.2.0.CR1
2020-06-11 02:00:19 -04:00
Lukas Krejci
a4689611f5
DBZ-2159 Fix a typo in the package name.
2020-06-09 19:28:33 +02:00
Lukas Krejci
90c637b1e3
DBZ-2159 Include the Postgres SPI in the API checks.
2020-06-09 19:28:33 +02:00
Gunnar Morling
8cac498a60
DBZ-2156 More meaningful exception in case of replication slot conflict
2020-06-08 10:28:08 +02:00
Jiri Pechanec
13419ae74a
DBZ-2118 Document type registry connection capability
2020-06-08 09:22:05 +02:00
Jiri Pechanec
d2ef7b7011
DBZ-2118 Slot dropping more resilient to race
2020-06-08 09:22:05 +02:00
Jiri Pechanec
642f4e7303
DBZ-2118 Switch to manual tx management
2020-06-08 09:22:05 +02:00
Jiri Pechanec
8c378400eb
DBZ-2118 Type registry provided only for dedicated connections
2020-06-08 09:22:05 +02:00
Jiri Pechanec
853ebafd7f
DBZ-2118 Close TX after type query
2020-06-08 09:22:05 +02:00
Chris Cranford
9b33264334
DBZ-2157 Fix intermittent postgres test failures
2020-06-05 20:02:14 +02:00
Chris Cranford
845a790593
DBZ-2060 Fix intermittent test failures (sqlserver & postgres)
2020-06-05 20:02:14 +02:00
Gunnar Morling
02b16e17ac
DBZ-1814 Adding tests for exporting unkown column type
2020-06-05 12:13:29 +02:00
Gunnar Morling
c54e377dd2
DBZ-1814 Exporting Hex and Base64 representations as string
2020-06-05 12:13:29 +02:00
Gunnar Morling
023064eedb
DBZ-1814 Renaming "raw" to "bytes"; also clarifying that this notion isn't Java-specific
2020-06-05 12:13:29 +02:00
Jeremy Finzel
5db614da21
DBZ-1814 added new binary handling mode option
2020-06-05 12:13:29 +02:00
Gunnar Morling
d7b3f0a7fb
DBZ-1813 Misc. clean-up;
...
* Removing unused method
* Simplifying tests
* Avoiding deprecated code
2020-06-05 06:24:25 +02:00
Gunnar Morling
59f34e7b16
DBZ-1813 Stabiling test
2020-06-05 06:24:25 +02:00
Brandon Brown
bd64ace7fc
DBZ-1813 Adding ability to configure pgoutput publication based on table filters
...
defined.
2020-06-05 06:24:25 +02:00
Debezium Builder
dc25c379e5
[maven-release-plugin] prepare for next development iteration
2020-05-19 03:40:25 -04:00
Debezium Builder
ad060181b9
[maven-release-plugin] prepare release v1.2.0.Beta2
2020-05-19 03:40:25 -04:00
Braden Groom
8439e70d09
DBZ-2090 Remove unused sourceInfo variable
2020-05-19 08:30:55 +02:00
Jiri Pechanec
97c3d3b6e9
DBZ-2088 Use POSIX tar
2020-05-18 14:29:38 +02:00
Chris Cranford
f449550b2d
DBZ-2068 Skip tests incompatible with Kafka 1.x
2020-05-13 08:22:07 +02:00
Debezium Builder
8d4203279e
[maven-release-plugin] prepare for next development iteration
2020-05-07 05:03:40 -04:00
Debezium Builder
a4e2c8f36c
[maven-release-plugin] prepare release v1.2.0.Beta1
2020-05-07 05:03:40 -04:00
Gunnar Morling
ab1d4bb1cd
DBZ-1970 Making change event API more consistent and uniform
2020-05-06 14:33:37 +02:00
Jiri Pechanec
d82307c331
DBZ-1970 Support for separate key/value embedded converter
2020-05-06 14:33:37 +02:00
Chris Cranford
cd43c4880f
DBZ-2014 Do not include outbox eventType field by default
2020-05-05 22:13:25 +02:00
Chris Cranford
81c3a808da
DBZ-1963 Suggested changes
2020-05-05 08:45:58 +02:00
Chris Cranford
a1cb06299c
DBZ-1963 Emit outbox events with value schema names
2020-05-05 08:45:58 +02:00
Jiri Pechanec
7f23d74d90
DBZ-1904 Add config param into a group
2020-05-04 12:31:05 +02:00
Jiri Pechanec
e350d74b17
DBZ-1904 Public facing schema history topic
2020-05-04 12:31:05 +02:00
Braden Groom
a8cb4e319c
DBZ-2044 Load Postgres enum values with a single query instead of N queries
2020-05-04 12:08:16 +02:00
Chris Cranford
96dda6c3cb
DBZ-1969 Add array support for time, timetz, timestamp, and timestamptz
2020-05-04 11:22:49 +02:00
Braden Groom
8093582487
DBZ-2038 Refactor postgres type registry queries to use the same base query
2020-04-30 14:29:14 -04:00
Braden Groom
63f96940fb
DBZ-2038 Factor out logic for converting postgres result sets to type builders
2020-04-30 14:29:14 -04:00
Braden Groom
50c61fe462
DBZ-2038 Prime postgres array and non-array types using same logic
2020-04-30 14:29:14 -04:00
Braden Groom
01dda2a8a9
DBZ-2038 Load unknown postgres types by name and oid using same logic
2020-04-30 14:29:14 -04:00
Braden Groom
905a732342
DBZ-2038 Resolve array and non-array postgres types with the same logic
2020-04-30 14:29:14 -04:00
Braden Groom
284a4357e0
DBZ-1969 Update convertLtreeArray to handle List instances
2020-04-29 13:06:43 -04:00
Braden Groom
1578ebc8bb
DBZ-1969 Have isArray return false for Postgres LTree arrays
2020-04-29 13:06:43 -04:00
Gunnar Morling
2310d6c792
DBZ-1969 Fixing incorrect assertion and utility which concealed this
2020-04-29 13:06:43 -04:00
Gunnar Morling
f718302d36
DBZ-1969 Simplifying array handling in PgProtoColumnValue
2020-04-29 13:06:43 -04:00
Braden Groom
0b429ce880
DBZ-1969 Add support for Postgres enum arrays
2020-04-29 13:06:43 -04:00
Chris Cranford
230ddaebdc
DBZ-1953 Generalized SkipWhenDatabaseVersion functionality
2020-04-29 12:27:38 +02:00
Gunnar Morling
3d0606b348
DBZ-2027 Small speed-up of PG test execution;
...
* Using Awaitility so we can use 100ms looping intervals; also it's more concise
* Avoiding creation of one temporary connection
2020-04-29 09:56:59 +02:00
Gunnar Morling
16b780fa3c
DBZ-2027 Upgrading Postgres JDBC driver to 42.2.12;
...
The driver upgrade mitigates some issues with using this connector with
Postgres on Azure. It comes with some behavioural changes, though:
* column metadata for DECIMAL without scale is returned differently by
the (see https://github.com/pgjdbc/pgjdbc/issues/1767 ): while it used
to be returned as 0, it's now returned as null. This should be
transparent to DBZ consumers
* snapshots for partitioned tables only export change events on the
partition topics now due to https://github.com/pgjdbc/pgjdbc/pull/1708 ;
this has an impact on consumers, but I think it's more reasonable than
exporting all change events twice, one partition table and main table
topics
2020-04-29 09:56:59 +02:00
Anton Kondratev
236ea1a15f
DBZ-1990 Support for Postgres Json and Jsonb array columns
2020-04-27 22:17:48 +03:00
JanHendrikDolling
33d83731af
DBZ-1972 move static Filed methods as static Filed constant to RelationalDatabaseConnectorConfig instead.
2020-04-27 12:31:19 +02:00
Gunnar Morling
ea7f8e918b
DBZ-1750 Removing unused method
2020-04-24 15:35:28 +02:00
Gunnar Morling
03ce403972
DBZ-1750 Separating config definition editor and immutable config definitions
2020-04-24 15:35:28 +02:00
Jiri Pechanec
37f0dbcaf8
DBZ-1750 Limit access to parent defs; dont share the parent defs
2020-04-24 15:35:28 +02:00
Jiri Pechanec
af90507fa6
DBZ-1750 Centralize shared config definitions
2020-04-24 15:35:28 +02:00
dajerome
ad8beb76d0
DBZ-1949 Return BitSet instead of short/int/long;
...
When converting Postgres bit varying column, convert to BitSet instead of short/int/long to handle cases where the value is larger than Long.MAX_VALUE
2020-04-21 11:26:49 +02:00
Jos Huiting
33fe631674
DBZ-1962 Fix PR feedback
2020-04-17 15:24:42 +02:00
Jos Huiting
a0f65830de
DBZ-1962 Remove TABLE_WHITELIST and TABLE_BLACKLIST in favor of definitions in RelationalDatabaseConnectorConfig
2020-04-17 15:24:42 +02:00
Jos Huiting
8ba21a98ef
DBZ-1962 Introduce column.whitelist for the Postgres connector
2020-04-17 15:24:42 +02:00
Debezium Builder
4ca9f92575
[maven-release-plugin] prepare for next development iteration
2020-04-16 02:22:00 -04:00
Debezium Builder
e704bccdaa
[maven-release-plugin] prepare release v1.2.0.Alpha1
2020-04-16 02:22:00 -04:00
Gunnar Morling
659d4a415b
DBZ-1807 Misc. adjustments;
...
* Adding @TestFor annotations
* Change -> ChangeEvent
2020-04-15 16:29:29 +02:00
Jiri Pechanec
c0914b245b
DBZ-1807 Support for CloudEvents converter
2020-04-15 16:29:29 +02:00
Jiri Pechanec
c06707f4c5
DBZ-1807 Support for Avro converters
2020-04-15 16:29:29 +02:00
Jiri Pechanec
4e2ac367a9
DBZ-1807 Support for JSON Converter
2020-04-15 16:29:29 +02:00
Chris Cranford
57af80afd5
DBZ-1859 Enhance MongoDB connector metrics
2020-04-15 08:04:23 +02:00
Jiri Pechanec
6219376bfe
DBZ-1960 Remove sources of busy wait
2020-04-14 12:59:10 +02:00
JanHendrikDolling
1e19270981
DBZ-1692 Added support for hash based column masking mode for string values
2020-04-08 21:21:42 +02:00
Chris Cranford
5f8719f201
DBZ-1925 Fix test regression after Confluent Platform 5.4.1 upgrade
2020-04-07 09:01:20 +02:00
Jiri Pechanec
cacd21c44a
DBZ-1922 wal2_json streaming uses NOOP messages
2020-04-02 17:29:16 +02:00
rk3rn3r
7f36b3c08f
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
rk3rn3r
6310e00675
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
rk3rn3r
fbd8b94e94
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
Debezium Builder
ab54ce062f
[maven-release-plugin] prepare for next development iteration
2020-03-24 01:23:05 -04:00
Debezium Builder
0b5a9117fb
[maven-release-plugin] prepare release v1.1.0.Final
2020-03-24 01:23:05 -04:00
Jiri Pechanec
224f97e380
DBZ-1857 Support for autorestart for embedded engine
2020-03-23 13:56:29 +01:00
Jiri Pechanec
b44cd8475e
DBZ-1815 Use separatae conection for db heartbeat
2020-03-23 12:02:31 +01:00
trolison
8784b41e22
DBZ-1815 Ading DatabaseHeartbeatImpl to allow for making queries to the DB when a heartbeat happens;
...
* Minor refactor to make DatabaseHeartbeatImpl usable
* Added integration test to verify heartbeat.action.query is being executed properly
2020-03-18 10:27:22 +01:00
Chris Cranford
5ce9d6fb14
DBZ-1755 Fix wal2json/pgoutput streaming of negative monetary values
2020-03-17 08:36:24 +01:00
Chris Cranford
f6d7778bb4
DBZ-1755 Suggested changes
...
* Add test case for snapshotting null currency value
* Restore previous exception handling for money types
2020-03-17 08:36:24 +01:00
Chris Cranford
0cc6e34264
DBZ-1755 Handle parsing negative monetary values during snapshot
2020-03-17 08:36:24 +01:00
Fabian Aussems
1be07ca4f4
DBZ-1755 Handle error conditions better for the Pg MONEY datatype
2020-03-17 08:36:24 +01:00
Jiri Pechanec
b114520f5e
DBZ-1875 Test stabilization;
...
* Snapshot metrics are present with snapshot never
* Skip extra empty TX
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2020-03-13 11:40:00 +01:00
Jiri Pechanec
4ffed1fa46
DBZ-1730 Improve test limits description
2020-03-13 09:39:23 +01:00
Jiri Pechanec
ee91eac418
DBZ-1730 Stream from replica slot position not end of tx log
2020-03-13 09:39:23 +01:00
Gunnar Morling
449154beaa
DBZ-1863 Centralizing coordinator shutdown
2020-03-12 11:28:08 +01:00
Debezium Builder
86c1ed90ed
[maven-release-plugin] prepare for next development iteration
2020-03-11 09:54:44 -04:00
Debezium Builder
062c6abbe5
[maven-release-plugin] prepare release v1.1.0.CR1
2020-03-11 09:54:44 -04:00
Gunnar Morling
c51a5fb597
DBZ-1723 Restarting after connection losses in Postgres
2020-03-11 13:57:23 +01:00
Gunnar Morling
3437da00d7
DBZ-1723 Simplifying shutdown handling;
...
doStop() is already called from stop(), no need to do it again via the error handler.
2020-03-11 13:57:23 +01:00
Gunnar Morling
c156d30048
DBZ-1723 Centralizing stopping() logic in BaseSourceTask
2020-03-11 13:57:23 +01:00
Gunnar Morling
8ce69dc597
DBZ-1723 Encapsulating common poll() and stop() logic in BaseSourceTask
2020-03-11 13:57:23 +01:00
Chris Cranford
6f1eb49b32
DBZ-1726 Fix formatting failures
2020-03-11 10:15:00 +01:00
Chris Cranford
3a4788cc33
DBZ-1726 Introduced AbstractSnapshotChangeEventSource and refactor implementations
2020-03-11 10:15:00 +01:00
Chris Cranford
5506fadd2d
DBZ-1664 Verify correctness of JMX metrics
2020-03-09 23:30:24 +01:00
Jiri Pechanec
0248fdde16
DBZ-1850 Delegate signed/nonsigned conversion to driver
2020-03-09 13:06:30 +01:00
Jiri Pechanec
69e87170e3
DBZ-1849 Only log message was fixed
2020-03-09 07:43:18 +01:00
Jiri Pechanec
62e6a0add7
DBZ-1849 Avoid type refresh for unchanged root type
2020-03-06 18:01:56 +01:00
Jiri Pechanec
f99064fda1
DBZ-1824 Restart incomplete Tx for wal2json
2020-03-04 14:03:21 +01:00
Gunnar Morling
a8b796685b
DBZ-1840 Typo fix; commenting
2020-03-04 09:31:22 +01:00
Jiri Pechanec
10dfc12c99
DBZ-1840 Explanation for unresolvable tables
2020-03-04 09:25:57 +01:00
Jiri Pechanec
19d0a88cc9
DBZ-1840 Test logic was out of order
2020-03-04 09:25:57 +01:00
Jiri Pechanec
b2370c2d8e
DBZ-1840 Syntheitc message to replace messages dropped in decoder
2020-03-04 09:25:57 +01:00
Jiri Pechanec
6bab948e76
DBZ-1840 No nulls to stream producer
2020-03-04 09:25:57 +01:00
Jan-Hendrik Dolling
5cfbaab7a6
DBZ-1845 Typos in deployment.yaml and code readability
...
* improve readability
* fixed some typos
2020-03-04 08:34:55 +01:00
Gunnar Morling
c5422e6b31
DBZ-1840 Not passing null to replication message processor;
...
Note this means to that WAL offsets cannot be acknowledged in cases
where a null message is received from the server (e.g. wal2json for
DDL events). But as we cannot tell apart null events from the server
from readPending() simply having no events to read, the current
logic renders the pausing between two read calls without events
obsolete, so that's the lesser evil
2020-03-03 11:45:53 +01:00
Gunnar Morling
0f6d2c54fc
DBZ-1134 Avoiding concrete class in SPI by introducing receiver parameter
2020-02-28 21:58:39 +01:00
Jiri Pechanec
d13e48cc55
DBZ-1134 Make converted field type parametrized
2020-02-28 21:58:39 +01:00
Jiri Pechanec
06e1eca085
DBZ-1134 Support for user provided converters
2020-02-28 21:58:39 +01:00
Jiri Pechanec
91f292a1f2
DBZ-1825 Keep keys for non-matching table
2020-02-26 15:03:03 +01:00
Jiri Pechanec
ae6ee3d458
DBZ-234 Place Incubating into a unique package
2020-02-25 15:31:10 +01:00
Jiri Pechanec
2b6e50daff
DBZ-1760 Allow skipping of invalid events
2020-02-25 10:43:11 +01:00
jcechace
3209de3e5f
DBZ-924 Adding integration tests for OpenShift and Strimzi
2020-02-20 12:48:08 +01:00
Gunnar Morling
eff3ffc345
DBZ-1758 Documentation update
2020-02-14 13:14:25 +01:00
Debezium Builder
f75746fb7b
[maven-release-plugin] prepare for next development iteration
2020-02-13 03:18:20 -05:00
Debezium Builder
1d2df32743
[maven-release-plugin] prepare release v1.1.0.Beta2
2020-02-13 03:18:20 -05:00
Gunnar Morling
dd5c2b8be9
DBZ-1766 Unifying handling of offset commits
2020-02-12 15:44:45 +01:00
Melissa Winstanley
ef55c9157d
DBZ-1766 Update lastOffset to commit only after a record is committed
2020-02-12 15:44:45 +01:00
Jiri Pechanec
d4d38dcbec
DBZ-1783 Ignore empty transactions
2020-02-12 14:58:15 +01:00