Debezium Builder
ead4ee7226
[maven-release-plugin] prepare for next development iteration
2021-05-20 19:07:44 +02:00
Debezium Builder
9e16df7d4b
[maven-release-plugin] prepare release v1.6.0.Beta1
2021-05-20 19:07:44 +02:00
Jiri Pechanec
a879b7b3e1
DBZ-3500 Re-use ResultSet to Object code
2021-05-20 08:06:37 +02:00
Jiri Pechanec
a626dc149f
DBZ-3500 Provide common test for incremental snapshot testing
2021-05-20 08:06:37 +02:00
Gunnar Morling
a362760429
DBZ-2337 Removing superfluous log statement
2021-05-18 21:47:16 +02:00
Jiri Pechanec
5fbc181b5e
DBZ-2337 All snapshots using exported mode
2021-05-18 21:44:08 +02:00
Jiri Pechanec
2a716d1b86
DBZ-3519 Avoid NPE in autoboxing
2021-05-18 10:32:18 +02:00
Debezium Builder
4dd3a146ca
[maven-release-plugin] prepare for next development iteration
2021-05-06 02:40:15 -04:00
Debezium Builder
b3c5bb281c
[maven-release-plugin] prepare release v1.6.0.Alpha1
2021-05-06 02:40:15 -04:00
Jiri Pechanec
5c722341e2
DBZ-3473 Extract incremental snapshot contract
2021-05-06 05:37:36 +02:00
Jiri Pechanec
7daae11600
DBZ-3473 Postgres has its own schema instance
2021-05-06 05:37:36 +02:00
Jiri Pechanec
39d21806eb
DBZ-3473 Metrics enabled
2021-05-06 05:37:36 +02:00
Jiri Pechanec
c53785dde7
DBZ-3473 Incremental Snapshot support for MySQL
2021-05-06 05:37:36 +02:00
Jiri Pechanec
4e95056ddd
DBZ-3473 Test stabilization
2021-05-06 05:37:36 +02:00
Jiri Pechanec
49c5a00bbf
DBZ-3473 Share read JDBC value between regular and incremental snapshot
2021-05-06 05:37:36 +02:00
Jiri Pechanec
dd2bc6354b
DBZ-3473 Pass the main clock form connector
2021-05-06 05:37:36 +02:00
Jiri Pechanec
260c32cf0e
DBZ-3473 Resume parallel snapshot after connector restart
2021-05-06 05:37:36 +02:00
Jiri Pechanec
37626c0dfe
DBZ-3473 Extract incremental snapshot context
2021-05-06 05:37:36 +02:00
Jiri Pechanec
07371c085b
DBZ-3473 Watermark signals must be in separate tx
2021-05-06 05:37:36 +02:00
Jiri Pechanec
a52c536a68
DBZ-3473 First prototype of incremental snapshotting
2021-05-06 05:37:36 +02:00
Gunnar Morling
dc02b896cd
DBZ-3449 Moving QA releated plug-ins to separate profile, so to avoid loading them at all
2021-04-28 15:14:05 +02:00
Gunnar Morling
2088c035b1
DBZ-3449 Adding "quick" profile
2021-04-26 06:09:14 +02:00
Hossein Torabi
5d6705c3fe
DBZ-2699 implement skipped.operation in core
2021-04-08 11:59:08 +02:00
Debezium Builder
8a88ba9b45
[maven-release-plugin] prepare for next development iteration
2021-04-08 04:04:00 -04:00
Debezium Builder
74152afe74
[maven-release-plugin] prepare release v1.5.0.Final
2021-04-08 04:04:00 -04:00
Gunnar Morling
5425e6c5dc
DBZ-3343 Re-using single shared SqlTypeMapper instance
2021-04-06 14:59:55 +02:00
JLDLaughlin
06b0475f17
DBZ-2911 Add additional LSN information to all sources
...
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00
Debezium Builder
6b4d88bb51
[maven-release-plugin] prepare for next development iteration
2021-03-24 06:35:02 -04:00
Debezium Builder
c578715233
[maven-release-plugin] prepare release v1.5.0.CR1
2021-03-24 06:35:02 -04:00
Jiri Pechanec
495be2659b
DBZ-2511 Dedicated logger for schema name adjuster
2021-03-18 14:42:34 +01:00
Jiri Pechanec
21f522217c
DBZ-3033 Map OID to long value
2021-03-17 18:11:52 +01:00
Gunnar Morling
911b5e9a3b
DBZ-3271 Unifying filter handling across relational connectors
2021-03-17 09:54:25 +01:00
Debezium Builder
f57057421b
[maven-release-plugin] prepare for next development iteration
2021-03-12 04:38:17 -05:00
Debezium Builder
b57293013a
[maven-release-plugin] prepare release v1.5.0.Beta2
2021-03-12 04:38:16 -05:00
Jiri Pechanec
123d9ef4eb
DBZ-3213 Refactor Maven structure to deploy support modules
2021-03-11 16:14:15 +01:00
Jiri Pechanec
f23421920b
DBZ-2919 Remove race condition
2021-03-10 19:12:34 +01:00
Jiri Pechanec
15c7b11a1f
DBZ-3141 Change schema signal tested for Postgres
2021-03-10 19:12:34 +01:00
Jiri Pechanec
ff7cb44801
DBZ-3141 Offsets are propagated to signal actions
2021-03-10 19:12:34 +01:00
Jiri Pechanec
7fdad2ed49
DBZ-3141 Support for signalling table
2021-03-10 19:12:34 +01:00
Jiri Pechanec
9f2cffa21e
DBZ-2885 Fix test
2021-03-09 17:32:01 +01:00
Anisha Mohanty
895d704d82
DBZ-2885 Handle misleading error message for filtered publication
2021-03-09 08:39:15 +01:00
Chris Cranford
04849734b3
DBZ-3030 Do not execute initial statements on connector validation
2021-03-05 11:59:22 +01:00
Debezium Builder
b4c260da50
[maven-release-plugin] prepare for next development iteration
2021-02-23 14:04:01 -05:00
Debezium Builder
123a711a6d
[maven-release-plugin] prepare release v1.5.0.Beta1
2021-02-23 14:04:01 -05:00
Fahim Farook
194258d87b
DBZ-3164 Log database connection validation failures consistently
2021-02-22 14:52:22 +01:00
Gunnar Morling
62ad3969c1
DBZ-3107 Typo fixes
2021-02-22 09:08:47 +01:00
Jiri Pechanec
a97b86db43
DBZ-3107 Workaround for DBZ-3158
2021-02-22 09:08:47 +01:00
Jiri Pechanec
1edad510ff
DBZ-2614 Support for infinite timestamps
2021-02-19 10:44:06 +01:00
Jiri Pechanec
1f79c15a48
DBZ-2616 Fix negative years conversion
2021-02-19 10:44:06 +01:00
Jiri Pechanec
a17e7cee44
DBZ-2865 Regression in warning message cleanup
2021-02-19 10:40:15 +01:00
Yilong Chang
a0b3704832
DBZ-3056 Validate all fields in subclasses.
2021-02-16 12:34:06 +01:00
Yilong Chang
76c7e0d426
DBZ-3056 Extract basic valdiation in parent class.
2021-02-16 12:34:06 +01:00
ani-sha
5f8a22a5df
DBZ-2858 Make field descriptions consistent for time values
2021-02-16 09:55:35 +01:00
Kevin Pullin
db5dd54c20
DBZ-3074 Split shouldReceiveChangesForInsertsIndependentOfReplicaIdentity
...
Split shouldReceiveChangesForInsertsIndependentOfReplicaIdentity into two tests,
one that works with the PGOUTPUT decoder and one that works with the other decoders
(due to differences between schema update handling).
2021-02-10 10:58:26 +01:00
Kevin Pullin
2426de849a
DBZ-3074 PgOutputMessageDecoder - Fix unordered keys
...
Fix issue where `PgOutputMessageDecoder` does not define primary key metadata in key-order.
`PgOutputMessageDecoder.getTablePrimaryKeyColumnNamesFromDatabase()` returns a `Set`, leading to unordered
primary keys in the metadata. Switch the logic to call `JdbcConnection.readPrimaryKeyNames()` which
_does_ correctly return an ordered primary key list.
2021-02-10 10:58:26 +01:00
Debezium Builder
e08df0a177
[maven-release-plugin] prepare for next development iteration
2021-02-06 01:25:23 -05:00
Debezium Builder
da0411bf70
[maven-release-plugin] prepare release v1.5.0.Alpha1
2021-02-06 01:25:23 -05:00
Naveen Kumar KR
75882f35ac
DBZ-2382 Support emitting TRUNCATE events in PG11+ PGOUTPUT plugin
...
default - TruncateHandlingMode.SKIP
supported configs - TruncateHandlingMode.SKIP / TruncateHandlingMode.INCLUDE
2021-02-03 13:53:01 +01:00
ani-sha
d4003c9172
DBZ-2420 Define database configs under RelationalDatabaseConnectorConfig
2021-02-03 08:05:42 +01:00
Debezium Builder
237b4ac0f1
[maven-release-plugin] prepare for next development iteration
2021-01-28 07:38:55 -05:00
Debezium Builder
06b1d0cbad
[maven-release-plugin] prepare release v1.4.1.Final
2021-01-28 07:38:55 -05:00
rkerner
6aa13e756a
DBZ-2952 Remove Postgres replication slot validation (maybe part 1 to fix user's issues)
2021-01-27 10:31:00 +01:00
Gunnar Morling
aa674842a3
DBZ-2923 Improving test stability
2021-01-14 17:02:04 +01:00
Gunnar Morling
b5b8ef358b
DBZ-2764 Misc. clean-up
2021-01-08 13:19:57 +01:00
ani-sha
bd427786e9
DBZ-2764 Centralize Postgres image for Testcontainers
2021-01-08 13:19:57 +01:00
Debezium Builder
3010f99c32
[maven-release-plugin] prepare for next development iteration
2021-01-07 03:38:13 -05:00
Debezium Builder
54534538d9
[maven-release-plugin] prepare release v1.4.0.Final
2021-01-07 03:38:13 -05:00
rkerner
752454e83d
DBZ-2800 fix AWS user roles validation
2021-01-07 07:22:37 +01:00
Debezium Builder
b1ab996c3e
[maven-release-plugin] prepare for next development iteration
2020-12-16 14:11:31 -05:00
Debezium Builder
8fc864b278
[maven-release-plugin] prepare release v1.4.0.CR1
2020-12-16 14:11:31 -05:00
Debezium Builder
cf921f56b4
[maven-release-plugin] prepare for next development iteration
2020-12-10 00:27:40 -05:00
Debezium Builder
c49a377487
[maven-release-plugin] prepare release v1.4.0.Beta1
2020-12-10 00:27:39 -05:00
Jiri Pechanec
d1a7aae736
DBZ-2772 wal2json needs db write to complete catch-up phase
2020-11-30 10:06:43 +01:00
Debezium Builder
4535549dcd
[maven-release-plugin] prepare for next development iteration
2020-11-16 15:18:43 -05:00
Debezium Builder
3c70c5f7d5
[maven-release-plugin] prepare release v1.4.0.Alpha2
2020-11-16 15:18:43 -05:00
Jiri Pechanec
af91d7d2bf
DBZ-2662 Increase wait time for metrics
2020-11-16 09:44:52 +01:00
vanhoale
17a424d9ac
DBZ-2662 Handle ChangeEventQueue by the size in bytes
2020-11-16 08:39:33 +01:00
rkerner
4faf13d0c9
DBZ-2637 apply feedback
2020-11-16 07:47:25 +01:00
rkerner
aff1df7573
DBZ-2637 fix unit test timeouts
2020-11-16 07:47:25 +01:00
rkerner
77eee964a1
DBZ-2637 unrelated cleanup
2020-11-16 07:47:25 +01:00
rkerner
c59e00c65a
DBZ-2637 Enhance Postgres validation checks
...
+ add wal_level config check
+ add LOGIN and REPLICATION roles check
+ add replication slot is already in use check
2020-11-16 07:47:25 +01:00
rkerner
f291b07b6b
DBZ-2724 cleanup code and apply PR feedback
2020-11-10 10:44:41 +01:00
rkerner
890bf217dc
DBZ-2724 unrelated cleanup
2020-11-10 10:44:41 +01:00
rkerner
0015d628d5
DBZ-2724 Add integration tests for DBZ-2617 (fix Postgres was not able to shutdown with shutdown mode "fast")
...
DBZ-2602 Migrate Testcontainers related changes on DebeziumContainer from UI PoC backend to Debezium main repo
2020-11-10 10:44:41 +01:00
Chris Cranford
4e6b3b1268
DBZ-2704 Fix test failure - PostgresConnectorIT#shouldRegularlyFlushLsnWithTxMonitoring
2020-11-04 06:15:16 +01:00
rkerner
c274c2b39b
DBZ-2617 refactor to proper HeartbeatErrorHandler injection
2020-11-03 07:23:02 +01:00
cooksey
c262238183
DBZ-2608 Add a snapshotComplete lifecycle hook to the Snapshotter
2020-10-30 13:34:38 -04:00
Debezium Builder
26883dad92
[maven-release-plugin] prepare for next development iteration
2020-10-22 03:45:59 -04:00
Debezium Builder
9adbc2d67e
[maven-release-plugin] prepare release v1.4.0.Alpha1
2020-10-22 03:45:59 -04:00
Jiri Pechanec
ee5353ef6f
DBZ-2653 Process commits even with tx monitoring
2020-10-20 10:42:10 +02:00
Kaushik Iyer
7d9e8fdc46
DBZ-2456 fixes after rebase
2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932
DBZ-2456 selective snapshot implementation
2020-10-16 10:13:48 +02:00
Chris Cranford
17039df7ce
DBZ-2344 Fix test failure - RecordsStreamProducerIT - shouldReceiveHeartbeatAlsoWhenChangingNonWhitelistedTable
2020-10-06 09:07:42 +02:00
Debezium Builder
95b8ed3877
[maven-release-plugin] prepare for next development iteration
2020-10-01 09:08:51 -04:00
Debezium Builder
19ad73beb2
[maven-release-plugin] prepare release v1.3.0.Final
2020-10-01 09:08:50 -04:00
Jiri Pechanec
12be0d8428
DBZ-2565 Disable test failing for snapshots
2020-10-01 14:27:13 +02:00
Jiri Pechanec
45d683724f
DBZ-2565 Fail on unsupported infinite timestamps
2020-10-01 14:27:13 +02:00
Chris Cranford
4fe6813179
DBZ-2435 - Fix test failure - ReplicationConnectionIT#shouldResumeFromLastReceivedLSN
2020-09-30 20:19:50 +02:00
Chris Cranford
155dd44dab
DBZ-2544 Fix formatting
2020-09-30 19:42:10 +02:00
Chris Cranford
1fd6fbb1fa
DBZ-2544 Fix test failure - PostgresConnectorIT#customSnapshotterSkipsTablesOnRestart
2020-09-30 19:42:10 +02:00
Chris Cranford
bb0b3fd158
DBZ-2468 Fix test failure - PostgresConnectorIT#shouldExecuteOnConnectStatements
2020-09-24 23:06:55 +02:00
Debezium Builder
b146b69154
[maven-release-plugin] prepare for next development iteration
2020-09-24 04:56:42 -04:00
Debezium Builder
c51cfe8eb9
[maven-release-plugin] prepare release v1.3.0.CR1
2020-09-24 04:56:41 -04:00
cooksey
ba074abe4c
DBZ-2550 Prevent duplicate events using catch up streaming
...
Normally when a connector gracefully shuts down, the connect framework attempts to commit offsets so the latest committed state gets acked on the replication stream. While the connector is running, the framework periodically commits offsets. Debezium does not manage triggering an offset commit. When the catch up streaming phase ends, there may be uncommitted state and the connector is unable to determine when the next commit will occur because the commit timing is externally managed. If a commit is not triggered between the end of the catch up streaming phase and the normal streaming phase after the snapshot, the connector may produce some duplicated messages.
Although the replication stream may be out of date, the internal OffsetContext is aware of the latest committed offset. When the snapshot phase recreates a new offset after catch up streaming, the previous offset has access to the latest state. Use the previous offset to forward known state to the new offset.
2020-09-21 09:28:15 +02:00
Debezium Builder
837669890a
[maven-release-plugin] prepare for next development iteration
2020-09-16 12:18:08 -04:00
Debezium Builder
086dbd960b
[maven-release-plugin] prepare release v1.3.0.Beta2
2020-09-16 12:18:08 -04:00
Jiri Pechanec
eed321d485
DBZ-2461 LSN must not be flushed after connection close
2020-09-16 11:40:52 +02:00
Chris Cranford
e5c01c6b09
DBZ-137 Fix compilation problems
2020-09-14 12:33:43 +02:00
AndreyIg
77662a0dde
DBZ-137 contribution to the core, Oracle related
2020-09-14 12:33:43 +02:00
cooksey
8bcbdb639d
DBZ-2094 Allow Postgres snapshotter to set streaming start on resume
...
When a connector resumes after previously streaming and takes a
snapshot, through a new method on the snapshotter interface,
shouldStreamEventsStartingFromSnapshot, can choose whether
to resume streaming from the last known streaming position or the
beginning of the snapshot. This is helpful for snapshotters that
may not want to resnapshot every table in the whitelist/blacklist
but not miss event on the tables that are skipped.
2020-09-09 10:54:11 +02:00
Debezium Builder
9979db648f
[maven-release-plugin] prepare for next development iteration
2020-08-28 05:04:26 -04:00
Debezium Builder
5c58b23756
[maven-release-plugin] prepare release v1.3.0.Beta1
2020-08-28 05:04:26 -04:00
Jiri Pechanec
03a11efd8e
DBZ-2338 Atomic is not necessary
2020-08-24 21:16:37 +02:00
Jiri Pechanec
cf0db85436
DBZ-2338 Flush LSNs on tx boundaries
2020-08-24 21:16:37 +02:00
Jiri Pechanec
483a483569
DBZ-2338 Log exception; restart keepalive
2020-08-24 21:16:37 +02:00
Jiri Pechanec
f01ab234a4
DBZ-2338 Skip initial statements on reconnect
2020-08-24 21:16:37 +02:00
Jiri Pechanec
4d0ec1f848
DBZ-2397 Test for restart in tx
2020-08-24 21:16:37 +02:00
Jiri Pechanec
aead9a6612
DBZ-2338 Minor corrections
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2020-08-24 21:16:37 +02:00
Jiri Pechanec
b5c2ed17ed
DBZ-2338 Support for pgoutput
2020-08-24 21:16:37 +02:00
Jiri Pechanec
39623aa799
DBZ-2338 Base WAL position detection on commit LSNs
2020-08-24 21:16:37 +02:00
Jiri Pechanec
31721c247b
DBZ-2200 Introduce LLSN domain type
2020-08-24 21:16:37 +02:00
rkerner
2c5c093587
DBZ-2171 avoid divisive language
2020-08-21 09:29:04 +02:00
Gunnar Morling
e89b65238f
DBZ-2423 Increasing visibility of some methods for UI PoC usage
2020-08-12 13:50:42 +02:00
Gunnar Morling
44efd1bc6b
DBZ-2423 Propagating port default values
2020-08-12 13:50:42 +02:00
Gunnar Morling
26b51e02cb
DBZ-2418 Misc. clean-up
2020-08-12 09:28:35 +02:00
Gunnar Morling
ebe5169a66
DBZ-2418 Delaying retrieval of DB charset;
...
This is called only once anyways, so there's no need for storing the info
in a field in PostgresConnection. This allows PostgresConnector#validate()
bring up a more meaningful error message in case of incorrect credentials
and other incorrect connection configuration.
2020-08-12 09:28:35 +02:00
Debezium Builder
c4c50f5fc6
[maven-release-plugin] prepare for next development iteration
2020-08-06 00:46:18 -04:00
Debezium Builder
94cbeb95fa
[maven-release-plugin] prepare release v1.3.0.Alpha1
2020-08-06 00:46:17 -04:00
rkerner
cad6cf62d3
DBZ-2315 fix BIT VARYING handling in Postgres connector
...
* removed little endian padding for BIT types in JdbcValueConverters (only used for Postgres yet)
* removed legacy format handling fot BIT related types in JdbcValueConverters#convertBits which were leftovers from PR #1408
* removed unnecessary zero-ing of a newly created byte array to improve performance for huge byte arrays
* updated Postgres connector docs
2020-08-03 14:58:31 +02:00
Björn Häuser
04254e3fe7
DBZ-2310: Return true when messages are skipped
...
See https://issues.redhat.com/browse/DBZ-2310 for more explanation.
Short summary: Whenever LSNs are skipped return back that messages have
been processed, which will cause two things:
* The replication can be advanced properly
* The connector does not fallback to the poll timeout waiting interval
I also think its more correct to say, "yes I have read messages, but
still skipped all of them".
2020-07-21 15:53:06 +02:00
Debezium Builder
e1ab38de84
[maven-release-plugin] prepare for next development iteration
2020-07-16 04:40:04 -04:00
Debezium Builder
69cf375faa
[maven-release-plugin] prepare release v1.2.1.Final
2020-07-16 04:40:04 -04:00
Jiri Pechanec
f06a14f1da
DBZ-2288 Rethrow exception in test
2020-07-16 09:51:00 +02:00
Jiri Pechanec
55ba8b8b89
DBZ-2288 Fix copy/paste errors
2020-07-16 09:51:00 +02:00
Jiri Pechanec
ea942a4268
DBZ-2288 Test for pgoutput
2020-07-16 09:51:00 +02:00
Jiri Pechanec
8b0b252eb9
DBZ-2288 Events in exported snapshot no longer filtered by LSN
2020-07-16 09:51:00 +02:00
Jos Huiting
da97be7842
DBZ-2307 - Improve logging when primary keys are missing
2020-07-15 11:18:48 -04:00
Chris Cranford
94f2932e95
DBZ-2271 Fix test failure - RecordsStreamProducerIT#testEmptyChangesProducesHeartbeat
...
This fixes a race condition with heartbeat emitted messages with empty DDLs
2020-07-14 17:25:44 +02:00
Chris Cranford
0e5122c69d
DBZ-2319 Fix test failure - PostgresConnectorIT#shouldOutputRecordsInCloudEventsFormat
2020-07-09 08:22:13 +02:00
Chris Cranford
4c6351e5e3
DBZ-2271 Fix test failure - RecordsStreamProducerIT#testEmptyChangesProducesHeartbeat
2020-07-08 17:23:58 +02:00
Debezium Builder
c0d30b87d9
[maven-release-plugin] prepare for next development iteration
2020-06-24 18:03:11 +02:00
Debezium Builder
0e2ac78301
[maven-release-plugin] prepare release v1.2.0.Final
2020-06-24 18:03:11 +02:00
Chris Cranford
41bfac49a3
DBZ-2230 Fix intermittent CI test failure - Postgres
2020-06-22 18:27:43 +02:00
Debezium Builder
b03a4d0e50
[maven-release-plugin] prepare for next development iteration
2020-06-19 00:39:01 -04:00
Debezium Builder
93e60258d5
[maven-release-plugin] prepare release v1.2.0.CR2
2020-06-19 00:39:00 -04:00
Gunnar Morling
f3b07a1374
DBZ-1916 Formatting
2020-06-16 13:28:49 +02:00
Chris Cranford
64bff85ad2
DBZ-1916 Add tests for datatype.propagate.source.type
2020-06-16 13:28:49 +02:00
cooksey
1282403c44
DBZ-2176 Open transaction test are more reliable
...
Checking pg_stat_activity for transactions with a state of "idle in transaction"
should be more reliable to find open abandoned transaction than looking for
a non-null backend_xmin. For example, an autovaccum process will have a
backend_xmin but will not have a stat of "idle in transaction"
2020-06-15 11:15:51 +02:00
Debezium Builder
65c39e9f11
[maven-release-plugin] prepare for next development iteration
2020-06-11 02:00:20 -04:00
Debezium Builder
bce332c900
[maven-release-plugin] prepare release v1.2.0.CR1
2020-06-11 02:00:19 -04:00