alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
4,887 Commits 3 Branches 0 Tags 51 MiB
c53785dde7
Commit Graph

889 Commits

Author SHA1 Message Date
Gunnar Morling
aa674842a3 DBZ-2923 Improving test stability 2021-01-14 17:02:04 +01:00
Gunnar Morling
b5b8ef358b DBZ-2764 Misc. clean-up 2021-01-08 13:19:57 +01:00
ani-sha
bd427786e9 DBZ-2764 Centralize Postgres image for Testcontainers 2021-01-08 13:19:57 +01:00
Debezium Builder
3010f99c32 [maven-release-plugin] prepare for next development iteration 2021-01-07 03:38:13 -05:00
Debezium Builder
54534538d9 [maven-release-plugin] prepare release v1.4.0.Final 2021-01-07 03:38:13 -05:00
rkerner
752454e83d DBZ-2800 fix AWS user roles validation 2021-01-07 07:22:37 +01:00
Debezium Builder
b1ab996c3e [maven-release-plugin] prepare for next development iteration 2020-12-16 14:11:31 -05:00
Debezium Builder
8fc864b278 [maven-release-plugin] prepare release v1.4.0.CR1 2020-12-16 14:11:31 -05:00
Debezium Builder
cf921f56b4 [maven-release-plugin] prepare for next development iteration 2020-12-10 00:27:40 -05:00
Debezium Builder
c49a377487 [maven-release-plugin] prepare release v1.4.0.Beta1 2020-12-10 00:27:39 -05:00
Jiri Pechanec
d1a7aae736 DBZ-2772 wal2json needs db write to complete catch-up phase 2020-11-30 10:06:43 +01:00
Debezium Builder
4535549dcd [maven-release-plugin] prepare for next development iteration 2020-11-16 15:18:43 -05:00
Debezium Builder
3c70c5f7d5 [maven-release-plugin] prepare release v1.4.0.Alpha2 2020-11-16 15:18:43 -05:00
Jiri Pechanec
af91d7d2bf DBZ-2662 Increase wait time for metrics 2020-11-16 09:44:52 +01:00
vanhoale
17a424d9ac DBZ-2662 Handle ChangeEventQueue by the size in bytes 2020-11-16 08:39:33 +01:00
rkerner
4faf13d0c9 DBZ-2637 apply feedback 2020-11-16 07:47:25 +01:00
rkerner
aff1df7573 DBZ-2637 fix unit test timeouts 2020-11-16 07:47:25 +01:00
rkerner
77eee964a1 DBZ-2637 unrelated cleanup 2020-11-16 07:47:25 +01:00
rkerner
c59e00c65a DBZ-2637 Enhance Postgres validation checks 
+ add wal_level config check
+ add LOGIN and REPLICATION roles check
+ add replication slot is already in use check
 2020-11-16 07:47:25 +01:00
rkerner
f291b07b6b DBZ-2724 cleanup code and apply PR feedback 2020-11-10 10:44:41 +01:00
rkerner
890bf217dc DBZ-2724 unrelated cleanup 2020-11-10 10:44:41 +01:00
rkerner
0015d628d5 DBZ-2724 Add integration tests for DBZ-2617 (fix Postgres was not able to shutdown with shutdown mode "fast") 
DBZ-2602 Migrate Testcontainers related changes on DebeziumContainer from UI PoC backend to Debezium main repo
 2020-11-10 10:44:41 +01:00
Chris Cranford
4e6b3b1268 DBZ-2704 Fix test failure - PostgresConnectorIT#shouldRegularlyFlushLsnWithTxMonitoring 2020-11-04 06:15:16 +01:00
rkerner
c274c2b39b DBZ-2617 refactor to proper HeartbeatErrorHandler injection 2020-11-03 07:23:02 +01:00
cooksey
c262238183 DBZ-2608 Add a snapshotComplete lifecycle hook to the Snapshotter 2020-10-30 13:34:38 -04:00
Debezium Builder
26883dad92 [maven-release-plugin] prepare for next development iteration 2020-10-22 03:45:59 -04:00
Debezium Builder
9adbc2d67e [maven-release-plugin] prepare release v1.4.0.Alpha1 2020-10-22 03:45:59 -04:00
Jiri Pechanec
ee5353ef6f DBZ-2653 Process commits even with tx monitoring 2020-10-20 10:42:10 +02:00
Kaushik Iyer
7d9e8fdc46 DBZ-2456 fixes after rebase 2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932 DBZ-2456 selective snapshot implementation 2020-10-16 10:13:48 +02:00
Chris Cranford
17039df7ce DBZ-2344 Fix test failure - RecordsStreamProducerIT - shouldReceiveHeartbeatAlsoWhenChangingNonWhitelistedTable 2020-10-06 09:07:42 +02:00
Debezium Builder
95b8ed3877 [maven-release-plugin] prepare for next development iteration 2020-10-01 09:08:51 -04:00
Debezium Builder
19ad73beb2 [maven-release-plugin] prepare release v1.3.0.Final 2020-10-01 09:08:50 -04:00
Jiri Pechanec
12be0d8428 DBZ-2565 Disable test failing for snapshots 2020-10-01 14:27:13 +02:00
Jiri Pechanec
45d683724f DBZ-2565 Fail on unsupported infinite timestamps 2020-10-01 14:27:13 +02:00
Chris Cranford
4fe6813179 DBZ-2435 - Fix test failure - ReplicationConnectionIT#shouldResumeFromLastReceivedLSN 2020-09-30 20:19:50 +02:00
Chris Cranford
155dd44dab DBZ-2544 Fix formatting 2020-09-30 19:42:10 +02:00
Chris Cranford
1fd6fbb1fa DBZ-2544 Fix test failure - PostgresConnectorIT#customSnapshotterSkipsTablesOnRestart 2020-09-30 19:42:10 +02:00
Chris Cranford
bb0b3fd158 DBZ-2468 Fix test failure - PostgresConnectorIT#shouldExecuteOnConnectStatements 2020-09-24 23:06:55 +02:00
Debezium Builder
b146b69154 [maven-release-plugin] prepare for next development iteration 2020-09-24 04:56:42 -04:00
Debezium Builder
c51cfe8eb9 [maven-release-plugin] prepare release v1.3.0.CR1 2020-09-24 04:56:41 -04:00
cooksey
ba074abe4c DBZ-2550 Prevent duplicate events using catch up streaming 
Normally when a connector gracefully shuts down, the connect framework attempts to commit offsets so the latest committed state gets acked on the replication stream.  While the connector is running, the framework periodically commits offsets. Debezium does not manage triggering an offset commit.  When the catch up streaming phase ends, there may be uncommitted state and the connector is unable to determine when the next commit will occur because the commit timing is externally managed. If a commit is not triggered between the end of the catch up streaming phase and the normal streaming phase after the snapshot, the connector may produce some duplicated messages.

Although the replication stream may be out of date, the internal OffsetContext is aware of the latest committed offset. When the snapshot phase recreates a new offset after catch up streaming, the previous offset has access to the latest state. Use the previous offset to forward known state to the new offset.
 2020-09-21 09:28:15 +02:00
Debezium Builder
837669890a [maven-release-plugin] prepare for next development iteration 2020-09-16 12:18:08 -04:00
Debezium Builder
086dbd960b [maven-release-plugin] prepare release v1.3.0.Beta2 2020-09-16 12:18:08 -04:00
Jiri Pechanec
eed321d485
DBZ-2461 LSN must not be flushed after connection close 2020-09-16 11:40:52 +02:00
Chris Cranford
e5c01c6b09 DBZ-137 Fix compilation problems 2020-09-14 12:33:43 +02:00
AndreyIg
77662a0dde DBZ-137 contribution to the core, Oracle related 2020-09-14 12:33:43 +02:00
cooksey
8bcbdb639d DBZ-2094 Allow Postgres snapshotter to set streaming start on resume 
When a connector resumes after previously streaming and takes a
snapshot, through a new method on the snapshotter interface,
shouldStreamEventsStartingFromSnapshot, can choose whether
to resume streaming from the last known streaming position or the
beginning of the snapshot. This is helpful for snapshotters that
may not want to resnapshot every table in the whitelist/blacklist
but not miss event on the tables that are skipped.
 2020-09-09 10:54:11 +02:00
Debezium Builder
9979db648f [maven-release-plugin] prepare for next development iteration 2020-08-28 05:04:26 -04:00
Debezium Builder
5c58b23756 [maven-release-plugin] prepare release v1.3.0.Beta1 2020-08-28 05:04:26 -04:00
Jiri Pechanec
03a11efd8e DBZ-2338 Atomic is not necessary 2020-08-24 21:16:37 +02:00
Jiri Pechanec
cf0db85436 DBZ-2338 Flush LSNs on tx boundaries 2020-08-24 21:16:37 +02:00
Jiri Pechanec
483a483569 DBZ-2338 Log exception; restart keepalive 2020-08-24 21:16:37 +02:00
Jiri Pechanec
f01ab234a4 DBZ-2338 Skip initial statements on reconnect 2020-08-24 21:16:37 +02:00
Jiri Pechanec
4d0ec1f848 DBZ-2397 Test for restart in tx 2020-08-24 21:16:37 +02:00
Jiri Pechanec
aead9a6612 DBZ-2338 Minor corrections 
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
 2020-08-24 21:16:37 +02:00
Jiri Pechanec
b5c2ed17ed DBZ-2338 Support for pgoutput 2020-08-24 21:16:37 +02:00
Jiri Pechanec
39623aa799 DBZ-2338 Base WAL position detection on commit LSNs 2020-08-24 21:16:37 +02:00
Jiri Pechanec
31721c247b DBZ-2200 Introduce LLSN domain type 2020-08-24 21:16:37 +02:00
rkerner
2c5c093587 DBZ-2171 avoid divisive language 2020-08-21 09:29:04 +02:00
Gunnar Morling
e89b65238f DBZ-2423 Increasing visibility of some methods for UI PoC usage 2020-08-12 13:50:42 +02:00
Gunnar Morling
44efd1bc6b DBZ-2423 Propagating port default values 2020-08-12 13:50:42 +02:00
Gunnar Morling
26b51e02cb DBZ-2418 Misc. clean-up 2020-08-12 09:28:35 +02:00
Gunnar Morling
ebe5169a66 DBZ-2418 Delaying retrieval of DB charset; 
This is called only once anyways, so there's no need for storing the info
in a field in PostgresConnection. This allows PostgresConnector#validate()
bring up a more meaningful error message in case of incorrect credentials
and other incorrect connection configuration.
 2020-08-12 09:28:35 +02:00
Debezium Builder
c4c50f5fc6 [maven-release-plugin] prepare for next development iteration 2020-08-06 00:46:18 -04:00
Debezium Builder
94cbeb95fa [maven-release-plugin] prepare release v1.3.0.Alpha1 2020-08-06 00:46:17 -04:00
rkerner
cad6cf62d3 DBZ-2315 fix BIT VARYING handling in Postgres connector 
* removed little endian padding for BIT types in JdbcValueConverters (only used for Postgres yet)
* removed legacy format handling fot BIT related types in JdbcValueConverters#convertBits which were leftovers from PR #1408
* removed unnecessary zero-ing of a newly created byte array to improve performance for huge byte arrays
* updated Postgres connector docs
 2020-08-03 14:58:31 +02:00
Björn Häuser
04254e3fe7 DBZ-2310: Return true when messages are skipped 
See https://issues.redhat.com/browse/DBZ-2310 for more explanation.

Short summary: Whenever LSNs are skipped return back that messages have
been processed, which will cause two things:

* The replication can be advanced properly
* The connector does not fallback to the poll timeout waiting interval

I also think its more correct to say, "yes I have read messages, but
still skipped all of them".
 2020-07-21 15:53:06 +02:00
Debezium Builder
e1ab38de84 [maven-release-plugin] prepare for next development iteration 2020-07-16 04:40:04 -04:00
Debezium Builder
69cf375faa [maven-release-plugin] prepare release v1.2.1.Final 2020-07-16 04:40:04 -04:00
Jiri Pechanec
f06a14f1da DBZ-2288 Rethrow exception in test 2020-07-16 09:51:00 +02:00
Jiri Pechanec
55ba8b8b89 DBZ-2288 Fix copy/paste errors 2020-07-16 09:51:00 +02:00
Jiri Pechanec
ea942a4268 DBZ-2288 Test for pgoutput 2020-07-16 09:51:00 +02:00
Jiri Pechanec
8b0b252eb9 DBZ-2288 Events in exported snapshot no longer filtered by LSN 2020-07-16 09:51:00 +02:00
Jos Huiting
da97be7842 DBZ-2307 - Improve logging when primary keys are missing 2020-07-15 11:18:48 -04:00
Chris Cranford
94f2932e95 DBZ-2271 Fix test failure - RecordsStreamProducerIT#testEmptyChangesProducesHeartbeat 
This fixes a race condition with heartbeat emitted messages with empty DDLs
 2020-07-14 17:25:44 +02:00
Chris Cranford
0e5122c69d DBZ-2319 Fix test failure - PostgresConnectorIT#shouldOutputRecordsInCloudEventsFormat 2020-07-09 08:22:13 +02:00
Chris Cranford
4c6351e5e3 DBZ-2271 Fix test failure - RecordsStreamProducerIT#testEmptyChangesProducesHeartbeat 2020-07-08 17:23:58 +02:00
Debezium Builder
c0d30b87d9 [maven-release-plugin] prepare for next development iteration 2020-06-24 18:03:11 +02:00
Debezium Builder
0e2ac78301 [maven-release-plugin] prepare release v1.2.0.Final 2020-06-24 18:03:11 +02:00
Chris Cranford
41bfac49a3 DBZ-2230 Fix intermittent CI test failure - Postgres 2020-06-22 18:27:43 +02:00
Debezium Builder
b03a4d0e50 [maven-release-plugin] prepare for next development iteration 2020-06-19 00:39:01 -04:00
Debezium Builder
93e60258d5 [maven-release-plugin] prepare release v1.2.0.CR2 2020-06-19 00:39:00 -04:00
Gunnar Morling
f3b07a1374 DBZ-1916 Formatting 2020-06-16 13:28:49 +02:00
Chris Cranford
64bff85ad2 DBZ-1916 Add tests for datatype.propagate.source.type 2020-06-16 13:28:49 +02:00
cooksey
1282403c44 DBZ-2176 Open transaction test are more reliable 
Checking pg_stat_activity for transactions with a state of "idle in transaction"
should be more reliable to find open abandoned transaction than looking for
a non-null backend_xmin. For example, an autovaccum process will have a
backend_xmin but will not have a stat of "idle in transaction"
 2020-06-15 11:15:51 +02:00
Debezium Builder
65c39e9f11 [maven-release-plugin] prepare for next development iteration 2020-06-11 02:00:20 -04:00
Debezium Builder
bce332c900 [maven-release-plugin] prepare release v1.2.0.CR1 2020-06-11 02:00:19 -04:00
Lukas Krejci
a4689611f5 DBZ-2159 Fix a typo in the package name. 2020-06-09 19:28:33 +02:00
Lukas Krejci
90c637b1e3 DBZ-2159 Include the Postgres SPI in the API checks. 2020-06-09 19:28:33 +02:00
Gunnar Morling
8cac498a60 DBZ-2156 More meaningful exception in case of replication slot conflict 2020-06-08 10:28:08 +02:00
Jiri Pechanec
13419ae74a DBZ-2118 Document type registry connection capability 2020-06-08 09:22:05 +02:00
Jiri Pechanec
d2ef7b7011 DBZ-2118 Slot dropping more resilient to race 2020-06-08 09:22:05 +02:00
Jiri Pechanec
642f4e7303 DBZ-2118 Switch to manual tx management 2020-06-08 09:22:05 +02:00
Jiri Pechanec
8c378400eb DBZ-2118 Type registry provided only for dedicated connections 2020-06-08 09:22:05 +02:00
Jiri Pechanec
853ebafd7f DBZ-2118 Close TX after type query 2020-06-08 09:22:05 +02:00
Chris Cranford
9b33264334 DBZ-2157 Fix intermittent postgres test failures 2020-06-05 20:02:14 +02:00
Chris Cranford
845a790593 DBZ-2060 Fix intermittent test failures (sqlserver & postgres) 2020-06-05 20:02:14 +02:00
Gunnar Morling
02b16e17ac DBZ-1814 Adding tests for exporting unkown column type 2020-06-05 12:13:29 +02:00
Gunnar Morling
c54e377dd2 DBZ-1814 Exporting Hex and Base64 representations as string 2020-06-05 12:13:29 +02:00