Addison Higham
62328bf137
DBZ-1238 Expose more options to the PG Snapshot SPI
...
This commit adds some more options to the Postgres Snapshottter SPI
interface, specifically, the ability to create the query for the start
of a snapshot, as well as the ability to generate a statement to lock
the tables.
Additionally, some rework is done to allow for the usage of an exported
snapshot in conjuction with the SPI taking metadata about a newly
created slot. This also changes how slots are initialized to allow for
the exported snapshot to be referenced, which requires adding a more
granular setup of a ReplicationConnection
Together, these options allow for a lot more flexibility, such as not
taking locks when snapshotting large databases as well as potentially to
use exported snapshots.
A future version should perhaps make some options possible without
implementing the SPI (such as using the exported snapshot by default)
but this commit is just trying to get all the groundwork in place to
allow for the Snapshotter SPI to have this functionality.
2019-07-09 21:14:28 +02:00
Gunnar Morling
369f74d875
DBZ-1320 Addressing review remarks
2019-07-09 21:07:18 +02:00
Brandon Brown
efff4f0809
DBZ-1320 Adding support for deletion events via new configurable property route.tombstone.on.empty.payload
2019-07-09 21:07:18 +02:00
Gunnar Morling
50e3a02d4d
DBZ-1371 README updates
2019-07-09 10:13:21 +02:00
Gunnar Morling
8c5d5021f4
DBZ-1371 Restoring original timeouts
2019-07-09 10:13:21 +02:00
Chris Cranford
faa31b079d
DBZ-1371 Added link to RDS.md from README.md
2019-07-09 10:13:21 +02:00
Chris Cranford
bf248e6fb0
DBZ-1371 Update to PostgreSQL connector RDS document
2019-07-09 10:13:21 +02:00
Chris Cranford
af513c2732
DBZ-1371 Derive timeouts from configurable timeout
2019-07-09 10:13:21 +02:00
Chris Cranford
f88970f2e6
DBZ-1371 Fix formatting and typos in RDS documentation
2019-07-09 10:13:21 +02:00
Chris Cranford
051d5a478d
DBZ-1371 Added RDS setup documentation for PostgreSQL
2019-07-09 10:13:21 +02:00
Chris Cranford
a50b9847ac
DBZ-1371 Fix tests to run more reliably on Amazon RDS
2019-07-09 10:13:21 +02:00
Jiri Pechanec
67ca8a2d76
DBZ-794 Filter out savepoints from database history
2019-07-08 12:54:01 +02:00
Renato Mefi
c990256fd1
DBZ-1379 Fix PostgreSQL false empty password Warn
2019-07-08 12:51:49 +02:00
Gunnar Morling
e2d8736a79
DBZ-1380 Misc. clean-up;
...
* reducing visibility of some methods
* resetting interrupted state
2019-07-05 21:08:35 +02:00
Jiri Pechanec
5dc4812ffa
DBZ-1380 Guard against partially initilized replication slot
2019-07-05 21:08:35 +02:00
BinLi1988
3b14c13bbb
DBZ-1338 Support for ensuring keepalive by using MySQL heartbeat
2019-07-05 09:10:30 +02:00
Gunnar Morling
02427a054b
DBZ-1222 EventsInError -> ErroneousEvents
2019-07-04 21:31:32 +02:00
Jiri Pechanec
c08a5374fe
DBZ-1222 Improve error event method name
2019-07-04 21:31:32 +02:00
Jiri Pechanec
2b365be63c
DBZ-1222 EventsInError metric added
2019-07-04 21:31:32 +02:00
Jiri Pechanec
13d638fd43
DBZ-1356 Metrics for schema history ( #947 )
...
* DBZ-1356 Metrics for schema history
2019-07-02 13:26:17 +02:00
Jiri Pechanec
b1c1c05d1f
DBZ-1363 Generate heartbeat periodically not upon event
2019-07-02 12:02:33 +02:00
Gunnar Morling
08c5d36789
Merge pull request #942 from jpechane/stab-lsn-flush-test
...
DBZ-1362 Stabilize test executions on CI
2019-07-01 09:34:24 +02:00
Gunnar Morling
a02daae3c1
DBZ-1362 Comment
2019-07-01 09:34:01 +02:00
Gunnar Morling
a991ea97d7
Handling option for emitting tombstones conistently
2019-07-01 08:27:33 +02:00
Chris Cranford
61f5e15889
DBZ-1366 Avoid creating unnecessary TypeMetadataImpl instances; only init once.
2019-06-28 13:44:53 -04:00
Jiri Pechanec
b546dc886e
DBZ-1362 Fix Snapshot/streaming switch race condition
2019-06-28 09:09:18 +02:00
Gunnar Morling
254dba97ee
DBZ-1358 Avoiding instantiation of SystemTime
2019-06-28 08:54:04 +02:00
Jiri Pechanec
a0df2c140b
Use Kafka SystemTime implementation
2019-06-28 08:54:04 +02:00
Jiri Pechanec
53f4db06b9
DBZ-1358 Update to Kafka 2.3.0
2019-06-28 08:54:04 +02:00
Jiri Pechanec
e0b188f80a
DBZ-1362 Drop replication slot after test execution
2019-06-28 05:41:07 +02:00
Jiri Pechanec
7e03dbe87e
DBZ-1362 Log test method executions
2019-06-28 05:41:02 +02:00
Jiri Pechanec
82d245acb1
DBZ-1362 Set longer ZooKeeper timeout
2019-06-28 05:33:49 +02:00
Jiri Pechanec
046064d653
DBZ-1362 Make toast test compatible with PostgreSQL 11
2019-06-28 05:32:11 +02:00
Jiri Pechanec
412ce20638
DBZ-1362 Switch to Awaitility implementation
2019-06-28 05:19:01 +02:00
Jiri Pechanec
5a5d969e99
DBZ-1362 Wait for real LSN change during test
2019-06-28 05:19:01 +02:00
Gunnar Morling
a41fb30eaa
DBZ-1361 Restoring compatibility with Apache Kafka 1.x
2019-06-28 05:07:52 +02:00
Jenkins user
e95d656bca
[maven-release-plugin] prepare for next development iteration
2019-06-27 07:36:13 +00:00
Jenkins user
d95fd87311
[maven-release-plugin] prepare release v0.10.0.Beta2
2019-06-27 07:36:12 +00:00
Jiri Pechanec
04dee4cc8e
[release] Add missing contributors
2019-06-27 09:33:12 +02:00
Jiri Pechanec
4b7e7f89b4
[release] Changelog for 0.10.0.Beta2
2019-06-27 09:29:25 +02:00
Gunnar Morling
edd2f8eca3
DBZ-1352 Adding Guillaume Rosauro to COPYRIGHT.txt
2019-06-26 16:25:33 +02:00
Guillaume Rosauro
dc81d3c8ac
DBZ-1352 Removing the unused topic selection strategy configuration from Postgres connector
2019-06-26 16:24:38 +02:00
Jiri Pechanec
355c8a94ac
DBZ-1347 JavaDoc update
2019-06-25 14:52:58 +02:00
Gunnar Morling
62fc03a44d
DBZ-1347 Commenting
2019-06-25 14:52:58 +02:00
Jiri Pechanec
e72d7edd2f
DBZ-1347 Switch to non-blocking stream read
2019-06-25 14:52:58 +02:00
Gunnar Morling
e05ef934a0
DBZ-1345 Adding @FixFor
2019-06-25 12:44:00 +02:00
Chris Cranford
d518fa59fe
DBZ-1345 Should not snapshot materialized views
2019-06-25 12:44:00 +02:00
Jiri Pechanec
9c22da610a
DBZ-1353 MySQL 8 returns null for unspecified timestmap column
2019-06-25 12:13:53 +02:00
Jiri Pechanec
6e5f633e40
DBZ-1350 NO_AUTO_CREATE_USER unsupported on MySQL 8
2019-06-24 14:18:31 +02:00
Jiri Pechanec
257f900abb
DBZ-1349 Support for UTF8mb3 charset
2019-06-24 14:03:23 +02:00