cooksey
8bcbdb639d
DBZ-2094 Allow Postgres snapshotter to set streaming start on resume
...
When a connector resumes after previously streaming and takes a
snapshot, through a new method on the snapshotter interface,
shouldStreamEventsStartingFromSnapshot, can choose whether
to resume streaming from the last known streaming position or the
beginning of the snapshot. This is helpful for snapshotters that
may not want to resnapshot every table in the whitelist/blacklist
but not miss event on the tables that are skipped.
2020-09-09 10:54:11 +02:00
Jiri Pechanec
03a11efd8e
DBZ-2338 Atomic is not necessary
2020-08-24 21:16:37 +02:00
Jiri Pechanec
cf0db85436
DBZ-2338 Flush LSNs on tx boundaries
2020-08-24 21:16:37 +02:00
Jiri Pechanec
483a483569
DBZ-2338 Log exception; restart keepalive
2020-08-24 21:16:37 +02:00
Jiri Pechanec
f01ab234a4
DBZ-2338 Skip initial statements on reconnect
2020-08-24 21:16:37 +02:00
Jiri Pechanec
4d0ec1f848
DBZ-2397 Test for restart in tx
2020-08-24 21:16:37 +02:00
Jiri Pechanec
aead9a6612
DBZ-2338 Minor corrections
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2020-08-24 21:16:37 +02:00
Jiri Pechanec
b5c2ed17ed
DBZ-2338 Support for pgoutput
2020-08-24 21:16:37 +02:00
Jiri Pechanec
39623aa799
DBZ-2338 Base WAL position detection on commit LSNs
2020-08-24 21:16:37 +02:00
Jiri Pechanec
31721c247b
DBZ-2200 Introduce LLSN domain type
2020-08-24 21:16:37 +02:00
rkerner
2c5c093587
DBZ-2171 avoid divisive language
2020-08-21 09:29:04 +02:00
Gunnar Morling
e89b65238f
DBZ-2423 Increasing visibility of some methods for UI PoC usage
2020-08-12 13:50:42 +02:00
Gunnar Morling
44efd1bc6b
DBZ-2423 Propagating port default values
2020-08-12 13:50:42 +02:00
Gunnar Morling
26b51e02cb
DBZ-2418 Misc. clean-up
2020-08-12 09:28:35 +02:00
Gunnar Morling
ebe5169a66
DBZ-2418 Delaying retrieval of DB charset;
...
This is called only once anyways, so there's no need for storing the info
in a field in PostgresConnection. This allows PostgresConnector#validate()
bring up a more meaningful error message in case of incorrect credentials
and other incorrect connection configuration.
2020-08-12 09:28:35 +02:00
rkerner
cad6cf62d3
DBZ-2315 fix BIT VARYING handling in Postgres connector
...
* removed little endian padding for BIT types in JdbcValueConverters (only used for Postgres yet)
* removed legacy format handling fot BIT related types in JdbcValueConverters#convertBits which were leftovers from PR #1408
* removed unnecessary zero-ing of a newly created byte array to improve performance for huge byte arrays
* updated Postgres connector docs
2020-08-03 14:58:31 +02:00
Björn Häuser
04254e3fe7
DBZ-2310: Return true when messages are skipped
...
See https://issues.redhat.com/browse/DBZ-2310 for more explanation.
Short summary: Whenever LSNs are skipped return back that messages have
been processed, which will cause two things:
* The replication can be advanced properly
* The connector does not fallback to the poll timeout waiting interval
I also think its more correct to say, "yes I have read messages, but
still skipped all of them".
2020-07-21 15:53:06 +02:00
Jiri Pechanec
f06a14f1da
DBZ-2288 Rethrow exception in test
2020-07-16 09:51:00 +02:00
Jiri Pechanec
55ba8b8b89
DBZ-2288 Fix copy/paste errors
2020-07-16 09:51:00 +02:00
Jiri Pechanec
ea942a4268
DBZ-2288 Test for pgoutput
2020-07-16 09:51:00 +02:00
Jiri Pechanec
8b0b252eb9
DBZ-2288 Events in exported snapshot no longer filtered by LSN
2020-07-16 09:51:00 +02:00
Jos Huiting
da97be7842
DBZ-2307 - Improve logging when primary keys are missing
2020-07-15 11:18:48 -04:00
Chris Cranford
94f2932e95
DBZ-2271 Fix test failure - RecordsStreamProducerIT#testEmptyChangesProducesHeartbeat
...
This fixes a race condition with heartbeat emitted messages with empty DDLs
2020-07-14 17:25:44 +02:00
Chris Cranford
0e5122c69d
DBZ-2319 Fix test failure - PostgresConnectorIT#shouldOutputRecordsInCloudEventsFormat
2020-07-09 08:22:13 +02:00
Chris Cranford
4c6351e5e3
DBZ-2271 Fix test failure - RecordsStreamProducerIT#testEmptyChangesProducesHeartbeat
2020-07-08 17:23:58 +02:00
Chris Cranford
41bfac49a3
DBZ-2230 Fix intermittent CI test failure - Postgres
2020-06-22 18:27:43 +02:00
Gunnar Morling
f3b07a1374
DBZ-1916 Formatting
2020-06-16 13:28:49 +02:00
Chris Cranford
64bff85ad2
DBZ-1916 Add tests for datatype.propagate.source.type
2020-06-16 13:28:49 +02:00
cooksey
1282403c44
DBZ-2176 Open transaction test are more reliable
...
Checking pg_stat_activity for transactions with a state of "idle in transaction"
should be more reliable to find open abandoned transaction than looking for
a non-null backend_xmin. For example, an autovaccum process will have a
backend_xmin but will not have a stat of "idle in transaction"
2020-06-15 11:15:51 +02:00
Gunnar Morling
8cac498a60
DBZ-2156 More meaningful exception in case of replication slot conflict
2020-06-08 10:28:08 +02:00
Jiri Pechanec
13419ae74a
DBZ-2118 Document type registry connection capability
2020-06-08 09:22:05 +02:00
Jiri Pechanec
d2ef7b7011
DBZ-2118 Slot dropping more resilient to race
2020-06-08 09:22:05 +02:00
Jiri Pechanec
642f4e7303
DBZ-2118 Switch to manual tx management
2020-06-08 09:22:05 +02:00
Jiri Pechanec
8c378400eb
DBZ-2118 Type registry provided only for dedicated connections
2020-06-08 09:22:05 +02:00
Jiri Pechanec
853ebafd7f
DBZ-2118 Close TX after type query
2020-06-08 09:22:05 +02:00
Chris Cranford
9b33264334
DBZ-2157 Fix intermittent postgres test failures
2020-06-05 20:02:14 +02:00
Chris Cranford
845a790593
DBZ-2060 Fix intermittent test failures (sqlserver & postgres)
2020-06-05 20:02:14 +02:00
Gunnar Morling
02b16e17ac
DBZ-1814 Adding tests for exporting unkown column type
2020-06-05 12:13:29 +02:00
Gunnar Morling
c54e377dd2
DBZ-1814 Exporting Hex and Base64 representations as string
2020-06-05 12:13:29 +02:00
Gunnar Morling
023064eedb
DBZ-1814 Renaming "raw" to "bytes"; also clarifying that this notion isn't Java-specific
2020-06-05 12:13:29 +02:00
Jeremy Finzel
5db614da21
DBZ-1814 added new binary handling mode option
2020-06-05 12:13:29 +02:00
Gunnar Morling
d7b3f0a7fb
DBZ-1813 Misc. clean-up;
...
* Removing unused method
* Simplifying tests
* Avoiding deprecated code
2020-06-05 06:24:25 +02:00
Gunnar Morling
59f34e7b16
DBZ-1813 Stabiling test
2020-06-05 06:24:25 +02:00
Brandon Brown
bd64ace7fc
DBZ-1813 Adding ability to configure pgoutput publication based on table filters
...
defined.
2020-06-05 06:24:25 +02:00
Braden Groom
8439e70d09
DBZ-2090 Remove unused sourceInfo variable
2020-05-19 08:30:55 +02:00
Chris Cranford
f449550b2d
DBZ-2068 Skip tests incompatible with Kafka 1.x
2020-05-13 08:22:07 +02:00
Gunnar Morling
ab1d4bb1cd
DBZ-1970 Making change event API more consistent and uniform
2020-05-06 14:33:37 +02:00
Jiri Pechanec
d82307c331
DBZ-1970 Support for separate key/value embedded converter
2020-05-06 14:33:37 +02:00
Chris Cranford
cd43c4880f
DBZ-2014 Do not include outbox eventType field by default
2020-05-05 22:13:25 +02:00
Chris Cranford
81c3a808da
DBZ-1963 Suggested changes
2020-05-05 08:45:58 +02:00