Igor Gabaydulin
9bea1e2638
DBZ-1727 Move null check to AbstractMessageDecoder
2020-02-05 13:33:29 +01:00
Igor Gabaydulin
fcc7a05579
DBZ-1727 Debezium Postgres connector does not apply keepalive lsn
2020-02-05 13:33:29 +01:00
Jiri Pechanec
77f9a61b95
DBZ-1751 Centralize envelope schema naming
2020-02-04 20:37:19 +01:00
Chris Cranford
c5902c3c32
DBZ-1158 Add test for REPLICA IDENTITY fallback values
2020-02-04 10:37:12 -05:00
Jiri Pechanec
1d9ac71a9e
DBZ-1698 Fix test timing issue
2020-02-03 22:38:02 +01:00
Jiri Pechanec
2a6ea1c41f
DBZ-1698 Handle toasted unknown column values
2020-02-03 22:38:02 +01:00
Jiri Pechanec
34d2979123
DBZ-1052 Stabilize test for changed heartbeats
2020-02-03 09:29:10 +01:00
Jiri Pechanec
010e0c6fa6
DBZ-1052 Flush LSN for skipped tx messages
2020-02-03 09:29:10 +01:00
Gunnar Morling
b66f314b3c
DBZ-1052 Misc. clean-up
...
* Doc updates
* Changed static method to instance
2020-02-03 09:29:10 +01:00
Jiri Pechanec
67e0079646
DBZ-1052 Expand known protobuf messages list
2020-02-03 09:29:10 +01:00
Jiri Pechanec
4fdda6c101
DBZ-1052 Add tx enable option to connector definitions
2020-02-03 09:29:10 +01:00
Jiri Pechanec
ba10a229b6
DBZ-1052 CE support for tx metadata in data messages
2020-02-03 09:29:10 +01:00
Jiri Pechanec
0e671d6167
DBZ-1052 Add counts per table to END
2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94
DBZ-1052 Transaction block moved to envelope
2020-02-03 09:29:10 +01:00
Jiri Pechanec
5749acda7e
DBZ-1052 Remove unused fields; added JavaDoc
2020-02-03 09:29:10 +01:00
Jiri Pechanec
072a37e790
DBZ-1052 Support for full Postgres/protobuf
2020-02-03 09:29:10 +01:00
Jiri Pechanec
c0557b325b
DBZ-1052 Skip CE for transaction struct
2020-02-03 09:29:10 +01:00
Jiri Pechanec
c466143f35
DBZ-1052 Test for limited Postgres/protobuf
2020-02-03 09:29:10 +01:00
Jiri Pechanec
fcafd2f193
DBZ-1052 Transaction metadata for Postgres/wal2json
2020-02-03 09:29:10 +01:00
Jiri Pechanec
cd6a1f942d
DBZ-1052 Transaction metadata for Postgres/pgoutput
2020-02-03 09:29:10 +01:00
Jiri Pechanec
b0eb571f9f
DBZ-1052 Transaction metadata for SQL Server
2020-02-03 09:29:10 +01:00
Jiri Pechanec
7283f5d6c1
DBZ-1746 Gracefully handle unknown protobuf messages
2020-01-30 12:24:52 +01:00
Marc Zbyszynski
507aac0e0f
DBZ-1738 replaced casts to PgConnection with casts to interface BaseConnection
...
DBZ-1738 replaced casts to PgConnection with casts to interface BaseConnection
2020-01-27 16:47:27 +01:00
Gunnar Morling
8c33a4e147
DBZ-1292 Catering for the differences in data schema;
...
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
2020-01-16 08:01:56 +01:00
Gunnar Morling
1a18bdbc81
DBZ-1292 Misc. refactorings;
...
* Protecting against Avro as CE format and JSON as data format
* Reducing mutability
* Single Avro client
2020-01-16 08:00:45 +01:00
GraySmog
d0e4b3c0af
DBZ-1292 Delete data.schema.registry.url config option
2020-01-16 08:00:45 +01:00
GraySmog
915c8cafd9
DBZ-1292 CloudEvents converter for JSON and Avro format
2020-01-16 08:00:45 +01:00
Gunnar Morling
07e89de91d
DBZ-1707 Ensuring correct Kafka record timestamp for outbox events;
...
Depending on the width of the configured TIMESTAMP column, a microsecond or nanosecond timestamp could have been returned before, whereas this should always be milliseconds.
2020-01-15 07:32:55 +01:00
Chris Cranford
1d41d53636
DBZ-1685 Document and add support for column.mask.with for PostgreSQL connector
2020-01-14 09:30:34 +01:00
Chris Cranford
9fc1eada11
DBZ-1600 Remove deprecated "slot.drop_on_stop" postgres configuration option
2020-01-14 09:27:32 +01:00
Chris Cranford
cf60466b02
DBZ-1684 Make sure publication initialized prior to slot
...
This is to avoid the need to restart the connector when streaming begins due to
an error that the publication can't be found. It would seem based on testing
that since we create the replication slot early on when it does not exist, then
when streaming starts its confused about trying to marry a newly created
publication to an slot. By creating the publication before the slot, this
works around the problem.
2020-01-09 15:55:22 +01:00
Chris Cranford
3413d674fb
DBZ-1684 Create missing publication when replication slot exists
2020-01-07 15:41:15 +01:00
Chris Cranford
5c6f8fdd70
DBZ-1680 Fix enum value resolution across all PostgreSQL decoders
2019-12-17 18:21:17 +01:00
Chris Cranford
debcb95fa2
DBZ-1677 Include root cause when PostgreSQL schema refresh fails during streaming
2019-12-17 07:19:02 +01:00
Gunnar Morling
d40641b3ab
DBZ-1666 Formatting
2019-12-12 16:39:10 +01:00
Gunnar Morling
4619f5eb9d
DBZ-1666 Wording fix
2019-12-12 11:56:05 +01:00
Jiri Pechanec
ffa15b100f
DBZ-1666 Warn for drop slot on stop
2019-12-12 11:52:30 +01:00
Chris Cranford
c32b771e1b
DBZ-1413 Fix format violation
2019-12-10 10:09:35 +01:00
Chris Cranford
19fd8dd1d9
DBZ-1413 Resolve column length/scale when reading table column metadata from TypeRegistry
2019-12-10 10:09:35 +01:00
Chris Cranford
372d199a71
DBZ-1413 Revert AbstractColumnValue changes in commit 774f2ed
2019-12-10 10:09:35 +01:00
Chris Cranford
365eb0d76e
DBZ-1413 Suggested Javadoc changes, added/fix tests, changed how Column native/jdbc type resolution happens
2019-12-10 10:09:35 +01:00
Chris Cranford
9685990fb8
DBZ-920 Add support for PostgreSQL enum types
2019-12-10 10:09:35 +01:00
Chris Cranford
46de58ae75
DBZ-1413 Updated tests
2019-12-10 10:09:35 +01:00
Chris Cranford
ef9b4a7431
DBZ-1413 Delay building type hierarchy after all base types built
2019-12-10 10:09:35 +01:00
Chris Cranford
547ba8e0db
DBZ-1413 Align domain type support across all 3 decoders
2019-12-10 10:09:35 +01:00
Chris Cranford
9586be7d4e
DBZ-1413 Support PostgreSQL domain types
2019-12-10 10:09:35 +01:00
Thomas Deblock
17e44d4c0c
DBZ-1648 outbox EventRouter remove topic toLowerCase
...
- kafka topics names are case sensitive. We should not perform
a toLowerCase on the topic name. It can cause some issue if
topic name have a upper case
2019-12-04 21:39:25 +01:00
Jiri Pechanec
d471f2f6ab
DBZ-1637 Support for UUID array
2019-11-28 09:06:23 +01:00
Jiri Pechanec
a56ab78b3f
DBZ-825 Unify decimal upscaling
2019-11-20 18:23:55 +01:00
David Feinblum
2b9fbcd5f6
DBZ-1519 Avoid erroneously logging there are no monitored tables
2019-11-14 05:44:37 +01:00
Chris Cranford
95927de405
DBZ-1596 Fix open resources while initializing publication
2019-11-08 12:55:24 +01:00
Jiri Pechanec
d693609779
DBZ-1570 handle null toasted values for wal2json
2019-11-08 10:52:57 +01:00
Jiri Pechanec
4084e39256
DBZ-1595 New parameter takes precedence over old
2019-11-08 07:57:06 +01:00
Jiri Pechanec
54cb9e8326
DBZ-1595 Use dots as separator in param name
2019-11-08 07:57:06 +01:00
Jeremy Finzel
c2f27cdb23
DBZ-1559 Change snapshot lock level to ACCESS SHARE
...
This is the correct mode that only prevents concurrent schema changes, while not requiring debezium user to also have UPDATE access to tables as does SHARE UPDATE EXCLUSIVE mode
2019-11-05 11:54:52 +02:00
Chris Cranford
244ee9dc5c
DBZ-1576 Gracefully skip TRUNCATE messages with pgoutput decoder on PG11+
2019-11-05 09:24:08 +02:00
Gunnar Morling
2c569977d7
DBZ-1392 Applying formatter;
...
* Keeping indentation formatting for JSON
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
Co-authored-by: Chris Cranford <chris@hibernate.org>
2019-11-01 13:20:43 +02:00
Addison Higham
b1b657b8bd
[DBZ-1579] Fix regression of large refreshes causing connection timeout
...
In DBZ-1214, an issue was fixed where during the initial schema refresh,
the replication stream connection would timeout. This occurred in cases
of many schemas that need to be refreshed.
This was fixed by adding a keep alive thread that ensure that we
periodically send an empty update to the DB.
It appears that in the refactor to move the new shared interface, the
call to this keep alive thread was removed, but the remaining keep alive
interface still exists
This simply wires the keep alive thread back up
2019-10-29 18:27:55 +01:00
Jiri Pechanec
097025bed9
DBZ-1336 Fix imports of Ltree
2019-10-22 08:07:54 +03:00
Gunnar Morling
e06d25dd92
DBZ-1336 Moving Ltree type to PG connector module
2019-10-21 12:17:08 +02:00
Mincong HUANG
1e3eb8c840
DBZ-1336 Support Postgres LTREE columns
2019-10-21 12:10:46 +02:00
Jiri Pechanec
0b15e76d2a
DBZ-1525 Validate replication slot name
2019-10-20 22:16:29 +02:00
Jiri Pechanec
d858e05bf6
DBZ-1564 Close TX after toasted query
2019-10-19 20:46:22 +03:00
Grant Cooksey
5ab5b4063d
DBZ-1564 Close open transaction during postgres streaming
...
After the schema refesh, we do not want to hold a long running open transaction
since that is expensive.
2019-10-19 20:46:22 +03:00
Jiri Pechanec
06ef4b6a95
DBZ-1565 Take empty messages into consideration
2019-10-18 13:53:53 +03:00
Jiri Pechanec
986dc4ef3a
DBZ-1565 Test the log message
2019-10-18 13:53:53 +03:00
Gunnar Morling
4ea85d7fd3
DBZ-1565 Raise warning about growing WAL backlog
2019-10-18 13:53:53 +03:00
Grant Cooksey
18ca6ec72e
DBZ-1546 Comma-separated regular expressions remove whitespace.
...
The table whitespace parameter should remove whitespace between regular expressions
since tables cannot start with whitespace characters.
2019-10-17 10:13:44 +03:00
Jiri Pechanec
bba550f955
DBZ-892 Flush on empty messages
2019-10-16 00:54:54 +02:00
Jiri Pechanec
6d8412e5de
DBZ-1401 Support for pgoutput
2019-10-10 09:37:52 +02:00
Jiri Pechanec
f77415936f
DBZ-1401 Fix formatting
2019-10-10 09:37:52 +02:00
Jiri Pechanec
7c4203cf60
DBZ-1401 Handle tables without explicit PK
2019-10-10 09:37:52 +02:00
Chris Cranford
4205a224d6
DBZ-1532 Pgoutput string decoding should not rely on JVM default charset
2019-10-09 14:35:25 +02:00
Jiri Pechanec
cf7eccb152
DBZ-1498 Docs added; microseconds changed to numeric; nanos supported
2019-10-09 12:14:35 +02:00
Jiri Pechanec
20363f24bb
DBZ-1498 Support for precise interval value
2019-10-09 12:14:35 +02:00
Gunnar Morling
92885ebe99
DBZ-1392 Removing trailing whitespace from Java files
2019-10-07 12:11:43 +03:00
Gunnar Morling
8d6f5409b1
DBZ-1392 Moving static imports up and applying this to all files
2019-10-07 12:11:43 +03:00
Chris Cranford
3594ff639a
DBZ-1341 Rebased against master and applied necessary checkstyle fixes
2019-10-03 19:44:43 +02:00
Chris Cranford
ca5517746a
DBZ-1341 Checkstyle flag missing whitespace
2019-10-03 19:44:43 +02:00
Chris Cranford
7442670692
DBZ-1355 Fix checkstyle problems detected after upgrade to 8.19
2019-10-03 19:44:43 +02:00
Chris Cranford
5ac2318d84
DBZ-1391 Do not allow code after closing brace ( #1065 )
...
* DBZ-1391 Do not allow code after closing brace
2019-10-02 20:44:40 +02:00
Jiri Pechanec
f868cb87c0
DBZ-1280 Lock timeout for SQL Server
2019-10-02 10:34:25 +02:00
Gunnar Morling
d94b37c693
DBZ-1507 Misc. clean-up;
...
* Removing unused Table methods
* Re-using primaryKeyColumnNames() instead of custom predicate
2019-10-02 10:25:37 +02:00
Jiri Pechanec
22e8397e6d
DBZ-1515 Add poll pause only after multiple no message attempts
2019-10-01 13:24:42 -04:00
Gunnar Morling
2fba51863e
DBZ-1015 Unifying the retrieval of custom key mappers
2019-09-26 10:14:48 +02:00
Guillaume Rosauro
1405889bef
DBZ-1015-allow-user-to-customize-key
2019-09-26 10:14:21 +02:00
Gunnar Morling
97cc493ef5
DBZ-1368 More expressive type name
2019-09-25 17:45:09 +02:00
Jiri Pechanec
0e2a79eba5
DBZ-1368 Change default toasted value
2019-09-25 17:24:21 +02:00
Jiri Pechanec
5bfe14ea66
DBZ-1368 Remove unnecessary optimizations
2019-09-25 17:24:21 +02:00
Jiri Pechanec
3c19a392ac
DBZ-1368 Added documentation
2019-09-25 17:24:21 +02:00
Jiri Pechanec
4150d2d0e1
DBZ-1368 Added JavaDoc
2019-09-25 17:24:21 +02:00
Jiri Pechanec
c638b16117
DBZ-1368 Toast marker presence not derived from plguin name
2019-09-25 17:24:21 +02:00
Jiri Pechanec
6efd2a76fe
DBZ-1368 Set new toasted vals from old
2019-09-25 17:24:21 +02:00
Jiri Pechanec
f19b4b15a7
DBZ-1368 Run with postgres dev image
2019-09-25 17:24:21 +02:00
Jiri Pechanec
29f6d9dd09
DBZ-1368 Support toasted placeholder in wal2json
2019-09-25 17:24:21 +02:00
Jiri Pechanec
9dd5a16160
DBZ-1368 Support toasted placeholder in protobuf
2019-09-25 17:24:21 +02:00
Gunnar Morling
ae0bf61bb4
DBZ-1367 Handling "datum_missing" marker
2019-09-25 17:24:21 +02:00
Jiri Pechanec
ab31147593
DBZ-1368 Support toasted placeholder in pgoutput
2019-09-25 17:24:21 +02:00
Gunnar Morling
442408be02
DBZ-1497 Using int64 for INTERVAL microseconds mapping
2019-09-25 11:21:40 +03:00
Jiri Pechanec
9b2fcdc13a
DBZ-1438 Reduce test runtime
2019-09-24 12:51:48 +02:00