alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
2,852 Commits 3 Branches 0 Tags 51 MiB
a83dd901e3
Commit Graph

705 Commits

Author SHA1 Message Date
Gunnar Morling
a8b796685b DBZ-1840 Typo fix; commenting 2020-03-04 09:31:22 +01:00
Jiri Pechanec
10dfc12c99 DBZ-1840 Explanation for unresolvable tables 2020-03-04 09:25:57 +01:00
Jiri Pechanec
19d0a88cc9 DBZ-1840 Test logic was out of order 2020-03-04 09:25:57 +01:00
Jiri Pechanec
b2370c2d8e DBZ-1840 Syntheitc message to replace messages dropped in decoder 2020-03-04 09:25:57 +01:00
Jiri Pechanec
6bab948e76 DBZ-1840 No nulls to stream producer 2020-03-04 09:25:57 +01:00
Jan-Hendrik Dolling
5cfbaab7a6
DBZ-1845 Typos in deployment.yaml and code readability 
* improve readability
* fixed some typos
 2020-03-04 08:34:55 +01:00
Gunnar Morling
c5422e6b31 DBZ-1840 Not passing null to replication message processor; 
Note this means to that WAL offsets cannot be acknowledged in cases
where a null message is received from the server (e.g. wal2json for
DDL events). But as we cannot tell apart null events from the server
from readPending() simply having no events to read, the current
logic renders the pausing between two read calls without events
obsolete, so that's the lesser evil
 2020-03-03 11:45:53 +01:00
Gunnar Morling
0f6d2c54fc DBZ-1134 Avoiding concrete class in SPI by introducing receiver parameter 2020-02-28 21:58:39 +01:00
Jiri Pechanec
d13e48cc55 DBZ-1134 Make converted field type parametrized 2020-02-28 21:58:39 +01:00
Jiri Pechanec
06e1eca085 DBZ-1134 Support for user provided converters 2020-02-28 21:58:39 +01:00
Jiri Pechanec
91f292a1f2 DBZ-1825 Keep keys for non-matching table 2020-02-26 15:03:03 +01:00
Jiri Pechanec
ae6ee3d458 DBZ-234 Place Incubating into a unique package 2020-02-25 15:31:10 +01:00
Jiri Pechanec
2b6e50daff DBZ-1760 Allow skipping of invalid events 2020-02-25 10:43:11 +01:00
jcechace
3209de3e5f DBZ-924 Adding integration tests for OpenShift and Strimzi 2020-02-20 12:48:08 +01:00
Gunnar Morling
eff3ffc345 DBZ-1758 Documentation update 2020-02-14 13:14:25 +01:00
Debezium Builder
f75746fb7b [maven-release-plugin] prepare for next development iteration 2020-02-13 03:18:20 -05:00
Debezium Builder
1d2df32743 [maven-release-plugin] prepare release v1.1.0.Beta2 2020-02-13 03:18:20 -05:00
Gunnar Morling
dd5c2b8be9 DBZ-1766 Unifying handling of offset commits 2020-02-12 15:44:45 +01:00
Melissa Winstanley
ef55c9157d DBZ-1766 Update lastOffset to commit only after a record is committed 2020-02-12 15:44:45 +01:00
Jiri Pechanec
d4d38dcbec DBZ-1783 Ignore empty transactions 2020-02-12 14:58:15 +01:00
Jiri Pechanec
40506d5352 [ci] Reduce postgres test logging for CI 2020-02-12 14:49:55 +01:00
Debezium Builder
9c424b2404 [maven-release-plugin] prepare for next development iteration 2020-02-05 08:54:52 -05:00
Debezium Builder
9f2caa3b7c [maven-release-plugin] prepare release v1.1.0.Beta1 2020-02-05 08:54:52 -05:00
Jiri Pechanec
7c9d78e597 DBZ-1727 Fix unused imports 2020-02-05 13:33:29 +01:00
Igor Gabaydulin
3890038c21 DBZ-1727 Reduce heartbeat interval in test 2020-02-05 13:33:29 +01:00
Igor Gabaydulin
a2a6525c84 DBZ-1727 Update heartbeat on changing non whitelisted table test 2020-02-05 13:33:29 +01:00
Igor Gabaydulin
2f6e522b0f DBZ-1727 Fix PostgresConnectorIT#shouldFlushLsnOnEmptyMessage test 2020-02-05 13:33:29 +01:00
Igor Gabaydulin
b62acfd144 DBZ-1727 Apply code formatter 2020-02-05 13:33:29 +01:00
Igor Gabaydulin
9bea1e2638 DBZ-1727 Move null check to AbstractMessageDecoder 2020-02-05 13:33:29 +01:00
Igor Gabaydulin
fcc7a05579 DBZ-1727 Debezium Postgres connector does not apply keepalive lsn 2020-02-05 13:33:29 +01:00
Jiri Pechanec
77f9a61b95 DBZ-1751 Centralize envelope schema naming 2020-02-04 20:37:19 +01:00
Chris Cranford
c5902c3c32 DBZ-1158 Add test for REPLICA IDENTITY fallback values 2020-02-04 10:37:12 -05:00
Jiri Pechanec
1d9ac71a9e DBZ-1698 Fix test timing issue 2020-02-03 22:38:02 +01:00
Jiri Pechanec
2a6ea1c41f DBZ-1698 Handle toasted unknown column values 2020-02-03 22:38:02 +01:00
Jiri Pechanec
34d2979123 DBZ-1052 Stabilize test for changed heartbeats 2020-02-03 09:29:10 +01:00
Jiri Pechanec
010e0c6fa6 DBZ-1052 Flush LSN for skipped tx messages 2020-02-03 09:29:10 +01:00
Gunnar Morling
b66f314b3c DBZ-1052 Misc. clean-up 
* Doc updates
* Changed static method to instance
 2020-02-03 09:29:10 +01:00
Jiri Pechanec
67e0079646 DBZ-1052 Expand known protobuf messages list 2020-02-03 09:29:10 +01:00
Jiri Pechanec
4fdda6c101 DBZ-1052 Add tx enable option to connector definitions 2020-02-03 09:29:10 +01:00
Jiri Pechanec
ba10a229b6 DBZ-1052 CE support for tx metadata in data messages 2020-02-03 09:29:10 +01:00
Jiri Pechanec
0e671d6167 DBZ-1052 Add counts per table to END 2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94 DBZ-1052 Transaction block moved to envelope 2020-02-03 09:29:10 +01:00
Jiri Pechanec
5749acda7e DBZ-1052 Remove unused fields; added JavaDoc 2020-02-03 09:29:10 +01:00
Jiri Pechanec
072a37e790 DBZ-1052 Support for full Postgres/protobuf 2020-02-03 09:29:10 +01:00
Jiri Pechanec
c0557b325b DBZ-1052 Skip CE for transaction struct 2020-02-03 09:29:10 +01:00
Jiri Pechanec
c466143f35 DBZ-1052 Test for limited Postgres/protobuf 2020-02-03 09:29:10 +01:00
Jiri Pechanec
fcafd2f193 DBZ-1052 Transaction metadata for Postgres/wal2json 2020-02-03 09:29:10 +01:00
Jiri Pechanec
cd6a1f942d DBZ-1052 Transaction metadata for Postgres/pgoutput 2020-02-03 09:29:10 +01:00
Jiri Pechanec
b0eb571f9f DBZ-1052 Transaction metadata for SQL Server 2020-02-03 09:29:10 +01:00
Jiri Pechanec
7283f5d6c1 DBZ-1746 Gracefully handle unknown protobuf messages 2020-01-30 12:24:52 +01:00
Marc Zbyszynski
507aac0e0f DBZ-1738 replaced casts to PgConnection with casts to interface BaseConnection 
DBZ-1738 replaced casts to PgConnection with casts to interface BaseConnection
 2020-01-27 16:47:27 +01:00
Debezium Builder
274bba9dc9 [maven-release-plugin] prepare for next development iteration 2020-01-16 05:40:24 -05:00
Debezium Builder
076df30108 [maven-release-plugin] prepare release v1.1.0.Alpha1 2020-01-16 05:40:24 -05:00
Gunnar Morling
8c33a4e147 DBZ-1292 Catering for the differences in data schema; 
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
 2020-01-16 08:01:56 +01:00
Gunnar Morling
1a18bdbc81 DBZ-1292 Misc. refactorings; 
* Protecting against Avro as CE format and JSON as data format
* Reducing mutability
* Single Avro client
 2020-01-16 08:00:45 +01:00
GraySmog
d0e4b3c0af DBZ-1292 Delete data.schema.registry.url config option 2020-01-16 08:00:45 +01:00
GraySmog
915c8cafd9 DBZ-1292 CloudEvents converter for JSON and Avro format 2020-01-16 08:00:45 +01:00
Gunnar Morling
07e89de91d DBZ-1707 Ensuring correct Kafka record timestamp for outbox events; 
Depending on the width of the configured TIMESTAMP column, a microsecond or nanosecond timestamp could have been returned before, whereas this should always be milliseconds.
 2020-01-15 07:32:55 +01:00
Chris Cranford
1d41d53636 DBZ-1685 Document and add support for column.mask.with for PostgreSQL connector 2020-01-14 09:30:34 +01:00
Chris Cranford
9fc1eada11 DBZ-1600 Remove deprecated "slot.drop_on_stop" postgres configuration option 2020-01-14 09:27:32 +01:00
Chris Cranford
cf60466b02 DBZ-1684 Make sure publication initialized prior to slot 
This is to avoid the need to restart the connector when streaming begins due to
an error that the publication can't be found.  It would seem based on testing
that since we create the replication slot early on when it does not exist, then
when streaming starts its confused about trying to marry a newly created
publication to an slot.  By creating the publication before the slot, this
works around the problem.
 2020-01-09 15:55:22 +01:00
Chris Cranford
3413d674fb DBZ-1684 Create missing publication when replication slot exists 2020-01-07 15:41:15 +01:00
Debezium Builder
9723c93db9 [maven-release-plugin] prepare for next development iteration 2019-12-18 01:44:33 -05:00
Debezium Builder
09049516f2 [maven-release-plugin] prepare release v1.0.0.Final 2019-12-18 01:44:33 -05:00
Chris Cranford
5c6f8fdd70 DBZ-1680 Fix enum value resolution across all PostgreSQL decoders 2019-12-17 18:21:17 +01:00
Chris Cranford
debcb95fa2 DBZ-1677 Include root cause when PostgreSQL schema refresh fails during streaming 2019-12-17 07:19:02 +01:00
Gunnar Morling
d40641b3ab DBZ-1666 Formatting 2019-12-12 16:39:10 +01:00
Gunnar Morling
4619f5eb9d DBZ-1666 Wording fix 2019-12-12 11:56:05 +01:00
Jiri Pechanec
ffa15b100f DBZ-1666 Warn for drop slot on stop 2019-12-12 11:52:30 +01:00
Debezium Builder
b1c62fe306 [maven-release-plugin] prepare for next development iteration 2019-12-10 06:39:17 -05:00
Debezium Builder
ad2efdb9a6 [maven-release-plugin] prepare release v1.0.0.CR1 2019-12-10 06:39:17 -05:00
Chris Cranford
c32b771e1b DBZ-1413 Fix format violation 2019-12-10 10:09:35 +01:00
Chris Cranford
19fd8dd1d9 DBZ-1413 Resolve column length/scale when reading table column metadata from TypeRegistry 2019-12-10 10:09:35 +01:00
Chris Cranford
372d199a71 DBZ-1413 Revert AbstractColumnValue changes in commit 774f2ed 2019-12-10 10:09:35 +01:00
Chris Cranford
365eb0d76e DBZ-1413 Suggested Javadoc changes, added/fix tests, changed how Column native/jdbc type resolution happens 2019-12-10 10:09:35 +01:00
Chris Cranford
9685990fb8 DBZ-920 Add support for PostgreSQL enum types 2019-12-10 10:09:35 +01:00
Chris Cranford
46de58ae75 DBZ-1413 Updated tests 2019-12-10 10:09:35 +01:00
Chris Cranford
ef9b4a7431 DBZ-1413 Delay building type hierarchy after all base types built 2019-12-10 10:09:35 +01:00
Chris Cranford
547ba8e0db DBZ-1413 Align domain type support across all 3 decoders 2019-12-10 10:09:35 +01:00
Chris Cranford
9586be7d4e DBZ-1413 Support PostgreSQL domain types 2019-12-10 10:09:35 +01:00
Thomas Deblock
17e44d4c0c DBZ-1648 outbox EventRouter remove topic toLowerCase 
- kafka topics names are case sensitive. We should not perform
  a toLowerCase on the topic name. It can cause some issue if
  topic name have a upper case
 2019-12-04 21:39:25 +01:00
Jiri Pechanec
d471f2f6ab DBZ-1637 Support for UUID array 2019-11-28 09:06:23 +01:00
Brandon Brown
a0f7f6ec6b DBZ-1402 Support for JDK 11 2019-11-25 11:53:19 +01:00
Jiri Pechanec
a56ab78b3f DBZ-825 Unify decimal upscaling 2019-11-20 18:23:55 +01:00
Debezium Builder
38279cc2dd [maven-release-plugin] prepare for next development iteration 2019-11-14 02:56:07 -05:00
Debezium Builder
868faf4412 [maven-release-plugin] prepare release v1.0.0.Beta3 2019-11-14 02:56:07 -05:00
David Feinblum
2b9fbcd5f6 DBZ-1519 Avoid erroneously logging there are no monitored tables 2019-11-14 05:44:37 +01:00
Chris Cranford
95927de405 DBZ-1596 Fix open resources while initializing publication 2019-11-08 12:55:24 +01:00
Jiri Pechanec
d693609779 DBZ-1570 handle null toasted values for wal2json 2019-11-08 10:52:57 +01:00
Jiri Pechanec
4084e39256 DBZ-1595 New parameter takes precedence over old 2019-11-08 07:57:06 +01:00
Jiri Pechanec
54cb9e8326 DBZ-1595 Use dots as separator in param name 2019-11-08 07:57:06 +01:00
Jeremy Finzel
c2f27cdb23 DBZ-1559 Change snapshot lock level to ACCESS SHARE 
This is the correct mode that only prevents concurrent schema changes, while not requiring debezium user to also have UPDATE access to tables as does SHARE UPDATE EXCLUSIVE mode
 2019-11-05 11:54:52 +02:00
Chris Cranford
244ee9dc5c DBZ-1576 Gracefully skip TRUNCATE messages with pgoutput decoder on PG11+ 2019-11-05 09:24:08 +02:00
Gunnar Morling
2c569977d7 DBZ-1392 Applying formatter; 
* Keeping indentation formatting for JSON


Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
Co-authored-by: Chris Cranford <chris@hibernate.org>
 2019-11-01 13:20:43 +02:00
Addison Higham
b1b657b8bd [DBZ-1579] Fix regression of large refreshes causing connection timeout 
In DBZ-1214, an issue was fixed where during the initial schema refresh,
the replication stream connection would timeout. This occurred in cases
of many schemas that need to be refreshed.

This was fixed by adding a keep alive thread that ensure that we
periodically send an empty update to the DB.

It appears that in the refactor to move the new shared interface, the
call to this keep alive thread was removed, but the remaining keep alive
interface still exists

This simply wires the keep alive thread back up
 2019-10-29 18:27:55 +01:00
Debezium Builder
b08f523ed7 [maven-release-plugin] prepare for next development iteration 2019-10-24 07:42:49 -04:00
Debezium Builder
8ecd9e28cf [maven-release-plugin] prepare release v1.0.0.Beta2 2019-10-24 07:42:49 -04:00
Jiri Pechanec
097025bed9 DBZ-1336 Fix imports of Ltree 2019-10-22 08:07:54 +03:00
Gunnar Morling
e06d25dd92 DBZ-1336 Moving Ltree type to PG connector module 2019-10-21 12:17:08 +02:00
Mincong HUANG
1e3eb8c840 DBZ-1336 Support Postgres LTREE columns 2019-10-21 12:10:46 +02:00