Commit Graph

2007 Commits

Author SHA1 Message Date
Jiri Pechanec
c8c6360095 DBZ-1244 Detecting unreplicated purged GTIDs;
The purpose of this change is to provide the same functionality for
when_needed snapshot for GTID enabled database like for non-GTID.
The non-GTID just relies on missing replication log to detect the
new snapshot needs to be triggered. This does not work in GTID
environment as we need to compare the GTIDs that are available on
the server with those we have already processed - stored in the
offsets.

If there is a set of GTIDs that were not replicated by Debezium
and at the same time have been already purged then we detect the
situation and trigger a new snapshot when required.

We thus

* Take all GTIDs ever processed by the server
* Filter out GTIDs that were processed by Debezium
* Compare them with purged GTID set
* If the interesction is not empty we know we have not replicated
transaction that have already been removed from the server
2019-05-21 15:51:17 +02:00
Jiri Pechanec
548b812d41 [jenkins-jobs] Run check contributors in correct dir 2019-05-21 14:56:11 +02:00
Gunnar Morling
1ed8615434 DBZ-1234 Removing deprecated "drop.deletes" SMT option 2019-05-21 14:11:32 +02:00
Jiri Pechanec
29c10c27ea DBZ-1276 Skip events upon connector restart 2019-05-21 10:38:41 +02:00
Jiri Pechanec
a8e7104f18 DBZ-1209 Remove events skipped metric form common metrics 2019-05-21 10:26:22 +02:00
Jiri Pechanec
547ac819df DBZ-1257 Fixed typo 2019-05-21 10:11:57 +02:00
Jiri Pechanec
8c376d1795 DBZ-1257 Validate data against schema 2019-05-21 10:11:57 +02:00
Gunnar Morling
4751b266f3 DBZ-1164 Misc. improvements;
* Moving stringToDuration() for the sake of re-use and testability
* Making pattern and durations constants
2019-05-21 09:38:23 +02:00
GraySmog
9b52ac86e8 DBZ-1164 Supporting TIME columns with value of "24:00:00" 2019-05-21 09:38:09 +02:00
Chris Cranford
9afe06945e DBZ-736 Fixed compilation problem with duplicate test class. 2019-05-20 13:38:01 -04:00
Gunnar Morling
d35e401e34 DBZ-736 Removing obsolete MySqlDefaultValueTest;
* Removing old test for legacy parser
* Pulling Antlr-specific methods up to base class
* Renaming that one into MySqlDefaultValueTest
2019-05-20 13:38:01 -04:00
Chris Cranford
80c4c394a7 DBZ-1282 Automate contributor check during release pipeline
* Removed filtering unknown contributor names
 * Added missing contributors
 * Added alias mapping for known contributor names
2019-05-20 19:03:53 +02:00
Chris Cranford
56c59ece67 DBZ-1282 Added additional output detail when contributor not found. 2019-05-20 19:03:53 +02:00
Chris Cranford
7f9fab0de5 DBZ-1282 Automate contributor check during release pipeline 2019-05-20 19:03:53 +02:00
Gunnar Morling
3f0e2c7758 DBZ-1246 Removing obsolete exclusion of legacy parser during test 2019-05-20 16:38:03 +02:00
Jiri Pechanec
30c2df4f23 DBZ-1246 Convert unique index to primary key 2019-05-20 16:38:03 +02:00
Gunnar Morling
c72a2fb14d DBZ-844 Expanding test 2019-05-20 15:33:39 +02:00
Jiri Pechanec
d35c2ec347 DBZ-844 Use table charset for parsing string defaults 2019-05-20 15:33:39 +02:00
jcechace
ce1aeeedd9 [DBZ-263] Removed outdated integration test module 2019-05-20 14:45:02 +02:00
Jiri Pechanec
2a8e948aab DBZ-1281 Warning for no change table situations 2019-05-20 14:40:12 +02:00
jcechace
d9657dab1a [DBZ-1273] Bumping JDBC and Mongo driver versions 2019-05-18 05:50:27 +02:00
Gunnar Morling
c7d2a35a0e DBZ-1264 Member ordering 2019-05-18 05:48:54 +02:00
Jiri Pechanec
a8f6533c66 DBZ-1264 Ignore unique index for non-monitored tables 2019-05-18 05:46:56 +02:00
Chris Cranford
dbcbe00a12 Updated COPYRIGHT.txt 2019-05-18 05:43:30 +02:00
Chris Cranford
f67ce1b8be DBZ-733 Consolidate parser tests 2019-05-17 13:18:24 -04:00
Chris Cranford
f8550fea62 DBZ-736 Remove legacy parser from Travis CI. 2019-05-17 13:18:24 -04:00
Chris Cranford
efa22016a8 DBZ-736 DBZ-733 Removed MySQL legacy parser and consolidate parser tests 2019-05-17 13:18:24 -04:00
Chris Cranford
373e508d70 DBZ-736 Remove MySQL legacy parser 2019-05-17 13:18:24 -04:00
Jiri Pechanec
13e5fe4537 DBZ-1228 Simplify error handling 2019-05-17 10:24:02 -04:00
Arkoprabho Chakraborti
ceb56c1c57 DBZ-1228 Changes as suggested in PR #867
Used multiple catch statements and handle in 1 branch.

Not using static modifier for keymanager.
2019-05-17 10:24:02 -04:00
Arkoprabho Chakraborti
b7526d537d DBZ-1228 MySQL connection with client authentication does not work
The SSL properties were being reset, and thus the authentication was failing on the second time.
When debezium connects to the database the first time in order to test the connections, the required parameters are all set. And thus the test passes.
After that the shutdown method is called that clears these properties, and the consecutive connection fails.

DBZ-1228: MySQL connection with client authentication does not work

Create and pass a socket factory that provides they keystore config

DBZ-1228: MySQL connection with client authentication does not work

Prevent forcing of SSL. Use SSL only if the required properties are set.

DBZ-1228: MySQL connection with client authentication does not work

Added better exception messages
2019-05-17 10:24:02 -04:00
Jenkins user
7748be6056 [maven-release-plugin] prepare for next development iteration 2019-05-02 16:04:56 +00:00
Jenkins user
5af083b86e [maven-release-plugin] prepare release v0.9.5.Final 2019-05-02 16:04:55 +00:00
Jiri Pechanec
34a1127e62 [release] Changelog for 0.9.5.Final 2019-05-02 18:01:55 +02:00
Gunnar Morling
d12926c404 DBZ-1214 Applying default status update interval 2019-05-02 11:30:16 +02:00
Gunnar Morling
6960c880ca DBZ-1214 Misc. clean-up:
* Using parker instead of Thread#sleep()
* Using flag for executor cancelation
* Using unique context name in thread name
2019-05-02 11:30:16 +02:00
Addison Higham
e1570dd330 [DBZ-1214] Ensure PG connection keep alive
This adds a small change to the postgres connector which
works around a problem when large databases take more
than a minute to refresh the schema

This works by creating a simple background thread that ensures we send
statusUpdate messages periodically

I considered if we could refresh the schema before we create the
replication connection but I believe we choose our offset in the log
and then get the schema in order to ensure we don't get out of sync with
any potential schema changes

This also makes some minor refactors to use a Duration instead of an
integer for the statusUpdateInterval
2019-05-02 11:30:16 +02:00
Jiri Pechanec
3b78e0bebb DBZ-1245 Fix empty heartbeat message test 2019-05-02 09:16:21 +02:00
Jiri Pechanec
b53f456912 DBZ-1245 Heartbeat only when offsets ready 2019-05-02 08:22:28 +02:00
Gunnar Morling
2f7cab6eb3 DBZ-1260 Removing some dead code 2019-05-02 07:28:23 +02:00
Chris Cranford
dc61e52bc5 DBZ-1260 Fix timetz microsecond precision support 2019-05-02 07:28:23 +02:00
Chris Cranford
9404eff794 DBZ-1226 Cleaned up tests 2019-05-01 18:37:09 -04:00
Gunnar Morling
2cd0eb17db DBZ-739 Removing obsolete method 2019-05-01 23:17:00 +02:00
Chris Cranford
46111505ed DBZ-1226 Fix test to validate enum/set options directly from antlr parsing. 2019-05-01 21:17:42 +02:00
Chris Cranford
a5fdfd9b24 DBZ-1226 Replace double single-quotes with a singular quote. 2019-05-01 21:17:42 +02:00
Chris Cranford
c6aa02f813 DBZ-1226 Add support for enum/set values that contain commas or escaped characters. 2019-05-01 21:17:42 +02:00
Chris Cranford
7602136cf6 DBZ-1236 Removed millisecond truncation. 2019-05-01 14:16:17 +02:00
Chris Cranford
16840d7d59 DBZ-1236 Handle timez precision consistently. 2019-05-01 14:16:17 +02:00
Jiri Pechanec
3ff81348b8 DBZ-1236 Support full timestamptz precision 2019-05-01 14:16:17 +02:00
Gunnar Morling
671adc1ca0 Adding missing committers from SQL Server connector to COPYRIGHT.txt 2019-04-30 16:05:08 +02:00