Commit Graph

714 Commits

Author SHA1 Message Date
Chris Cranford
1603ebda89 DBZ-1234 Remove support for adaptive time precision mode 2019-05-22 10:19:05 +02:00
Chris Cranford
e2c74111ad DBZ-1234 Removed deprecated configuration options 2019-05-22 10:19:05 +02:00
Gunnar Morling
7519623c58 DBZ-1244 Fixing formatting glitch 2019-05-21 15:53:55 +02:00
Jiri Pechanec
c8c6360095 DBZ-1244 Detecting unreplicated purged GTIDs;
The purpose of this change is to provide the same functionality for
when_needed snapshot for GTID enabled database like for non-GTID.
The non-GTID just relies on missing replication log to detect the
new snapshot needs to be triggered. This does not work in GTID
environment as we need to compare the GTIDs that are available on
the server with those we have already processed - stored in the
offsets.

If there is a set of GTIDs that were not replicated by Debezium
and at the same time have been already purged then we detect the
situation and trigger a new snapshot when required.

We thus

* Take all GTIDs ever processed by the server
* Filter out GTIDs that were processed by Debezium
* Compare them with purged GTID set
* If the interesction is not empty we know we have not replicated
transaction that have already been removed from the server
2019-05-21 15:51:17 +02:00
Jiri Pechanec
29c10c27ea DBZ-1276 Skip events upon connector restart 2019-05-21 10:38:41 +02:00
Chris Cranford
9afe06945e DBZ-736 Fixed compilation problem with duplicate test class. 2019-05-20 13:38:01 -04:00
Gunnar Morling
d35e401e34 DBZ-736 Removing obsolete MySqlDefaultValueTest;
* Removing old test for legacy parser
* Pulling Antlr-specific methods up to base class
* Renaming that one into MySqlDefaultValueTest
2019-05-20 13:38:01 -04:00
Gunnar Morling
3f0e2c7758 DBZ-1246 Removing obsolete exclusion of legacy parser during test 2019-05-20 16:38:03 +02:00
Jiri Pechanec
30c2df4f23 DBZ-1246 Convert unique index to primary key 2019-05-20 16:38:03 +02:00
Gunnar Morling
c72a2fb14d DBZ-844 Expanding test 2019-05-20 15:33:39 +02:00
Jiri Pechanec
d35c2ec347 DBZ-844 Use table charset for parsing string defaults 2019-05-20 15:33:39 +02:00
jcechace
d9657dab1a [DBZ-1273] Bumping JDBC and Mongo driver versions 2019-05-18 05:50:27 +02:00
Gunnar Morling
c7d2a35a0e DBZ-1264 Member ordering 2019-05-18 05:48:54 +02:00
Jiri Pechanec
a8f6533c66 DBZ-1264 Ignore unique index for non-monitored tables 2019-05-18 05:46:56 +02:00
Chris Cranford
f67ce1b8be DBZ-733 Consolidate parser tests 2019-05-17 13:18:24 -04:00
Chris Cranford
efa22016a8 DBZ-736 DBZ-733 Removed MySQL legacy parser and consolidate parser tests 2019-05-17 13:18:24 -04:00
Chris Cranford
373e508d70 DBZ-736 Remove MySQL legacy parser 2019-05-17 13:18:24 -04:00
Jiri Pechanec
13e5fe4537 DBZ-1228 Simplify error handling 2019-05-17 10:24:02 -04:00
Arkoprabho Chakraborti
ceb56c1c57 DBZ-1228 Changes as suggested in PR #867
Used multiple catch statements and handle in 1 branch.

Not using static modifier for keymanager.
2019-05-17 10:24:02 -04:00
Arkoprabho Chakraborti
b7526d537d DBZ-1228 MySQL connection with client authentication does not work
The SSL properties were being reset, and thus the authentication was failing on the second time.
When debezium connects to the database the first time in order to test the connections, the required parameters are all set. And thus the test passes.
After that the shutdown method is called that clears these properties, and the consecutive connection fails.

DBZ-1228: MySQL connection with client authentication does not work

Create and pass a socket factory that provides they keystore config

DBZ-1228: MySQL connection with client authentication does not work

Prevent forcing of SSL. Use SSL only if the required properties are set.

DBZ-1228: MySQL connection with client authentication does not work

Added better exception messages
2019-05-17 10:24:02 -04:00
Jenkins user
7748be6056 [maven-release-plugin] prepare for next development iteration 2019-05-02 16:04:56 +00:00
Jenkins user
5af083b86e [maven-release-plugin] prepare release v0.9.5.Final 2019-05-02 16:04:55 +00:00
Chris Cranford
9404eff794 DBZ-1226 Cleaned up tests 2019-05-01 18:37:09 -04:00
Gunnar Morling
2cd0eb17db DBZ-739 Removing obsolete method 2019-05-01 23:17:00 +02:00
Chris Cranford
46111505ed DBZ-1226 Fix test to validate enum/set options directly from antlr parsing. 2019-05-01 21:17:42 +02:00
Chris Cranford
a5fdfd9b24 DBZ-1226 Replace double single-quotes with a singular quote. 2019-05-01 21:17:42 +02:00
Chris Cranford
c6aa02f813 DBZ-1226 Add support for enum/set values that contain commas or escaped characters. 2019-05-01 21:17:42 +02:00
jchipmunk
72b06366fe Removing extra initialisation of "config" variable in PG config 2019-04-30 09:57:11 +02:00
jchipmunk
9fe033ce24 DBZ-1247 Specifying default snapshot fetch size for each connector config 2019-04-30 09:57:11 +02:00
Chris Cranford
83bf0f861a DBZ-1243 Fix handling of default value for datetime(0) 2019-04-25 17:31:22 +02:00
Jiri Pechanec
79afafcb0d DBZ-1249 Fix default value conversion for larger bits 2019-04-23 13:02:31 +02:00
krizhan
70c564b4c2 DBZ-212 Moved SERVER_NAME to RelationalDatabaseConnectorConfig 2019-04-23 12:29:44 +02:00
Gunnar Morling
5339dfc289 DBZ-1233 Formatting 2019-04-23 12:18:53 +02:00
Mathieu Rozieres
df79dfe751 DBZ-1233 MODE and others as MySQL column names
Add MODE to keywordsCanBeId to fix parse exception on so named columns
2019-04-23 12:18:40 +02:00
Jenkins user
cefc5ccfb9 [maven-release-plugin] prepare for next development iteration 2019-04-11 12:07:16 +00:00
Jenkins user
fc3026adc3 [maven-release-plugin] prepare release v0.9.4.Final 2019-04-11 12:07:15 +00:00
Gunnar Morling
f04147d67d DBZ-1208 Misc. clean-up;
* Adding reference to source of logic for setting up SSL socket factory
* Making method side-effect free
* Adding Jordon to COPYRIGHT.txt
2019-04-10 11:41:51 +02:00
jbragg
9ae2ebe329 DBZ-1208 Support for TLSv1.2;
Using accepted TLS protocol version  to set for BinaryLogClient
2019-04-10 11:41:13 +02:00
Jiri Pechanec
50fbe32113 DBZ-1220 Integration test for schema metadata 2019-04-10 11:20:09 +02:00
Jiri Pechanec
394eb74d0f DBZ-1220 FLOAT supports also single precision constraint 2019-04-10 11:20:09 +02:00
Jiri Pechanec
de9e80a58d DBZ-1143 Describe test values; improve tests 2019-04-10 10:59:02 +02:00
Jiri Pechanec
9c7f181174 DBZ-1143 Year adjustment configurable; test 19xx years 2019-04-10 10:59:02 +02:00
Jiri Pechanec
155e63adab DBZ-1143 Change default to Debezium-made conversion 2019-04-10 10:59:02 +02:00
Jiri Pechanec
16e731b748 DBZ-1143 2-digit years are converted by database by default 2019-04-10 10:59:02 +02:00
Steviep
7742e66e11 DBZ-1221 Creating new metric IsGtidModeEnabled 2019-04-09 14:52:18 +02:00
Steviep
94f71ea96e DBZ-1206 Adding new connector metric "numberOfFilteredEvents" 2019-04-09 14:46:54 +02:00
Chris Cranford
664c617661 DBZ-1203 Replace collectionOption rule with STRING_LITERAL token. 2019-04-08 11:16:42 +02:00
Chris Cranford
38e1cc56bb DBZ-1203 Fix parsing alter column with enum and character set 2019-04-08 11:16:42 +02:00
Joy Gao
08271ab444 DBZ-1218 Close JDBC connection in SnapshotReader for MySQL Connector 2019-04-08 08:47:43 +02:00
jchipmunk
7c0ae3ee20 DBZ-1212 SLF4J usage issues 2019-04-04 21:32:12 +02:00
Jiri Pechanec
b90274cc63 DBZ-1194 Convert nulls even for key 2019-03-29 21:20:53 +01:00
Jiri Pechanec
e6b956b36d DBZ-1204 Allow setting boolean as default value for TINYINT 2019-03-29 09:41:44 +01:00
ShubhamRwt
540a951211 DBZ- 362 Adding WhitespaceAfter check to Checkstyle 2019-03-28 09:24:11 +01:00
Jenkins user
8b0edd1871 [maven-release-plugin] prepare for next development iteration 2019-03-25 12:16:31 +00:00
Jenkins user
56f98a48b2 [maven-release-plugin] prepare release v0.9.3.Final 2019-03-25 12:16:30 +00:00
Jiri Pechanec
9b405aa84d DBZ-1039 Add missing spaces 2019-03-25 10:23:14 +01:00
shubham
8cca21e969 DBZ-1039 Make all ifs with braces 2019-03-25 10:23:14 +01:00
Jiri Pechanec
13f49f02a9 DBZ-1185 Use Boolean instead of Optional 2019-03-21 14:02:23 +01:00
Jiri Pechanec
958d207121 DBZ-1185 Skip unsupported tests for legacy parser 2019-03-21 14:02:23 +01:00
Jiri Pechanec
601f2008ac DBZ-1185 SERIAL is valid table/column id 2019-03-21 14:02:23 +01:00
Jiri Pechanec
76e7cd6664 DBZ-1185 Support for SERIAL default value 2019-03-21 14:02:23 +01:00
Jiri Pechanec
4d4741a207 DBZ-1185 Support for SERIAL type alias 2019-03-21 14:02:23 +01:00
Jiri Pechanec
915bdc9b7f DBZ-1186 Comma is not mandatory between table options 2019-03-21 11:22:07 +01:00
Jiri Pechanec
f3c0c94b40 DBZ-1188 Use string testing utility method 2019-03-21 10:38:32 +01:00
Jiri Pechanec
2df2a62ddf DBZ-1188 False pasitive warning for non-empty password 2019-03-21 10:32:06 +01:00
Jiri Pechanec
c740400587 DBZ-1184 Run the test as the last in testsuite 2019-03-18 12:12:12 +01:00
Jiri Pechanec
08bc66f8ef DBZ-1184 Simplify the test 2019-03-18 12:12:12 +01:00
Jiri Pechanec
a892a4eb6f DBZ-1184 Add test 2019-03-18 12:12:12 +01:00
Jiri Pechanec
41734d322e DBZ-1184 Support long purged GTID set 2019-03-18 12:12:12 +01:00
Jenkins user
50a7c568fa [maven-release-plugin] prepare for next development iteration 2019-02-23 09:53:58 +00:00
Jenkins user
28f3839804 [maven-release-plugin] prepare release v0.9.2.Final 2019-02-23 09:53:58 +00:00
Jiri Pechanec
c7e0ff231b DBZ-1156 DBZ-1157 Upgrade to Kafka 2.1.1, Confluent Plat. 5.1.2 2019-02-21 09:39:05 +01:00
Gunnar Morling
510e9415f9 DBZ-1137 Some clean-up;
* Using existing justifyLeft() method
* Giving expected values as Duration
* Removing unused methods
2019-02-19 18:41:09 +01:00
Jiri Pechanec
0d60e60243 DBZ-1137 Default for TIME can be generic interval value 2019-02-19 13:40:01 +01:00
Jiri Pechanec
46aad6bcf5 DBZ-1147 Single quotes for string constant 2019-02-18 14:41:03 +01:00
Jiri Pechanec
14c1f30ca3 DBZ-1150 CHECK TABLE options are valid identifiers 2019-02-18 14:38:36 +01:00
Jenkins user
b96e5fee0d [maven-release-plugin] prepare for next development iteration 2019-02-13 11:13:44 +00:00
Jenkins user
3de2d04bcd [maven-release-plugin] prepare release v0.9.1.Final 2019-02-13 11:13:44 +00:00
Gunnar Morling
6a871e1b65 DBZ-983 Expanding test 2019-02-07 15:04:43 +01:00
Jiri Pechanec
eff78cae5a DBZ-983 Handle rounding of defaults 2019-02-07 15:04:43 +01:00
Jiri Pechanec
3487cf1bfb DBZ-983 BigDecimal default value scales according to column 2019-02-07 15:04:43 +01:00
Jiri Pechanec
6637f68861 DBZ-1123 Integration test for generated defaults 2019-02-07 14:06:49 +01:00
Jiri Pechanec
f65cbb7b7d DBZ-1123 Support generated colums 2019-02-07 14:06:49 +01:00
Gunnar Morling
99caad60d8 DBZ-1040 Changing resolution of "lag behind source" to milli-seconds;
Also using Duration/Instant types internally.
2019-02-04 12:39:07 +01:00
Gunnar Morling
913e0bc5c8 DBZ-1040 Making metadata provider a member of Metrics instead of passing it for each onEvent() call 2019-02-04 12:39:07 +01:00
Jiri Pechanec
a621e43d8b DBZ-1040 Expose transaction id 2019-02-04 12:39:07 +01:00
Jiri Pechanec
213d4a42ca DBZ-1040 Metrics for internal queue 2019-02-04 12:39:07 +01:00
Jiri Pechanec
d993ee265e DBZ-1040 Metrics for lag behind source, offset and tx count 2019-02-04 12:39:07 +01:00
jchipmunk
ff4e38cc46 DBZ-1112 Strings.join() doesn't apply conversation for first element
Replace:
- Integer.parseInt() to Integer.valueOf()
- Short.parseShort() and new Short() to Short.valueOf()
- Long.parseLong() to Long.valueOf()
2019-01-30 09:36:09 +01:00
Gunnar Morling
dd01d26d16 DBZ-1113 Pulling up test to MySqlDdlParserTest;
* Adding Joy Gao to COPYRIGHT.txt
* Typo fix
2019-01-30 09:22:05 +01:00
Joy Gao
030cf9ac14 DBZ-1113 allow adding multiple partitions in a single statement 2019-01-30 09:22:05 +01:00
Jenkins user
c5b7d21d3e [maven-release-plugin] prepare for next development iteration 2019-01-28 11:07:04 +00:00
Jenkins user
f1ae79ff73 [maven-release-plugin] prepare release v0.9.0.CR1 2019-01-28 11:07:04 +00:00
Gunnar Morling
ccff79e07d DBZ-1105 Removing TableImpl#columnNames field 2019-01-28 10:23:56 +01:00
Gunnar Morling
c9c84afc9d DBZ-1099 Don't enque further records after request to stop 2019-01-25 10:19:19 +01:00
Gunnar Morling
95a13b5dd7 DBZ-1062 Fix MySQL trustStore password setting 2019-01-24 17:38:42 +01:00
Moira Tagle
01c779fb62 DBZ-175 Setting completed GTIDs in the final binlog reader context in setupUnifiedReader() 2019-01-24 10:43:44 +01:00
Moira Tagle
0e10c4af48 DBZ-175 Modifying BinlogReaderMetrics to take in the BinlogReader name 2019-01-24 10:43:44 +01:00
Gunnar Morling
884f2f40ea DBZ-175 Adding toString() for readers 2019-01-24 10:43:44 +01:00
Gunnar Morling
206cd06c24 DBZ-175 Using passed filters instead of rebuilding them in MySqlSchema 2019-01-24 10:43:44 +01:00