Commit Graph

1762 Commits

Author SHA1 Message Date
Moira Tagle
01c779fb62 DBZ-175 Setting completed GTIDs in the final binlog reader context in setupUnifiedReader() 2019-01-24 10:43:44 +01:00
Moira Tagle
0e10c4af48 DBZ-175 Modifying BinlogReaderMetrics to take in the BinlogReader name 2019-01-24 10:43:44 +01:00
Gunnar Morling
884f2f40ea DBZ-175 Adding toString() for readers 2019-01-24 10:43:44 +01:00
Gunnar Morling
206cd06c24 DBZ-175 Using passed filters instead of rebuilding them in MySqlSchema 2019-01-24 10:43:44 +01:00
Gunnar Morling
ed4787bc8a DBZ-175 Misc. clean-up;
* Removing unused code (constructor, method and return value)
* Making ParallelSnapshotReader logger static
* Making RecordMakers#restartOffset final; avoiding unchecked cast
2019-01-24 10:43:44 +01:00
Gunnar Morling
965b789dab DBZ-175 Misc. adjustments;
* Dedicated functional interface for halting predicates
* Using semantic temporal types
* Typo fixes
* Exposing SnapshotNewTables through connector config
* Static loggers
* Adding Moira to COPYRIGHT.txt
2019-01-24 10:43:44 +01:00
Moira Tagle
a6d791cd8c DBZ-175 Initial implementation for support to whitelist/blacklist changes;
* The filter config is stored in offsets now, allowing to detect changes
to the config after a connector restart
* In that case, roughly the following steps are done:
- set up a binlog reader for the "old" tables
- set up a snapshot reader for the "new" tables
- if the snapshot is done, set up a binlog reader for the new tables
- if both binlog readers are in proximity of the logs head, stop them
and set up a single binlog reader for all tables
* That behavior is disabled by default for the purposes of testing and
can be enabled via new connector option "snapshot.new.tables"
* To facilitate connector restarts while whitelist/blacklist changes are
processed, separate restart offsets are added to the offsets
2019-01-24 10:43:44 +01:00
Gunnar Morling
276e053f65 DBZ-1090 Some clean-up 2019-01-24 10:11:35 +01:00
Jiri Pechanec
b05daaf2c1 DBZ-1090 Print error details for test database failure 2019-01-24 10:11:35 +01:00
Jiri Pechanec
9b90f10331 DBZ-1090 Change position consists of commit LSN and change LSN 2019-01-24 10:11:35 +01:00
Jiri Pechanec
3a2f93eef8 DBZ-1084 Adding SQL Server to Travis build 2019-01-24 07:44:09 +01:00
Gunnar Morling
b6e36306f6 DBZ-1084 Adding SQL Server to aggregator 2019-01-24 05:46:49 +01:00
Gunnar Morling
d445193b5a DBZ-1067 Moving SourceRecordAssert to core 2019-01-24 05:46:49 +01:00
Grzegorz Kołakowski
9b66e9a2a3 DBZ-1067 Add column blacklisting in SQL Server connector 2019-01-24 05:46:49 +01:00
Jiri Pechanec
2d198a8674 DBZ-1089 Database is no longer part of schema name 2019-01-24 05:46:49 +01:00
Gunnar Morling
1451349ae2 DBZ-1051 Obtaining database name eagerly;
Also fixing some typos and adding issue reference to test.
2019-01-24 05:46:49 +01:00
Jiri Pechanec
805cf9e4bf DBZ-1051 Handle object and db name letter case 2019-01-24 05:46:49 +01:00
Grzegorz Kołakowski
ac9cf8780f DBZ-1078 Cache sys.fn_cdc_map_lsn_to_time() results 2019-01-24 05:46:49 +01:00
Jiri Pechanec
d3b4e481b1 DBZ-1069 Store max LSN at start of snapshot 2019-01-24 05:46:49 +01:00
Jiri Pechanec
85e20f2dde DBZ-1069 Test of offsets 2019-01-24 05:46:49 +01:00
Jiri Pechanec
6b99569674 DBZ-1069 Snapshot is completed when offset is recovered 2019-01-24 05:46:49 +01:00
Grzegorz Kołakowski
fd8b50b0d2 DBZ-1066 Improve "Found previous offset" log
This is achieved by adding custom toString() to SqlServerOffsetContext
and SourceInfo.
2019-01-24 05:46:49 +01:00
Jenkins user
18ee93fab8 [maven-release-plugin] prepare for next development iteration 2019-01-24 05:46:49 +01:00
Jenkins user
44b067fff0 [maven-release-plugin] prepare release v0.9.0.Beta2 2019-01-24 05:46:49 +01:00
Jiri Pechanec
08b20f8084 DBZ-1047 Log proper change tables 2019-01-24 05:46:49 +01:00
Jiri Pechanec
efad7e4101 DBZ-859 Heartbeat is sent after snapshot 2019-01-24 05:46:49 +01:00
Gunnar Morling
91a89fae43 DBZ-1017 Formatting 2019-01-24 05:46:49 +01:00
Jiri Pechanec
ed71835cd2 DBZ-1017 Record schema evolution into history correctly 2019-01-24 05:46:49 +01:00
Gunnar Morling
33a39fe111 DBZ-978 Changing logged connector name 2019-01-24 05:46:49 +01:00
Jiri Pechanec
348af519e0 DBZ-978 Added last event and captured tables metrics 2019-01-24 05:46:49 +01:00
Gunnar Morling
ef77fb3c42 DBZ-1031 Some clean-up 2019-01-24 05:46:49 +01:00
Wout Scheepers
2ec234d386 DBZ-1031 Support for tables with reserved names 2019-01-24 05:46:49 +01:00
Gunnar Morling
8daac8a4b0 DBZ-966 Adding 'snapshot.delay.ms' option to Oracle and SQL Server connectors 2019-01-24 05:46:49 +01:00
Jiri Pechanec
683fdfda6d DBZ-1007 Log captured but not whitelisted table 2019-01-24 05:46:49 +01:00
Jiri Pechanec
11201d382c DBZ-1003 Initialize database history 2019-01-24 05:46:49 +01:00
Gunnar Morling
944c67b0f2 DBZ-1002 Avoiding NPEs when connector failed to start 2019-01-24 05:46:49 +01:00
Jenkins user
5bced93cd8 [maven-release-plugin] prepare for next development iteration 2019-01-24 05:46:49 +01:00
Jenkins user
b7db816aa0 [maven-release-plugin] prepare release v0.9.0.Beta1 2019-01-24 05:46:49 +01:00
Gunnar Morling
050c192dd7 DBZ-812 Moving test-only methods to TestHelper 2019-01-24 05:46:49 +01:00
Jiri Pechanec
fdeaa1cff8 DBZ-812 Test for changes made before new capture is added 2019-01-24 05:46:49 +01:00
Jiri Pechanec
4973e1bf44 DBZ-812 Start new TX for snapshots 2019-01-24 05:46:49 +01:00
Jiri Pechanec
a47af6c633 DBZ-812 Add missing Javadoc 2019-01-24 05:46:49 +01:00
Jiri Pechanec
a52256aeb9 DBZ-812 Rename var; guard against NULL row LSN 2019-01-24 05:46:49 +01:00
Jiri Pechanec
fe9a61941c Test for change type of column 2019-01-24 05:46:49 +01:00
Jiri Pechanec
a39fe657e9 Support for column rename 2019-01-24 05:46:49 +01:00
Jiri Pechanec
f9e2f3571b Test drop column 2019-01-24 05:46:49 +01:00
Jiri Pechanec
70a93769eb DBZ-812 Changed schema read from the source table; schema evolution works for changes without new records in the batch 2019-01-24 05:46:49 +01:00
Jiri Pechanec
cf74b28ac0 DBZ-812 CDC tables poll interval derived from poll.interval.ms 2019-01-24 05:46:49 +01:00
Jiri Pechanec
8c28f3b859 DBZ-812 Column added during streaming 2019-01-24 05:46:49 +01:00
Jiri Pechanec
a912d43a51 DBZ-812 Table removed during streaming 2019-01-24 05:46:49 +01:00