Grzegorz Kołakowski
91c72738c0
DBZ-1067 Add column blacklist field to RelationalDatabaseConnectorConfig
2019-01-09 18:13:26 +01:00
Gagan Agrawal
aff45c7dc6
DBZ-1063 Fixed schema parsing bug for handling unsigned max default value
2019-01-09 17:50:18 +01:00
Jiri Pechanec
03570a1a3a
DBZ-1059 Support qualified table name in rename
2019-01-04 12:57:55 +01:00
Jiri Pechanec
9fcc25e4c5
DBZ-688 Uncommitted TX with temp tables are not stored in binlog in MySQL 8
2018-12-18 15:42:15 +01:00
LiuHanlin
c58031582d
DBZ-1033 Mysql binlog reader lost data if restart task when last binlog event is QUERY event.
...
https://issues.jboss.org/browse/DBZ-1033
Reset restartEventsToSkip each time updating the restartBinlogPosition.
2018-12-17 13:42:01 +01:00
Gunnar Morling
1258beae55
DBZ-688 Moving differences related solely to geo-spatial test into the test class itself
2018-12-14 10:39:05 +01:00
Jiri Pechanec
c8f09f110b
DBZ-688 Centralize MySQL differences in a single file
2018-12-14 10:39:05 +01:00
Jiri Pechanec
3c1da7d5d4
DBZ-688 Robust identification of geom collection type
2018-12-14 10:39:05 +01:00
Jiri Pechanec
12083452a5
DBZ-688 CURRNT_TIMESTAMP handled differently by MySQL 8
2018-12-14 10:39:05 +01:00
Jiri Pechanec
994f1b6e03
DBZ-688 Update geometry handling
2018-12-14 10:39:05 +01:00
Jiri Pechanec
8b83df82b5
DBZ-688 Ignore differences in generated metadata
2018-12-14 10:39:05 +01:00
Jiri Pechanec
974731b0ae
DBZ-688 Support for test execution on MySQL 8 server
2018-12-14 10:39:05 +01:00
Jiri Pechanec
edec1c3090
DBZ-978 Added last event and captured tables metrics
2018-12-13 20:52:11 +01:00
Grzegorz Kołakowski
2a1934eeb1
DBZ-966 Make snapshot.delay.ms global property
2018-12-13 14:29:54 +01:00
Gunnar Morling
0075bbb17e
DBZ-1028, DBZ-992 Expanding test
2018-12-12 23:05:29 +01:00
Jiri Pechanec
946d5c113d
DBZ-1028 Literal "CSV" is not a special token
2018-12-12 23:05:07 +01:00
Jiri Pechanec
f3a87a039f
DBZ-1008 Process first GTID after failover
2018-12-12 16:52:53 +01:00
Jiri Pechanec
edb116677d
DBZ-960 Handle TX closing safely
2018-12-11 14:15:53 +01:00
Jiri Pechanec
2b2ff0754d
DBZ-960 Run SnapshotReader in a single transaction
2018-12-11 14:15:53 +01:00
Gunnar Morling
68b6bc2efe
DBZ-977 Adding log statement
2018-12-11 14:12:23 +01:00
Jiri Pechanec
6a88309f0e
DBZ-977 ALTER TABLE filters works even for stored DDL
2018-12-11 14:12:23 +01:00
Jiri Pechanec
c5ecff4be6
DBZ-1005 Detect GTID by database setting not GTID set
2018-11-30 11:58:07 +01:00
Jiri Pechanec
415830003a
DBZ-1016 Fix expected records count
2018-11-30 11:18:47 +01:00
Jiri Pechanec
2c3d2ee083
DBZ-1010 Handle error deserialization also in deserializers
2018-11-30 11:09:30 +01:00
Jiri Pechanec
9c81e54b9d
DBZ-1006 Guard against NPE when start() fails
2018-11-23 16:13:50 +01:00
Gunnar Morling
62fe7d1ee7
DBZ-604 Making sure connector cleanly shuts down also if records are produced after polling loop has stopped
2018-11-23 14:36:05 +01:00
Gunnar Morling
2fd16a6bc0
DBZ-923 Misc. clean-up;
...
* Exposing new option via MySqlConnectorConfig
* Formatting
* Using GtidSet type in signatures
* Adding new option to configDef() and ALL_FIELDS
2018-11-22 10:54:10 +01:00
Eero Koplimets
972c08fcda
fix checkstyle errors
2018-11-22 09:50:46 +01:00
Eero Koplimets
3e1eaef318
fix GTID_NEW_CHANNEL_POSITION description
2018-11-22 09:50:46 +01:00
Eero Koplimets
268101acd5
Change config from boolean to enum
2018-11-22 09:50:46 +01:00
Eero Koplimets
8844442459
DBZ-923 config to use earliest available gtid set from mysql server when connecting
2018-11-22 09:50:46 +01:00
Jiri Pechanec
b7e7bfa218
DBZ-990 Engine names can be quoted
2018-11-19 14:30:21 +01:00
Jiri Pechanec
530e2190a8
DBZ-757 Use antlr parser by default
2018-11-16 14:17:47 +01:00
Gunnar Morling
6bd4024618
DBZ-776 Misc. improvements;
...
* Renaming getTimeSinceLastEvent() to getMilliSecondsSinceLastEvent()
* Further unifying metrics implementation across connectors
* Emitting event in EventDispatcher also if event is filtered out
* Typo fixes
2018-11-16 08:52:07 +01:00
Gunnar Morling
818d5e4696
DBZ-776 Misc. clean-up
2018-11-16 08:52:07 +01:00
Jiri Pechanec
4510e2bbe6
DBZ-776 Cleanup after review
2018-11-16 08:52:07 +01:00
Gunnar Morling
360714a5a1
DBZ-776 Formatting and minor clean-up
2018-11-16 08:52:07 +01:00
Jiri Pechanec
b44c9fd04f
DBZ-776 A first set of metrics implemented in new framework
2018-11-16 08:52:07 +01:00
Jiri Pechanec
4cdc3e669b
DBZ-776 Extract metrics to a common code
2018-11-16 08:52:07 +01:00
Gunnar Morling
9994172860
DBZ-953 Pulling decimal mode handling up to RelationalDatabaseConnectorConfig;
...
Also using it in MySQL connector.
2018-11-08 09:23:28 +01:00
Jiri Pechanec
a5ff561deb
DBZ-959 ADD PARTITION needs parenthesis
2018-11-02 07:14:42 +01:00
s0r01ed
fdab3386d4
DBZ-780 | Adding RENAME column semantics to rename a column
2018-10-24 20:20:04 +02:00
Deepak Barr
bc0712e240
DBZ-935 Error while parsing json column type for MySQL
2018-10-11 11:40:18 +02:00
Deepak Barr
4aaed1fd2b
DBZ-927 Gracefully handling invalid default values for timestamp fields
2018-10-04 10:30:56 +02:00
jchipmunk
3ec0b3be81
DBZ-918 Moving connector identifier from SourceInfo to Module class
2018-10-04 09:00:13 +02:00
jchipmunk
05ba99bb0a
DBZ-918 Adding Debezium connector field to source info
...
This will allow consumers to recognize the Debezium connector used for creating a given message, helping them to adjust their behavior for a variety of connectors.
2018-10-04 09:00:13 +02:00
Jiri Pechanec
3b51818864
DBZ-910 Verify also anonymous CONSTRAINT CHECK
2018-09-18 15:51:46 +02:00
Jiri Pechanec
3c5a67856b
DBZ-910 Improve support for CHECK constraint
2018-09-18 15:51:46 +02:00
Jiri Pechanec
6fe48b7764
DBZ-769 Try to release table locks during exception
2018-09-18 10:49:48 +02:00
jchipmunk
b0feaf496a
DBZ-633 Adding "field.blacklist" property for MongoDB connector
...
The "field.blacklist" configuration property is an optional comma-separated list of the fully-qualified names of fields that should be excluded from change event message values. Fully-qualified names for fields are of the form "databaseName.collectionName.fieldName.nestedFieldName", where "databaseName" and "collectionName" may contain the wildcard (*) which matches any characters.
Although the "field.blacklist" configuration property allows you to remove fields from the event values, the "_id" field is always included in the event’s key.
2018-09-14 12:54:11 +02:00
Jiri Pechanec
e6b28eeea4
DBZ-903 Support function named DATABASE()
2018-09-13 16:17:50 +02:00
Jiri Pechanec
8dd8327826
DBZ-901 Handle default date/time values without micros
2018-09-13 15:47:00 +02:00
Gunnar Morling
e1bbbd7992
DBZ-865 DBZ-878 Replacing invalid topic name characters with "_";
2018-09-05 12:56:53 +02:00
Cliff Wheadon
685f72f988
DBZ-880 MySQLConnectorTask no longer always reports finding the binlog
2018-08-28 08:56:52 +02:00
Jiri Pechanec
ce0b3cc940
DBZ-872 Use converters in parser tests
2018-08-24 08:12:54 +02:00
Jiri Pechanec
2cbc35dac7
DBZ-877 Process newly added columns
2018-08-24 08:12:54 +02:00
Gunnar Morling
985999b4af
DBZ-872 Making MySqlAntlrDdlParser#tableFilter final
2018-08-24 08:12:54 +02:00
Jiri Pechanec
63ee65bb7d
DBZ-872 Honor filters in ALTER TABLE parsing
2018-08-24 08:12:54 +02:00
Jiri Pechanec
29af79057b
DBZ-859 Test for MySQL heartbeat
2018-08-23 11:44:53 +02:00
Jiri Pechanec
985e03e7b5
DBZ-859 Force heartbeat after snapshot completion
2018-08-23 11:44:53 +02:00
Rao
49214491a7
DBZ-763 Correcting the JDBC driver class
2018-08-23 11:31:37 +02:00
Gunnar Morling
414ebe5f13
DBZ-870 Adding test
2018-08-23 11:19:27 +02:00
Jiri Pechanec
99ab131910
DBZ-870 Accept zero as valid date/time value
2018-08-23 11:19:27 +02:00
Jiri Pechanec
26b82c88bd
DBZ-860 DBZ-869 Enable default value tests for antlr parser
2018-08-23 11:19:27 +02:00
Jiri Pechanec
e9f9e4eb8f
DBZ-860 Fix for primary keys with default value
2018-08-23 11:19:27 +02:00
Jiri Pechanec
7e0639f733
DBZ-864 Add support for CHARSET database option
2018-08-22 13:31:34 +02:00
Gunnar Morling
207f1896ab
DBZ-763 Cleaning up tests
2018-08-22 11:54:55 +02:00
Rao
d13ea932f7
DBZ-763 Upgrading Mysql driver to version 8.0.12
2018-08-22 11:54:55 +02:00
Gunnar Morling
3862083756
DBZ-860 Expanding test
2018-08-20 19:01:55 +02:00
Jiri Pechanec
c2f014750e
DBZ-860 Handle implicitly NOT NULL PKs
2018-08-20 19:01:32 +02:00
PengLv
3d978d717b
fix gitd bug
...
method isGtidModeEnabled when to check gtid mode ,it'll always be true
2018-08-14 09:46:16 +02:00
artiship
bb4ecc79e0
DBZ-849 Refact read mysql system variables methods
2018-08-14 09:43:49 +02:00
artiship
cdb6d7301c
DBZ-855 Make BinlogReader.informAboutUnknownTableIfRequired log with tableId
2018-08-14 08:41:30 +02:00
Gunnar Morling
3061c1dc0b
DBZ-815 Passing offset to Heartbeat#heartbeat();
...
That's simpler to grasp than the approach of passing a supplier lambda to the constructor.
Also it allows to pass on the offset via local variables instead of instance fields in some cases.
2018-07-25 14:49:52 +02:00
Jiri Pechanec
0e35439019
DBZ-40 Snapshotting and connector restart
2018-07-18 14:39:11 +02:00
Gunnar Morling
20db9299c5
DBZ-627 Unifying TopicSelector implementations
2018-07-18 12:36:07 +02:00
Gunnar Morling
1523f230ca
DBZ-793 Using TableFilter consistently;
...
Only the MySQL connector's Filters class still uses Predicate for the time being, so to avoid to much merging trouble with DBZ-175.
2018-07-11 13:16:44 +02:00
Peter Goransson
448330fd07
DBZ-789 Expose more granular snapshot metrics via JMX
2018-07-09 12:30:41 +02:00
Gunnar Morling
9d52614b79
DBZ-771 Adding test for changing column type and default value
2018-07-03 11:55:20 +02:00
Gunnar Morling
99048365c9
DBZ-771 Unsetting default value when changing a column's type
2018-07-03 11:55:20 +02:00
Gunnar Morling
dcd6b01134
DBZ-644 Simplifying RelationalDatabaseSchema constructor;
...
Also retrieving logical name via CommonConnectorConfig#getLogicalName() in more places
2018-07-03 07:03:59 +02:00
Gunnar Morling
068aa85bd6
DBZ-644 Misc. clean-up and tests;
...
* Using parameter keys under "__debezium" namespace
* More expressive names
* Adding tests
2018-07-03 07:03:59 +02:00
Gunnar Morling
8744488c8a
DBZ-644 Unifying retrieval of ColumnMappers in RelationalDatabaseSchema
2018-07-03 07:03:59 +02:00
orr.ganani
747184c572
DBZ-644 add JDBC data type as additional metadata to DBZ events, if configuration is opted in
2018-07-03 07:03:59 +02:00
Gunnar Morling
c4c8cbc3ab
DBZ-773 Moving management of Tables to RelationalDatabaseSchema
2018-06-29 09:09:10 +02:00
Gunnar Morling
bbfbdf6fab
DBZ-773 Moving management of table schemas to RelationalDatabaseSchema
2018-06-29 09:09:10 +02:00
Gunnar Morling
90a453b0ee
DBZ-768 Checking boolean flag just once
2018-06-28 10:14:01 +02:00
Jiri Pechanec
b4b1f6976b
DBZ-768 Fix formatting. Behaviour not dependent on a timezone
2018-06-28 07:24:09 +02:00
Jiri Pechanec
741debe18e
DBZ-768 Default values with variable second fractions
2018-06-28 06:17:41 +02:00
Gunnar Morling
a3f42610ff
DBZ-751 Adding tests for NUMERIC columns
2018-06-27 14:48:59 +02:00
Gunnar Morling
0600ccf213
DBZ-751 Incorporating review remarks;
...
* Expanding test
* Extracting constant for parameter key in tests
2018-06-27 14:48:59 +02:00
Gunnar Morling
a292b05a96
DBZ-751 Propagating DECIMAL column precision to Avro schemas
2018-06-27 14:48:59 +02:00
Jiri Pechanec
d61db8930d
DBZ-770 Typename comparison should not be case dependent
2018-06-27 11:37:58 +02:00
Jiri Pechanec
ca6b1c9168
DBZ-743 Empty password for PostgreSQL and MySQL
2018-06-27 11:18:19 +02:00
Gunnar Morling
9d05fc2dc5
DBZ-767 Typo fix
2018-06-27 10:34:00 +02:00
Gunnar Morling
20f622dc40
DBZ-767 Adjusting test to more closely match original report
2018-06-27 10:33:41 +02:00
Jiri Pechanec
84f8bfb070
DBZ-767 Column should not be renamed when name is not changed
2018-06-27 09:14:59 +02:00
Jiri Pechanec
c14693c4ec
DBZ-765 Reduce the amount of test prints
2018-06-25 10:45:46 +02:00
Gunnar Morling
f5629d9f0b
DBZ-578 Interpret DATETIME columns using UTC;
...
This partly reverts the work previously done for DBZ-578,
where DATETIME columns (logical date + time values without TZ)
were shifted using the database's (or connection's) time zone.
Instead, the DATETIME values are interpreted using UTC again
with this change.
2018-06-20 15:58:19 +02:00
Gunnar Morling
42e313284a
DBZ-20 Adjustment after rebase
2018-06-20 13:05:37 +02:00
Gunnar Morling
b83f1493a2
DBZ-20 Avoiding Optional as method parameter
2018-06-20 13:05:37 +02:00
Gunnar Morling
dce1aa29f1
DBZ-20 Oracle precision supports negative numbers
2018-06-20 13:05:37 +02:00
Gunnar Morling
603f02e70d
DBZ-20 Excluding generated sources from CheckStyle
2018-06-20 13:05:37 +02:00
Gunnar Morling
d7e196a18e
DBZ-20 Initial import of Oracle connector based on XStream
2018-06-20 13:05:37 +02:00
Gunnar Morling
5b1807b286
DBZ-734 Avoiding repetition of option name and default value
2018-06-18 09:51:01 +02:00
Jiri Pechanec
ec03b431c9
DBZ-734 Maven profile for testing old/new DDL parser
2018-06-18 06:02:29 +02:00
Gunnar Morling
9eb4b90ec9
DBZ-191 Adding record validations
2018-06-15 20:23:17 +02:00
Gunnar Morling
84dd36df46
DBZ-252 Misc typo fixes and clean-up
2018-06-15 16:43:30 +02:00
Gunnar Morling
b56d6efdf1
DBZ-252 Making DataTypeResolver immutable
2018-06-15 16:43:29 +02:00
Gunnar Morling
54ca30624d
DBZ-252 Misc. improvements;
...
* Dedicated getter for DDL mode
* Using Objects#equal()
* Typo fixes
2018-06-15 16:43:29 +02:00
Gunnar Morling
6a6a8c9f99
DBZ-727 Initializing defaults for NUMERIC in Antlr parser
2018-06-15 16:43:29 +02:00
Gunnar Morling
759940b879
DBZ-252 Using existing parser implementation by default;
...
* Avoiding reflection for parser instantiation
* Making legacy parser instantiatable again
2018-06-15 16:43:25 +02:00
Jiri Pechanec
9580c8c290
DBZ-252 Rebase to master
2018-06-15 11:42:24 +02:00
rkuchar
5022933581
DBZ-252 add javadoc
2018-06-15 11:42:24 +02:00
rkuchar
c2e13b3b5f
DBZ-252 minor refactor
2018-06-15 11:42:24 +02:00
rkuchar
98384822eb
DBZ-252 refactor - move mysql antlr ddl parsser implementation into mysql-connector module
2018-06-15 11:42:24 +02:00
rkuchar
b8191963f7
DBZ-252 resolve todos
2018-06-15 11:42:24 +02:00
rkuchar
6812b4f7f0
DBZ-252 remove unused import
2018-06-15 11:42:24 +02:00
rkuchar
5c9e718436
DBZ-252 uncomment getting ddl parser instance from configuration + improve/refactor dataType resolver for ANTLR
2018-06-15 11:42:24 +02:00
rkuchar
99eac9a8e2
DBZ-252 some test fixes + separate ddl test for antlr parser
2018-06-15 11:42:24 +02:00
rkuchar
a4105adaaa
DBZ-252 refactor skipping nodes in tree walk
2018-06-15 11:42:24 +02:00
rkuchar
1ae7859acd
DBZ-252 parse create view
2018-06-15 11:42:23 +02:00
rkuchar
07212043b5
DBZ-252 test fixes + grammar fixes + some bug repairs in antlr parser
2018-06-15 11:42:23 +02:00
rkuchar
b4480c55b7
DBZ-252 parse database queries (create, alter, delete), parse name tokens without quotes, add new Mysql connector configuration field for choosing ddl parsing mode
2018-06-15 11:42:23 +02:00
rkuchar
32d181480d
DBZ-252 fix troubles with generalized system variables + add new data types that was missing in grammar
2018-06-15 11:42:23 +02:00
rkuchar
5851d1f07d
DBZ-252 fix initialization of system variables object + add default scope for variales in case that scope will no be set
2018-06-15 11:42:23 +02:00
rkuchar
9311c82bc5
DBZ-252 reformat code to not have anything after closing "}"
2018-06-15 11:42:23 +02:00
rkuchar
782ab75160
DBZ-252 move listener support from base to only legacy implementation, refactor system variables for possible use with other DBMSs + introduce data type resolver for antlr mysql parser
2018-06-15 11:42:23 +02:00
rkuchar
6a21702ac9
DBZ-252 finished alter table query listeners + new listener for rename table and create index
2018-06-15 11:42:23 +02:00
rkuchar
909668e14a
DBZ-252 Mysql alter table by add column/s parser listener
2018-06-15 11:42:23 +02:00
rkuchar
1df0b2033c
DBZ-252 Create new debezium-ddl-parser module
2018-06-15 11:42:23 +02:00
rkuchar
36e2f33bf6
DBZ-252 - extract creation of DdlParser interface
2018-06-15 11:42:23 +02:00
rkuchar
30cb9c3059
DBZ-252 - remove UNDERSCORE fragment from lexer
2018-06-15 11:42:23 +02:00
rkuchar
4a70d9bd59
DBZ-252 - case insensitive lexer
2018-06-15 11:42:23 +02:00
rkuchar
fb53cde565
DBZ-252 = add ANTLR gramatic for MySQLm setup build for it and exclude generated files from checkstyle
2018-06-15 11:42:23 +02:00
Jiri Pechanec
f9c84030b3
DBZ-727 Initializing defaults for NUMERIC
2018-06-14 16:39:48 +02:00
Jiri Pechanec
29f8891b4f
DBZ-578 Process timestamps without timezones as in server timezone
2018-06-11 15:27:08 +02:00
luobo
3f7186b3e5
DBZ-191 Represent all-zero time value with null if column allows null
2018-06-11 10:01:22 +02:00
Peter Goransson
3bf3e2e989
DBZ-601 Exposing new config
2018-06-07 10:42:20 +02:00
Gunnar Morling
c5b907873b
DBZ-601 Minor clean-up
2018-06-06 08:40:05 +02:00
Peter Goransson
f387f72474
DBZ-601 Snapshot delay implementation
2018-06-06 08:33:10 +02:00
luobo
5b33d81f00
DBZ-191 support default value of column in mysql
2018-06-04 10:43:53 +02:00
Gunnar Morling
61f576bb90
DBZ-706 Misc. clean-up
2018-06-01 11:23:30 +02:00
Stephen Powis
40d872f48c
DBZ-706 General cleanup
2018-06-01 11:23:30 +02:00
Stephen Powis
867202e0ca
DBZ-706 Slight refactoring / shuffling of code to validate source query field in snapshot tests
2018-06-01 11:23:12 +02:00
Stephen Powis
cc33fed16a
DBZ-706 Adding option for showing source query in sourceInfo element
2018-06-01 11:23:12 +02:00
Gunnar Morling
8d7806e71a
DBZ-693 Expanding test; updating connector option description
2018-05-28 12:35:47 +02:00
Jiri Pechanec
45bc7b1536
DBZ-693 On connect statements supported for PostgreSQL
2018-05-28 12:35:47 +02:00
Jiri Pechanec
f74a9fe059
DBZ-693 Initial SQL statements
2018-05-28 12:35:47 +02:00
Jiri Pechanec
fc107972f2
DBZ-598 Metrics expose the list of captured tables
2018-05-28 09:40:33 +02:00