Commit Graph

1008 Commits

Author SHA1 Message Date
ahodavdekar
91b7ef2c36 DBZ-4029 Adding support for heartbeat action queries to MySQL connector 2021-11-05 13:27:09 +01:00
Chris Cranford
9f75ece307 DBZ-4241 Add more assertions for MySqlTimestampColumnIT 2021-11-04 17:21:40 +01:00
Gunnar Morling
d1cae3f3b7 DBZ-3966 Making defaultValueExpression() return Optional<String> from editor too 2021-11-04 10:47:17 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
Gunnar Morling
6aa9b2ea96 DBZ-3966 Avoiding reference to Column::defaultValue 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Kate
a645d0bc7e DBZ-4197 Process transaction started/committed in R/O snapshot 2021-11-04 06:19:58 +01:00
harveyyue
3ced90130e DBZ-4229 CREATE PROCEDURE DDL throws ParsingException 2021-11-03 18:23:22 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4 DBZ-2975 Using Offsets in recover() contract;
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
harveyyue
62f00343b7 DBZ-4174 DDL statement couldn't be parsed 2021-11-01 09:22:09 +01:00
harveyyue
4be1674dbd DBZ-4166 Producer failure NullPointerException 2021-10-26 19:23:09 +05:30
harveyyue
3f2fe270b2 DBZ-4193 Parse the "window" keyword for agg and nonagg function in mysql8 2021-10-25 14:28:02 +02:00
Jiri Pechanec
ebc49b41c2 DBZ-4000 Fix typo in test name 2021-10-20 15:19:31 +02:00
harveyyue
90e9bea93f DBZ-4000 Support parse table and columns comment 2021-10-20 15:19:31 +02:00
Hossein Torabi
6027d762a6 DBZ-4150 Trim numerical defaultValue before converting postgres-connector 2021-10-19 12:27:26 +02:00
Chris Cranford
fef29f1093
DBZ-4032 Treat empty TIMESTAMP blob value as null 2021-10-19 09:39:27 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Hossein Torabi
aa2d8539f9 DBZ-3989 Trim numerical default values before parsing 2021-10-12 15:29:31 +02:00
Jiri Pechanec
aec2080415 DBZ-3895 Config returns Patterns not Strings 2021-10-11 10:57:33 +02:00
Jiri Pechanec
68f148c3f3 DBZ-3895 Make snapshot collection list matching case insensitive 2021-10-11 10:57:33 +02:00
Anisha Mohanty
52f9669807 DBZ-4005 Remove hard-coded version of MySQL example image 2021-10-06 09:22:12 +02:00
Kate
0099a50c53 DBZ-3948 Support kafka topic based signals 2021-09-22 13:08:45 +02:00
Vivek Wassan
b6e891ec7d DBZ-3951 Moving preReadChunk() to AbstractIncrementalSnapshotChangeEventSource 2021-09-22 07:01:29 +02:00
Vivek Wassan
65ac2387dc DBZ-3951 Adding a separate isValid method 2021-09-22 07:01:29 +02:00
Vivek Wassan
3f6c632296 DBZ-3951 Review comment: Changing Exception message 2021-09-22 07:01:29 +02:00
Vivek Wassan
5f37e6630f DBZ-3951 Adding a safety check, isValid, for connection 2021-09-22 07:01:29 +02:00
Anisha Mohanty
f57545d7b1 DBZ-3787 Add tests for invisible & visible columns using testcontainers
*Using user "debezium" to have right grants provided
2021-09-15 15:13:18 +02:00
harveyyue
97cb997be3 DBZ-3984 Mysql-Connector fails parsing invalid decimal format DDL statement 2021-09-13 13:55:49 +02:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Gunnar Morling
6f1577a70b DBZ-3958 Gracefully handling history file in sym-linked directory;
Also removing redundant test method definition.
2021-09-09 12:18:21 +02:00
camilesing
f2021330cb DBZ-3976 fix MySqlValueConvertes.java typo 2021-09-08 09:54:50 +02:00
jiabao.sun
96c2d33c83 DBZ-3969 Strings with binary collation shouldn't be parsed as Types.BINARY 2021-09-06 12:12:41 +02:00
Kate
390a331ecb DBZ-3947 Fix empty high watermark check 2021-09-06 10:53:33 +02:00
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Gunnar Morling
aea2827016 DBZ-2525 Removing unused methods 2021-08-30 12:20:55 +02:00
Jiri Pechanec
a36eb45dff
DBZ-3912 Added Binary padding for hex/base64 handling mode
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-08-27 09:48:19 +02:00
rkerner
52333596de DBZ-3364 add additional metadata to fields for API spec generator for the Debezium UI
part of https://issues.redhat.com/browse/DBZ-3364
DBZ-2653 User rollback from parent class
2021-08-23 17:57:38 +02:00
Jiri Pechanec
934c078e30 DBZ-3833 Misc. clean-up 2021-08-16 13:43:51 +02:00
Jiri Pechanec
ad1fb98fe7 DBZ-3833 Skip legacy test failures 2021-08-16 13:43:51 +02:00
Jiri Pechanec
f173def3b2 DBZ-3833 Receive timezoned data in server timezone 2021-08-16 13:43:51 +02:00
Erik Malm
f53ab40ddb DBZ-3833 Updated mysql-connector-java dependency to 8.0.26
Updated charset extraction method to use new static accessor methods, rather than direct field access.

MySqlValueConverters.java: Added wrapper class to access Java charset mappings in mysql-connector-java class.
2021-08-16 13:43:51 +02:00
Jiri Pechanec
99d5748584 DBZ-3869 Stop connector only after error was recorded 2021-08-13 21:26:07 +02:00
Chris Cranford
7b2cdf9235 DBZ-3773 Add logging about each column value 2021-08-13 06:08:15 +02:00
Chris Cranford
3182af55da DBZ-3773 Treat empty TIME blob value as null 2021-08-13 06:08:15 +02:00
Chris Cranford
e74b1c4999 DBZ-3838 Suggested changes 2021-08-11 23:57:09 +02:00
Chris Cranford
060420b0bc DBZ-3838 Do not reset trx isolation when using minimal_percona 2021-08-11 23:57:09 +02:00
Chris Cranford
c15cf81e18 DBZ-3839 Correctly skip tests with minor/patch not specified 2021-08-11 07:35:57 +02:00
Sergei Morozov
a40ad7132d DBZ-2975: Remove partition from offset context 2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12 DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets 2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52 DBZ-2975: Move Partition to io.debezium.pipeline.spi 2021-08-11 07:34:37 +02:00
pkgonan
5e0ffa28d2 DBZ-3765 Allow dot in database.server.name 2021-08-08 16:25:15 -04:00
Kate
c6e530cc27 DBZ-3577 Skip read-only test when gtid mode is off 2021-07-29 07:10:46 +02:00
Kate
6a30ad3811 DBZ-3577 Fix race condition in shouldFailOnSchemaInconsistency test 2021-07-29 07:10:46 +02:00
Kate
9b66ab374a DBZ-3577 Support read-only MySQL incremental snapshots 2021-07-29 07:10:46 +02:00
Chris Cranford
add76ae008 DBZ-3717 Fix formatting 2021-07-22 14:12:38 -04:00
Chris Cranford
c3684539c3 DBZ-3717 Add test case 2021-07-22 14:12:38 -04:00
Chris Cranford
ed31ea9ffb DBZ-3668 Adjust ServiceLoader for SPI change 2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d DBZ-3668 Extracting SPI package 2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110 DBZ-3668 Add ServiceLoader hook CloudEvents converter 2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba DBZ-2975: Add partition awareness to source task components
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Jiri Pechanec
472b82abb7 DBZ-3622 Decouple database and schema history record writes 2021-06-29 10:36:41 +02:00
Jiri Pechanec
443c0ce089 DBZ-3622 Fix non-captured database storing; make the code more robust 2021-06-29 10:36:41 +02:00
camile.sing
b05ac5549e DBZ-3638 Modify Mysql SourceInfo to be public 2021-06-17 16:16:05 +02:00
Sergei Morozov
b36e8247a3 DBZ-3615: Keep database connection closed during schema recovery 2021-06-15 11:27:44 +02:00
Gunnar Morling
1ce65fa628 DBZ-2975 Avoiding raw types in some places;
Also parameterizing offset loader contract, so to avoid casts later on.
2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542 DBZ-2975: Extract offset context from object states to method signatures 2021-06-09 16:02:33 +02:00
Sergei Morozov
213d9ffdcc DBZ-3562: Revert test changes from DBZ-3427 2021-05-27 11:03:30 +02:00
Sergei Morozov
3b72e5149c DBZ-3486: Replace @see with @link where a URL is referenced 2021-05-25 07:19:43 +02:00
Jiri Pechanec
4929397022 DBZ-3500 Per-connector table name quoting 2021-05-20 08:06:37 +02:00
Jiri Pechanec
a626dc149f DBZ-3500 Provide common test for incremental snapshot testing 2021-05-20 08:06:37 +02:00
Jiri Pechanec
5486cf3cf9 DBZ-3399 Add asserts for DDLs 2021-05-18 10:26:10 +02:00
Jiri Pechanec
0dc25a6846 DBZ-3399 Store full RENAME TABLE in history 2021-05-18 10:26:10 +02:00
Jiri Pechanec
367746fcc9 DBZ-3485 Emit quoted DROP TABLE 2021-05-18 10:26:10 +02:00
Jiri Pechanec
4df0d93b4d DBZ-2300 Make too many connections retriable 2021-05-13 08:07:38 -04:00
John Martin
cef0997428 DBZ-3508 return empty ConfigDef for ReadToInsertEvent.config 2021-05-11 05:59:33 +02:00
Jiri Pechanec
b4327ab13a DBZ-3499 Moved test statements to examples 2021-05-06 06:14:24 +02:00
Tommy Karlsson
f9028926f8 DBZ-3499 Add support for parsing of GRANT statements with newer MySQL privileges 2021-05-06 06:14:24 +02:00
Jiri Pechanec
5c722341e2 DBZ-3473 Extract incremental snapshot contract 2021-05-06 05:37:36 +02:00
Jiri Pechanec
39d21806eb DBZ-3473 Metrics enabled 2021-05-06 05:37:36 +02:00
Jiri Pechanec
3d940ca14a DBZ-3473 Support for cursor-based fetching 2021-05-06 05:37:36 +02:00
Jiri Pechanec
c53785dde7 DBZ-3473 Incremental Snapshot support for MySQL 2021-05-06 05:37:36 +02:00
Jiri Pechanec
7415dc91de DBZ-3497 Rename the variable 2021-05-05 13:17:28 +02:00
Anisha Mohanty
5156ea0d16 DBZ-3497 Handle MySQL DATE default value parser to accept timestamp 2021-05-05 13:17:28 +02:00
Anisha Mohanty
a6b54c7000 DBZ-3427 Validate the server name field 2021-04-28 13:18:52 +02:00
Gunnar Morling
0250c64013 DBZ-3161 Formatting 2021-04-26 13:07:23 +02:00
Gunnar Morling
b225092f1a DBZ-3161 Using fallback option in legacy code path 2021-04-26 13:07:23 +02:00
Anisha Mohanty
11fb079582 DBZ-3161 Add database.history.store.only.captured.tables.ddl option & CapturedTables metrics to documentation 2021-04-26 13:07:23 +02:00
Anisha Mohanty
f0f8d5d180 DBZ-3161 Refactor/Rename all references of MonitoredTables to CapturedTables 2021-04-26 13:07:23 +02:00
Gunnar Morling
ec5746a7fe DBZ-3233 Propagating socket exceptions 2021-04-21 12:36:47 +02:00
Gunnar Morling
42a7b74725 DBZ-3403 Misc. improvements 2021-04-14 11:14:07 +02:00
Hossein Torabi
ba048cf47d DBZ-3403 Semi Optimisation on MongoDB and MySQL connector for skipped.operations 2021-04-14 11:14:07 +02:00
yangsanity
a2b4c263d3 DBZ-3238 Snapshot fails when reading TIME, DATE, DATETIME fields in mysql from ResultSet 2021-04-08 12:05:29 +02:00
Chris Egerton
67f044ff87 DBZ-3371: Adjust scale of fallback BigDecimal values to match column schema 2021-04-06 10:35:23 +02:00
Jiri Pechanec
f50c3e8222 DBZ-3361 Prefer DDL over logical schema for MySQL 2021-03-30 11:35:12 +02:00
JLDLaughlin
06b0475f17 DBZ-2911 Add additional LSN information to all sources
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00
Gunnar Morling
178140ae9c DBZ-3218 Removing superfluous method parameter 2021-03-19 15:04:20 +01:00
Anisha Mohanty
c761d92b2a DBZ-3218 Add separate method for logging warnings 2021-03-19 15:04:20 +01:00
Jiri Pechanec
495be2659b DBZ-2511 Dedicated logger for schema name adjuster 2021-03-18 14:42:34 +01:00
Jiri Pechanec
11e4880018 DBZ-3309 Revert to MySQL specific default snapshot fetch size 2021-03-18 11:08:26 +01:00