Commit Graph

1274 Commits

Author SHA1 Message Date
Vojtech Juranek
15ccdbed70 DBZ-1344 Don't warn about empty schema when using snapshot mode 'never' 2021-11-16 10:01:20 +01:00
Debezium Builder
f93e901dce [maven-release-plugin] prepare for next development iteration 2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19 [maven-release-plugin] prepare release v1.8.0.Alpha2 2021-11-11 09:21:59 +00:00
harveyyue
80e97964f1 DBZ-4261 Support all charsets in MySQL parser 2021-11-10 16:55:05 +01:00
Kate
992ae537c8 DBZ-4244 Quote signal table name in MySQL connector 2021-11-10 10:18:26 +01:00
harveyyue
a707da9645 DBZ-4246 Does Debezium support database using charset GB18030 2021-11-05 20:37:32 +01:00
harveyyue
aa3ae05e22 DBZ-4107 Incremental snapshot doesn't work without primary key 2021-11-05 13:31:26 +01:00
Gunnar Morling
1226c3b2ab DBZ-4029 Misc. clean-up;
* Exposing heartbeatInterval() on CommonConnectorConfig
* Closing heartbeat connection
* Making test more resilient
* Correct member ordering and visibility
* Doc fixes
2021-11-05 13:27:09 +01:00
ahodavdekar
91b7ef2c36 DBZ-4029 Adding support for heartbeat action queries to MySQL connector 2021-11-05 13:27:09 +01:00
Chris Cranford
9f75ece307 DBZ-4241 Add more assertions for MySqlTimestampColumnIT 2021-11-04 17:21:40 +01:00
Gunnar Morling
d1cae3f3b7 DBZ-3966 Making defaultValueExpression() return Optional<String> from editor too 2021-11-04 10:47:17 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
Gunnar Morling
6aa9b2ea96 DBZ-3966 Avoiding reference to Column::defaultValue 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Kate
a645d0bc7e DBZ-4197 Process transaction started/committed in R/O snapshot 2021-11-04 06:19:58 +01:00
harveyyue
3ced90130e DBZ-4229 CREATE PROCEDURE DDL throws ParsingException 2021-11-03 18:23:22 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4 DBZ-2975 Using Offsets in recover() contract;
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
harveyyue
62f00343b7 DBZ-4174 DDL statement couldn't be parsed 2021-11-01 09:22:09 +01:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
harveyyue
4be1674dbd DBZ-4166 Producer failure NullPointerException 2021-10-26 19:23:09 +05:30
harveyyue
3f2fe270b2 DBZ-4193 Parse the "window" keyword for agg and nonagg function in mysql8 2021-10-25 14:28:02 +02:00
Jiri Pechanec
ebc49b41c2 DBZ-4000 Fix typo in test name 2021-10-20 15:19:31 +02:00
harveyyue
90e9bea93f DBZ-4000 Support parse table and columns comment 2021-10-20 15:19:31 +02:00
Hossein Torabi
6027d762a6 DBZ-4150 Trim numerical defaultValue before converting postgres-connector 2021-10-19 12:27:26 +02:00
Chris Cranford
fef29f1093
DBZ-4032 Treat empty TIMESTAMP blob value as null 2021-10-19 09:39:27 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Hossein Torabi
aa2d8539f9 DBZ-3989 Trim numerical default values before parsing 2021-10-12 15:29:31 +02:00
Jiri Pechanec
aec2080415 DBZ-3895 Config returns Patterns not Strings 2021-10-11 10:57:33 +02:00
Jiri Pechanec
68f148c3f3 DBZ-3895 Make snapshot collection list matching case insensitive 2021-10-11 10:57:33 +02:00
Anisha Mohanty
52f9669807 DBZ-4005 Remove hard-coded version of MySQL example image 2021-10-06 09:22:12 +02:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00
Debezium Builder
bec0b6b67e [maven-release-plugin] prepare for next development iteration 2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725 [maven-release-plugin] prepare release v1.7.0.CR2 2021-09-23 06:31:25 +00:00
Kate
0099a50c53 DBZ-3948 Support kafka topic based signals 2021-09-22 13:08:45 +02:00
Vivek Wassan
b6e891ec7d DBZ-3951 Moving preReadChunk() to AbstractIncrementalSnapshotChangeEventSource 2021-09-22 07:01:29 +02:00
Vivek Wassan
65ac2387dc DBZ-3951 Adding a separate isValid method 2021-09-22 07:01:29 +02:00
Vivek Wassan
3f6c632296 DBZ-3951 Review comment: Changing Exception message 2021-09-22 07:01:29 +02:00
Vivek Wassan
5f37e6630f DBZ-3951 Adding a safety check, isValid, for connection 2021-09-22 07:01:29 +02:00
Debezium Builder
c15e0b303b [maven-release-plugin] prepare for next development iteration 2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121 [maven-release-plugin] prepare release v1.7.0.CR1 2021-09-16 08:10:44 +00:00
Anisha Mohanty
f57545d7b1 DBZ-3787 Add tests for invisible & visible columns using testcontainers
*Using user "debezium" to have right grants provided
2021-09-15 15:13:18 +02:00
harveyyue
97cb997be3 DBZ-3984 Mysql-Connector fails parsing invalid decimal format DDL statement 2021-09-13 13:55:49 +02:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Gunnar Morling
6f1577a70b DBZ-3958 Gracefully handling history file in sym-linked directory;
Also removing redundant test method definition.
2021-09-09 12:18:21 +02:00
camilesing
f2021330cb DBZ-3976 fix MySqlValueConvertes.java typo 2021-09-08 09:54:50 +02:00
jiabao.sun
96c2d33c83 DBZ-3969 Strings with binary collation shouldn't be parsed as Types.BINARY 2021-09-06 12:12:41 +02:00
Kate
390a331ecb DBZ-3947 Fix empty high watermark check 2021-09-06 10:53:33 +02:00
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Gunnar Morling
aea2827016 DBZ-2525 Removing unused methods 2021-08-30 12:20:55 +02:00
Jiri Pechanec
a36eb45dff
DBZ-3912 Added Binary padding for hex/base64 handling mode
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-08-27 09:48:19 +02:00
Debezium Builder
2ce6bcb2ab [maven-release-plugin] prepare for next development iteration 2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423 [maven-release-plugin] prepare release v1.7.0.Beta1 2021-08-25 05:20:56 -04:00
rkerner
52333596de DBZ-3364 add additional metadata to fields for API spec generator for the Debezium UI
part of https://issues.redhat.com/browse/DBZ-3364
DBZ-2653 User rollback from parent class
2021-08-23 17:57:38 +02:00
Jiri Pechanec
934c078e30 DBZ-3833 Misc. clean-up 2021-08-16 13:43:51 +02:00
Jiri Pechanec
ad1fb98fe7 DBZ-3833 Skip legacy test failures 2021-08-16 13:43:51 +02:00
Jiri Pechanec
f173def3b2 DBZ-3833 Receive timezoned data in server timezone 2021-08-16 13:43:51 +02:00
Erik Malm
f53ab40ddb DBZ-3833 Updated mysql-connector-java dependency to 8.0.26
Updated charset extraction method to use new static accessor methods, rather than direct field access.

MySqlValueConverters.java: Added wrapper class to access Java charset mappings in mysql-connector-java class.
2021-08-16 13:43:51 +02:00
Jiri Pechanec
99d5748584 DBZ-3869 Stop connector only after error was recorded 2021-08-13 21:26:07 +02:00
Chris Cranford
7b2cdf9235 DBZ-3773 Add logging about each column value 2021-08-13 06:08:15 +02:00
Chris Cranford
3182af55da DBZ-3773 Treat empty TIME blob value as null 2021-08-13 06:08:15 +02:00
Chris Cranford
e74b1c4999 DBZ-3838 Suggested changes 2021-08-11 23:57:09 +02:00
Chris Cranford
060420b0bc DBZ-3838 Do not reset trx isolation when using minimal_percona 2021-08-11 23:57:09 +02:00
Chris Cranford
c15cf81e18 DBZ-3839 Correctly skip tests with minor/patch not specified 2021-08-11 07:35:57 +02:00
Sergei Morozov
a40ad7132d DBZ-2975: Remove partition from offset context 2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12 DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets 2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52 DBZ-2975: Move Partition to io.debezium.pipeline.spi 2021-08-11 07:34:37 +02:00
pkgonan
5e0ffa28d2 DBZ-3765 Allow dot in database.server.name 2021-08-08 16:25:15 -04:00
Debezium Builder
d3c4482d06 [maven-release-plugin] prepare for next development iteration 2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426 [maven-release-plugin] prepare release v1.7.0.Alpha1 2021-07-30 02:39:08 -04:00
Kate
c6e530cc27 DBZ-3577 Skip read-only test when gtid mode is off 2021-07-29 07:10:46 +02:00
Kate
6a30ad3811 DBZ-3577 Fix race condition in shouldFailOnSchemaInconsistency test 2021-07-29 07:10:46 +02:00
Kate
9b66ab374a DBZ-3577 Support read-only MySQL incremental snapshots 2021-07-29 07:10:46 +02:00
Chris Cranford
add76ae008 DBZ-3717 Fix formatting 2021-07-22 14:12:38 -04:00
Chris Cranford
c3684539c3 DBZ-3717 Add test case 2021-07-22 14:12:38 -04:00
Chris Cranford
ed31ea9ffb DBZ-3668 Adjust ServiceLoader for SPI change 2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d DBZ-3668 Extracting SPI package 2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110 DBZ-3668 Add ServiceLoader hook CloudEvents converter 2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba DBZ-2975: Add partition awareness to source task components
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Debezium Builder
9d3f6b2a86 [maven-release-plugin] prepare for next development iteration 2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56 [maven-release-plugin] prepare release v1.6.0.Final 2021-06-30 03:45:06 -04:00
Jiri Pechanec
472b82abb7 DBZ-3622 Decouple database and schema history record writes 2021-06-29 10:36:41 +02:00
Jiri Pechanec
443c0ce089 DBZ-3622 Fix non-captured database storing; make the code more robust 2021-06-29 10:36:41 +02:00
Debezium Builder
ae053414ac [maven-release-plugin] prepare for next development iteration 2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74 [maven-release-plugin] prepare release v1.6.0.CR1 2021-06-24 01:50:07 -04:00
camile.sing
b05ac5549e DBZ-3638 Modify Mysql SourceInfo to be public 2021-06-17 16:16:05 +02:00
Sergei Morozov
b36e8247a3 DBZ-3615: Keep database connection closed during schema recovery 2021-06-15 11:27:44 +02:00
Debezium Builder
48ca58a609 [maven-release-plugin] prepare for next development iteration 2021-06-10 06:03:12 -04:00
Debezium Builder
0961517859 [maven-release-plugin] prepare release v1.6.0.Beta2 2021-06-10 06:03:12 -04:00
Gunnar Morling
1ce65fa628 DBZ-2975 Avoiding raw types in some places;
Also parameterizing offset loader contract, so to avoid casts later on.
2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542 DBZ-2975: Extract offset context from object states to method signatures 2021-06-09 16:02:33 +02:00
Jiri Pechanec
7afcd1bdc6 DBZ-3559 Support MySQL JSON functions 2021-05-31 09:49:56 +02:00
Sergei Morozov
213d9ffdcc DBZ-3562: Revert test changes from DBZ-3427 2021-05-27 11:03:30 +02:00
Sergei Morozov
3b72e5149c DBZ-3486: Replace @see with @link where a URL is referenced 2021-05-25 07:19:43 +02:00
Debezium Builder
ead4ee7226 [maven-release-plugin] prepare for next development iteration 2021-05-20 19:07:44 +02:00
Debezium Builder
9e16df7d4b [maven-release-plugin] prepare release v1.6.0.Beta1 2021-05-20 19:07:44 +02:00
Jiri Pechanec
4929397022 DBZ-3500 Per-connector table name quoting 2021-05-20 08:06:37 +02:00
Jiri Pechanec
a626dc149f DBZ-3500 Provide common test for incremental snapshot testing 2021-05-20 08:06:37 +02:00
Jiri Pechanec
5486cf3cf9 DBZ-3399 Add asserts for DDLs 2021-05-18 10:26:10 +02:00
Jiri Pechanec
0dc25a6846 DBZ-3399 Store full RENAME TABLE in history 2021-05-18 10:26:10 +02:00
Jiri Pechanec
367746fcc9 DBZ-3485 Emit quoted DROP TABLE 2021-05-18 10:26:10 +02:00
Jiri Pechanec
4df0d93b4d DBZ-2300 Make too many connections retriable 2021-05-13 08:07:38 -04:00
John Martin
cef0997428 DBZ-3508 return empty ConfigDef for ReadToInsertEvent.config 2021-05-11 05:59:33 +02:00
Debezium Builder
4dd3a146ca [maven-release-plugin] prepare for next development iteration 2021-05-06 02:40:15 -04:00
Debezium Builder
b3c5bb281c [maven-release-plugin] prepare release v1.6.0.Alpha1 2021-05-06 02:40:15 -04:00
Jiri Pechanec
b4327ab13a DBZ-3499 Moved test statements to examples 2021-05-06 06:14:24 +02:00
Tommy Karlsson
f9028926f8 DBZ-3499 Add support for parsing of GRANT statements with newer MySQL privileges 2021-05-06 06:14:24 +02:00
Jiri Pechanec
5c722341e2 DBZ-3473 Extract incremental snapshot contract 2021-05-06 05:37:36 +02:00
Jiri Pechanec
39d21806eb DBZ-3473 Metrics enabled 2021-05-06 05:37:36 +02:00
Jiri Pechanec
3d940ca14a DBZ-3473 Support for cursor-based fetching 2021-05-06 05:37:36 +02:00
Jiri Pechanec
c53785dde7 DBZ-3473 Incremental Snapshot support for MySQL 2021-05-06 05:37:36 +02:00
Jiri Pechanec
7415dc91de DBZ-3497 Rename the variable 2021-05-05 13:17:28 +02:00
Anisha Mohanty
5156ea0d16 DBZ-3497 Handle MySQL DATE default value parser to accept timestamp 2021-05-05 13:17:28 +02:00
Gunnar Morling
dc02b896cd DBZ-3449 Moving QA releated plug-ins to separate profile, so to avoid loading them at all 2021-04-28 15:14:05 +02:00
Anisha Mohanty
a6b54c7000 DBZ-3427 Validate the server name field 2021-04-28 13:18:52 +02:00
Gunnar Morling
0250c64013 DBZ-3161 Formatting 2021-04-26 13:07:23 +02:00
Gunnar Morling
b225092f1a DBZ-3161 Using fallback option in legacy code path 2021-04-26 13:07:23 +02:00
Anisha Mohanty
11fb079582 DBZ-3161 Add database.history.store.only.captured.tables.ddl option & CapturedTables metrics to documentation 2021-04-26 13:07:23 +02:00
Anisha Mohanty
f0f8d5d180 DBZ-3161 Refactor/Rename all references of MonitoredTables to CapturedTables 2021-04-26 13:07:23 +02:00
Gunnar Morling
2088c035b1 DBZ-3449 Adding "quick" profile 2021-04-26 06:09:14 +02:00
Gunnar Morling
ec5746a7fe DBZ-3233 Propagating socket exceptions 2021-04-21 12:36:47 +02:00
Gunnar Morling
42a7b74725 DBZ-3403 Misc. improvements 2021-04-14 11:14:07 +02:00
Hossein Torabi
ba048cf47d DBZ-3403 Semi Optimisation on MongoDB and MySQL connector for skipped.operations 2021-04-14 11:14:07 +02:00
yangsanity
a2b4c263d3 DBZ-3238 Snapshot fails when reading TIME, DATE, DATETIME fields in mysql from ResultSet 2021-04-08 12:05:29 +02:00
Debezium Builder
8a88ba9b45 [maven-release-plugin] prepare for next development iteration 2021-04-08 04:04:00 -04:00
Debezium Builder
74152afe74 [maven-release-plugin] prepare release v1.5.0.Final 2021-04-08 04:04:00 -04:00
Chris Egerton
67f044ff87 DBZ-3371: Adjust scale of fallback BigDecimal values to match column schema 2021-04-06 10:35:23 +02:00
Jiri Pechanec
f50c3e8222 DBZ-3361 Prefer DDL over logical schema for MySQL 2021-03-30 11:35:12 +02:00
JLDLaughlin
06b0475f17 DBZ-2911 Add additional LSN information to all sources
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00
Debezium Builder
6b4d88bb51 [maven-release-plugin] prepare for next development iteration 2021-03-24 06:35:02 -04:00
Debezium Builder
c578715233 [maven-release-plugin] prepare release v1.5.0.CR1 2021-03-24 06:35:02 -04:00
Gunnar Morling
178140ae9c DBZ-3218 Removing superfluous method parameter 2021-03-19 15:04:20 +01:00
Anisha Mohanty
c761d92b2a DBZ-3218 Add separate method for logging warnings 2021-03-19 15:04:20 +01:00
Jiri Pechanec
495be2659b DBZ-2511 Dedicated logger for schema name adjuster 2021-03-18 14:42:34 +01:00
Jiri Pechanec
11e4880018 DBZ-3309 Revert to MySQL specific default snapshot fetch size 2021-03-18 11:08:26 +01:00
Gunnar Morling
647076ea69 DBZ-2957 Misc. fixes;
* Simplifying reg exp
* Adding leniency towards whitespace
* Reporting *all* problems including correct count
* Fixing incorrect actual/expected order
2021-03-17 14:04:16 +01:00
Anisha Mohanty
2e5a5ce001 DBZ-2957 Handle message.key.columns regex validation time complexity 2021-03-17 14:04:16 +01:00
Jiri Pechanec
f5475cf7c5 DBZ-3304 Fix intermittent test failure 2021-03-17 11:43:01 +01:00
Gunnar Morling
911b5e9a3b DBZ-3271 Unifying filter handling across relational connectors 2021-03-17 09:54:25 +01:00
Jiri Pechanec
f2eb868cde DBZ-2145 Provide Debezium BOM 2021-03-17 07:54:12 +01:00
Debezium Builder
f57057421b [maven-release-plugin] prepare for next development iteration 2021-03-12 04:38:17 -05:00
Debezium Builder
b57293013a [maven-release-plugin] prepare release v1.5.0.Beta2 2021-03-12 04:38:16 -05:00
Jiri Pechanec
123d9ef4eb DBZ-3213 Refactor Maven structure to deploy support modules 2021-03-11 16:14:15 +01:00
Debezium Builder
b4c260da50 [maven-release-plugin] prepare for next development iteration 2021-02-23 14:04:01 -05:00
Debezium Builder
123a711a6d [maven-release-plugin] prepare release v1.5.0.Beta1 2021-02-23 14:04:01 -05:00
ani-sha
c39192e9f2 DBZ-3067 Add OR REPLACE condition for create index 2021-02-23 08:54:28 +01:00
Fahim Farook
194258d87b
DBZ-3164 Log database connection validation failures consistently 2021-02-22 14:52:22 +01:00