Commit Graph

1396 Commits

Author SHA1 Message Date
Hossein Torabi
aa2d8539f9 DBZ-3989 Trim numerical default values before parsing 2021-10-12 15:29:31 +02:00
Jiri Pechanec
aec2080415 DBZ-3895 Config returns Patterns not Strings 2021-10-11 10:57:33 +02:00
Jiri Pechanec
68f148c3f3 DBZ-3895 Make snapshot collection list matching case insensitive 2021-10-11 10:57:33 +02:00
Anisha Mohanty
52f9669807 DBZ-4005 Remove hard-coded version of MySQL example image 2021-10-06 09:22:12 +02:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00
Debezium Builder
bec0b6b67e [maven-release-plugin] prepare for next development iteration 2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725 [maven-release-plugin] prepare release v1.7.0.CR2 2021-09-23 06:31:25 +00:00
Kate
0099a50c53 DBZ-3948 Support kafka topic based signals 2021-09-22 13:08:45 +02:00
Vivek Wassan
b6e891ec7d DBZ-3951 Moving preReadChunk() to AbstractIncrementalSnapshotChangeEventSource 2021-09-22 07:01:29 +02:00
Vivek Wassan
65ac2387dc DBZ-3951 Adding a separate isValid method 2021-09-22 07:01:29 +02:00
Vivek Wassan
3f6c632296 DBZ-3951 Review comment: Changing Exception message 2021-09-22 07:01:29 +02:00
Vivek Wassan
5f37e6630f DBZ-3951 Adding a safety check, isValid, for connection 2021-09-22 07:01:29 +02:00
Debezium Builder
c15e0b303b [maven-release-plugin] prepare for next development iteration 2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121 [maven-release-plugin] prepare release v1.7.0.CR1 2021-09-16 08:10:44 +00:00
Anisha Mohanty
f57545d7b1 DBZ-3787 Add tests for invisible & visible columns using testcontainers
*Using user "debezium" to have right grants provided
2021-09-15 15:13:18 +02:00
harveyyue
97cb997be3 DBZ-3984 Mysql-Connector fails parsing invalid decimal format DDL statement 2021-09-13 13:55:49 +02:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Gunnar Morling
6f1577a70b DBZ-3958 Gracefully handling history file in sym-linked directory;
Also removing redundant test method definition.
2021-09-09 12:18:21 +02:00
camilesing
f2021330cb DBZ-3976 fix MySqlValueConvertes.java typo 2021-09-08 09:54:50 +02:00
jiabao.sun
96c2d33c83 DBZ-3969 Strings with binary collation shouldn't be parsed as Types.BINARY 2021-09-06 12:12:41 +02:00
Kate
390a331ecb DBZ-3947 Fix empty high watermark check 2021-09-06 10:53:33 +02:00
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Gunnar Morling
aea2827016 DBZ-2525 Removing unused methods 2021-08-30 12:20:55 +02:00
Jiri Pechanec
a36eb45dff
DBZ-3912 Added Binary padding for hex/base64 handling mode
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-08-27 09:48:19 +02:00
Debezium Builder
2ce6bcb2ab [maven-release-plugin] prepare for next development iteration 2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423 [maven-release-plugin] prepare release v1.7.0.Beta1 2021-08-25 05:20:56 -04:00
rkerner
52333596de DBZ-3364 add additional metadata to fields for API spec generator for the Debezium UI
part of https://issues.redhat.com/browse/DBZ-3364
DBZ-2653 User rollback from parent class
2021-08-23 17:57:38 +02:00
Jiri Pechanec
934c078e30 DBZ-3833 Misc. clean-up 2021-08-16 13:43:51 +02:00
Jiri Pechanec
ad1fb98fe7 DBZ-3833 Skip legacy test failures 2021-08-16 13:43:51 +02:00
Jiri Pechanec
f173def3b2 DBZ-3833 Receive timezoned data in server timezone 2021-08-16 13:43:51 +02:00
Erik Malm
f53ab40ddb DBZ-3833 Updated mysql-connector-java dependency to 8.0.26
Updated charset extraction method to use new static accessor methods, rather than direct field access.

MySqlValueConverters.java: Added wrapper class to access Java charset mappings in mysql-connector-java class.
2021-08-16 13:43:51 +02:00
Jiri Pechanec
99d5748584 DBZ-3869 Stop connector only after error was recorded 2021-08-13 21:26:07 +02:00
Chris Cranford
7b2cdf9235 DBZ-3773 Add logging about each column value 2021-08-13 06:08:15 +02:00
Chris Cranford
3182af55da DBZ-3773 Treat empty TIME blob value as null 2021-08-13 06:08:15 +02:00
Chris Cranford
e74b1c4999 DBZ-3838 Suggested changes 2021-08-11 23:57:09 +02:00
Chris Cranford
060420b0bc DBZ-3838 Do not reset trx isolation when using minimal_percona 2021-08-11 23:57:09 +02:00
Chris Cranford
c15cf81e18 DBZ-3839 Correctly skip tests with minor/patch not specified 2021-08-11 07:35:57 +02:00
Sergei Morozov
a40ad7132d DBZ-2975: Remove partition from offset context 2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12 DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets 2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52 DBZ-2975: Move Partition to io.debezium.pipeline.spi 2021-08-11 07:34:37 +02:00
pkgonan
5e0ffa28d2 DBZ-3765 Allow dot in database.server.name 2021-08-08 16:25:15 -04:00
Debezium Builder
d3c4482d06 [maven-release-plugin] prepare for next development iteration 2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426 [maven-release-plugin] prepare release v1.7.0.Alpha1 2021-07-30 02:39:08 -04:00
Kate
c6e530cc27 DBZ-3577 Skip read-only test when gtid mode is off 2021-07-29 07:10:46 +02:00
Kate
6a30ad3811 DBZ-3577 Fix race condition in shouldFailOnSchemaInconsistency test 2021-07-29 07:10:46 +02:00
Kate
9b66ab374a DBZ-3577 Support read-only MySQL incremental snapshots 2021-07-29 07:10:46 +02:00
Chris Cranford
add76ae008 DBZ-3717 Fix formatting 2021-07-22 14:12:38 -04:00
Chris Cranford
c3684539c3 DBZ-3717 Add test case 2021-07-22 14:12:38 -04:00
Chris Cranford
ed31ea9ffb DBZ-3668 Adjust ServiceLoader for SPI change 2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d DBZ-3668 Extracting SPI package 2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110 DBZ-3668 Add ServiceLoader hook CloudEvents converter 2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba DBZ-2975: Add partition awareness to source task components
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Debezium Builder
9d3f6b2a86 [maven-release-plugin] prepare for next development iteration 2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56 [maven-release-plugin] prepare release v1.6.0.Final 2021-06-30 03:45:06 -04:00
Jiri Pechanec
472b82abb7 DBZ-3622 Decouple database and schema history record writes 2021-06-29 10:36:41 +02:00
Jiri Pechanec
443c0ce089 DBZ-3622 Fix non-captured database storing; make the code more robust 2021-06-29 10:36:41 +02:00
Debezium Builder
ae053414ac [maven-release-plugin] prepare for next development iteration 2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74 [maven-release-plugin] prepare release v1.6.0.CR1 2021-06-24 01:50:07 -04:00
camile.sing
b05ac5549e DBZ-3638 Modify Mysql SourceInfo to be public 2021-06-17 16:16:05 +02:00
Sergei Morozov
b36e8247a3 DBZ-3615: Keep database connection closed during schema recovery 2021-06-15 11:27:44 +02:00
Debezium Builder
48ca58a609 [maven-release-plugin] prepare for next development iteration 2021-06-10 06:03:12 -04:00
Debezium Builder
0961517859 [maven-release-plugin] prepare release v1.6.0.Beta2 2021-06-10 06:03:12 -04:00
Gunnar Morling
1ce65fa628 DBZ-2975 Avoiding raw types in some places;
Also parameterizing offset loader contract, so to avoid casts later on.
2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542 DBZ-2975: Extract offset context from object states to method signatures 2021-06-09 16:02:33 +02:00
Jiri Pechanec
7afcd1bdc6 DBZ-3559 Support MySQL JSON functions 2021-05-31 09:49:56 +02:00
Sergei Morozov
213d9ffdcc DBZ-3562: Revert test changes from DBZ-3427 2021-05-27 11:03:30 +02:00
Sergei Morozov
3b72e5149c DBZ-3486: Replace @see with @link where a URL is referenced 2021-05-25 07:19:43 +02:00
Debezium Builder
ead4ee7226 [maven-release-plugin] prepare for next development iteration 2021-05-20 19:07:44 +02:00
Debezium Builder
9e16df7d4b [maven-release-plugin] prepare release v1.6.0.Beta1 2021-05-20 19:07:44 +02:00
Jiri Pechanec
4929397022 DBZ-3500 Per-connector table name quoting 2021-05-20 08:06:37 +02:00
Jiri Pechanec
a626dc149f DBZ-3500 Provide common test for incremental snapshot testing 2021-05-20 08:06:37 +02:00
Jiri Pechanec
5486cf3cf9 DBZ-3399 Add asserts for DDLs 2021-05-18 10:26:10 +02:00
Jiri Pechanec
0dc25a6846 DBZ-3399 Store full RENAME TABLE in history 2021-05-18 10:26:10 +02:00
Jiri Pechanec
367746fcc9 DBZ-3485 Emit quoted DROP TABLE 2021-05-18 10:26:10 +02:00
Jiri Pechanec
4df0d93b4d DBZ-2300 Make too many connections retriable 2021-05-13 08:07:38 -04:00
John Martin
cef0997428 DBZ-3508 return empty ConfigDef for ReadToInsertEvent.config 2021-05-11 05:59:33 +02:00
Debezium Builder
4dd3a146ca [maven-release-plugin] prepare for next development iteration 2021-05-06 02:40:15 -04:00
Debezium Builder
b3c5bb281c [maven-release-plugin] prepare release v1.6.0.Alpha1 2021-05-06 02:40:15 -04:00
Jiri Pechanec
b4327ab13a DBZ-3499 Moved test statements to examples 2021-05-06 06:14:24 +02:00
Tommy Karlsson
f9028926f8 DBZ-3499 Add support for parsing of GRANT statements with newer MySQL privileges 2021-05-06 06:14:24 +02:00
Jiri Pechanec
5c722341e2 DBZ-3473 Extract incremental snapshot contract 2021-05-06 05:37:36 +02:00
Jiri Pechanec
39d21806eb DBZ-3473 Metrics enabled 2021-05-06 05:37:36 +02:00
Jiri Pechanec
3d940ca14a DBZ-3473 Support for cursor-based fetching 2021-05-06 05:37:36 +02:00
Jiri Pechanec
c53785dde7 DBZ-3473 Incremental Snapshot support for MySQL 2021-05-06 05:37:36 +02:00
Jiri Pechanec
7415dc91de DBZ-3497 Rename the variable 2021-05-05 13:17:28 +02:00
Anisha Mohanty
5156ea0d16 DBZ-3497 Handle MySQL DATE default value parser to accept timestamp 2021-05-05 13:17:28 +02:00
Gunnar Morling
dc02b896cd DBZ-3449 Moving QA releated plug-ins to separate profile, so to avoid loading them at all 2021-04-28 15:14:05 +02:00
Anisha Mohanty
a6b54c7000 DBZ-3427 Validate the server name field 2021-04-28 13:18:52 +02:00
Gunnar Morling
0250c64013 DBZ-3161 Formatting 2021-04-26 13:07:23 +02:00
Gunnar Morling
b225092f1a DBZ-3161 Using fallback option in legacy code path 2021-04-26 13:07:23 +02:00
Anisha Mohanty
11fb079582 DBZ-3161 Add database.history.store.only.captured.tables.ddl option & CapturedTables metrics to documentation 2021-04-26 13:07:23 +02:00
Anisha Mohanty
f0f8d5d180 DBZ-3161 Refactor/Rename all references of MonitoredTables to CapturedTables 2021-04-26 13:07:23 +02:00
Gunnar Morling
2088c035b1 DBZ-3449 Adding "quick" profile 2021-04-26 06:09:14 +02:00
Gunnar Morling
ec5746a7fe DBZ-3233 Propagating socket exceptions 2021-04-21 12:36:47 +02:00
Gunnar Morling
42a7b74725 DBZ-3403 Misc. improvements 2021-04-14 11:14:07 +02:00
Hossein Torabi
ba048cf47d DBZ-3403 Semi Optimisation on MongoDB and MySQL connector for skipped.operations 2021-04-14 11:14:07 +02:00
yangsanity
a2b4c263d3 DBZ-3238 Snapshot fails when reading TIME, DATE, DATETIME fields in mysql from ResultSet 2021-04-08 12:05:29 +02:00
Debezium Builder
8a88ba9b45 [maven-release-plugin] prepare for next development iteration 2021-04-08 04:04:00 -04:00
Debezium Builder
74152afe74 [maven-release-plugin] prepare release v1.5.0.Final 2021-04-08 04:04:00 -04:00
Chris Egerton
67f044ff87 DBZ-3371: Adjust scale of fallback BigDecimal values to match column schema 2021-04-06 10:35:23 +02:00
Jiri Pechanec
f50c3e8222 DBZ-3361 Prefer DDL over logical schema for MySQL 2021-03-30 11:35:12 +02:00
JLDLaughlin
06b0475f17 DBZ-2911 Add additional LSN information to all sources
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00
Debezium Builder
6b4d88bb51 [maven-release-plugin] prepare for next development iteration 2021-03-24 06:35:02 -04:00
Debezium Builder
c578715233 [maven-release-plugin] prepare release v1.5.0.CR1 2021-03-24 06:35:02 -04:00
Gunnar Morling
178140ae9c DBZ-3218 Removing superfluous method parameter 2021-03-19 15:04:20 +01:00
Anisha Mohanty
c761d92b2a DBZ-3218 Add separate method for logging warnings 2021-03-19 15:04:20 +01:00
Jiri Pechanec
495be2659b DBZ-2511 Dedicated logger for schema name adjuster 2021-03-18 14:42:34 +01:00
Jiri Pechanec
11e4880018 DBZ-3309 Revert to MySQL specific default snapshot fetch size 2021-03-18 11:08:26 +01:00
Gunnar Morling
647076ea69 DBZ-2957 Misc. fixes;
* Simplifying reg exp
* Adding leniency towards whitespace
* Reporting *all* problems including correct count
* Fixing incorrect actual/expected order
2021-03-17 14:04:16 +01:00
Anisha Mohanty
2e5a5ce001 DBZ-2957 Handle message.key.columns regex validation time complexity 2021-03-17 14:04:16 +01:00
Jiri Pechanec
f5475cf7c5 DBZ-3304 Fix intermittent test failure 2021-03-17 11:43:01 +01:00
Gunnar Morling
911b5e9a3b DBZ-3271 Unifying filter handling across relational connectors 2021-03-17 09:54:25 +01:00
Jiri Pechanec
f2eb868cde DBZ-2145 Provide Debezium BOM 2021-03-17 07:54:12 +01:00
Debezium Builder
f57057421b [maven-release-plugin] prepare for next development iteration 2021-03-12 04:38:17 -05:00
Debezium Builder
b57293013a [maven-release-plugin] prepare release v1.5.0.Beta2 2021-03-12 04:38:16 -05:00
Jiri Pechanec
123d9ef4eb DBZ-3213 Refactor Maven structure to deploy support modules 2021-03-11 16:14:15 +01:00
Debezium Builder
b4c260da50 [maven-release-plugin] prepare for next development iteration 2021-02-23 14:04:01 -05:00
Debezium Builder
123a711a6d [maven-release-plugin] prepare release v1.5.0.Beta1 2021-02-23 14:04:01 -05:00
ani-sha
c39192e9f2 DBZ-3067 Add OR REPLACE condition for create index 2021-02-23 08:54:28 +01:00
Fahim Farook
194258d87b
DBZ-3164 Log database connection validation failures consistently 2021-02-22 14:52:22 +01:00
Gunnar Morling
e024fc60ab DBZ-3095 Propagating socket exceptions 2021-02-19 10:30:41 +01:00
Gunnar Morling
edcc3a041f DBZ-3147 Renaming test connection class 2021-02-19 09:16:31 +01:00
Nitin Agarwal
62f51e8b29 DBZ-3114: addressing review comments 2021-02-18 12:41:34 +01:00
Jiri Pechanec
737d2353a6 DBZ-3114 Test more resilient for repeted runs and testsuite execution 2021-02-18 12:41:34 +01:00
Jiri Pechanec
decb4ec3da DBZ-3114 Tests only for new implementation 2021-02-18 12:41:34 +01:00
Nitin Agarwal
fd1ceeb02e DBZ-3114 Transaction metadata feature in MySQL connector 2021-02-18 12:41:34 +01:00
ani-sha
b6c61ac810 DBZ-2788 Replace MySQL connector option with SMT for mitigating wrong op flag 2021-02-18 12:35:03 +01:00
Gunnar Morling
184d1a2399 DBZ-3056 Misc. clean-up 2021-02-16 12:45:09 +01:00
Yilong Chang
a0b3704832 DBZ-3056 Validate all fields in subclasses. 2021-02-16 12:34:06 +01:00
Yilong Chang
76c7e0d426 DBZ-3056 Extract basic valdiation in parent class. 2021-02-16 12:34:06 +01:00
Gunnar Morling
cb2b2fc07a DBZ-3099 Doc fix 2021-02-16 10:11:23 +01:00
Jiri Pechanec
1c9f7a1c1c DBZ-3099 Document non-volatile fields accessed by a single thread 2021-02-16 10:02:17 +01:00
Jiri Pechanec
745bb6c11d DBZ-3099 Address review comments; extract history comparator for testability 2021-02-16 10:02:17 +01:00
Jiri Pechanec
cb1476ce18 DBZ-3099 Address review comments 2021-02-16 10:02:17 +01:00
Gunnar Morling
5ca1d9fc4f DBZ-3099 Preferring explicit functional interface over Function 2021-02-16 10:02:17 +01:00
Jiri Pechanec
2af13af300 DBZ-3099 Streaming source test for new impl only 2021-02-16 10:02:17 +01:00
Jiri Pechanec
c53082f94f DBZ-3099 Fix typos 2021-02-16 10:02:17 +01:00
Jiri Pechanec
b0f906df35 DBZ-3099 Race condition in waiting for metrics 2021-02-16 10:02:17 +01:00
Jiri Pechanec
21b15facb2 DBZ-3099 Snapshot buffering to handle config corner cases 2021-02-16 10:02:17 +01:00
Jiri Pechanec
7394ecfd62 DBZ-3099 Make streaming MBean name configurable in tests 2021-02-16 10:02:17 +01:00
Jiri Pechanec
048530aeb8 DBZ-3099 Make metrics tests running with legacy 2021-02-16 10:02:17 +01:00
Jiri Pechanec
ea247b710d DBZ-3099 Rewritten reader tests to connector 2021-02-16 10:02:17 +01:00
Jiri Pechanec
6a9ca7d544 DBZ-3099 Fix schema recovery; Add table level locking 2021-02-16 10:02:17 +01:00
Jiri Pechanec
08e4988c72 DBZ-3093 Unify snapshot and streaming parsing 2021-02-16 10:02:17 +01:00
Jiri Pechanec
7bfbd5c7c5 DBZ-3093 Dispatch schema change events always 2021-02-16 10:02:17 +01:00
Jiri Pechanec
6607310f13 DBZ-3093 Separate parsing and change applying phase in MySQL schema 2021-02-16 10:02:17 +01:00
Jiri Pechanec
5bf5e18d81 DBZ-3086 Legacy source info make for legacy tests 2021-02-16 10:02:16 +01:00
Jiri Pechanec
f01af4bec8 DBZ-3086 Source info formatting for legacy implementation 2021-02-16 10:02:16 +01:00
Jiri Pechanec
14a628ed60 DBZ-3086 Mark moved method as deprecated 2021-02-16 10:02:16 +01:00
Jiri Pechanec
a43bae7638 DBZ-3086 Separate offset and source info 2021-02-16 10:02:16 +01:00
Jiri Pechanec
e9ed4a0a2a DBZ-3086 Remove parallel snapshot reader offsets 2021-02-16 10:02:16 +01:00
Jiri Pechanec
488464419e DBZ-3086 Separate legacy and new SourceInfo 2021-02-16 10:02:16 +01:00
Jiri Pechanec
1d86d7068f DBZ-3077 Unified record creation 2021-02-16 10:02:16 +01:00
ani-sha
5f8a22a5df DBZ-2858 Make field descriptions consistent for time values 2021-02-16 09:55:35 +01:00
Debezium Builder
e08df0a177 [maven-release-plugin] prepare for next development iteration 2021-02-06 01:25:23 -05:00
Debezium Builder
da0411bf70 [maven-release-plugin] prepare release v1.5.0.Alpha1 2021-02-06 01:25:23 -05:00
Jiri Pechanec
f63d08fc28 DBZ-3023 Handle default charsets for table 2021-02-05 05:44:14 +01:00
Jiri Pechanec
ed7a1c2486 DBZ-3047 Run the test after legacy package 2021-02-05 05:44:06 +01:00
Jiri Pechanec
c9fd39d04c DBZ-1865 Support for when_needed snapshot 2021-02-04 09:07:55 +01:00
Jiri Pechanec
f57343dc3b DBZ-1865 Use OptionaLong; add comments 2021-02-04 09:07:55 +01:00
Jiri Pechanec
2374b6b045 DBZ-1865 First draft of MySQL rewrite 2021-02-04 09:07:55 +01:00
Jiri Pechanec
23c1546362 DBZ-1865 Modify metrics to conform to new classes 2021-02-04 09:07:55 +01:00
Jiri Pechanec
d333c9f005 DBZ-1865 Move legacy classes into separate package 2021-02-04 09:07:55 +01:00
Jiri Pechanec
5e887b2bfb DBZ-3020 Ignore expressions in default values 2021-02-03 10:12:09 +01:00
ani-sha
d4003c9172 DBZ-2420 Define database configs under RelationalDatabaseConnectorConfig 2021-02-03 08:05:42 +01:00
rkerner
89cc1d7003 DBZ-3008 Fix that an invalid regex for database.inlcude.list and database.exlcude.list does not raise a validation error for MySQL connector and the connector only fails on start, also the config validated before
closes https://issues.redhat.com/browse/DBZ-3008
2021-02-01 18:38:54 +01:00
Debezium Builder
237b4ac0f1 [maven-release-plugin] prepare for next development iteration 2021-01-28 07:38:55 -05:00
Debezium Builder
06b1d0cbad [maven-release-plugin] prepare release v1.4.1.Final 2021-01-28 07:38:55 -05:00
Jiri Pechanec
5092f327d8 DBZ-2922 DatabaseLocales generates the DDL 2021-01-27 10:40:21 +01:00
Jiri Pechanec
8153404033 DBZ-2922 Support for cahrsets from collations 2021-01-27 10:40:21 +01:00
shuguang.xiang
363c794185 DBZ-2922 Resolve column type from collation name 2021-01-27 10:40:21 +01:00
Gunnar Morling
b5bb534429 DBZ-2921 Removing superfluous author tag 2021-01-14 15:52:18 +01:00
Jiri Pechanec
ff4fe78037 DBZ-2921 Record default database charset in history 2021-01-14 15:52:18 +01:00
Debezium Builder
3010f99c32 [maven-release-plugin] prepare for next development iteration 2021-01-07 03:38:13 -05:00
Debezium Builder
54534538d9 [maven-release-plugin] prepare release v1.4.0.Final 2021-01-07 03:38:13 -05:00
Jiri Pechanec
fbfba94027 DBZ-2167 Remove superfluous char
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2020-12-21 16:30:15 +01:00
Jiri Pechanec
58713599ba DBZ-2167 Remove legacy parser completely; tests depending on parser move to MySQL 2020-12-21 16:30:15 +01:00
Debezium Builder
b1ab996c3e [maven-release-plugin] prepare for next development iteration 2020-12-16 14:11:31 -05:00
Debezium Builder
8fc864b278 [maven-release-plugin] prepare release v1.4.0.CR1 2020-12-16 14:11:31 -05:00
Debezium Builder
cf921f56b4 [maven-release-plugin] prepare for next development iteration 2020-12-10 00:27:40 -05:00
Debezium Builder
c49a377487 [maven-release-plugin] prepare release v1.4.0.Beta1 2020-12-10 00:27:39 -05:00
Jiri Pechanec
a967afbd1a DBZ-2821 Support for CHAR VARYING use 2020-12-04 10:34:49 +01:00
Jiri Pechanec
b7fede7d53 DBZ-735 Verify Avro serialization 2020-11-27 17:33:23 +01:00
John Martin
f069cd6f3f DBZ-2775 add option for setting snapshot events as reads 2020-11-20 07:46:07 +01:00
Debezium Builder
4535549dcd [maven-release-plugin] prepare for next development iteration 2020-11-16 15:18:43 -05:00
Debezium Builder
3c70c5f7d5 [maven-release-plugin] prepare release v1.4.0.Alpha2 2020-11-16 15:18:43 -05:00
vanhoale
17a424d9ac DBZ-2662 Handle ChangeEventQueue by the size in bytes 2020-11-16 08:39:33 +01:00
rkerner
9c5db0cd2f DBZ-2580 Fix "The primary key cannot reference a non-existant column" error from MySQL DDL parser when CREATE TABLE statement starts with a primary key definition like "CREATE TABLE Products (PRIMARY KEY (id), ..." where the referenced primary key column is not yet defined 2020-11-12 07:42:48 +01:00
Kewei Shang
78c061a86d DBZ-2726 extend data separator and time separator 2020-11-10 10:01:33 +01:00
Kewei Shang
7e44a3068a DBZ-2726 Clean MySQL TIMESTAMP default value 2020-11-10 10:01:33 +01:00
Jiri Pechanec
b9a6bb35b8 DBZ-2673 Added comment; use defensive equals 2020-11-03 08:02:06 +01:00
Arik Cohen
e44b76fb9d DBZ-2673 Read the raw bytes of a character-type field 2020-11-03 08:02:06 +01:00
rkerner
c274c2b39b DBZ-2617 refactor to proper HeartbeatErrorHandler injection 2020-11-03 07:23:02 +01:00
Debezium Builder
26883dad92 [maven-release-plugin] prepare for next development iteration 2020-10-22 03:45:59 -04:00
Debezium Builder
9adbc2d67e [maven-release-plugin] prepare release v1.4.0.Alpha1 2020-10-22 03:45:59 -04:00
Sergei Morozov
5bccf7ad1d DBZ-2688: DropViewParserListener should respect the skipViews flag 2020-10-22 05:43:46 +02:00
Jiri Pechanec
b699e37359 DBZ-2670 Modify testing approach 2020-10-21 17:41:22 +02:00
karamel
4898d18184 DBZ-2670 Allow non-Ascii characters in MySQL ids 2020-10-21 17:41:22 +02:00
Kaushik Iyer
7d9e8fdc46 DBZ-2456 fixes after rebase 2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932 DBZ-2456 selective snapshot implementation 2020-10-16 10:13:48 +02:00
John Martin
4fe4aed24f DBZ-2643 Only set filter info in offsets when snapshot.new.tables = parallel 2020-10-14 16:53:04 +02:00
Jiri Pechanec
2270d23adb DBZ-2641 BLOB type has dimension 2020-10-08 09:01:23 +02:00
Jiri Pechanec
dd6e10b92b DBZ-2604 Query charset name in lowercase 2020-10-06 11:41:06 +02:00
Jiri Pechanec
cc09f164b9 DBZ-2604 Use default db charset as default table charset 2020-10-06 11:41:06 +02:00
Debezium Builder
95b8ed3877 [maven-release-plugin] prepare for next development iteration 2020-10-01 09:08:51 -04:00
Debezium Builder
19ad73beb2 [maven-release-plugin] prepare release v1.3.0.Final 2020-10-01 09:08:50 -04:00
Peter Junos
ab7db1ddca DBZ-2583 MySQL connector - ignore statement-based logs
Current mysql debezium connector fails once it sees an event generated
with statement or mixed based replication.

As users and programs can call SET SESSION binlog_format='STATEMENT'; as
they wish, they are able to break debezium connector. Only MySQL 8.0.14
is fixing this, but not everyone is on that version.

To prevent connector crashing in such cases, there should be an option
to log these issues and continue. That would be similar to processing
inconsistent schema (on the setting level).
2020-09-29 15:55:15 +02:00
Gunnar Morling
3d12616627 DBZ-2563 Avoiding dependency from MySqlValueConverters to BinlogReader 2020-09-29 10:36:33 +02:00
Gunnar Morling
87d70cb96d DBZ-2563 Simplifying MySqlValueConverters constructors 2020-09-29 10:36:33 +02:00
Jiri Pechanec
5b2c14e058 DBZ-2563 JSON processing can ignore deserialization errors 2020-09-29 10:36:33 +02:00
Gunnar Morling
c1b057f792 DBZ-2588 Introducing dedicated functional interface for key/value generators;
Also keys are always KC Struct instead of generic j.l.Object.
2020-09-25 06:01:59 +02:00
Debezium Builder
b146b69154 [maven-release-plugin] prepare for next development iteration 2020-09-24 04:56:42 -04:00
Debezium Builder
c51cfe8eb9 [maven-release-plugin] prepare release v1.3.0.CR1 2020-09-24 04:56:41 -04:00
Debezium Builder
837669890a [maven-release-plugin] prepare for next development iteration 2020-09-16 12:18:08 -04:00
Debezium Builder
086dbd960b [maven-release-plugin] prepare release v1.3.0.Beta2 2020-09-16 12:18:08 -04:00
Aaron Brady
9468b1f074 DBZ-2466 Start connector when using Oracle MySQL, so afterEach can stop it 2020-09-15 11:43:49 +02:00
Aaron Brady
a5b30ffa78 DBZ-2466 Address Backup Lock review feedback 2020-09-15 11:43:49 +02:00
Aaron Brady
9057896c89 DBZ-2466 Percona Backup Locks option for snapshots 2020-09-15 11:43:49 +02:00
Aaron Brady
304ad4998c DBZ-2466 Add Percona Server profile to assembly 2020-09-15 11:43:49 +02:00
rkerner
011c3be948 DBZ-2527 Add missing ListOfRegex validator to all regex list fields and fix dependent fields to not include @Deprecated whitelist/blacklist fields 2020-09-15 10:05:04 +02:00
Gunnar Morling
e91629cc04 DBZ-1962 Doc fix 2020-09-08 17:11:14 +02:00
Jos Huiting
29c6b2abc7 DBZ-1962 Introduce column.whitelist for the MySql connector 2020-09-08 17:06:29 +02:00
Debezium Builder
9979db648f [maven-release-plugin] prepare for next development iteration 2020-08-28 05:04:26 -04:00
Debezium Builder
5c58b23756 [maven-release-plugin] prepare release v1.3.0.Beta1 2020-08-28 05:04:26 -04:00
rkerner
2c5c093587 DBZ-2171 avoid divisive language 2020-08-21 09:29:04 +02:00
Gunnar Morling
44efd1bc6b DBZ-2423 Propagating port default values 2020-08-12 13:50:42 +02:00
Debezium Builder
c4c50f5fc6 [maven-release-plugin] prepare for next development iteration 2020-08-06 00:46:18 -04:00
Debezium Builder
94cbeb95fa [maven-release-plugin] prepare release v1.3.0.Alpha1 2020-08-06 00:46:17 -04:00
Chris Cranford
00463e10c0 DBZ-2332 Fix test failures with Kafka 1.x CI
MySqlDecimalIT#testPreciseDecimalHandlingMode
SqlServerConnectorIT#restartInTheMiddleOfTx
2020-08-04 23:21:23 +02:00
Chris Cranford
856fd5ee34 DBZ-2173 Upgrade MySQL binlog client 0.23.1 2020-08-04 10:40:06 +02:00
Gunnar Morling
e70708a6ad DBZ-1939 Removing unused methods; reducing visbility 2020-07-30 17:53:22 +02:00
Gunnar Morling
5cb82bb7c7 DBZ-1939 Simplifying boolean logic 2020-07-30 17:53:22 +02:00
Arik Cohen
e111bd585c DBZ-1939 graceful handling of "phantom" tables 2020-07-30 17:53:22 +02:00
Gunnar Morling
c1a1f381e9 DBZ-2387 Formatting 2020-07-30 09:04:51 +02:00
Moira Tagle
bee8d30f39 DBZ-2387 fix NPE in ParallelHaltingPredicate 2020-07-30 09:04:51 +02:00
Jiri Pechanec
6e1eb61e72 DBZ-2365 LONG types have separate grammar rules 2020-07-24 08:30:40 +02:00
Jiri Pechanec
18d0143d64 DBZ-2365 Support for crss-db datatypes 2020-07-24 08:30:40 +02:00
Debezium Builder
e1ab38de84 [maven-release-plugin] prepare for next development iteration 2020-07-16 04:40:04 -04:00
Debezium Builder
69cf375faa [maven-release-plugin] prepare release v1.2.1.Final 2020-07-16 04:40:04 -04:00
Kewei Shang
9811b67e9a DBZ-2330 Fix null default value when NOT NULL is after DEFAULT 2020-07-15 09:14:46 +02:00
Michael Wang
d7ae30a8d1 DBZ-2305 Allow single dimension DECIMAL in CAST 2020-07-13 20:52:12 +02:00
Chris Cranford
e3abc020c9 DBZ-2238 Fix test failure - MySqlSourceTypeInSchemaIT#shouldPropagateSourceTypeAsSchemaParameter 2020-07-10 08:14:28 +02:00
Chris Cranford
a286de7d97 DBZ-2269 Fix test failure - MySqlSourceTypeInSchemaIT#shouldPropagateSourceTypeByDatatype 2020-07-09 08:23:59 +02:00
Chris Cranford
1aae3cd262 DBZ-2243 Fix test failure - MySqlConnectorRegressionIT#shouldConsumeAllEventsFromDatabaseUsingBinlogAndNoSnapshot 2020-07-09 06:30:56 +02:00
Chris Cranford
6a8eb416a1 DBZ-2270 Fix test failure - MySqlConnectorIT#shouldNotParseQueryIfServerOptionDisabled 2020-07-09 06:29:41 +02:00
rkerner
7b2e9be0d5 DBZ-730 add MySqlDecimalIT integration test for all decimal.handling.mode/s 2020-07-09 06:26:52 +02:00
Chris Cranford
f5ab12c346 DBZ-2229 Fix test failure - MySqlConnectorRegressionIT#shouldConsumeAllEventsFromDecimalTableInDatabaseUsingBinlogAndNoSnapshot 2020-07-08 21:56:10 +02:00
Jiri Pechanec
15c49f3fb6 DBZ-2301 Hide internal config fields 2020-07-01 15:46:17 +02:00
Jiri Pechanec
3c6f3eb75c DBZ-2278 Resolve concurrent access to the thread map 2020-06-26 08:38:59 +02:00
Randall Hauch
5860812a63
DBZ-2275 Updated default database history DML filter default to handle additional RDS statements;
* Added two more regular expressions to the default database history DML filter. These are intended to catch and filter out `INSERT into mysql.rds_monitor…` statements that RDS may write in the binlog
* Added a new unit test that checks that the regular expressions do catch some example statements
2020-06-25 20:57:49 +02:00
Debezium Builder
c0d30b87d9 [maven-release-plugin] prepare for next development iteration 2020-06-24 18:03:11 +02:00
Debezium Builder
0e2ac78301 [maven-release-plugin] prepare release v1.2.0.Final 2020-06-24 18:03:11 +02:00
Jiri Pechanec
87d93d44fd DBZ-2221 Wait for keepalive thread initialization 2020-06-24 09:14:42 +02:00
Jiri Pechanec
50943f59f7 DBZ-2267 Optionality ignored while converting default value 2020-06-23 18:36:36 +02:00
Jiri Pechanec
e9355c3589 DBZ-2261 Take the full filter count into assert 2020-06-22 20:54:44 +02:00
Debezium Builder
b03a4d0e50 [maven-release-plugin] prepare for next development iteration 2020-06-19 00:39:01 -04:00
Debezium Builder
93e60258d5 [maven-release-plugin] prepare release v1.2.0.CR2 2020-06-19 00:39:00 -04:00
Jiri Pechanec
dc3d251f16 DBZ-2207 Intermittnet test failure 2020-06-16 16:55:34 +02:00
Chris Cranford
d4cefaa1c2 DBZ-2177 Fix inconsistent test failure 2020-06-16 00:06:34 +02:00
Debezium Builder
65c39e9f11 [maven-release-plugin] prepare for next development iteration 2020-06-11 02:00:20 -04:00
Debezium Builder
bce332c900 [maven-release-plugin] prepare release v1.2.0.CR1 2020-06-11 02:00:19 -04:00
Jiri Pechanec
752bed1a6f DBZ-2169 Fix test failure 2020-06-10 17:38:08 -04:00
Emmanuel
c7ef4128db
DBZ-1989 Avoid returning distorted (Milli)SecondsBehindSource values 2020-06-09 17:21:08 +02:00
Balázs Németh
0853940f3d
DBZ-2169 Fix for misuse of ConfigurationDefaults.RETURN_CONTROL_INTERVAL;
* Implemented Temporals.min()
* Fixed pollInterval calculation based on the documentation
2020-06-09 10:24:50 +02:00
Gunnar Morling
c54e377dd2 DBZ-1814 Exporting Hex and Base64 representations as string 2020-06-05 12:13:29 +02:00
Gunnar Morling
023064eedb DBZ-1814 Renaming "raw" to "bytes"; also clarifying that this notion isn't Java-specific 2020-06-05 12:13:29 +02:00
Jeremy Finzel
5db614da21 DBZ-1814 added new binary handling mode option 2020-06-05 12:13:29 +02:00
Gunnar Morling
79a64179c1 DBZ-2140 Typo fix 2020-06-03 11:34:58 +02:00
Jiri Pechanec
71c9607944 DBZ-2140 Handle drop default value 2020-06-03 11:34:58 +02:00
Jiri Pechanec
2b67e26407 DBZ-2130 Avoid ambiguity between type and charset keyword 2020-06-03 11:04:49 +02:00
Jiri Pechanec
06f8023a54 DBZ-2130 CHARACTER keyword used also as a type 2020-06-02 15:11:53 +02:00
Jiri Pechanec
20b45f84f3 DBZ-1657 Remove duplicate option definitions 2020-05-22 12:07:29 +02:00
Debezium Builder
dc25c379e5 [maven-release-plugin] prepare for next development iteration 2020-05-19 03:40:25 -04:00
Debezium Builder
ad060181b9 [maven-release-plugin] prepare release v1.2.0.Beta2 2020-05-19 03:40:25 -04:00
Jiri Pechanec
e676d715c3 DBZ-2085 Apply custom converters to default values 2020-05-18 17:27:59 +02:00
Jiri Pechanec
97c3d3b6e9 DBZ-2088 Use POSIX tar 2020-05-18 14:29:38 +02:00
Fándly Gergő
9cea694510 DBZ-2067 Add support for ALGORITHM=INSTANT on alter table statements 2020-05-14 12:31:14 +02:00
Max Kaplan
1b89b89301 DBZ-2062 allowing compression keyword to contain backticks in create table 2020-05-14 11:21:25 +02:00
Jiri Pechanec
c4f975bd0a DBZ-2061 Handle change of default value 2020-05-14 08:31:27 +02:00
Chris Cranford
f449550b2d DBZ-2068 Skip tests incompatible with Kafka 1.x 2020-05-13 08:22:07 +02:00
Debezium Builder
8d4203279e [maven-release-plugin] prepare for next development iteration 2020-05-07 05:03:40 -04:00
Debezium Builder
a4e2c8f36c [maven-release-plugin] prepare release v1.2.0.Beta1 2020-05-07 05:03:40 -04:00
Jiri Pechanec
e350d74b17 DBZ-1904 Public facing schema history topic 2020-05-04 12:31:05 +02:00
Chris Cranford
11c8e9df3d DBZ-1953 Rework configuration files 2020-04-29 12:27:38 +02:00
Chris Cranford
230ddaebdc DBZ-1953 Generalized SkipWhenDatabaseVersion functionality 2020-04-29 12:27:38 +02:00
Chris Cranford
bcae276234 DBZ-1953 MySQL 5.5 and 5.6 added to test matrix 2020-04-29 12:27:38 +02:00
Gunnar Morling
3d0606b348 DBZ-2027 Small speed-up of PG test execution;
* Using Awaitility so we can use 100ms looping intervals; also it's more concise
* Avoiding creation of one temporary connection
2020-04-29 09:56:59 +02:00
JanHendrikDolling
33d83731af DBZ-1972 move static Filed methods as static Filed constant to RelationalDatabaseConnectorConfig instead. 2020-04-27 12:31:19 +02:00
Jiri Pechanec
0d8d6a41c5 DBZ-1750 Validate Kafka params only for Kafka history 2020-04-24 15:35:28 +02:00
Gunnar Morling
0998fc533a DBZ-1895 Completing implementation;
* Restoring original derserializers; excluding skipped events in event handlers
* Adding test
2020-04-22 15:04:36 +02:00
Hossein Torabi
9ddd893074 DBZ-1895 Implement SKIPPED_OPERATIONS for mysql 2020-04-22 15:04:36 +02:00
Ivan Klass
75f19239d1 DBZ-1886 Introduce separate storageExists() method to support manual topic creation 2020-04-20 17:46:03 +02:00
Jos Huiting
a0f65830de DBZ-1962 Remove TABLE_WHITELIST and TABLE_BLACKLIST in favor of definitions in RelationalDatabaseConnectorConfig 2020-04-17 15:24:42 +02:00
Jos Huiting
8ba21a98ef DBZ-1962 Introduce column.whitelist for the Postgres connector 2020-04-17 15:24:42 +02:00
Chris Cranford
e7d7456a3f DBZ-1947 Remove obsolete MySQL metrics 2020-04-16 09:31:29 +02:00
Debezium Builder
4ca9f92575 [maven-release-plugin] prepare for next development iteration 2020-04-16 02:22:00 -04:00
Debezium Builder
e704bccdaa [maven-release-plugin] prepare release v1.2.0.Alpha1 2020-04-16 02:22:00 -04:00
JanHendrikDolling
1e19270981 DBZ-1692 Added support for hash based column masking mode for string values 2020-04-08 21:21:42 +02:00