Commit Graph

1194 Commits

Author SHA1 Message Date
Chris Cranford
7f7e23b110 DBZ-3668 Add ServiceLoader hook CloudEvents converter 2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba DBZ-2975: Add partition awareness to source task components
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Debezium Builder
9d3f6b2a86 [maven-release-plugin] prepare for next development iteration 2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56 [maven-release-plugin] prepare release v1.6.0.Final 2021-06-30 03:45:06 -04:00
Jiri Pechanec
472b82abb7 DBZ-3622 Decouple database and schema history record writes 2021-06-29 10:36:41 +02:00
Jiri Pechanec
443c0ce089 DBZ-3622 Fix non-captured database storing; make the code more robust 2021-06-29 10:36:41 +02:00
Debezium Builder
ae053414ac [maven-release-plugin] prepare for next development iteration 2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74 [maven-release-plugin] prepare release v1.6.0.CR1 2021-06-24 01:50:07 -04:00
camile.sing
b05ac5549e DBZ-3638 Modify Mysql SourceInfo to be public 2021-06-17 16:16:05 +02:00
Sergei Morozov
b36e8247a3 DBZ-3615: Keep database connection closed during schema recovery 2021-06-15 11:27:44 +02:00
Debezium Builder
48ca58a609 [maven-release-plugin] prepare for next development iteration 2021-06-10 06:03:12 -04:00
Debezium Builder
0961517859 [maven-release-plugin] prepare release v1.6.0.Beta2 2021-06-10 06:03:12 -04:00
Gunnar Morling
1ce65fa628 DBZ-2975 Avoiding raw types in some places;
Also parameterizing offset loader contract, so to avoid casts later on.
2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542 DBZ-2975: Extract offset context from object states to method signatures 2021-06-09 16:02:33 +02:00
Jiri Pechanec
7afcd1bdc6 DBZ-3559 Support MySQL JSON functions 2021-05-31 09:49:56 +02:00
Sergei Morozov
213d9ffdcc DBZ-3562: Revert test changes from DBZ-3427 2021-05-27 11:03:30 +02:00
Sergei Morozov
3b72e5149c DBZ-3486: Replace @see with @link where a URL is referenced 2021-05-25 07:19:43 +02:00
Debezium Builder
ead4ee7226 [maven-release-plugin] prepare for next development iteration 2021-05-20 19:07:44 +02:00
Debezium Builder
9e16df7d4b [maven-release-plugin] prepare release v1.6.0.Beta1 2021-05-20 19:07:44 +02:00
Jiri Pechanec
4929397022 DBZ-3500 Per-connector table name quoting 2021-05-20 08:06:37 +02:00
Jiri Pechanec
a626dc149f DBZ-3500 Provide common test for incremental snapshot testing 2021-05-20 08:06:37 +02:00
Jiri Pechanec
5486cf3cf9 DBZ-3399 Add asserts for DDLs 2021-05-18 10:26:10 +02:00
Jiri Pechanec
0dc25a6846 DBZ-3399 Store full RENAME TABLE in history 2021-05-18 10:26:10 +02:00
Jiri Pechanec
367746fcc9 DBZ-3485 Emit quoted DROP TABLE 2021-05-18 10:26:10 +02:00
Jiri Pechanec
4df0d93b4d DBZ-2300 Make too many connections retriable 2021-05-13 08:07:38 -04:00
John Martin
cef0997428 DBZ-3508 return empty ConfigDef for ReadToInsertEvent.config 2021-05-11 05:59:33 +02:00
Debezium Builder
4dd3a146ca [maven-release-plugin] prepare for next development iteration 2021-05-06 02:40:15 -04:00
Debezium Builder
b3c5bb281c [maven-release-plugin] prepare release v1.6.0.Alpha1 2021-05-06 02:40:15 -04:00
Jiri Pechanec
b4327ab13a DBZ-3499 Moved test statements to examples 2021-05-06 06:14:24 +02:00
Tommy Karlsson
f9028926f8 DBZ-3499 Add support for parsing of GRANT statements with newer MySQL privileges 2021-05-06 06:14:24 +02:00
Jiri Pechanec
5c722341e2 DBZ-3473 Extract incremental snapshot contract 2021-05-06 05:37:36 +02:00
Jiri Pechanec
39d21806eb DBZ-3473 Metrics enabled 2021-05-06 05:37:36 +02:00
Jiri Pechanec
3d940ca14a DBZ-3473 Support for cursor-based fetching 2021-05-06 05:37:36 +02:00
Jiri Pechanec
c53785dde7 DBZ-3473 Incremental Snapshot support for MySQL 2021-05-06 05:37:36 +02:00
Jiri Pechanec
7415dc91de DBZ-3497 Rename the variable 2021-05-05 13:17:28 +02:00
Anisha Mohanty
5156ea0d16 DBZ-3497 Handle MySQL DATE default value parser to accept timestamp 2021-05-05 13:17:28 +02:00
Gunnar Morling
dc02b896cd DBZ-3449 Moving QA releated plug-ins to separate profile, so to avoid loading them at all 2021-04-28 15:14:05 +02:00
Anisha Mohanty
a6b54c7000 DBZ-3427 Validate the server name field 2021-04-28 13:18:52 +02:00
Gunnar Morling
0250c64013 DBZ-3161 Formatting 2021-04-26 13:07:23 +02:00
Gunnar Morling
b225092f1a DBZ-3161 Using fallback option in legacy code path 2021-04-26 13:07:23 +02:00
Anisha Mohanty
11fb079582 DBZ-3161 Add database.history.store.only.captured.tables.ddl option & CapturedTables metrics to documentation 2021-04-26 13:07:23 +02:00
Anisha Mohanty
f0f8d5d180 DBZ-3161 Refactor/Rename all references of MonitoredTables to CapturedTables 2021-04-26 13:07:23 +02:00
Gunnar Morling
2088c035b1 DBZ-3449 Adding "quick" profile 2021-04-26 06:09:14 +02:00
Gunnar Morling
ec5746a7fe DBZ-3233 Propagating socket exceptions 2021-04-21 12:36:47 +02:00
Gunnar Morling
42a7b74725 DBZ-3403 Misc. improvements 2021-04-14 11:14:07 +02:00
Hossein Torabi
ba048cf47d DBZ-3403 Semi Optimisation on MongoDB and MySQL connector for skipped.operations 2021-04-14 11:14:07 +02:00
yangsanity
a2b4c263d3 DBZ-3238 Snapshot fails when reading TIME, DATE, DATETIME fields in mysql from ResultSet 2021-04-08 12:05:29 +02:00
Debezium Builder
8a88ba9b45 [maven-release-plugin] prepare for next development iteration 2021-04-08 04:04:00 -04:00
Debezium Builder
74152afe74 [maven-release-plugin] prepare release v1.5.0.Final 2021-04-08 04:04:00 -04:00
Chris Egerton
67f044ff87 DBZ-3371: Adjust scale of fallback BigDecimal values to match column schema 2021-04-06 10:35:23 +02:00
Jiri Pechanec
f50c3e8222 DBZ-3361 Prefer DDL over logical schema for MySQL 2021-03-30 11:35:12 +02:00
JLDLaughlin
06b0475f17 DBZ-2911 Add additional LSN information to all sources
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00
Debezium Builder
6b4d88bb51 [maven-release-plugin] prepare for next development iteration 2021-03-24 06:35:02 -04:00
Debezium Builder
c578715233 [maven-release-plugin] prepare release v1.5.0.CR1 2021-03-24 06:35:02 -04:00
Gunnar Morling
178140ae9c DBZ-3218 Removing superfluous method parameter 2021-03-19 15:04:20 +01:00
Anisha Mohanty
c761d92b2a DBZ-3218 Add separate method for logging warnings 2021-03-19 15:04:20 +01:00
Jiri Pechanec
495be2659b DBZ-2511 Dedicated logger for schema name adjuster 2021-03-18 14:42:34 +01:00
Jiri Pechanec
11e4880018 DBZ-3309 Revert to MySQL specific default snapshot fetch size 2021-03-18 11:08:26 +01:00
Gunnar Morling
647076ea69 DBZ-2957 Misc. fixes;
* Simplifying reg exp
* Adding leniency towards whitespace
* Reporting *all* problems including correct count
* Fixing incorrect actual/expected order
2021-03-17 14:04:16 +01:00
Anisha Mohanty
2e5a5ce001 DBZ-2957 Handle message.key.columns regex validation time complexity 2021-03-17 14:04:16 +01:00
Jiri Pechanec
f5475cf7c5 DBZ-3304 Fix intermittent test failure 2021-03-17 11:43:01 +01:00
Gunnar Morling
911b5e9a3b DBZ-3271 Unifying filter handling across relational connectors 2021-03-17 09:54:25 +01:00
Jiri Pechanec
f2eb868cde DBZ-2145 Provide Debezium BOM 2021-03-17 07:54:12 +01:00
Debezium Builder
f57057421b [maven-release-plugin] prepare for next development iteration 2021-03-12 04:38:17 -05:00
Debezium Builder
b57293013a [maven-release-plugin] prepare release v1.5.0.Beta2 2021-03-12 04:38:16 -05:00
Jiri Pechanec
123d9ef4eb DBZ-3213 Refactor Maven structure to deploy support modules 2021-03-11 16:14:15 +01:00
Debezium Builder
b4c260da50 [maven-release-plugin] prepare for next development iteration 2021-02-23 14:04:01 -05:00
Debezium Builder
123a711a6d [maven-release-plugin] prepare release v1.5.0.Beta1 2021-02-23 14:04:01 -05:00
ani-sha
c39192e9f2 DBZ-3067 Add OR REPLACE condition for create index 2021-02-23 08:54:28 +01:00
Fahim Farook
194258d87b
DBZ-3164 Log database connection validation failures consistently 2021-02-22 14:52:22 +01:00
Gunnar Morling
e024fc60ab DBZ-3095 Propagating socket exceptions 2021-02-19 10:30:41 +01:00
Gunnar Morling
edcc3a041f DBZ-3147 Renaming test connection class 2021-02-19 09:16:31 +01:00
Nitin Agarwal
62f51e8b29 DBZ-3114: addressing review comments 2021-02-18 12:41:34 +01:00
Jiri Pechanec
737d2353a6 DBZ-3114 Test more resilient for repeted runs and testsuite execution 2021-02-18 12:41:34 +01:00
Jiri Pechanec
decb4ec3da DBZ-3114 Tests only for new implementation 2021-02-18 12:41:34 +01:00
Nitin Agarwal
fd1ceeb02e DBZ-3114 Transaction metadata feature in MySQL connector 2021-02-18 12:41:34 +01:00
ani-sha
b6c61ac810 DBZ-2788 Replace MySQL connector option with SMT for mitigating wrong op flag 2021-02-18 12:35:03 +01:00
Gunnar Morling
184d1a2399 DBZ-3056 Misc. clean-up 2021-02-16 12:45:09 +01:00
Yilong Chang
a0b3704832 DBZ-3056 Validate all fields in subclasses. 2021-02-16 12:34:06 +01:00
Yilong Chang
76c7e0d426 DBZ-3056 Extract basic valdiation in parent class. 2021-02-16 12:34:06 +01:00
Gunnar Morling
cb2b2fc07a DBZ-3099 Doc fix 2021-02-16 10:11:23 +01:00
Jiri Pechanec
1c9f7a1c1c DBZ-3099 Document non-volatile fields accessed by a single thread 2021-02-16 10:02:17 +01:00
Jiri Pechanec
745bb6c11d DBZ-3099 Address review comments; extract history comparator for testability 2021-02-16 10:02:17 +01:00
Jiri Pechanec
cb1476ce18 DBZ-3099 Address review comments 2021-02-16 10:02:17 +01:00
Gunnar Morling
5ca1d9fc4f DBZ-3099 Preferring explicit functional interface over Function 2021-02-16 10:02:17 +01:00
Jiri Pechanec
2af13af300 DBZ-3099 Streaming source test for new impl only 2021-02-16 10:02:17 +01:00
Jiri Pechanec
c53082f94f DBZ-3099 Fix typos 2021-02-16 10:02:17 +01:00
Jiri Pechanec
b0f906df35 DBZ-3099 Race condition in waiting for metrics 2021-02-16 10:02:17 +01:00
Jiri Pechanec
21b15facb2 DBZ-3099 Snapshot buffering to handle config corner cases 2021-02-16 10:02:17 +01:00
Jiri Pechanec
7394ecfd62 DBZ-3099 Make streaming MBean name configurable in tests 2021-02-16 10:02:17 +01:00
Jiri Pechanec
048530aeb8 DBZ-3099 Make metrics tests running with legacy 2021-02-16 10:02:17 +01:00
Jiri Pechanec
ea247b710d DBZ-3099 Rewritten reader tests to connector 2021-02-16 10:02:17 +01:00
Jiri Pechanec
6a9ca7d544 DBZ-3099 Fix schema recovery; Add table level locking 2021-02-16 10:02:17 +01:00
Jiri Pechanec
08e4988c72 DBZ-3093 Unify snapshot and streaming parsing 2021-02-16 10:02:17 +01:00
Jiri Pechanec
7bfbd5c7c5 DBZ-3093 Dispatch schema change events always 2021-02-16 10:02:17 +01:00
Jiri Pechanec
6607310f13 DBZ-3093 Separate parsing and change applying phase in MySQL schema 2021-02-16 10:02:17 +01:00
Jiri Pechanec
5bf5e18d81 DBZ-3086 Legacy source info make for legacy tests 2021-02-16 10:02:16 +01:00
Jiri Pechanec
f01af4bec8 DBZ-3086 Source info formatting for legacy implementation 2021-02-16 10:02:16 +01:00
Jiri Pechanec
14a628ed60 DBZ-3086 Mark moved method as deprecated 2021-02-16 10:02:16 +01:00
Jiri Pechanec
a43bae7638 DBZ-3086 Separate offset and source info 2021-02-16 10:02:16 +01:00
Jiri Pechanec
e9ed4a0a2a DBZ-3086 Remove parallel snapshot reader offsets 2021-02-16 10:02:16 +01:00
Jiri Pechanec
488464419e DBZ-3086 Separate legacy and new SourceInfo 2021-02-16 10:02:16 +01:00
Jiri Pechanec
1d86d7068f DBZ-3077 Unified record creation 2021-02-16 10:02:16 +01:00
ani-sha
5f8a22a5df DBZ-2858 Make field descriptions consistent for time values 2021-02-16 09:55:35 +01:00
Debezium Builder
e08df0a177 [maven-release-plugin] prepare for next development iteration 2021-02-06 01:25:23 -05:00
Debezium Builder
da0411bf70 [maven-release-plugin] prepare release v1.5.0.Alpha1 2021-02-06 01:25:23 -05:00
Jiri Pechanec
f63d08fc28 DBZ-3023 Handle default charsets for table 2021-02-05 05:44:14 +01:00
Jiri Pechanec
ed7a1c2486 DBZ-3047 Run the test after legacy package 2021-02-05 05:44:06 +01:00
Jiri Pechanec
c9fd39d04c DBZ-1865 Support for when_needed snapshot 2021-02-04 09:07:55 +01:00
Jiri Pechanec
f57343dc3b DBZ-1865 Use OptionaLong; add comments 2021-02-04 09:07:55 +01:00
Jiri Pechanec
2374b6b045 DBZ-1865 First draft of MySQL rewrite 2021-02-04 09:07:55 +01:00
Jiri Pechanec
23c1546362 DBZ-1865 Modify metrics to conform to new classes 2021-02-04 09:07:55 +01:00
Jiri Pechanec
d333c9f005 DBZ-1865 Move legacy classes into separate package 2021-02-04 09:07:55 +01:00
Jiri Pechanec
5e887b2bfb DBZ-3020 Ignore expressions in default values 2021-02-03 10:12:09 +01:00
ani-sha
d4003c9172 DBZ-2420 Define database configs under RelationalDatabaseConnectorConfig 2021-02-03 08:05:42 +01:00
rkerner
89cc1d7003 DBZ-3008 Fix that an invalid regex for database.inlcude.list and database.exlcude.list does not raise a validation error for MySQL connector and the connector only fails on start, also the config validated before
closes https://issues.redhat.com/browse/DBZ-3008
2021-02-01 18:38:54 +01:00
Debezium Builder
237b4ac0f1 [maven-release-plugin] prepare for next development iteration 2021-01-28 07:38:55 -05:00
Debezium Builder
06b1d0cbad [maven-release-plugin] prepare release v1.4.1.Final 2021-01-28 07:38:55 -05:00
Jiri Pechanec
5092f327d8 DBZ-2922 DatabaseLocales generates the DDL 2021-01-27 10:40:21 +01:00
Jiri Pechanec
8153404033 DBZ-2922 Support for cahrsets from collations 2021-01-27 10:40:21 +01:00
shuguang.xiang
363c794185 DBZ-2922 Resolve column type from collation name 2021-01-27 10:40:21 +01:00
Gunnar Morling
b5bb534429 DBZ-2921 Removing superfluous author tag 2021-01-14 15:52:18 +01:00
Jiri Pechanec
ff4fe78037 DBZ-2921 Record default database charset in history 2021-01-14 15:52:18 +01:00
Debezium Builder
3010f99c32 [maven-release-plugin] prepare for next development iteration 2021-01-07 03:38:13 -05:00
Debezium Builder
54534538d9 [maven-release-plugin] prepare release v1.4.0.Final 2021-01-07 03:38:13 -05:00
Jiri Pechanec
fbfba94027 DBZ-2167 Remove superfluous char
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2020-12-21 16:30:15 +01:00
Jiri Pechanec
58713599ba DBZ-2167 Remove legacy parser completely; tests depending on parser move to MySQL 2020-12-21 16:30:15 +01:00
Debezium Builder
b1ab996c3e [maven-release-plugin] prepare for next development iteration 2020-12-16 14:11:31 -05:00
Debezium Builder
8fc864b278 [maven-release-plugin] prepare release v1.4.0.CR1 2020-12-16 14:11:31 -05:00
Debezium Builder
cf921f56b4 [maven-release-plugin] prepare for next development iteration 2020-12-10 00:27:40 -05:00
Debezium Builder
c49a377487 [maven-release-plugin] prepare release v1.4.0.Beta1 2020-12-10 00:27:39 -05:00
Jiri Pechanec
a967afbd1a DBZ-2821 Support for CHAR VARYING use 2020-12-04 10:34:49 +01:00
Jiri Pechanec
b7fede7d53 DBZ-735 Verify Avro serialization 2020-11-27 17:33:23 +01:00
John Martin
f069cd6f3f DBZ-2775 add option for setting snapshot events as reads 2020-11-20 07:46:07 +01:00
Debezium Builder
4535549dcd [maven-release-plugin] prepare for next development iteration 2020-11-16 15:18:43 -05:00
Debezium Builder
3c70c5f7d5 [maven-release-plugin] prepare release v1.4.0.Alpha2 2020-11-16 15:18:43 -05:00
vanhoale
17a424d9ac DBZ-2662 Handle ChangeEventQueue by the size in bytes 2020-11-16 08:39:33 +01:00
rkerner
9c5db0cd2f DBZ-2580 Fix "The primary key cannot reference a non-existant column" error from MySQL DDL parser when CREATE TABLE statement starts with a primary key definition like "CREATE TABLE Products (PRIMARY KEY (id), ..." where the referenced primary key column is not yet defined 2020-11-12 07:42:48 +01:00
Kewei Shang
78c061a86d DBZ-2726 extend data separator and time separator 2020-11-10 10:01:33 +01:00
Kewei Shang
7e44a3068a DBZ-2726 Clean MySQL TIMESTAMP default value 2020-11-10 10:01:33 +01:00
Jiri Pechanec
b9a6bb35b8 DBZ-2673 Added comment; use defensive equals 2020-11-03 08:02:06 +01:00
Arik Cohen
e44b76fb9d DBZ-2673 Read the raw bytes of a character-type field 2020-11-03 08:02:06 +01:00
rkerner
c274c2b39b DBZ-2617 refactor to proper HeartbeatErrorHandler injection 2020-11-03 07:23:02 +01:00
Debezium Builder
26883dad92 [maven-release-plugin] prepare for next development iteration 2020-10-22 03:45:59 -04:00
Debezium Builder
9adbc2d67e [maven-release-plugin] prepare release v1.4.0.Alpha1 2020-10-22 03:45:59 -04:00
Sergei Morozov
5bccf7ad1d DBZ-2688: DropViewParserListener should respect the skipViews flag 2020-10-22 05:43:46 +02:00
Jiri Pechanec
b699e37359 DBZ-2670 Modify testing approach 2020-10-21 17:41:22 +02:00
karamel
4898d18184 DBZ-2670 Allow non-Ascii characters in MySQL ids 2020-10-21 17:41:22 +02:00
Kaushik Iyer
7d9e8fdc46 DBZ-2456 fixes after rebase 2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932 DBZ-2456 selective snapshot implementation 2020-10-16 10:13:48 +02:00