Commit Graph

1284 Commits

Author SHA1 Message Date
harveyyue
e7dc03fe6d DBZ-4787 Add mysql connector ssl it and build the relation mysql docker container 2022-03-09 09:23:13 +01:00
harveyyue
49963a5688 DBZ-4787 Not reading the keystore/truststore when enable mysql ssl configurations 2022-03-09 09:23:13 +01:00
harveyyue
da67ba332e DBZ-4823 Add event type for filtering trace message 2022-03-08 09:43:01 +01:00
Gunnar Morling
d20a6f00e7 DBZ-4801 Using JdbcConfiguration in JdbcConnection 2022-03-07 17:53:45 +01:00
Gunnar Morling
c1c322ecf0 DBZ-4801 Simplifying JdbcConnection constructors 2022-03-07 17:53:45 +01:00
Gunnar Morling
d7dfeed12d DBZ-4823 Consistent trace message in case of filtering 2022-03-07 14:41:21 +01:00
harveyyue
b30a8d8492 DBZ-4823 Log the tableId is null when filter out some tables 2022-03-07 12:44:58 +01:00
harveyyue
856ab85cef DBZ-4824 Expect the null value with snapshot CapturedTables metric when skipping snapshotting 2022-03-07 12:19:13 +01:00
Debezium Builder
fece16039c [maven-release-plugin] prepare for next development iteration 2022-03-03 17:00:08 +00:00
Debezium Builder
e0d8a0d809 [maven-release-plugin] prepare release v1.9.0.Beta1 2022-03-03 17:00:08 +00:00
Gunnar Morling
e050d17c4c [ci] Expanding logging in flaky test 2022-02-23 08:57:02 +01:00
Jiri Pechanec
d13a1635d7 DBZ-3952 Store schema for tables not in schema collection list 2022-02-17 07:41:00 +01:00
Sergei Morozov
2d14b5b09f DBZ-4478: Multi-partition metrics for SQL Server 2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces 2022-02-16 11:31:38 +01:00
harveyyue
8431a614a2 DBZ-4730 Expect plain value instead of scientific exponential notation when using decimal string mode 2022-02-10 17:40:12 +01:00
Debezium Builder
7a47f478a4 [maven-release-plugin] prepare for next development iteration 2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e [maven-release-plugin] prepare release v1.9.0.Alpha2 2022-02-09 07:23:10 +00:00
Farid Uyar
a559e51b08 DBZ-4547 Create History Topic with optional RF 2022-02-08 16:58:13 +01:00
Ismail Simsek
25ed5898c5 DBZ-4675 parse MariaDB PAGE_COMPRESSED and PAGE_COMPRESSION_LEVEL table options 2022-02-04 11:07:14 -05:00
Snigdhajyoti Ghosh
0ab45ecab0 DBZ-4518 Make kafka query timeout configurable 2022-02-04 14:08:15 +01:00
Ismail Simsek
a59b5a203e DBZ-4661 parse MariaDB encrypted keyword
Co-authored-by: Anisha Mohanty <anishamohanty23@gmail.com>
2022-02-04 15:15:07 +05:30
Gunnar Morling
a9bf4d6bd5 DBZ-4294 Awaiting PURGE has happened;
Also fixing the regexp for capturing the start TX id. Only one
capturing group is needed, and the first one would never capture
anything due to the greedy part before.
2022-02-03 15:10:05 -05:00
Jiri Pechanec
fafcea9fe4
DBZ-4605 Upgrade binlog client; test MySQL partial update
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-02-02 10:36:56 +01:00
harveyyue
bfd2ce97e8 DBZ-4640 Parse including keyword column table ddl error 2022-01-30 12:04:04 -05:00
Debezium Builder
33e2f5cd0f [maven-release-plugin] prepare for next development iteration 2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e [maven-release-plugin] prepare release v1.9.0.Alpha1 2022-01-26 19:00:20 +00:00
Chris Cranford
35ef67852c DBZ-4562 Reduce log verbosity 2022-01-25 18:41:06 +01:00
Jiri Pechanec
4236e3291a DBZ-4583 Workround for columns longer than max int 2022-01-25 15:16:47 +01:00
Jiri Pechanec
664d989e42 DBZ-4577 Provide custom error message handling 2022-01-21 10:24:19 +01:00
Jiri Pechanec
8f5bb31eab DBZ-3700 Strings a bytes only when converters present
When database was used with non-UTF8 charset the snapshot was sending
byte array with UTF-8 bytes but MySQL converter was using database based
charset to convert it to String leading to malformed data.
It is necessary to convert strings using the database charset but it
might be a problem in case of non-charset matching.
The current solution
1) Uses strings by default
2) Switches to byte array only when converters are present to cover
original use case
3) If the conversion fails it switches back to string
2022-01-19 16:20:32 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Sergei Morozov
17fba7258b DBZ-4541: Promote failure to register metrics to exception 2022-01-14 19:50:57 +01:00
Sergei Morozov
6d97433d18 DBZ-4541: Remove logger from Metrics register/unregister signatures 2022-01-14 19:50:57 +01:00
Chris Cranford
4f5f72500c DBZ-4371 Add hint on how to log problematic values 2022-01-13 08:16:20 +01:00
Chris Cranford
0721ff991c DBZ-4371 Log problematic column values 2022-01-13 08:16:20 +01:00
Sergei Morozov
0329859cda DBZ-4459: Introduce interfaces and default implementations for change event source metrics 2022-01-12 14:32:19 +01:00
Anisha Mohanty
d6c5ad2e7c DBZ-4460 Renaming all openapi occurrences to schema 2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f DBZ-4460 Set default values for format & output directory 2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691 DBZ-4460 Apply the plug-in to all connector modules 2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221 DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation 2022-01-06 19:03:46 +01:00
Kate
22ba108e0d DBZ-4502 Check GTID changes when current GTID is undefined 2022-01-04 08:54:19 +01:00
Kate
5d81466ec1 DBZ-4501 Null out incremental snapshot event's query field 2022-01-03 14:38:36 +01:00
Qishang Zhong
189c3baa07 DBZ-4500 Set the correct binlog serverId & threadId 2022-01-03 14:03:58 +01:00
harveyyue
831217053c DBZ-4503 Drop the primary key column getting exception 2022-01-03 10:57:07 +01:00
harveyyue
3670b0c6ef DBZ-4497 Parse multiple signed/unsigned keyword from ddl statement failed 2022-01-03 10:47:03 +01:00
harveyyue
792187f669 DBZ-4472 Make connector task partition readability for log 2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98 [maven-release-plugin] prepare for next development iteration 2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f [maven-release-plugin] prepare release v1.8.0.Final 2021-12-16 10:11:28 +00:00
Gunnar Morling
0023cb10a5
DBZ-4393 Create a Debezium Schema Generator for Debezium connectors
* added an API generator for Debezium connectors and static API definitions for connectors in a separate module
* added Maven plug-in
* added GH workflow for debezium-schema-generator

Co-authored-by: rkerner <rkerner.mobil@gmail.com>
Co-authored-by: Anisha Mohanty <anishamohanty23@gmail.com>
2021-12-10 12:35:09 +01:00
Debezium Builder
f53e6c00df [maven-release-plugin] prepare for next development iteration 2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a [maven-release-plugin] prepare release v1.8.0.CR1 2021-12-09 20:16:04 +00:00
Debezium Builder
b5439b54bf [maven-release-plugin] prepare for next development iteration 2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2 [maven-release-plugin] prepare release v1.8.0.Beta1 2021-11-30 09:38:47 +00:00
Kate
b51a4be019 DBZ-4331 Avoid holding metadata lock in R/O incremental snapshots 2021-11-30 09:28:44 +01:00
Gunnar Morling
be2d2d20c7 DBZ-4334 Propagating exception message 2021-11-24 11:16:34 +01:00
harveyyue
c0ba784459 DBZ-4334 Convert mysql time type default value error 2021-11-24 11:16:34 +01:00
harveyyue
304c7a3952 DBZ-4320 support for JSON function in MySQL index 2021-11-23 09:57:07 +01:00
Anisha Mohanty
f1173e53d4
DBZ-4225 Update last offset for logging statements
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-11-17 15:46:22 +01:00
Kate
44073cf7d8 DBZ-4196 Support schema changes during incremental snapshot 2021-11-16 14:56:06 +01:00
Chris Cranford
3569cb4602
DBZ-4291 Reducing log verbosity
* Reduce Incremental Snapshot Test verbosity
* Reduce excessive SnapshotReader logging
2021-11-16 14:46:27 +01:00
Vojtech Juranek
15ccdbed70 DBZ-1344 Don't warn about empty schema when using snapshot mode 'never' 2021-11-16 10:01:20 +01:00
Debezium Builder
f93e901dce [maven-release-plugin] prepare for next development iteration 2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19 [maven-release-plugin] prepare release v1.8.0.Alpha2 2021-11-11 09:21:59 +00:00
harveyyue
80e97964f1 DBZ-4261 Support all charsets in MySQL parser 2021-11-10 16:55:05 +01:00
Kate
992ae537c8 DBZ-4244 Quote signal table name in MySQL connector 2021-11-10 10:18:26 +01:00
harveyyue
a707da9645 DBZ-4246 Does Debezium support database using charset GB18030 2021-11-05 20:37:32 +01:00
harveyyue
aa3ae05e22 DBZ-4107 Incremental snapshot doesn't work without primary key 2021-11-05 13:31:26 +01:00
Gunnar Morling
1226c3b2ab DBZ-4029 Misc. clean-up;
* Exposing heartbeatInterval() on CommonConnectorConfig
* Closing heartbeat connection
* Making test more resilient
* Correct member ordering and visibility
* Doc fixes
2021-11-05 13:27:09 +01:00
ahodavdekar
91b7ef2c36 DBZ-4029 Adding support for heartbeat action queries to MySQL connector 2021-11-05 13:27:09 +01:00
Chris Cranford
9f75ece307 DBZ-4241 Add more assertions for MySqlTimestampColumnIT 2021-11-04 17:21:40 +01:00
Gunnar Morling
d1cae3f3b7 DBZ-3966 Making defaultValueExpression() return Optional<String> from editor too 2021-11-04 10:47:17 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
Gunnar Morling
6aa9b2ea96 DBZ-3966 Avoiding reference to Column::defaultValue 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Kate
a645d0bc7e DBZ-4197 Process transaction started/committed in R/O snapshot 2021-11-04 06:19:58 +01:00
harveyyue
3ced90130e DBZ-4229 CREATE PROCEDURE DDL throws ParsingException 2021-11-03 18:23:22 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4 DBZ-2975 Using Offsets in recover() contract;
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
harveyyue
62f00343b7 DBZ-4174 DDL statement couldn't be parsed 2021-11-01 09:22:09 +01:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
harveyyue
4be1674dbd DBZ-4166 Producer failure NullPointerException 2021-10-26 19:23:09 +05:30
harveyyue
3f2fe270b2 DBZ-4193 Parse the "window" keyword for agg and nonagg function in mysql8 2021-10-25 14:28:02 +02:00
Jiri Pechanec
ebc49b41c2 DBZ-4000 Fix typo in test name 2021-10-20 15:19:31 +02:00
harveyyue
90e9bea93f DBZ-4000 Support parse table and columns comment 2021-10-20 15:19:31 +02:00
Hossein Torabi
6027d762a6 DBZ-4150 Trim numerical defaultValue before converting postgres-connector 2021-10-19 12:27:26 +02:00
Chris Cranford
fef29f1093
DBZ-4032 Treat empty TIMESTAMP blob value as null 2021-10-19 09:39:27 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Hossein Torabi
aa2d8539f9 DBZ-3989 Trim numerical default values before parsing 2021-10-12 15:29:31 +02:00
Jiri Pechanec
aec2080415 DBZ-3895 Config returns Patterns not Strings 2021-10-11 10:57:33 +02:00
Jiri Pechanec
68f148c3f3 DBZ-3895 Make snapshot collection list matching case insensitive 2021-10-11 10:57:33 +02:00
Anisha Mohanty
52f9669807 DBZ-4005 Remove hard-coded version of MySQL example image 2021-10-06 09:22:12 +02:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00
Debezium Builder
bec0b6b67e [maven-release-plugin] prepare for next development iteration 2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725 [maven-release-plugin] prepare release v1.7.0.CR2 2021-09-23 06:31:25 +00:00
Kate
0099a50c53 DBZ-3948 Support kafka topic based signals 2021-09-22 13:08:45 +02:00
Vivek Wassan
b6e891ec7d DBZ-3951 Moving preReadChunk() to AbstractIncrementalSnapshotChangeEventSource 2021-09-22 07:01:29 +02:00
Vivek Wassan
65ac2387dc DBZ-3951 Adding a separate isValid method 2021-09-22 07:01:29 +02:00