Debezium Builder
683851fd90
[maven-release-plugin] prepare release v1.9.0.Final
2022-04-05 14:49:51 +00:00
Nenad Stojanovikj
2d89f296de
DBZ-4933 Fix NPE on null column data in MySQL
...
When doing a snapshot on a MySQL database which has char type columns
(VARCHAR, TEXT, CHAR) and they are null, and a custom converter is
present, the MySQL reader throws an NPE.
This fix addresses the problem by returning an object from the `null`
value.
https://issues.redhat.com/browse/DBZ-4933
2022-04-01 08:36:05 +02:00
Jiri Pechanec
586657f715
DBZ-3541 Test scientific as string
2022-03-29 09:12:17 +02:00
Sergei Morozov
a0533227cb
DBZ-3541 Test case for scientific notation
2022-03-29 09:12:17 +02:00
Sergei Morozov
d766d806af
DBZ-3541 Round decimal default values of integer columns
2022-03-29 09:12:17 +02:00
Debezium Builder
ab7fe3b96a
[maven-release-plugin] prepare for next development iteration
2022-03-25 16:45:06 +00:00
Debezium Builder
d19fc234ee
[maven-release-plugin] prepare release v1.9.0.CR1
2022-03-25 16:45:06 +00:00
Sergei Morozov
b258674782
DBZ-3535: Introduce schema.name.adjustment.mode
2022-03-24 09:37:05 +01:00
Sergei Morozov
3a03ff0186
DBZ-3535: Remove unused EventDispatcher constructor parameter
2022-03-24 09:37:05 +01:00
Vojtěch Juránek
49d3a10f1e
DBZ-3949 Ignore DML records in binlog in MySQL connector;
...
In some cases (e.g. in some cases when MEMORY engine is used), DML
records can appear in binlog in spite of the fact it's set to ROW
format. Always ignore these records.
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-03-23 08:12:02 +01:00
Vojtech Juranek
0163c07800
DBZ-4786 Avoid NPE when removing column which doesn't exists
2022-03-23 07:53:06 +01:00
harveyyue
e1706802a6
DBZ-4787 Improving MySQL SSL truststore/keystore property descriptions
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-03-18 09:11:23 +01:00
kate
4b2d5c29be
DBZ-4878 Re-read incremental snapshot chunk on DDL event
2022-03-18 07:55:43 +01:00
harveyyue
044e454e0a
DBZ-4832 Don't set truststore/keystore parameters to system variables
2022-03-15 11:25:28 +01:00
harveyyue
dac2e1350f
DBZ-4841 Debezium Mysql connector can't handle CREATE INDEX IF NOT EXISTS (MariaDB)
2022-03-11 15:11:00 +01:00
harveyyue
ba3438c860
DBZ-4822 Mysql: Getting ERROR `Failed due to error: connect.errors.ConnectException: For input string: "false"
2022-03-11 10:22:43 +01:00
harveyyue
759e52c423
DBZ-4787 Skip some tests with SSL auth enabled
2022-03-11 10:10:18 +01:00
harveyyue
66d413c114
DBZ-4833 MySQL 5.7 - no viable alternative at input 'ALTER TABLE ORD_ALLOCATION_CONFIG CHANGE RANK'
2022-03-10 15:09:13 +01:00
Gunnar Morling
b46773e5e4
DBZ-4787 Making one more test pass with SSL auth enabled, removing another, now obsolete, one
2022-03-09 14:42:51 +01:00
Gunnar Morling
76b365e1cb
DBZ-4787 Skipping one test when SSL authentication is enabled
2022-03-09 12:12:25 +01:00
Gunnar Morling
8896feb635
DBZ-4787 Adjusting several tests to run with SSL enabled
2022-03-09 11:24:49 +01:00
Gunnar Morling
7e987cd806
DBZ-4787 Simplifying the execution of tests with SSL authentication in the IDE;
...
When starting a MySQL test with -Ddatabase.ssl.mode=verify_ca, the right
defaults for truststore/keystore location and password are used, matching
the set-up created and executed by the Maven build.
2022-03-09 09:23:13 +01:00
Gunnar Morling
8125b7d8b8
DBZ-4787 Allowing to run entire MySQL test suite with SSL authentication
2022-03-09 09:23:13 +01:00
harveyyue
e7dc03fe6d
DBZ-4787 Add mysql connector ssl it and build the relation mysql docker container
2022-03-09 09:23:13 +01:00
harveyyue
49963a5688
DBZ-4787 Not reading the keystore/truststore when enable mysql ssl configurations
2022-03-09 09:23:13 +01:00
harveyyue
da67ba332e
DBZ-4823 Add event type for filtering trace message
2022-03-08 09:43:01 +01:00
Gunnar Morling
d20a6f00e7
DBZ-4801 Using JdbcConfiguration in JdbcConnection
2022-03-07 17:53:45 +01:00
Gunnar Morling
c1c322ecf0
DBZ-4801 Simplifying JdbcConnection constructors
2022-03-07 17:53:45 +01:00
Gunnar Morling
d7dfeed12d
DBZ-4823 Consistent trace message in case of filtering
2022-03-07 14:41:21 +01:00
harveyyue
b30a8d8492
DBZ-4823 Log the tableId is null when filter out some tables
2022-03-07 12:44:58 +01:00
harveyyue
856ab85cef
DBZ-4824 Expect the null value with snapshot CapturedTables metric when skipping snapshotting
2022-03-07 12:19:13 +01:00
Debezium Builder
fece16039c
[maven-release-plugin] prepare for next development iteration
2022-03-03 17:00:08 +00:00
Debezium Builder
e0d8a0d809
[maven-release-plugin] prepare release v1.9.0.Beta1
2022-03-03 17:00:08 +00:00
Gunnar Morling
e050d17c4c
[ci] Expanding logging in flaky test
2022-02-23 08:57:02 +01:00
Jiri Pechanec
d13a1635d7
DBZ-3952 Store schema for tables not in schema collection list
2022-02-17 07:41:00 +01:00
Sergei Morozov
2d14b5b09f
DBZ-4478: Multi-partition metrics for SQL Server
2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c
DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces
2022-02-16 11:31:38 +01:00
harveyyue
8431a614a2
DBZ-4730 Expect plain value instead of scientific exponential notation when using decimal string mode
2022-02-10 17:40:12 +01:00
Debezium Builder
7a47f478a4
[maven-release-plugin] prepare for next development iteration
2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e
[maven-release-plugin] prepare release v1.9.0.Alpha2
2022-02-09 07:23:10 +00:00
Farid Uyar
a559e51b08
DBZ-4547 Create History Topic with optional RF
2022-02-08 16:58:13 +01:00
Ismail Simsek
25ed5898c5
DBZ-4675 parse MariaDB PAGE_COMPRESSED and PAGE_COMPRESSION_LEVEL table options
2022-02-04 11:07:14 -05:00
Snigdhajyoti Ghosh
0ab45ecab0
DBZ-4518 Make kafka query timeout configurable
2022-02-04 14:08:15 +01:00
Ismail Simsek
a59b5a203e
DBZ-4661 parse MariaDB encrypted keyword
...
Co-authored-by: Anisha Mohanty <anishamohanty23@gmail.com>
2022-02-04 15:15:07 +05:30
Gunnar Morling
a9bf4d6bd5
DBZ-4294 Awaiting PURGE has happened;
...
Also fixing the regexp for capturing the start TX id. Only one
capturing group is needed, and the first one would never capture
anything due to the greedy part before.
2022-02-03 15:10:05 -05:00
Jiri Pechanec
fafcea9fe4
DBZ-4605 Upgrade binlog client; test MySQL partial update
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-02-02 10:36:56 +01:00
harveyyue
bfd2ce97e8
DBZ-4640 Parse including keyword column table ddl error
2022-01-30 12:04:04 -05:00
Debezium Builder
33e2f5cd0f
[maven-release-plugin] prepare for next development iteration
2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e
[maven-release-plugin] prepare release v1.9.0.Alpha1
2022-01-26 19:00:20 +00:00
Chris Cranford
35ef67852c
DBZ-4562 Reduce log verbosity
2022-01-25 18:41:06 +01:00
Jiri Pechanec
4236e3291a
DBZ-4583 Workround for columns longer than max int
2022-01-25 15:16:47 +01:00
Jiri Pechanec
664d989e42
DBZ-4577 Provide custom error message handling
2022-01-21 10:24:19 +01:00
Jiri Pechanec
8f5bb31eab
DBZ-3700 Strings a bytes only when converters present
...
When database was used with non-UTF8 charset the snapshot was sending
byte array with UTF-8 bytes but MySQL converter was using database based
charset to convert it to String leading to malformed data.
It is necessary to convert strings using the database charset but it
might be a problem in case of non-charset matching.
The current solution
1) Uses strings by default
2) Switches to byte array only when converters are present to cover
original use case
3) If the conversion fails it switches back to string
2022-01-19 16:20:32 +01:00
Jiri Pechanec
8fd3243a86
DBZ-2224 Test logging based on logback
2022-01-18 11:24:21 +01:00
Sergei Morozov
17fba7258b
DBZ-4541: Promote failure to register metrics to exception
2022-01-14 19:50:57 +01:00
Sergei Morozov
6d97433d18
DBZ-4541: Remove logger from Metrics register/unregister signatures
2022-01-14 19:50:57 +01:00
Chris Cranford
4f5f72500c
DBZ-4371 Add hint on how to log problematic values
2022-01-13 08:16:20 +01:00
Chris Cranford
0721ff991c
DBZ-4371 Log problematic column values
2022-01-13 08:16:20 +01:00
Sergei Morozov
0329859cda
DBZ-4459: Introduce interfaces and default implementations for change event source metrics
2022-01-12 14:32:19 +01:00
Anisha Mohanty
d6c5ad2e7c
DBZ-4460 Renaming all openapi occurrences to schema
2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f
DBZ-4460 Set default values for format & output directory
2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691
DBZ-4460 Apply the plug-in to all connector modules
2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221
DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation
2022-01-06 19:03:46 +01:00
Kate
22ba108e0d
DBZ-4502 Check GTID changes when current GTID is undefined
2022-01-04 08:54:19 +01:00
Kate
5d81466ec1
DBZ-4501 Null out incremental snapshot event's query field
2022-01-03 14:38:36 +01:00
Qishang Zhong
189c3baa07
DBZ-4500 Set the correct binlog serverId & threadId
2022-01-03 14:03:58 +01:00
harveyyue
831217053c
DBZ-4503 Drop the primary key column getting exception
2022-01-03 10:57:07 +01:00
harveyyue
3670b0c6ef
DBZ-4497 Parse multiple signed/unsigned keyword from ddl statement failed
2022-01-03 10:47:03 +01:00
harveyyue
792187f669
DBZ-4472 Make connector task partition readability for log
2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98
[maven-release-plugin] prepare for next development iteration
2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f
[maven-release-plugin] prepare release v1.8.0.Final
2021-12-16 10:11:28 +00:00
Gunnar Morling
0023cb10a5
DBZ-4393 Create a Debezium Schema Generator for Debezium connectors
...
* added an API generator for Debezium connectors and static API definitions for connectors in a separate module
* added Maven plug-in
* added GH workflow for debezium-schema-generator
Co-authored-by: rkerner <rkerner.mobil@gmail.com>
Co-authored-by: Anisha Mohanty <anishamohanty23@gmail.com>
2021-12-10 12:35:09 +01:00
Debezium Builder
f53e6c00df
[maven-release-plugin] prepare for next development iteration
2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a
[maven-release-plugin] prepare release v1.8.0.CR1
2021-12-09 20:16:04 +00:00
Debezium Builder
b5439b54bf
[maven-release-plugin] prepare for next development iteration
2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2
[maven-release-plugin] prepare release v1.8.0.Beta1
2021-11-30 09:38:47 +00:00
Kate
b51a4be019
DBZ-4331 Avoid holding metadata lock in R/O incremental snapshots
2021-11-30 09:28:44 +01:00
Gunnar Morling
be2d2d20c7
DBZ-4334 Propagating exception message
2021-11-24 11:16:34 +01:00
harveyyue
c0ba784459
DBZ-4334 Convert mysql time type default value error
2021-11-24 11:16:34 +01:00
harveyyue
304c7a3952
DBZ-4320 support for JSON function in MySQL index
2021-11-23 09:57:07 +01:00
Anisha Mohanty
f1173e53d4
DBZ-4225 Update last offset for logging statements
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-11-17 15:46:22 +01:00
Kate
44073cf7d8
DBZ-4196 Support schema changes during incremental snapshot
2021-11-16 14:56:06 +01:00
Chris Cranford
3569cb4602
DBZ-4291 Reducing log verbosity
...
* Reduce Incremental Snapshot Test verbosity
* Reduce excessive SnapshotReader logging
2021-11-16 14:46:27 +01:00
Vojtech Juranek
15ccdbed70
DBZ-1344 Don't warn about empty schema when using snapshot mode 'never'
2021-11-16 10:01:20 +01:00
Debezium Builder
f93e901dce
[maven-release-plugin] prepare for next development iteration
2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19
[maven-release-plugin] prepare release v1.8.0.Alpha2
2021-11-11 09:21:59 +00:00
harveyyue
80e97964f1
DBZ-4261 Support all charsets in MySQL parser
2021-11-10 16:55:05 +01:00
Kate
992ae537c8
DBZ-4244 Quote signal table name in MySQL connector
2021-11-10 10:18:26 +01:00
harveyyue
a707da9645
DBZ-4246 Does Debezium support database using charset GB18030
2021-11-05 20:37:32 +01:00
harveyyue
aa3ae05e22
DBZ-4107 Incremental snapshot doesn't work without primary key
2021-11-05 13:31:26 +01:00
Gunnar Morling
1226c3b2ab
DBZ-4029 Misc. clean-up;
...
* Exposing heartbeatInterval() on CommonConnectorConfig
* Closing heartbeat connection
* Making test more resilient
* Correct member ordering and visibility
* Doc fixes
2021-11-05 13:27:09 +01:00
ahodavdekar
91b7ef2c36
DBZ-4029 Adding support for heartbeat action queries to MySQL connector
2021-11-05 13:27:09 +01:00
Chris Cranford
9f75ece307
DBZ-4241 Add more assertions for MySqlTimestampColumnIT
2021-11-04 17:21:40 +01:00
Gunnar Morling
d1cae3f3b7
DBZ-3966 Making defaultValueExpression() return Optional<String> from editor too
2021-11-04 10:47:17 +01:00
jiabao.sun
24ead16c24
DBZ-3966 Remove defaultValue and keep defaultValueExpression
2021-11-04 10:47:17 +01:00
Gunnar Morling
6aa9b2ea96
DBZ-3966 Avoiding reference to Column::defaultValue
2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697
DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues
2021-11-04 10:47:17 +01:00
Kate
a645d0bc7e
DBZ-4197 Process transaction started/committed in R/O snapshot
2021-11-04 06:19:58 +01:00
harveyyue
3ced90130e
DBZ-4229 CREATE PROCEDURE DDL throws ParsingException
2021-11-03 18:23:22 +01:00
ahodavdekar
1d81b6db19
DBZ-4077 Exposing the transaction metadata topic name as a config option
2021-11-02 06:07:05 +01:00