jiabao.sun
96c2d33c83
DBZ-3969 Strings with binary collation shouldn't be parsed as Types.BINARY
2021-09-06 12:12:41 +02:00
Kate
390a331ecb
DBZ-3947 Fix empty high watermark check
2021-09-06 10:53:33 +02:00
Anisha Mohanty
153e0920e1
DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
...
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Gunnar Morling
aea2827016
DBZ-2525 Removing unused methods
2021-08-30 12:20:55 +02:00
Jiri Pechanec
a36eb45dff
DBZ-3912 Added Binary padding for hex/base64 handling mode
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-08-27 09:48:19 +02:00
rkerner
52333596de
DBZ-3364 add additional metadata to fields for API spec generator for the Debezium UI
...
part of https://issues.redhat.com/browse/DBZ-3364
DBZ-2653 User rollback from parent class
2021-08-23 17:57:38 +02:00
Jiri Pechanec
934c078e30
DBZ-3833 Misc. clean-up
2021-08-16 13:43:51 +02:00
Jiri Pechanec
ad1fb98fe7
DBZ-3833 Skip legacy test failures
2021-08-16 13:43:51 +02:00
Jiri Pechanec
f173def3b2
DBZ-3833 Receive timezoned data in server timezone
2021-08-16 13:43:51 +02:00
Erik Malm
f53ab40ddb
DBZ-3833 Updated mysql-connector-java dependency to 8.0.26
...
Updated charset extraction method to use new static accessor methods, rather than direct field access.
MySqlValueConverters.java: Added wrapper class to access Java charset mappings in mysql-connector-java class.
2021-08-16 13:43:51 +02:00
Jiri Pechanec
99d5748584
DBZ-3869 Stop connector only after error was recorded
2021-08-13 21:26:07 +02:00
Chris Cranford
7b2cdf9235
DBZ-3773 Add logging about each column value
2021-08-13 06:08:15 +02:00
Chris Cranford
3182af55da
DBZ-3773 Treat empty TIME blob value as null
2021-08-13 06:08:15 +02:00
Chris Cranford
e74b1c4999
DBZ-3838 Suggested changes
2021-08-11 23:57:09 +02:00
Chris Cranford
060420b0bc
DBZ-3838 Do not reset trx isolation when using minimal_percona
2021-08-11 23:57:09 +02:00
Chris Cranford
c15cf81e18
DBZ-3839 Correctly skip tests with minor/patch not specified
2021-08-11 07:35:57 +02:00
Sergei Morozov
a40ad7132d
DBZ-2975: Remove partition from offset context
2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12
DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets
2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52
DBZ-2975: Move Partition to io.debezium.pipeline.spi
2021-08-11 07:34:37 +02:00
pkgonan
5e0ffa28d2
DBZ-3765 Allow dot in database.server.name
2021-08-08 16:25:15 -04:00
Kate
c6e530cc27
DBZ-3577 Skip read-only test when gtid mode is off
2021-07-29 07:10:46 +02:00
Kate
6a30ad3811
DBZ-3577 Fix race condition in shouldFailOnSchemaInconsistency test
2021-07-29 07:10:46 +02:00
Kate
9b66ab374a
DBZ-3577 Support read-only MySQL incremental snapshots
2021-07-29 07:10:46 +02:00
Chris Cranford
add76ae008
DBZ-3717 Fix formatting
2021-07-22 14:12:38 -04:00
Chris Cranford
c3684539c3
DBZ-3717 Add test case
2021-07-22 14:12:38 -04:00
Chris Cranford
ed31ea9ffb
DBZ-3668 Adjust ServiceLoader for SPI change
2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d
DBZ-3668 Extracting SPI package
2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110
DBZ-3668 Add ServiceLoader hook CloudEvents converter
2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba
DBZ-2975: Add partition awareness to source task components
...
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Jiri Pechanec
472b82abb7
DBZ-3622 Decouple database and schema history record writes
2021-06-29 10:36:41 +02:00
Jiri Pechanec
443c0ce089
DBZ-3622 Fix non-captured database storing; make the code more robust
2021-06-29 10:36:41 +02:00
camile.sing
b05ac5549e
DBZ-3638 Modify Mysql SourceInfo to be public
2021-06-17 16:16:05 +02:00
Sergei Morozov
b36e8247a3
DBZ-3615: Keep database connection closed during schema recovery
2021-06-15 11:27:44 +02:00
Gunnar Morling
1ce65fa628
DBZ-2975 Avoiding raw types in some places;
...
Also parameterizing offset loader contract, so to avoid casts later on.
2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542
DBZ-2975: Extract offset context from object states to method signatures
2021-06-09 16:02:33 +02:00
Sergei Morozov
213d9ffdcc
DBZ-3562: Revert test changes from DBZ-3427
2021-05-27 11:03:30 +02:00
Sergei Morozov
3b72e5149c
DBZ-3486: Replace @see with @link where a URL is referenced
2021-05-25 07:19:43 +02:00
Jiri Pechanec
4929397022
DBZ-3500 Per-connector table name quoting
2021-05-20 08:06:37 +02:00
Jiri Pechanec
a626dc149f
DBZ-3500 Provide common test for incremental snapshot testing
2021-05-20 08:06:37 +02:00
Jiri Pechanec
5486cf3cf9
DBZ-3399 Add asserts for DDLs
2021-05-18 10:26:10 +02:00
Jiri Pechanec
0dc25a6846
DBZ-3399 Store full RENAME TABLE in history
2021-05-18 10:26:10 +02:00
Jiri Pechanec
367746fcc9
DBZ-3485 Emit quoted DROP TABLE
2021-05-18 10:26:10 +02:00
Jiri Pechanec
4df0d93b4d
DBZ-2300 Make too many connections retriable
2021-05-13 08:07:38 -04:00
John Martin
cef0997428
DBZ-3508 return empty ConfigDef for ReadToInsertEvent.config
2021-05-11 05:59:33 +02:00
Jiri Pechanec
b4327ab13a
DBZ-3499 Moved test statements to examples
2021-05-06 06:14:24 +02:00
Tommy Karlsson
f9028926f8
DBZ-3499 Add support for parsing of GRANT statements with newer MySQL privileges
2021-05-06 06:14:24 +02:00
Jiri Pechanec
5c722341e2
DBZ-3473 Extract incremental snapshot contract
2021-05-06 05:37:36 +02:00
Jiri Pechanec
39d21806eb
DBZ-3473 Metrics enabled
2021-05-06 05:37:36 +02:00
Jiri Pechanec
3d940ca14a
DBZ-3473 Support for cursor-based fetching
2021-05-06 05:37:36 +02:00
Jiri Pechanec
c53785dde7
DBZ-3473 Incremental Snapshot support for MySQL
2021-05-06 05:37:36 +02:00
Jiri Pechanec
7415dc91de
DBZ-3497 Rename the variable
2021-05-05 13:17:28 +02:00
Anisha Mohanty
5156ea0d16
DBZ-3497 Handle MySQL DATE default value parser to accept timestamp
2021-05-05 13:17:28 +02:00
Anisha Mohanty
a6b54c7000
DBZ-3427 Validate the server name field
2021-04-28 13:18:52 +02:00
Gunnar Morling
0250c64013
DBZ-3161 Formatting
2021-04-26 13:07:23 +02:00
Gunnar Morling
b225092f1a
DBZ-3161 Using fallback option in legacy code path
2021-04-26 13:07:23 +02:00
Anisha Mohanty
11fb079582
DBZ-3161 Add database.history.store.only.captured.tables.ddl option & CapturedTables metrics to documentation
2021-04-26 13:07:23 +02:00
Anisha Mohanty
f0f8d5d180
DBZ-3161 Refactor/Rename all references of MonitoredTables to CapturedTables
2021-04-26 13:07:23 +02:00
Gunnar Morling
ec5746a7fe
DBZ-3233 Propagating socket exceptions
2021-04-21 12:36:47 +02:00
Gunnar Morling
42a7b74725
DBZ-3403 Misc. improvements
2021-04-14 11:14:07 +02:00
Hossein Torabi
ba048cf47d
DBZ-3403 Semi Optimisation on MongoDB and MySQL connector for skipped.operations
2021-04-14 11:14:07 +02:00
yangsanity
a2b4c263d3
DBZ-3238 Snapshot fails when reading TIME, DATE, DATETIME fields in mysql from ResultSet
2021-04-08 12:05:29 +02:00
Chris Egerton
67f044ff87
DBZ-3371: Adjust scale of fallback BigDecimal values to match column schema
2021-04-06 10:35:23 +02:00
Jiri Pechanec
f50c3e8222
DBZ-3361 Prefer DDL over logical schema for MySQL
2021-03-30 11:35:12 +02:00
JLDLaughlin
06b0475f17
DBZ-2911 Add additional LSN information to all sources
...
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00
Gunnar Morling
178140ae9c
DBZ-3218 Removing superfluous method parameter
2021-03-19 15:04:20 +01:00
Anisha Mohanty
c761d92b2a
DBZ-3218 Add separate method for logging warnings
2021-03-19 15:04:20 +01:00
Jiri Pechanec
495be2659b
DBZ-2511 Dedicated logger for schema name adjuster
2021-03-18 14:42:34 +01:00
Jiri Pechanec
11e4880018
DBZ-3309 Revert to MySQL specific default snapshot fetch size
2021-03-18 11:08:26 +01:00
Gunnar Morling
647076ea69
DBZ-2957 Misc. fixes;
...
* Simplifying reg exp
* Adding leniency towards whitespace
* Reporting *all* problems including correct count
* Fixing incorrect actual/expected order
2021-03-17 14:04:16 +01:00
Anisha Mohanty
2e5a5ce001
DBZ-2957 Handle message.key.columns regex validation time complexity
2021-03-17 14:04:16 +01:00
Jiri Pechanec
f5475cf7c5
DBZ-3304 Fix intermittent test failure
2021-03-17 11:43:01 +01:00
Gunnar Morling
911b5e9a3b
DBZ-3271 Unifying filter handling across relational connectors
2021-03-17 09:54:25 +01:00
ani-sha
c39192e9f2
DBZ-3067 Add OR REPLACE condition for create index
2021-02-23 08:54:28 +01:00
Fahim Farook
194258d87b
DBZ-3164 Log database connection validation failures consistently
2021-02-22 14:52:22 +01:00
Gunnar Morling
e024fc60ab
DBZ-3095 Propagating socket exceptions
2021-02-19 10:30:41 +01:00
Gunnar Morling
edcc3a041f
DBZ-3147 Renaming test connection class
2021-02-19 09:16:31 +01:00
Nitin Agarwal
62f51e8b29
DBZ-3114: addressing review comments
2021-02-18 12:41:34 +01:00
Jiri Pechanec
737d2353a6
DBZ-3114 Test more resilient for repeted runs and testsuite execution
2021-02-18 12:41:34 +01:00
Jiri Pechanec
decb4ec3da
DBZ-3114 Tests only for new implementation
2021-02-18 12:41:34 +01:00
Nitin Agarwal
fd1ceeb02e
DBZ-3114 Transaction metadata feature in MySQL connector
2021-02-18 12:41:34 +01:00
ani-sha
b6c61ac810
DBZ-2788 Replace MySQL connector option with SMT for mitigating wrong op flag
2021-02-18 12:35:03 +01:00
Gunnar Morling
184d1a2399
DBZ-3056 Misc. clean-up
2021-02-16 12:45:09 +01:00
Yilong Chang
a0b3704832
DBZ-3056 Validate all fields in subclasses.
2021-02-16 12:34:06 +01:00
Yilong Chang
76c7e0d426
DBZ-3056 Extract basic valdiation in parent class.
2021-02-16 12:34:06 +01:00
Gunnar Morling
cb2b2fc07a
DBZ-3099 Doc fix
2021-02-16 10:11:23 +01:00
Jiri Pechanec
1c9f7a1c1c
DBZ-3099 Document non-volatile fields accessed by a single thread
2021-02-16 10:02:17 +01:00
Jiri Pechanec
745bb6c11d
DBZ-3099 Address review comments; extract history comparator for testability
2021-02-16 10:02:17 +01:00
Jiri Pechanec
cb1476ce18
DBZ-3099 Address review comments
2021-02-16 10:02:17 +01:00
Gunnar Morling
5ca1d9fc4f
DBZ-3099 Preferring explicit functional interface over Function
2021-02-16 10:02:17 +01:00
Jiri Pechanec
2af13af300
DBZ-3099 Streaming source test for new impl only
2021-02-16 10:02:17 +01:00
Jiri Pechanec
c53082f94f
DBZ-3099 Fix typos
2021-02-16 10:02:17 +01:00
Jiri Pechanec
b0f906df35
DBZ-3099 Race condition in waiting for metrics
2021-02-16 10:02:17 +01:00
Jiri Pechanec
21b15facb2
DBZ-3099 Snapshot buffering to handle config corner cases
2021-02-16 10:02:17 +01:00
Jiri Pechanec
7394ecfd62
DBZ-3099 Make streaming MBean name configurable in tests
2021-02-16 10:02:17 +01:00
Jiri Pechanec
048530aeb8
DBZ-3099 Make metrics tests running with legacy
2021-02-16 10:02:17 +01:00
Jiri Pechanec
ea247b710d
DBZ-3099 Rewritten reader tests to connector
2021-02-16 10:02:17 +01:00
Jiri Pechanec
6a9ca7d544
DBZ-3099 Fix schema recovery; Add table level locking
2021-02-16 10:02:17 +01:00
Jiri Pechanec
08e4988c72
DBZ-3093 Unify snapshot and streaming parsing
2021-02-16 10:02:17 +01:00
Jiri Pechanec
7bfbd5c7c5
DBZ-3093 Dispatch schema change events always
2021-02-16 10:02:17 +01:00
Jiri Pechanec
6607310f13
DBZ-3093 Separate parsing and change applying phase in MySQL schema
2021-02-16 10:02:17 +01:00
Jiri Pechanec
5bf5e18d81
DBZ-3086 Legacy source info make for legacy tests
2021-02-16 10:02:16 +01:00
Jiri Pechanec
f01af4bec8
DBZ-3086 Source info formatting for legacy implementation
2021-02-16 10:02:16 +01:00
Jiri Pechanec
14a628ed60
DBZ-3086 Mark moved method as deprecated
2021-02-16 10:02:16 +01:00
Jiri Pechanec
a43bae7638
DBZ-3086 Separate offset and source info
2021-02-16 10:02:16 +01:00
Jiri Pechanec
e9ed4a0a2a
DBZ-3086 Remove parallel snapshot reader offsets
2021-02-16 10:02:16 +01:00
Jiri Pechanec
488464419e
DBZ-3086 Separate legacy and new SourceInfo
2021-02-16 10:02:16 +01:00
Jiri Pechanec
1d86d7068f
DBZ-3077 Unified record creation
2021-02-16 10:02:16 +01:00
ani-sha
5f8a22a5df
DBZ-2858 Make field descriptions consistent for time values
2021-02-16 09:55:35 +01:00
Jiri Pechanec
f63d08fc28
DBZ-3023 Handle default charsets for table
2021-02-05 05:44:14 +01:00
Jiri Pechanec
ed7a1c2486
DBZ-3047 Run the test after legacy package
2021-02-05 05:44:06 +01:00
Jiri Pechanec
c9fd39d04c
DBZ-1865 Support for when_needed snapshot
2021-02-04 09:07:55 +01:00
Jiri Pechanec
f57343dc3b
DBZ-1865 Use OptionaLong; add comments
2021-02-04 09:07:55 +01:00
Jiri Pechanec
2374b6b045
DBZ-1865 First draft of MySQL rewrite
2021-02-04 09:07:55 +01:00
Jiri Pechanec
23c1546362
DBZ-1865 Modify metrics to conform to new classes
2021-02-04 09:07:55 +01:00
Jiri Pechanec
d333c9f005
DBZ-1865 Move legacy classes into separate package
2021-02-04 09:07:55 +01:00
Jiri Pechanec
5e887b2bfb
DBZ-3020 Ignore expressions in default values
2021-02-03 10:12:09 +01:00
ani-sha
d4003c9172
DBZ-2420 Define database configs under RelationalDatabaseConnectorConfig
2021-02-03 08:05:42 +01:00
rkerner
89cc1d7003
DBZ-3008 Fix that an invalid regex for database.inlcude.list
and database.exlcude.list
does not raise a validation error for MySQL connector and the connector only fails on start, also the config validated before
...
closes https://issues.redhat.com/browse/DBZ-3008
2021-02-01 18:38:54 +01:00
Jiri Pechanec
5092f327d8
DBZ-2922 DatabaseLocales generates the DDL
2021-01-27 10:40:21 +01:00
Jiri Pechanec
8153404033
DBZ-2922 Support for cahrsets from collations
2021-01-27 10:40:21 +01:00
shuguang.xiang
363c794185
DBZ-2922 Resolve column type from collation name
2021-01-27 10:40:21 +01:00
Gunnar Morling
b5bb534429
DBZ-2921 Removing superfluous author tag
2021-01-14 15:52:18 +01:00
Jiri Pechanec
ff4fe78037
DBZ-2921 Record default database charset in history
2021-01-14 15:52:18 +01:00
Jiri Pechanec
fbfba94027
DBZ-2167 Remove superfluous char
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2020-12-21 16:30:15 +01:00
Jiri Pechanec
58713599ba
DBZ-2167 Remove legacy parser completely; tests depending on parser move to MySQL
2020-12-21 16:30:15 +01:00
Jiri Pechanec
a967afbd1a
DBZ-2821 Support for CHAR VARYING use
2020-12-04 10:34:49 +01:00
Jiri Pechanec
b7fede7d53
DBZ-735 Verify Avro serialization
2020-11-27 17:33:23 +01:00
John Martin
f069cd6f3f
DBZ-2775 add option for setting snapshot events as reads
2020-11-20 07:46:07 +01:00
vanhoale
17a424d9ac
DBZ-2662 Handle ChangeEventQueue by the size in bytes
2020-11-16 08:39:33 +01:00
rkerner
9c5db0cd2f
DBZ-2580 Fix "The primary key cannot reference a non-existant column" error from MySQL DDL parser when CREATE TABLE statement starts with a primary key definition like "CREATE TABLE Products (PRIMARY KEY (id), ..." where the referenced primary key column is not yet defined
2020-11-12 07:42:48 +01:00
Kewei Shang
78c061a86d
DBZ-2726 extend data separator and time separator
2020-11-10 10:01:33 +01:00
Kewei Shang
7e44a3068a
DBZ-2726 Clean MySQL TIMESTAMP default value
2020-11-10 10:01:33 +01:00
Jiri Pechanec
b9a6bb35b8
DBZ-2673 Added comment; use defensive equals
2020-11-03 08:02:06 +01:00
Arik Cohen
e44b76fb9d
DBZ-2673 Read the raw bytes of a character-type field
2020-11-03 08:02:06 +01:00
rkerner
c274c2b39b
DBZ-2617 refactor to proper HeartbeatErrorHandler injection
2020-11-03 07:23:02 +01:00
Sergei Morozov
5bccf7ad1d
DBZ-2688: DropViewParserListener should respect the skipViews flag
2020-10-22 05:43:46 +02:00
Jiri Pechanec
b699e37359
DBZ-2670 Modify testing approach
2020-10-21 17:41:22 +02:00
karamel
4898d18184
DBZ-2670 Allow non-Ascii characters in MySQL ids
2020-10-21 17:41:22 +02:00
Kaushik Iyer
7d9e8fdc46
DBZ-2456 fixes after rebase
2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932
DBZ-2456 selective snapshot implementation
2020-10-16 10:13:48 +02:00
John Martin
4fe4aed24f
DBZ-2643 Only set filter info in offsets when snapshot.new.tables = parallel
2020-10-14 16:53:04 +02:00
Jiri Pechanec
2270d23adb
DBZ-2641 BLOB type has dimension
2020-10-08 09:01:23 +02:00
Jiri Pechanec
dd6e10b92b
DBZ-2604 Query charset name in lowercase
2020-10-06 11:41:06 +02:00
Jiri Pechanec
cc09f164b9
DBZ-2604 Use default db charset as default table charset
2020-10-06 11:41:06 +02:00
Peter Junos
ab7db1ddca
DBZ-2583 MySQL connector - ignore statement-based logs
...
Current mysql debezium connector fails once it sees an event generated
with statement or mixed based replication.
As users and programs can call SET SESSION binlog_format='STATEMENT'; as
they wish, they are able to break debezium connector. Only MySQL 8.0.14
is fixing this, but not everyone is on that version.
To prevent connector crashing in such cases, there should be an option
to log these issues and continue. That would be similar to processing
inconsistent schema (on the setting level).
2020-09-29 15:55:15 +02:00
Gunnar Morling
3d12616627
DBZ-2563 Avoiding dependency from MySqlValueConverters to BinlogReader
2020-09-29 10:36:33 +02:00
Gunnar Morling
87d70cb96d
DBZ-2563 Simplifying MySqlValueConverters constructors
2020-09-29 10:36:33 +02:00
Jiri Pechanec
5b2c14e058
DBZ-2563 JSON processing can ignore deserialization errors
2020-09-29 10:36:33 +02:00
Gunnar Morling
c1b057f792
DBZ-2588 Introducing dedicated functional interface for key/value generators;
...
Also keys are always KC Struct instead of generic j.l.Object.
2020-09-25 06:01:59 +02:00
Aaron Brady
9468b1f074
DBZ-2466 Start connector when using Oracle MySQL, so afterEach can stop it
2020-09-15 11:43:49 +02:00
Aaron Brady
a5b30ffa78
DBZ-2466 Address Backup Lock review feedback
2020-09-15 11:43:49 +02:00
Aaron Brady
9057896c89
DBZ-2466 Percona Backup Locks option for snapshots
2020-09-15 11:43:49 +02:00
Aaron Brady
304ad4998c
DBZ-2466 Add Percona Server profile to assembly
2020-09-15 11:43:49 +02:00
rkerner
011c3be948
DBZ-2527 Add missing ListOfRegex validator to all regex list fields and fix dependent fields to not include @Deprecated whitelist/blacklist fields
2020-09-15 10:05:04 +02:00
Gunnar Morling
e91629cc04
DBZ-1962 Doc fix
2020-09-08 17:11:14 +02:00
Jos Huiting
29c6b2abc7
DBZ-1962 Introduce column.whitelist for the MySql connector
2020-09-08 17:06:29 +02:00
rkerner
2c5c093587
DBZ-2171 avoid divisive language
2020-08-21 09:29:04 +02:00
Gunnar Morling
44efd1bc6b
DBZ-2423 Propagating port default values
2020-08-12 13:50:42 +02:00
Chris Cranford
00463e10c0
DBZ-2332 Fix test failures with Kafka 1.x CI
...
MySqlDecimalIT#testPreciseDecimalHandlingMode
SqlServerConnectorIT#restartInTheMiddleOfTx
2020-08-04 23:21:23 +02:00
Gunnar Morling
e70708a6ad
DBZ-1939 Removing unused methods; reducing visbility
2020-07-30 17:53:22 +02:00
Gunnar Morling
5cb82bb7c7
DBZ-1939 Simplifying boolean logic
2020-07-30 17:53:22 +02:00
Arik Cohen
e111bd585c
DBZ-1939 graceful handling of "phantom" tables
2020-07-30 17:53:22 +02:00
Gunnar Morling
c1a1f381e9
DBZ-2387 Formatting
2020-07-30 09:04:51 +02:00
Moira Tagle
bee8d30f39
DBZ-2387 fix NPE in ParallelHaltingPredicate
2020-07-30 09:04:51 +02:00
Jiri Pechanec
6e1eb61e72
DBZ-2365 LONG types have separate grammar rules
2020-07-24 08:30:40 +02:00
Jiri Pechanec
18d0143d64
DBZ-2365 Support for crss-db datatypes
2020-07-24 08:30:40 +02:00
Kewei Shang
9811b67e9a
DBZ-2330 Fix null default value when NOT NULL is after DEFAULT
2020-07-15 09:14:46 +02:00
Michael Wang
d7ae30a8d1
DBZ-2305 Allow single dimension DECIMAL in CAST
2020-07-13 20:52:12 +02:00
Chris Cranford
e3abc020c9
DBZ-2238 Fix test failure - MySqlSourceTypeInSchemaIT#shouldPropagateSourceTypeAsSchemaParameter
2020-07-10 08:14:28 +02:00
Chris Cranford
a286de7d97
DBZ-2269 Fix test failure - MySqlSourceTypeInSchemaIT#shouldPropagateSourceTypeByDatatype
2020-07-09 08:23:59 +02:00
Chris Cranford
1aae3cd262
DBZ-2243 Fix test failure - MySqlConnectorRegressionIT#shouldConsumeAllEventsFromDatabaseUsingBinlogAndNoSnapshot
2020-07-09 06:30:56 +02:00
Chris Cranford
6a8eb416a1
DBZ-2270 Fix test failure - MySqlConnectorIT#shouldNotParseQueryIfServerOptionDisabled
2020-07-09 06:29:41 +02:00
rkerner
7b2e9be0d5
DBZ-730 add MySqlDecimalIT integration test for all decimal.handling.mode/s
2020-07-09 06:26:52 +02:00
Chris Cranford
f5ab12c346
DBZ-2229 Fix test failure - MySqlConnectorRegressionIT#shouldConsumeAllEventsFromDecimalTableInDatabaseUsingBinlogAndNoSnapshot
2020-07-08 21:56:10 +02:00
Jiri Pechanec
15c49f3fb6
DBZ-2301 Hide internal config fields
2020-07-01 15:46:17 +02:00
Jiri Pechanec
3c6f3eb75c
DBZ-2278 Resolve concurrent access to the thread map
2020-06-26 08:38:59 +02:00
Randall Hauch
5860812a63
DBZ-2275 Updated default database history DML filter default to handle additional RDS statements;
...
* Added two more regular expressions to the default database history DML filter. These are intended to catch and filter out `INSERT into mysql.rds_monitor…` statements that RDS may write in the binlog
* Added a new unit test that checks that the regular expressions do catch some example statements
2020-06-25 20:57:49 +02:00
Jiri Pechanec
87d93d44fd
DBZ-2221 Wait for keepalive thread initialization
2020-06-24 09:14:42 +02:00
Jiri Pechanec
50943f59f7
DBZ-2267 Optionality ignored while converting default value
2020-06-23 18:36:36 +02:00
Jiri Pechanec
e9355c3589
DBZ-2261 Take the full filter count into assert
2020-06-22 20:54:44 +02:00
Jiri Pechanec
dc3d251f16
DBZ-2207 Intermittnet test failure
2020-06-16 16:55:34 +02:00
Chris Cranford
d4cefaa1c2
DBZ-2177 Fix inconsistent test failure
2020-06-16 00:06:34 +02:00
Jiri Pechanec
752bed1a6f
DBZ-2169 Fix test failure
2020-06-10 17:38:08 -04:00
Emmanuel
c7ef4128db
DBZ-1989 Avoid returning distorted (Milli)SecondsBehindSource values
2020-06-09 17:21:08 +02:00
Balázs Németh
0853940f3d
DBZ-2169 Fix for misuse of ConfigurationDefaults.RETURN_CONTROL_INTERVAL;
...
* Implemented Temporals.min()
* Fixed pollInterval calculation based on the documentation
2020-06-09 10:24:50 +02:00
Gunnar Morling
c54e377dd2
DBZ-1814 Exporting Hex and Base64 representations as string
2020-06-05 12:13:29 +02:00
Gunnar Morling
023064eedb
DBZ-1814 Renaming "raw" to "bytes"; also clarifying that this notion isn't Java-specific
2020-06-05 12:13:29 +02:00
Jeremy Finzel
5db614da21
DBZ-1814 added new binary handling mode option
2020-06-05 12:13:29 +02:00
Gunnar Morling
79a64179c1
DBZ-2140 Typo fix
2020-06-03 11:34:58 +02:00
Jiri Pechanec
71c9607944
DBZ-2140 Handle drop default value
2020-06-03 11:34:58 +02:00
Jiri Pechanec
2b67e26407
DBZ-2130 Avoid ambiguity between type and charset keyword
2020-06-03 11:04:49 +02:00
Jiri Pechanec
06f8023a54
DBZ-2130 CHARACTER keyword used also as a type
2020-06-02 15:11:53 +02:00
Jiri Pechanec
20b45f84f3
DBZ-1657 Remove duplicate option definitions
2020-05-22 12:07:29 +02:00
Jiri Pechanec
e676d715c3
DBZ-2085 Apply custom converters to default values
2020-05-18 17:27:59 +02:00
Fándly Gergő
9cea694510
DBZ-2067 Add support for ALGORITHM=INSTANT on alter table statements
2020-05-14 12:31:14 +02:00
Max Kaplan
1b89b89301
DBZ-2062 allowing compression keyword to contain backticks in create table
2020-05-14 11:21:25 +02:00
Jiri Pechanec
c4f975bd0a
DBZ-2061 Handle change of default value
2020-05-14 08:31:27 +02:00
Chris Cranford
f449550b2d
DBZ-2068 Skip tests incompatible with Kafka 1.x
2020-05-13 08:22:07 +02:00
Jiri Pechanec
e350d74b17
DBZ-1904 Public facing schema history topic
2020-05-04 12:31:05 +02:00
Chris Cranford
11c8e9df3d
DBZ-1953 Rework configuration files
2020-04-29 12:27:38 +02:00
Chris Cranford
230ddaebdc
DBZ-1953 Generalized SkipWhenDatabaseVersion functionality
2020-04-29 12:27:38 +02:00
Chris Cranford
bcae276234
DBZ-1953 MySQL 5.5 and 5.6 added to test matrix
2020-04-29 12:27:38 +02:00
JanHendrikDolling
33d83731af
DBZ-1972 move static Filed methods as static Filed constant to RelationalDatabaseConnectorConfig instead.
2020-04-27 12:31:19 +02:00
Jiri Pechanec
0d8d6a41c5
DBZ-1750 Validate Kafka params only for Kafka history
2020-04-24 15:35:28 +02:00
Gunnar Morling
0998fc533a
DBZ-1895 Completing implementation;
...
* Restoring original derserializers; excluding skipped events in event handlers
* Adding test
2020-04-22 15:04:36 +02:00
Hossein Torabi
9ddd893074
DBZ-1895 Implement SKIPPED_OPERATIONS for mysql
2020-04-22 15:04:36 +02:00
Ivan Klass
75f19239d1
DBZ-1886 Introduce separate storageExists() method to support manual topic creation
2020-04-20 17:46:03 +02:00
Jos Huiting
a0f65830de
DBZ-1962 Remove TABLE_WHITELIST and TABLE_BLACKLIST in favor of definitions in RelationalDatabaseConnectorConfig
2020-04-17 15:24:42 +02:00
Jos Huiting
8ba21a98ef
DBZ-1962 Introduce column.whitelist for the Postgres connector
2020-04-17 15:24:42 +02:00
Chris Cranford
e7d7456a3f
DBZ-1947 Remove obsolete MySQL metrics
2020-04-16 09:31:29 +02:00
JanHendrikDolling
1e19270981
DBZ-1692 Added support for hash based column masking mode for string values
2020-04-08 21:21:42 +02:00
Jiri Pechanec
318d1d3cc7
DBZ-1905 Make thread-naming params internal and optional
2020-04-08 12:18:32 +02:00
Jiri Pechanec
e81aec0ed1
DBZ-1905 Validate database history topic
2020-04-08 12:18:32 +02:00
Chris Cranford
35eaf9828f
DBZ-1950 Make validation of binlog_row_image compatible with MySQL 5.5
2020-04-08 10:28:12 +02:00
Chris Cranford
44bdf429c5
DBZ-1926 Properly log failed SQL during snapshot failure
2020-04-07 08:36:22 +02:00
Jiri Pechanec
242f50b2f3
DBZ-1932 Snapshot events calculated from table stats
2020-04-06 08:52:30 +02:00
Gunnar Morling
3d58d6cf32
DBZ-1911 Formatting; adding Nayana Hettiarachchi to authors list
2020-03-31 13:37:54 +02:00
Nayana Hettiarachchi
2c6e33ac76
DBZ-1911 - improve error messaging for binlog configuration validation
2020-03-31 13:34:06 +02:00
Gunnar Morling
89bb6eba6c
DBZ-1531 Misc. clean-up;
...
* Removing obsolete default impl
* Completing test
* Documention fixes
2020-03-25 12:33:38 +01:00
rk3rn3r
7f36b3c08f
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
Gunnar Morling
aaffae2964
DBZ-1531 Typo fix
2020-03-25 12:33:38 +01:00
rk3rn3r
6310e00675
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
rk3rn3r
fbd8b94e94
DBZ-1531 added headers for primary key update events to reference the original key
2020-03-25 12:33:38 +01:00
Gunnar Morling
c156d30048
DBZ-1723 Centralizing stopping() logic in BaseSourceTask
2020-03-11 13:57:23 +01:00
Gunnar Morling
8ce69dc597
DBZ-1723 Encapsulating common poll() and stop() logic in BaseSourceTask
2020-03-11 13:57:23 +01:00
Jiri Pechanec
082761effc
DBZ-1856 Deprecation process is not necessary
2020-03-11 12:02:07 +01:00
Fabio Cantarini
62b46ae596
DBZ-1830 Enhancement to datatype.propagate.source.type connector property
...
Add support for matching db and table name
Amend documentation accordingly
2020-03-10 14:58:16 +01:00
Fabio Cantarini
61cc791d32
DBZ-1830 Add support for new connector property datatype.propagate.source.type
2020-03-10 14:58:16 +01:00
Chris Cranford
01b4137a13
DBZ-1664 Fix metrics test failures
2020-03-09 23:30:24 +01:00
Chris Cranford
5506fadd2d
DBZ-1664 Verify correctness of JMX metrics
2020-03-09 23:30:24 +01:00
Ruslan Gibaiev
4e45347f8e
DBZ-1833 - CREATE TABLE [IF NOT EXISTS] shouldn't update state for existing table
2020-03-03 13:11:03 +01:00
Jiri Pechanec
504648d367
DBZ-1801 Fix typo
...
Co-Authored-By: Gunnar Morling <gunnar.morling@googlemail.com>
2020-03-03 12:14:16 +01:00
Jiri Pechanec
51b9a732b9
DBZ-1801 TinyInt1 to boolean converter
2020-03-03 12:14:16 +01:00
Jiri Pechanec
e4b4aa818a
DBZ-1834 Support for escaping
2020-03-03 10:56:19 +01:00
Jiri Pechanec
0f11f7e6de
DBZ-1834 Support separately quoted schema and table
2020-03-03 10:56:19 +01:00
Jiri Pechanec
c201578d29
DBZ-1834 Support dots in table names
2020-03-03 10:56:19 +01:00
Jiri Pechanec
06e1eca085
DBZ-1134 Support for user provided converters
2020-02-28 21:58:39 +01:00
Jiri Pechanec
1b77cf21b6
DBZ-1826 Avoid default false warning with default value
2020-02-26 16:55:19 +01:00
Gunnar Morling
c7c7183b11
DBZ-1826 Formatting
2020-02-26 15:49:26 +01:00
Jiri Pechanec
06049a5e9d
DBZ-1826 Rename error handling config field
2020-02-26 15:49:26 +01:00
Jiri Pechanec
e3ce802c36
DBZ-1705 Switch new GTID process to earliest
2020-02-25 16:19:22 +01:00
Jiri Pechanec
f0cc055833
DBZ-1773 Change test for null value
2020-02-17 16:40:52 +01:00
Jiri Pechanec
a4d3c1e89a
DBZ-1773 Process TINYINT(1) as number
2020-02-17 16:40:52 +01:00
Gunnar Morling
dd5c2b8be9
DBZ-1766 Unifying handling of offset commits
2020-02-12 15:44:45 +01:00
Aykut Farsak
26cdc58efc
Fixing missing whitespace in exception message
2020-02-06 17:23:29 +01:00
Jiri Pechanec
ba10a229b6
DBZ-1052 CE support for tx metadata in data messages
2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94
DBZ-1052 Transaction block moved to envelope
2020-02-03 09:29:10 +01:00
Jiri Pechanec
b0eb571f9f
DBZ-1052 Transaction metadata for SQL Server
2020-02-03 09:29:10 +01:00
Gunnar Morling
8c33a4e147
DBZ-1292 Catering for the differences in data schema;
...
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
2020-01-16 08:01:56 +01:00
Gunnar Morling
7c18a6d8d5
DBZ-1292 Removing static state in CloudEventsConverterTest
2020-01-16 08:00:45 +01:00
GraySmog
d0e4b3c0af
DBZ-1292 Delete data.schema.registry.url config option
2020-01-16 08:00:45 +01:00
GraySmog
915c8cafd9
DBZ-1292 CloudEvents converter for JSON and Avro format
2020-01-16 08:00:45 +01:00
Chris Cranford
1ec377224a
DBZ-1712 MySQL connector use default port when database.port option not specified
2020-01-15 21:24:55 +01:00
Jiri Pechanec
88e280d89e
DBZ-1693 Replace other instances of schema with catalog
2020-01-10 22:02:49 +01:00
Jiri Pechanec
6163f46585
DBZ-1693 Use corrent TableId component
2020-01-10 22:02:49 +01:00
Vasily Ulianko
8e342bea84
DBZ-1689 Allow setting boolean as default value for INT
2020-01-02 11:55:22 +01:00
Gunnar Morling
f5b563ff87
DBZ-1671 Propagating exception instead of message only
2019-12-17 07:25:51 +01:00
John Martin
fc24de8dde
DBZ-1671 add innodb_lock_wait_timeout and update info log
2019-12-17 07:23:29 +01:00
John Martin
3f006f8c0e
DBZ-1671 Adding configurable lock_wait_timeout for mysql connector SnapshotReader
2019-12-17 07:23:29 +01:00
Nikhil Benesch
afd69fc7fc
DBZ-1667 Regression test for MySQL dates in snapshot being off by one
...
In Debezium 0.9, if the timezone of the JVM running Debezium had an
earlier offset than the timezone of the MySQL server, any values of type
DATE read by the snapshot reader would be incorrectly shifted backwards
by one day. This was the result of a known bug/deficiency in MySQL's
JDBC connector [0].
This bug was inadvertently fixed in Debezium 0.10 by #913 , which
bypassed the JDBC date retrieval logic to support zero dates, thus also
avoiding the inappropriate timezone shifting logic. However, since the
fix was inadvertent, there was no test to protect against regression.
This commit adds such a regression test. Since the MySQL server used in
tests uses timezone GMT-11, we just need to run a SnapshotReader in
timezone GMT-12 and verify that the dates are computed correctly. This
test fails if added to Debezium 0.9, but passes now thanks to #913 .
Humorously, it is likely someone would have noticed this bug long ago
had the test MySQL server used any other timezone; for example, if the
MySQL server used EST as its timezone, anyone running the tests from the
International Date Line to Chicago would have seen the failure. Bt with
GMT-11 there is only one timezone with a smaller offset, GMT-12, which
is only used by tiny outlying islands of the US.
[0]: https://bugs.mysql.com/bug.php?id=91112
2019-12-12 12:53:44 +01:00
Chris Cranford
5e680a1d05
DBZ-1636 Add MySQL ENUM test propagating source type schema parameters
2019-12-10 09:24:34 +01:00
Jiri Pechanec
249e54ac3c
DBZ-1645 Allow alter and rename table in a single step
2019-12-04 17:11:03 +01:00
Jiri Pechanec
e551e89a92
DBZ-1201 Always store SET commands
2019-11-28 17:28:42 +01:00
Gunnar Morling
ded3174d55
DBZ-1632 Exposing connection timeout as Duration in one single method
2019-11-22 14:45:18 +01:00
Collin Van Dyck
b817f2fa38
DBZ-1632 Making connection timeout configurable in MySQL connection URL
...
Without this setting, if someone POSTs a connector config with
an unreachable db hostname, the verify routine of the mySQL
connector will hang indefinitely. Interestingly, this
prevents other connectors from being submitted (a synchronization
issue that this does not address).
With this patch, though, the value for the `connect.timeout.ms`
connector property will be set as the `connectTimeout` URL parameter,
which, if nonzero, will cause the connection to eventually
time out.
2019-11-22 14:44:32 +01:00
David Feinblum
2b9fbcd5f6
DBZ-1519 Avoid erroneously logging there are no monitored tables
2019-11-14 05:44:37 +01:00
Jiri Pechanec
eb27cc5c54
DBZ-1613 Fix schema snapshotting of unlocked tables
2019-11-13 09:18:10 -05:00
Jiri Pechanec
2b9536f24d
DBZ-1607 use Instant for envelope timestamps
2019-11-12 16:36:11 -05:00
Jiri Pechanec
fd62e7d3ef
DBZ-1588 Fresh timestamp for each snapshot event
2019-11-12 16:36:11 -05:00
Luis Garcés-Erice
0198bceffa
DBZ-1555 Enabling configuration of table parse mode to support DB2
2019-11-08 15:07:25 +01:00
Gunnar Morling
2c569977d7
DBZ-1392 Applying formatter;
...
* Keeping indentation formatting for JSON
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
Co-authored-by: Chris Cranford <chris@hibernate.org>
2019-11-01 13:20:43 +02:00
Jiri Pechanec
776414a4f8
DBZ-1428 Restore TX isolation level after table read lock
2019-10-21 12:23:51 +02:00
Jiri Pechanec
a92b93182e
DBZ-1560 Removed dropped PK from the list
2019-10-20 22:13:02 +02:00
Grant Cooksey
f0bd58c8ff
DBZ-1546 Correct fix number test annotation
2019-10-17 10:13:44 +03:00
Grant Cooksey
18ca6ec72e
DBZ-1546 Comma-separated regular expressions remove whitespace.
...
The table whitespace parameter should remove whitespace between regular expressions
since tables cannot start with whitespace characters.
2019-10-17 10:13:44 +03:00
Gunnar Morling
92885ebe99
DBZ-1392 Removing trailing whitespace from Java files
2019-10-07 12:11:43 +03:00
Gunnar Morling
8d6f5409b1
DBZ-1392 Moving static imports up and applying this to all files
2019-10-07 12:11:43 +03:00
Chris Cranford
ca5517746a
DBZ-1341 Checkstyle flag missing whitespace
2019-10-03 19:44:43 +02:00
Chris Cranford
7442670692
DBZ-1355 Fix checkstyle problems detected after upgrade to 8.19
2019-10-03 19:44:43 +02:00
Chris Cranford
5ac2318d84
DBZ-1391 Do not allow code after closing brace ( #1065 )
...
* DBZ-1391 Do not allow code after closing brace
2019-10-02 20:44:40 +02:00
Gunnar Morling
d94b37c693
DBZ-1507 Misc. clean-up;
...
* Removing unused Table methods
* Re-using primaryKeyColumnNames() instead of custom predicate
2019-10-02 10:25:37 +02:00
Gunnar Morling
2fba51863e
DBZ-1015 Unifying the retrieval of custom key mappers
2019-09-26 10:14:48 +02:00
Guillaume Rosauro
1405889bef
DBZ-1015-allow-user-to-customize-key
2019-09-26 10:14:21 +02:00
Jiri Pechanec
0f61a0c8de
DBZ-1501 Support partial timstamps in default values
2019-09-25 23:49:25 +02:00
Chris Cranford
dc3f07d9d2
DBZ-1500 Fix race condition in mysql connector test suite
2019-09-25 08:02:42 +03:00
jerrinot
3064a4af06
DBZ-1438 Fix InterruptedException handling
...
It appears there is an intent to restore the interruption flag
when catching InterruptedException. However the old code was just
checking the current state of the flag instead of raising it.
2019-09-24 12:51:48 +02:00
Chris Cranford
130210b5ad
DBZ-1044 Add config option sanitize.field.names
and FieldNameSelector
2019-09-20 07:40:23 +03:00
Gunnar Morling
2a065686bd
DBZ-1255 Exporting null value when temporal precision mode is "connect" and the value is out of the supported range
2019-08-21 07:50:40 +02:00
Gunnar Morling
a85f975d18
DBZ-1419 Avoiding redundancy in field definition; updating description
2019-08-20 18:43:03 +02:00
Gunnar Morling
cb66fdafdc
DBZ-1419 Avoiding redundancy in field definition
2019-08-20 18:43:03 +02:00
Jiri Pechanec
0e39965c0e
DBZ-1419 Override time precision for MySQL
2019-08-20 18:43:03 +02:00
Jiri Pechanec
51c12d930d
DBZ-1419 Support for Connect temporal types in SQL Server
2019-08-20 18:43:03 +02:00
Jiri Pechanec
af50ea64a4
DBZ-1414 Rename to captured
2019-08-06 10:59:41 +02:00
Jiri Pechanec
6276b4817a
DBZ-1414 Fix test for correct DDL output
2019-08-06 10:59:41 +02:00
Jiri Pechanec
93fc39d92c
DBZ-1414 Lock only monitored tables
2019-08-06 10:59:41 +02:00
Jiri Pechanec
360bcc6f36
DBZ-1411 Support unquted full names in GRANT
2019-07-29 15:49:55 +02:00
Jiri Pechanec
55c267557f
DBZ-1410 Filter DML before throwing an invalid replication format error
2019-07-22 14:19:06 -04:00
Jiri Pechanec
ff87bb1ab7
DBZ-1409 Built-in database filter throws NPE
2019-07-22 14:18:36 -04:00
Jiri Pechanec
d3b33e5fbd
DBZ-1376 Both ALGORTIHM and LOCK are allowed for INDEX
2019-07-17 16:09:21 -04:00
Jiri Pechanec
558d97aa82
DBZ-1398 Support for arbitrary third party engine name
2019-07-17 15:15:11 -04:00
Jiri Pechanec
fbeb0076dc
DBZ-1397 Support CHARSET in CAST function
2019-07-17 14:50:40 -04:00
Jiri Pechanec
c9997a5fd6
DBZ-599 Emit schema change only for DDL with no errors
2019-07-10 08:38:08 +02:00
Jiri Pechanec
67ca8a2d76
DBZ-794 Filter out savepoints from database history
2019-07-08 12:54:01 +02:00
BinLi1988
3b14c13bbb
DBZ-1338 Support for ensuring keepalive by using MySQL heartbeat
2019-07-05 09:10:30 +02:00
Jiri Pechanec
c08a5374fe
DBZ-1222 Improve error event method name
2019-07-04 21:31:32 +02:00
Jiri Pechanec
2b365be63c
DBZ-1222 EventsInError metric added
2019-07-04 21:31:32 +02:00
Jiri Pechanec
13d638fd43
DBZ-1356 Metrics for schema history ( #947 )
...
* DBZ-1356 Metrics for schema history
2019-07-02 13:26:17 +02:00
Gunnar Morling
a991ea97d7
Handling option for emitting tombstones conistently
2019-07-01 08:27:33 +02:00
Jiri Pechanec
9c22da610a
DBZ-1353 MySQL 8 returns null for unspecified timestmap column
2019-06-25 12:13:53 +02:00
Jiri Pechanec
6e5f633e40
DBZ-1350 NO_AUTO_CREATE_USER unsupported on MySQL 8
2019-06-24 14:18:31 +02:00
Jiri Pechanec
257f900abb
DBZ-1349 Support for UTF8mb3 charset
2019-06-24 14:03:23 +02:00
Jiri Pechanec
c88e454809
DBZ-1348 Add INTERNAL among allowed ids
2019-06-21 19:27:21 +02:00
Gunnar Morling
d3e399e167
DBZ-1340 Avoiding repeated case conversion of incoming DML statements;
...
Also adding startsWithIgnoreCase() method.
2019-06-20 13:33:12 +02:00
Jiri Pechanec
ace742a43e
DBZ-1340 Guard against binlog misconfiguration
2019-06-20 13:33:12 +02:00
Jiri Pechanec
807da1f9b8
DBZ-1278 Change log message wording
...
Co-Authored-By: Gunnar Morling <gunnar.morling@googlemail.com>
2019-06-19 17:05:26 +02:00
Jiri Pechanec
3012524ea1
DBZ-1278 Rename to non-whitelisted table sends warn
2019-06-19 17:05:26 +02:00
Jiri Pechanec
e2f2c88952
DBZ-1329 Support for rename index
2019-06-17 20:55:04 +02:00
Gunnar Morling
5d01f409f0
DBZ-1317 Separating update and query methods for MongoDB's SourceInfo;
...
* Avoids access to collection id after events which don't have one
* Pulling up struct() and schema() methods to common base class
2019-06-11 10:07:36 +02:00
Jiri Pechanec
6a412eb72f
DBZ-1318 Log when conversion happens
2019-06-07 09:44:46 +02:00
Jiri Pechanec
3e94fc2ef8
DBZ-1318 Handle invalid dates in non-strict mode ( #913 )
...
* DBZ-1318 Handle invalid dates in non-strict mode
2019-06-06 11:40:11 +02:00
pancheng
1180736124
DBZ-1321 Add test case
2019-06-06 10:38:56 +02:00
pancheng
bc17bc90d1
DBZ-1321 Fix alter by modify column about default value
2019-06-06 10:38:56 +02:00
Chris Cranford
0aadaa10dc
DBZ-1242 Fixed typo and added negative test checks
2019-06-05 13:31:25 -04:00
Chris Cranford
b3ca33287a
DBZ-1242 Issue warning when filters produce an empty schema
2019-06-05 13:31:25 -04:00
Gunnar Morling
246c1be305
DBZ-1283 Enforcing presence of database.server.name globally
2019-06-03 10:58:14 +02:00
Chris Cranford
5f0b44b4ec
DBZ-1283 Only validate history topic name for affected connectors
2019-06-03 10:58:14 +02:00
Jiri Pechanec
4b64c8e447
DBZ-1295 3state snapshot for MySQL
2019-05-31 10:56:05 +02:00
Bartosz Miedlar
ead68b1b14
DBZ-1300 DDL that contains user
are unparsable by antlr
2019-05-30 11:40:55 +02:00
Gunnar Morling
0c7763c68a
DBZ-871 Simplifying test assertions
2019-05-30 08:51:28 +02:00
Jiri Pechanec
4209900731
DBZ-871 Test for multitable statement
2019-05-30 08:51:28 +02:00
Gunnar Morling
ca361bd122
DBZ-871 Clearly separating between DB and table events
2019-05-30 08:51:28 +02:00
Jiri Pechanec
e826599e2e
DBZ-871 Add table(s) name to schema change event
2019-05-30 08:51:27 +02:00
Gunnar Morling
7759333fe3
DBZ-1092 Using ColumnNameFilter instead of Predicate<Column>
2019-05-29 15:49:49 +02:00
Jiri Pechanec
ab460c86af
DBZ-1235 Return server name to legacy MySQL
2019-05-28 09:35:15 +02:00
Gunnar Morling
3377b96ca8
DBZ-1235 Removing redundant method
2019-05-28 09:35:15 +02:00
Jiri Pechanec
526e780513
DBZ-1235 Misc fixes
2019-05-28 09:35:15 +02:00
Jiri Pechanec
80afd4975a
DBZ-1235 Changes missed in refactoring
2019-05-28 09:35:15 +02:00
Gunnar Morling
eef37cb567
DBZ-1235 Misc adjustments;
...
* Removing superfluous parameter from getSourceInfoStructMaker()
* JavaDoc
* Renaming field to "source.struct.version"
2019-05-28 09:35:15 +02:00
Gunnar Morling
8f28f323e7
DBZ-1235 Using Instant to represent timestamps internally;
...
Only "rendered" as epoch milli-seconds at the system boundaries.
2019-05-28 09:35:15 +02:00
Jiri Pechanec
6f6c8ddf06
DBZ-1235 Refactored to unify the code
2019-05-28 09:35:15 +02:00
Jiri Pechanec
0ec2d651fe
DBZ-1235 Timestamp in ms for MySQL connector
2019-05-28 09:35:15 +02:00
Jiri Pechanec
f5757dbd9f
DBZ-1235 Extract serverName to common source
2019-05-28 09:35:15 +02:00
Gunnar Morling
4ed8b4636c
DBZ-1224 Completing implementation;
...
* Further unification of override handling;
* Undoing change related to SnapshotStatementFactory as it seems not needed
* Adding test
2019-05-27 08:44:42 +02:00
mokkara
b3de0250a9
DBZ-1224 Snapshot SELECT support for SQL Server
2019-05-27 08:44:42 +02:00
Chris Cranford
377728ef87
DBZ-1127 Synchronize MySQL grammar with upstream grammar.
2019-05-22 17:05:11 +02:00
Chris Cranford
778b394085
DBZ-1127 Synchronize MySQL grammar with upstream grammar.
2019-05-22 17:05:11 +02:00
Jiri Pechanec
c1c4d3d149
DBZ-683 After review changes
2019-05-22 14:52:06 +02:00
Jiri Pechanec
540196091c
DBZ-683 Snapshot supports storing only whitelisted tables setting
2019-05-22 14:52:06 +02:00
Chris Cranford
1603ebda89
DBZ-1234 Remove support for adaptive time precision mode
2019-05-22 10:19:05 +02:00
Chris Cranford
e2c74111ad
DBZ-1234 Removed deprecated configuration options
2019-05-22 10:19:05 +02:00
Gunnar Morling
7519623c58
DBZ-1244 Fixing formatting glitch
2019-05-21 15:53:55 +02:00
Jiri Pechanec
c8c6360095
DBZ-1244 Detecting unreplicated purged GTIDs;
...
The purpose of this change is to provide the same functionality for
when_needed snapshot for GTID enabled database like for non-GTID.
The non-GTID just relies on missing replication log to detect the
new snapshot needs to be triggered. This does not work in GTID
environment as we need to compare the GTIDs that are available on
the server with those we have already processed - stored in the
offsets.
If there is a set of GTIDs that were not replicated by Debezium
and at the same time have been already purged then we detect the
situation and trigger a new snapshot when required.
We thus
* Take all GTIDs ever processed by the server
* Filter out GTIDs that were processed by Debezium
* Compare them with purged GTID set
* If the interesction is not empty we know we have not replicated
transaction that have already been removed from the server
2019-05-21 15:51:17 +02:00
Jiri Pechanec
29c10c27ea
DBZ-1276 Skip events upon connector restart
2019-05-21 10:38:41 +02:00
Chris Cranford
9afe06945e
DBZ-736 Fixed compilation problem with duplicate test class.
2019-05-20 13:38:01 -04:00
Gunnar Morling
d35e401e34
DBZ-736 Removing obsolete MySqlDefaultValueTest;
...
* Removing old test for legacy parser
* Pulling Antlr-specific methods up to base class
* Renaming that one into MySqlDefaultValueTest
2019-05-20 13:38:01 -04:00
Gunnar Morling
3f0e2c7758
DBZ-1246 Removing obsolete exclusion of legacy parser during test
2019-05-20 16:38:03 +02:00
Jiri Pechanec
30c2df4f23
DBZ-1246 Convert unique index to primary key
2019-05-20 16:38:03 +02:00
Gunnar Morling
c72a2fb14d
DBZ-844 Expanding test
2019-05-20 15:33:39 +02:00
Jiri Pechanec
d35c2ec347
DBZ-844 Use table charset for parsing string defaults
2019-05-20 15:33:39 +02:00
jcechace
d9657dab1a
[DBZ-1273] Bumping JDBC and Mongo driver versions
2019-05-18 05:50:27 +02:00
Gunnar Morling
c7d2a35a0e
DBZ-1264 Member ordering
2019-05-18 05:48:54 +02:00
Jiri Pechanec
a8f6533c66
DBZ-1264 Ignore unique index for non-monitored tables
2019-05-18 05:46:56 +02:00
Chris Cranford
f67ce1b8be
DBZ-733 Consolidate parser tests
2019-05-17 13:18:24 -04:00
Chris Cranford
efa22016a8
DBZ-736 DBZ-733 Removed MySQL legacy parser and consolidate parser tests
2019-05-17 13:18:24 -04:00
Chris Cranford
373e508d70
DBZ-736 Remove MySQL legacy parser
2019-05-17 13:18:24 -04:00
Jiri Pechanec
13e5fe4537
DBZ-1228 Simplify error handling
2019-05-17 10:24:02 -04:00
Arkoprabho Chakraborti
ceb56c1c57
DBZ-1228 Changes as suggested in PR #867
...
Used multiple catch statements and handle in 1 branch.
Not using static modifier for keymanager.
2019-05-17 10:24:02 -04:00
Arkoprabho Chakraborti
b7526d537d
DBZ-1228 MySQL connection with client authentication does not work
...
The SSL properties were being reset, and thus the authentication was failing on the second time.
When debezium connects to the database the first time in order to test the connections, the required parameters are all set. And thus the test passes.
After that the shutdown method is called that clears these properties, and the consecutive connection fails.
DBZ-1228: MySQL connection with client authentication does not work
Create and pass a socket factory that provides they keystore config
DBZ-1228: MySQL connection with client authentication does not work
Prevent forcing of SSL. Use SSL only if the required properties are set.
DBZ-1228: MySQL connection with client authentication does not work
Added better exception messages
2019-05-17 10:24:02 -04:00
Chris Cranford
9404eff794
DBZ-1226 Cleaned up tests
2019-05-01 18:37:09 -04:00
Gunnar Morling
2cd0eb17db
DBZ-739 Removing obsolete method
2019-05-01 23:17:00 +02:00
Chris Cranford
46111505ed
DBZ-1226 Fix test to validate enum/set options directly from antlr parsing.
2019-05-01 21:17:42 +02:00
Chris Cranford
a5fdfd9b24
DBZ-1226 Replace double single-quotes with a singular quote.
2019-05-01 21:17:42 +02:00
Chris Cranford
c6aa02f813
DBZ-1226 Add support for enum/set values that contain commas or escaped characters.
2019-05-01 21:17:42 +02:00
jchipmunk
72b06366fe
Removing extra initialisation of "config" variable in PG config
2019-04-30 09:57:11 +02:00
jchipmunk
9fe033ce24
DBZ-1247 Specifying default snapshot fetch size for each connector config
2019-04-30 09:57:11 +02:00
Chris Cranford
83bf0f861a
DBZ-1243 Fix handling of default value for datetime(0)
2019-04-25 17:31:22 +02:00
Jiri Pechanec
79afafcb0d
DBZ-1249 Fix default value conversion for larger bits
2019-04-23 13:02:31 +02:00
krizhan
70c564b4c2
DBZ-212 Moved SERVER_NAME to RelationalDatabaseConnectorConfig
2019-04-23 12:29:44 +02:00
Gunnar Morling
5339dfc289
DBZ-1233 Formatting
2019-04-23 12:18:53 +02:00
Mathieu Rozieres
df79dfe751
DBZ-1233 MODE and others as MySQL column names
...
Add MODE to keywordsCanBeId to fix parse exception on so named columns
2019-04-23 12:18:40 +02:00
Gunnar Morling
f04147d67d
DBZ-1208 Misc. clean-up;
...
* Adding reference to source of logic for setting up SSL socket factory
* Making method side-effect free
* Adding Jordon to COPYRIGHT.txt
2019-04-10 11:41:51 +02:00
jbragg
9ae2ebe329
DBZ-1208 Support for TLSv1.2;
...
Using accepted TLS protocol version to set for BinaryLogClient
2019-04-10 11:41:13 +02:00
Jiri Pechanec
50fbe32113
DBZ-1220 Integration test for schema metadata
2019-04-10 11:20:09 +02:00
Jiri Pechanec
394eb74d0f
DBZ-1220 FLOAT supports also single precision constraint
2019-04-10 11:20:09 +02:00
Jiri Pechanec
de9e80a58d
DBZ-1143 Describe test values; improve tests
2019-04-10 10:59:02 +02:00
Jiri Pechanec
9c7f181174
DBZ-1143 Year adjustment configurable; test 19xx years
2019-04-10 10:59:02 +02:00
Jiri Pechanec
155e63adab
DBZ-1143 Change default to Debezium-made conversion
2019-04-10 10:59:02 +02:00
Jiri Pechanec
16e731b748
DBZ-1143 2-digit years are converted by database by default
2019-04-10 10:59:02 +02:00
Steviep
7742e66e11
DBZ-1221 Creating new metric IsGtidModeEnabled
2019-04-09 14:52:18 +02:00
Steviep
94f71ea96e
DBZ-1206 Adding new connector metric "numberOfFilteredEvents"
2019-04-09 14:46:54 +02:00
Chris Cranford
664c617661
DBZ-1203 Replace collectionOption rule with STRING_LITERAL token.
2019-04-08 11:16:42 +02:00
Chris Cranford
38e1cc56bb
DBZ-1203 Fix parsing alter column with enum and character set
2019-04-08 11:16:42 +02:00
Joy Gao
08271ab444
DBZ-1218 Close JDBC connection in SnapshotReader for MySQL Connector
2019-04-08 08:47:43 +02:00
jchipmunk
7c0ae3ee20
DBZ-1212 SLF4J usage issues
2019-04-04 21:32:12 +02:00
Jiri Pechanec
b90274cc63
DBZ-1194 Convert nulls even for key
2019-03-29 21:20:53 +01:00
Jiri Pechanec
e6b956b36d
DBZ-1204 Allow setting boolean as default value for TINYINT
2019-03-29 09:41:44 +01:00
ShubhamRwt
540a951211
DBZ- 362 Adding WhitespaceAfter check to Checkstyle
2019-03-28 09:24:11 +01:00
Jiri Pechanec
9b405aa84d
DBZ-1039 Add missing spaces
2019-03-25 10:23:14 +01:00
shubham
8cca21e969
DBZ-1039 Make all ifs with braces
2019-03-25 10:23:14 +01:00
Jiri Pechanec
13f49f02a9
DBZ-1185 Use Boolean instead of Optional
2019-03-21 14:02:23 +01:00