alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
5,300 Commits 3 Branches 0 Tags 51 MiB
018763a3f3
Commit Graph

1149 Commits

Author SHA1 Message Date
Jiri Pechanec
7daae11600 DBZ-3473 Postgres has its own schema instance 2021-05-06 05:37:36 +02:00
Jiri Pechanec
13334ee72f DBZ-3473 Add current chunk metric 2021-05-06 05:37:36 +02:00
Jiri Pechanec
39d21806eb DBZ-3473 Metrics enabled 2021-05-06 05:37:36 +02:00
Jiri Pechanec
3d940ca14a DBZ-3473 Support for cursor-based fetching 2021-05-06 05:37:36 +02:00
Jiri Pechanec
c53785dde7 DBZ-3473 Incremental Snapshot support for MySQL 2021-05-06 05:37:36 +02:00
Jiri Pechanec
d10bf3f7ef DBZ-3473 Log chunk id 2021-05-06 05:37:36 +02:00
Jiri Pechanec
49c5a00bbf DBZ-3473 Share read JDBC value between regular and incremental snapshot 2021-05-06 05:37:36 +02:00
Jiri Pechanec
91ecbcc81a DBZ-3473 Share read statement creation between regular and incremental snapshot 2021-05-06 05:37:36 +02:00
Jiri Pechanec
dd2bc6354b DBZ-3473 Pass the main clock form connector 2021-05-06 05:37:36 +02:00
Jiri Pechanec
3371e6ccb3 DBZ-3473 Enable per-dialect query limit 2021-05-06 05:37:36 +02:00
Jiri Pechanec
260c32cf0e DBZ-3473 Resume parallel snapshot after connector restart 2021-05-06 05:37:36 +02:00
Jiri Pechanec
4d52b21a76 DBZ-3473 Ignore parallel snapshot for connector not supporting it 2021-05-06 05:37:36 +02:00
Jiri Pechanec
fd9c9d02b4 DBZ-3473 Handle exceptions 2021-05-06 05:37:36 +02:00
Jiri Pechanec
37626c0dfe DBZ-3473 Extract incremental snapshot context 2021-05-06 05:37:36 +02:00
Jiri Pechanec
07371c085b DBZ-3473 Watermark signals must be in separate tx 2021-05-06 05:37:36 +02:00
Jiri Pechanec
a52c536a68 DBZ-3473 First prototype of incremental snapshotting 2021-05-06 05:37:36 +02:00
Anisha Mohanty
a6b54c7000 DBZ-3427 Validate the server name field 2021-04-28 13:18:52 +02:00
Gunnar Morling
8f891248ad DBZ-3429 Making option retrieval lenient towards trailing/leading whitespace 2021-04-28 11:01:27 +02:00
kyleyj
99536f21d2 DBZ-3429 Support spaces in the SQL Server properties 
Many of the SQL Server properties support spaces in the comma-separated lists.
However, the snapshot.select.statement.overrides property doesn't support
spaces after the commas.
 2021-04-28 10:23:02 +02:00
Gunnar Morling
91b784c3b6 DBZ-3161 Avoid failing when legacy option is given; also 
* adding all public history options on config surface
* adding missing whitespace in field docs
* recommending non-deprecated option in docs
 2021-04-26 13:07:23 +02:00
Anisha Mohanty
11fb079582 DBZ-3161 Add database.history.store.only.captured.tables.ddl option & CapturedTables metrics to documentation 2021-04-26 13:07:23 +02:00
Anisha Mohanty
f0f8d5d180 DBZ-3161 Refactor/Rename all references of MonitoredTables to CapturedTables 2021-04-26 13:07:23 +02:00
Anisha Mohanty
062c1c3860 DBZ-3161 Add new option for CapturedTables, deprecate existing MonitoredTables option & emit warnings 2021-04-26 13:07:23 +02:00
Anisha Mohanty
4a86330c0a DBZ-3161 Add new CapturedTables metrics 2021-04-26 13:07:23 +02:00
Gunnar Morling
42a7b74725 DBZ-3403 Misc. improvements 2021-04-14 11:14:07 +02:00
Hossein Torabi
ba048cf47d DBZ-3403 Semi Optimisation on MongoDB and MySQL connector for skipped.operations 2021-04-14 11:14:07 +02:00
Hossein Torabi
5d6705c3fe DBZ-2699 implement skipped.operation in core 2021-04-08 11:59:08 +02:00
Debezium Builder
8a88ba9b45 [maven-release-plugin] prepare for next development iteration 2021-04-08 04:04:00 -04:00
Debezium Builder
74152afe74 [maven-release-plugin] prepare release v1.5.0.Final 2021-04-08 04:04:00 -04:00
Chris Egerton
67f044ff87 DBZ-3371: Adjust scale of fallback BigDecimal values to match column schema 2021-04-06 10:35:23 +02:00
Jiri Pechanec
f50c3e8222 DBZ-3361 Prefer DDL over logical schema for MySQL 2021-03-30 11:35:12 +02:00
Chris Cranford
776180a0df DBZ-3347 Emit schema change events with correct source partition 2021-03-30 07:26:06 +02:00
Jiri Pechanec
a02e530c80 DBZ-2911 Use sequence only when available 2021-03-26 09:19:17 +01:00
JLDLaughlin
06b0475f17 DBZ-2911 Add additional LSN information to all sources 
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
 2021-03-26 09:19:17 +01:00
Debezium Builder
6b4d88bb51 [maven-release-plugin] prepare for next development iteration 2021-03-24 06:35:02 -04:00
Debezium Builder
c578715233 [maven-release-plugin] prepare release v1.5.0.CR1 2021-03-24 06:35:02 -04:00
Gunnar Morling
c7b7d5303a DBZ-3218 Avoiding duplicated validation (again ;) 2021-03-19 15:04:20 +01:00
Gunnar Morling
178140ae9c DBZ-3218 Removing superfluous method parameter 2021-03-19 15:04:20 +01:00
Anisha Mohanty
c761d92b2a DBZ-3218 Add separate method for logging warnings 2021-03-19 15:04:20 +01:00
Anisha Mohanty
6856dd9a80 DBZ-3218 Handle duplicate warnings for deprecated options 2021-03-19 15:04:20 +01:00
Jiri Pechanec
f7b6750ce3 DBZ-2511 Fix tests 2021-03-18 14:42:34 +01:00
Jiri Pechanec
495be2659b DBZ-2511 Dedicated logger for schema name adjuster 2021-03-18 14:42:34 +01:00
Jiri Pechanec
11e4880018 DBZ-3309 Revert to MySQL specific default snapshot fetch size 2021-03-18 11:08:26 +01:00
Gunnar Morling
647076ea69 DBZ-2957 Misc. fixes; 
* Simplifying reg exp
* Adding leniency towards whitespace
* Reporting *all* problems including correct count
* Fixing incorrect actual/expected order
 2021-03-17 14:04:16 +01:00
Anisha Mohanty
2e5a5ce001 DBZ-2957 Handle message.key.columns regex validation time complexity 2021-03-17 14:04:16 +01:00
Gunnar Morling
1f02d25738 DBZ-3271 Removing unused methods 2021-03-17 09:54:25 +01:00
Gunnar Morling
911b5e9a3b DBZ-3271 Unifying filter handling across relational connectors 2021-03-17 09:54:25 +01:00
Jiri Pechanec
f2eb868cde DBZ-2145 Provide Debezium BOM 2021-03-17 07:54:12 +01:00
Debezium Builder
f57057421b [maven-release-plugin] prepare for next development iteration 2021-03-12 04:38:17 -05:00
Debezium Builder
b57293013a [maven-release-plugin] prepare release v1.5.0.Beta2 2021-03-12 04:38:16 -05:00
Jiri Pechanec
123d9ef4eb DBZ-3213 Refactor Maven structure to deploy support modules 2021-03-11 16:14:15 +01:00
Gunnar Morling
4d61c57206 DBZ-3157 Adding test 2021-03-11 16:10:08 +01:00
Vladimir Osin
88f751ad3a DBZ-3157 Add event_serial_no to CloudEvent Id 2021-03-11 16:10:08 +01:00
Jiri Pechanec
c8eec4995b DBZ-3141 Changes after review 2021-03-10 19:12:34 +01:00
Jiri Pechanec
f23421920b DBZ-2919 Remove race condition 2021-03-10 19:12:34 +01:00
Jiri Pechanec
de0d540a9f DBZ-3141 Change schema signal for Oracle 2021-03-10 19:12:34 +01:00
Jiri Pechanec
15c7b11a1f DBZ-3141 Change schema signal tested for Postgres 2021-03-10 19:12:34 +01:00
Jiri Pechanec
ff7cb44801 DBZ-3141 Offsets are propagated to signal actions 2021-03-10 19:12:34 +01:00
Jiri Pechanec
7bcf9338a0 DBZ-3141 Added unit tests 2021-03-10 19:12:34 +01:00
Jiri Pechanec
7fdad2ed49 DBZ-3141 Support for signalling table 2021-03-10 19:12:34 +01:00
Anisha Mohanty
323b23498e DBZ-3084 Handle wrong warnings about deprecated options 2021-03-09 07:10:45 +01:00
Kewei Shang
158b616bfe DBZ-3199 Add support for SET column to Vitess Connector 2021-02-26 21:23:12 +01:00
Debezium Builder
b4c260da50 [maven-release-plugin] prepare for next development iteration 2021-02-23 14:04:01 -05:00
Debezium Builder
123a711a6d [maven-release-plugin] prepare release v1.5.0.Beta1 2021-02-23 14:04:01 -05:00
Chris Cranford
7e34c918e2 DBZ-3034 Add validate methods to CommonConnectorConfig 2021-02-23 10:28:17 +01:00
Chris Cranford
85f7688527 DBZ-3151 Add filter hook for table unique index resolution 2021-02-22 15:19:25 +01:00
Kewei Shang
92659d6a27 DBZ-3124 Overload builder() and schema() to take multiple values 2021-02-19 12:26:44 +01:00
Jiri Pechanec
1edad510ff DBZ-2614 Support for infinite timestamps 2021-02-19 10:44:06 +01:00
Gunnar Morling
440364e781 DBZ-2984 Removing unused field 2021-02-16 14:49:35 +01:00
Jiri Pechanec
8c0b87c667 DBZ-2984 Guess struct name only when unavailable 2021-02-16 14:49:35 +01:00
Gunnar Morling
184d1a2399 DBZ-3056 Misc. clean-up 2021-02-16 12:45:09 +01:00
Yilong Chang
a0b3704832 DBZ-3056 Validate all fields in subclasses. 2021-02-16 12:34:06 +01:00
Yilong Chang
76c7e0d426 DBZ-3056 Extract basic valdiation in parent class. 2021-02-16 12:34:06 +01:00
Gunnar Morling
cb2b2fc07a DBZ-3099 Doc fix 2021-02-16 10:11:23 +01:00
Jiri Pechanec
1c9f7a1c1c DBZ-3099 Document non-volatile fields accessed by a single thread 2021-02-16 10:02:17 +01:00
Jiri Pechanec
745bb6c11d DBZ-3099 Address review comments; extract history comparator for testability 2021-02-16 10:02:17 +01:00
Jiri Pechanec
cb1476ce18 DBZ-3099 Address review comments 2021-02-16 10:02:17 +01:00
Jiri Pechanec
21b15facb2 DBZ-3099 Snapshot buffering to handle config corner cases 2021-02-16 10:02:17 +01:00
Jiri Pechanec
6a9ca7d544 DBZ-3099 Fix schema recovery; Add table level locking 2021-02-16 10:02:17 +01:00
Jiri Pechanec
08e4988c72 DBZ-3093 Unify snapshot and streaming parsing 2021-02-16 10:02:17 +01:00
Jiri Pechanec
6607310f13 DBZ-3093 Separate parsing and change applying phase in MySQL schema 2021-02-16 10:02:17 +01:00
ani-sha
5f8a22a5df DBZ-2858 Make field descriptions consistent for time values 2021-02-16 09:55:35 +01:00
Gunnar Morling
b5b73b4409 DBZ-3057 Formatting fix 2021-02-16 09:40:13 +01:00
Chris Cranford
09de77cf7d DBZ-3057 Add some TableId helper methods 2021-02-16 09:40:13 +01:00
harveyyue
3a4bcb104b DBZ-3096 Getting RejectedExecutionException when checking topic settings from KafkaDatabaseHistory.checkTopicSettings 2021-02-12 08:37:16 +01:00
Kevin Pullin
2426de849a DBZ-3074 PgOutputMessageDecoder - Fix unordered keys 
Fix issue where `PgOutputMessageDecoder` does not define primary key metadata in key-order.

`PgOutputMessageDecoder.getTablePrimaryKeyColumnNamesFromDatabase()` returns a `Set`, leading to unordered
primary keys in the metadata. Switch the logic to call `JdbcConnection.readPrimaryKeyNames()` which
_does_ correctly return an ordered primary key list.
 2021-02-10 10:58:26 +01:00
Yilong Chang
0e63a5a651 DBZ-3075 Close Kafka Database History producer with a timeout of 30s. 2021-02-10 09:08:02 +01:00
Debezium Builder
e08df0a177 [maven-release-plugin] prepare for next development iteration 2021-02-06 01:25:23 -05:00
Debezium Builder
da0411bf70 [maven-release-plugin] prepare release v1.5.0.Alpha1 2021-02-06 01:25:23 -05:00
Jiri Pechanec
f57343dc3b DBZ-1865 Use OptionaLong; add comments 2021-02-04 09:07:55 +01:00
Jiri Pechanec
2374b6b045 DBZ-1865 First draft of MySQL rewrite 2021-02-04 09:07:55 +01:00
Gunnar Morling
6c5fb793af DBZ-2575 Marking option as private 2021-02-04 08:28:55 +01:00
Martin Sillence
164ab1330c DBZ-2575 Improve performance where tables we fetch are much less than total tables 2021-02-04 08:28:49 +01:00
Naveen Kumar KR
75882f35ac DBZ-2382 Support emitting TRUNCATE events in PG11+ PGOUTPUT plugin 
default - TruncateHandlingMode.SKIP
supported configs - TruncateHandlingMode.SKIP / TruncateHandlingMode.INCLUDE
 2021-02-03 13:53:01 +01:00
ani-sha
d4003c9172 DBZ-2420 Define database configs under RelationalDatabaseConnectorConfig 2021-02-03 08:05:42 +01:00
Debezium Builder
237b4ac0f1 [maven-release-plugin] prepare for next development iteration 2021-01-28 07:38:55 -05:00
Debezium Builder
06b1d0cbad [maven-release-plugin] prepare release v1.4.1.Final 2021-01-28 07:38:55 -05:00
Gunnar Morling
f76d8e0869 DBZ-2938 Calling snapshot listener only after complete() hook 2021-01-19 15:16:46 +01:00
Gunnar Morling
6d441bc538 DBZ-2938 Centralizing listener handling; avoiding some empty methods 2021-01-19 15:16:46 +01:00
rkerner
d7ac0f7e6b DBZ-2572 Fix docs for message.key.columns and skipped.operations 2021-01-12 14:08:21 +01:00