Commit Graph

938 Commits

Author SHA1 Message Date
cooksey
8bcbdb639d DBZ-2094 Allow Postgres snapshotter to set streaming start on resume
When a connector resumes after previously streaming and takes a
snapshot, through a new method on the snapshotter interface,
shouldStreamEventsStartingFromSnapshot, can choose whether
to resume streaming from the last known streaming position or the
beginning of the snapshot. This is helpful for snapshotters that
may not want to resnapshot every table in the whitelist/blacklist
but not miss event on the tables that are skipped.
2020-09-09 10:54:11 +02:00
Grzegorz Kołakowski
c74579c1df DBZ-1068 Forward port the work by @grzegorz8 to master
Co-authored-by: GuyIEX <gpascarella@ironeaglex.com>
2020-09-04 12:06:57 +02:00
Nathan Mills
6e915b7cfd
DBZ-2473 Decrement remaining for skipped tables 2020-09-04 07:50:34 +02:00
Debezium Builder
9979db648f [maven-release-plugin] prepare for next development iteration 2020-08-28 05:04:26 -04:00
Debezium Builder
5c58b23756 [maven-release-plugin] prepare release v1.3.0.Beta1 2020-08-28 05:04:26 -04:00
Jiri Pechanec
d9f616caed DBZ-2303 Set source when new table detected 2020-08-24 13:08:09 +02:00
rkerner
2c5c093587 DBZ-2171 avoid divisive language 2020-08-21 09:29:04 +02:00
Gunnar Morling
4c3cf9f93e DBZ-2427 Logging inability to unregister metrics MBean as WARN 2020-08-13 14:05:11 -04:00
Gunnar Morling
dac7f3998c DBZ-2412 Housekeeping;
* Static logger
* Protecting against empty topic name
* Removing unused logger
2020-08-13 13:53:50 -04:00
Gunnar Morling
19ae707a18 DBZ-2412 Ignoring non change events in logical router 2020-08-13 13:53:50 -04:00
Gunnar Morling
44efd1bc6b DBZ-2423 Propagating port default values 2020-08-12 13:50:42 +02:00
Gunnar Morling
26b51e02cb DBZ-2418 Misc. clean-up 2020-08-12 09:28:35 +02:00
Jiri Pechanec
0b95df28d5 DBZ-2411 Use Scala 2.12 2020-08-11 09:20:53 +02:00
Jiri Pechanec
391d086529 DBZ-2411 Upgrade to Kafka 2.6.0 2020-08-11 09:20:53 +02:00
Debezium Builder
c4c50f5fc6 [maven-release-plugin] prepare for next development iteration 2020-08-06 00:46:18 -04:00
Debezium Builder
94cbeb95fa [maven-release-plugin] prepare release v1.3.0.Alpha1 2020-08-06 00:46:17 -04:00
rkerner
cad6cf62d3 DBZ-2315 fix BIT VARYING handling in Postgres connector
* removed little endian padding for BIT types in JdbcValueConverters (only used for Postgres yet)
* removed legacy format handling fot BIT related types in JdbcValueConverters#convertBits which were leftovers from PR #1408
* removed unnecessary zero-ing of a newly created byte array to improve performance for huge byte arrays
* updated Postgres connector docs
2020-08-03 14:58:31 +02:00
Cory Harper
724fc7ac98 DBZ-2362 add configurable restart wait time 2020-07-30 18:08:26 +02:00
Jiri Pechanec
5fcb221993 DBZ-1491 Database connection provides default value 2020-07-24 09:07:09 +02:00
Jiri Pechanec
45a6f9bef1 DBZ-1491 Refactor after review 2020-07-24 09:07:09 +02:00
Grzegorz Kołakowski
825ffe3848 DBZ-1491 Add SqlServerDefaultValueConverter class 2020-07-24 09:07:07 +02:00
Grzegorz Kołakowski
234341a471 DBZ-1491 Parse temporal values using queries on database
* Add tests for altering column default value
 * Add end-to-end test
2020-07-24 09:06:30 +02:00
Grzegorz Kołakowski
a8ea5e2256 DBZ-1491 Extract default values from schema
The goal is to enrich schema metadata with column default value.
2020-07-24 09:05:58 +02:00
Gunnar Morling
3ebfbcefdb DBZ-2329 Moving isNewTransaction() to SQL Server implementation 2020-07-24 07:57:50 +02:00
Lukasz Korzeniowski
1ada5c4b23 DBZ-2329 Do not skip events after restart when stream is not monotonic 2020-07-21 14:21:29 +02:00
Debezium Builder
e1ab38de84 [maven-release-plugin] prepare for next development iteration 2020-07-16 04:40:04 -04:00
Debezium Builder
69cf375faa [maven-release-plugin] prepare release v1.2.1.Final 2020-07-16 04:40:04 -04:00
Jos Huiting
da97be7842 DBZ-2307 - Improve logging when primary keys are missing 2020-07-15 11:18:48 -04:00
Omar Al-Safi
4d2467ca20 DBZ-2302: Allow OffsetCommitPolicy to be initiated with Properties object 2020-07-09 08:38:26 +02:00
Randall Hauch
5860812a63
DBZ-2275 Updated default database history DML filter default to handle additional RDS statements;
* Added two more regular expressions to the default database history DML filter. These are intended to catch and filter out `INSERT into mysql.rds_monitor…` statements that RDS may write in the binlog
* Added a new unit test that checks that the regular expressions do catch some example statements
2020-06-25 20:57:49 +02:00
Jiri Pechanec
63a2f6a0ae DBZ-2255 Document JSON parsing in groovy-based SMTs 2020-06-25 11:08:59 +02:00
Debezium Builder
c0d30b87d9 [maven-release-plugin] prepare for next development iteration 2020-06-24 18:03:11 +02:00
Debezium Builder
0e2ac78301 [maven-release-plugin] prepare release v1.2.0.Final 2020-06-24 18:03:11 +02:00
Jiri Pechanec
87d93d44fd DBZ-2221 Wait for keepalive thread initialization 2020-06-24 09:14:42 +02:00
Gunnar Morling
b80f064131 DBZ-2250 Allowing to use CloudEventsConverter with Avro via Apicurio 2020-06-22 14:41:10 +02:00
Debezium Builder
b03a4d0e50 [maven-release-plugin] prepare for next development iteration 2020-06-19 00:39:01 -04:00
Debezium Builder
93e60258d5 [maven-release-plugin] prepare release v1.2.0.CR2 2020-06-19 00:39:00 -04:00
Gunnar Morling
f2d13238aa DBZ-2228 Using unique names for admin clients 2020-06-18 14:08:56 +02:00
Debezium Builder
65c39e9f11 [maven-release-plugin] prepare for next development iteration 2020-06-11 02:00:20 -04:00
Debezium Builder
bce332c900 [maven-release-plugin] prepare release v1.2.0.CR1 2020-06-11 02:00:19 -04:00
Chris Cranford
ac0d9ede8a DBZ-2152 Fix test failure 2020-06-09 17:20:51 +02:00
Balázs Németh
0853940f3d
DBZ-2169 Fix for misuse of ConfigurationDefaults.RETURN_CONTROL_INTERVAL;
* Implemented Temporals.min()
* Fixed pollInterval calculation based on the documentation
2020-06-09 10:24:50 +02:00
Gunnar Morling
bfaadcf2dd DBZ-2149 Starting/stopping Kafka just once in KafkaDatabaseHistoryTest;
By using distinct topic names in the tests, the same Kafka instance can
be used for all test methods. This brings down execution time of this
test from ~40sec to ~8sec.
2020-06-09 10:15:47 +02:00
Chris Cranford
c3b36c2417 DBZ-2149 Log begin/end of schema recovery 2020-06-09 10:15:47 +02:00
Gunnar Morling
1fdad23087 Revert "DBZ-2166 Handling error condition where schema field can not be found in"
This reverts commit 283740f37e.
2020-06-08 20:12:50 +02:00
Dave Cumberland
4254e29667 DBZ-2152 Adding fix annotations to new tests 2020-06-08 13:57:35 -04:00
Dave Cumberland
a17e4cbad0 DBZ-2152 Adding another unit test with the key mapping definied 2020-06-08 13:57:35 -04:00
Dave Cumberland
223812def3 DBZ-2152 Updating the EventRouter to allow key types other than String 2020-06-08 13:57:35 -04:00
Fabian Aussems
283740f37e DBZ-2166 Handling error condition where schema field can not be found in
TableSchemaBuilder
2020-06-08 12:55:16 +02:00
Gunnar Morling
1b62036cf4 DBZ-2150 Awaiting coordinator shutdown in embedded engine 2020-06-08 10:26:37 +02:00