alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
2,586 Commits 3 Branches 0 Tags 51 MiB
6114351102
Commit Graph

767 Commits

Author SHA1 Message Date
Jiri Pechanec
cf7eccb152 DBZ-1498 Docs added; microseconds changed to numeric; nanos supported 2019-10-09 12:14:35 +02:00
Jiri Pechanec
20363f24bb DBZ-1498 Support for precise interval value 2019-10-09 12:14:35 +02:00
Jiri Pechanec
74fd88afca DBZ-1513 Improve start logging 2019-10-07 18:38:35 +02:00
Jiri Pechanec
2c4cb83259 DBZ-1513 Centralize handling of non-data messages in SMT 2019-10-07 18:38:35 +02:00
Gunnar Morling
92885ebe99 DBZ-1392 Removing trailing whitespace from Java files 2019-10-07 12:11:43 +03:00
Gunnar Morling
8d6f5409b1 DBZ-1392 Moving static imports up and applying this to all files 2019-10-07 12:11:43 +03:00
Chris Cranford
3594ff639a DBZ-1341 Rebased against master and applied necessary checkstyle fixes 2019-10-03 19:44:43 +02:00
Chris Cranford
ca5517746a DBZ-1341 Checkstyle flag missing whitespace 2019-10-03 19:44:43 +02:00
Chris Cranford
7442670692 DBZ-1355 Fix checkstyle problems detected after upgrade to 8.19 2019-10-03 19:44:43 +02:00
Chris Cranford
5ac2318d84 DBZ-1391 Do not allow code after closing brace (#1065) 
* DBZ-1391 Do not allow code after closing brace
 2019-10-02 20:44:40 +02:00
Jiri Pechanec
f868cb87c0 DBZ-1280 Lock timeout for SQL Server 2019-10-02 10:34:25 +02:00
pushpavanthar
891c8b90f4 DBZ-1492 - MySQL Connector Fails while parsing AWS RDS internal events 2019-10-02 10:31:09 +02:00
Gunnar Morling
d94b37c693 DBZ-1507 Misc. clean-up; 
* Removing unused Table methods
* Re-using primaryKeyColumnNames() instead of custom predicate
 2019-10-02 10:25:37 +02:00
Chris Cranford
d906096820 DBZ-1507 Ensure message keys have correct field order 2019-10-02 10:25:37 +02:00
Debezium Builder
2ff77b993b [maven-release-plugin] prepare for next development iteration 2019-10-01 15:34:23 -04:00
Debezium Builder
e09d584b11 [maven-release-plugin] prepare release v0.10.0.Final 2019-10-01 15:34:23 -04:00
Jiri Pechanec
410662c4aa DBZ-1517 Skip unknow records while operation header is used 2019-09-30 20:25:44 +02:00
Debezium Builder
2f5960c5d2 [maven-release-plugin] prepare for next development iteration 2019-09-27 01:03:50 -04:00
Debezium Builder
e3b44ffb12 [maven-release-plugin] prepare release v0.10.0.CR2 2019-09-27 01:03:50 -04:00
Gunnar Morling
2fba51863e DBZ-1015 Unifying the retrieval of custom key mappers 2019-09-26 10:14:48 +02:00
Guillaume Rosauro
1405889bef DBZ-1015-allow-user-to-customize-key 2019-09-26 10:14:21 +02:00
Gunnar Morling
236bae4265 DBZ-1508 Avoiding assertion based on platform-specific line endings 2019-09-26 09:25:24 +02:00
Gunnar Morling
442408be02 DBZ-1497 Using int64 for INTERVAL microseconds mapping 2019-09-25 11:21:40 +03:00
Chris Cranford
b20e689b2c DBZ-1495 Avoid NPE by throwing more meaningful error messages 2019-09-25 08:08:16 +03:00
Jiri Pechanec
8f308746d3 DBZ-1438 Interrupt only after interrupt affected operations 2019-09-24 12:51:48 +02:00
jerrinot
3064a4af06 DBZ-1438 Fix InterruptedException handling 
It appears there is an intent to restore the interruption flag
when catching InterruptedException. However the old code was just
checking the current state of the flag instead of raising it.
 2019-09-24 12:51:48 +02:00
Gunnar Morling
9de7c25d60 DBZ-1405 Misc adjustments; 
* Adding test
* Removing remaining double variables
 2019-09-24 12:08:55 +02:00
Bingqin Zhou
d6353dd519 DBZ-1405 Add NanoDuration. 2019-09-24 12:08:55 +02:00
Gunnar Morling
c5d0b18ea3 DBZ-1044 "AVRO" -> "Avro", as it's not an abbreviation 2019-09-23 12:21:54 +02:00
Chris Cranford
074cbf01a3 DBZ-1044 Checkstyle fix: remove unused import 2019-09-20 07:40:23 +03:00
Chris Cranford
6dc37fc8f6 DBZ-1044 Fix broken test caused by previous commit 2019-09-20 07:40:23 +03:00
Chris Cranford
910d00f6a2 DBZ-1044 Fixed documentation typo, added tests, adjusted FieldNameSelector 2019-09-20 07:40:23 +03:00
Chris Cranford
25086e82e3 DBZ-1044 Add auto-Enable sanitize.field.names support 
When the connector detects that its configuration explicitly specifies
that "key.converter" or "value.converter" are using the AvroConverter,
the "sanitize.field.names" option will be automatically enabled.
 2019-09-20 07:40:23 +03:00
Chris Cranford
130210b5ad DBZ-1044 Add config option sanitize.field.names and FieldNameSelector 2019-09-20 07:40:23 +03:00
Josh Arenberg
6573738fe9 DBZ-1044 Sanitize column/topic names to always be valid Avro Names 
This patch fixes the issue where more lenient standards for name conventions in source databases cause the
snapshot to fail when the schema for the table is created. This patch will prepend any column names that start
with a digit with an underscore, and will replace any subsequent invalid characters with an underscore. This should
conform to the Avro Name standard here: https://avro.apache.org/docs/1.7.7/spec.html#Names
 2019-09-20 07:40:23 +03:00
Debezium Builder
9b7e09fdda [maven-release-plugin] prepare for next development iteration 2019-09-10 09:12:12 -04:00
Debezium Builder
a1c2861458 [maven-release-plugin] prepare release v0.10.0.CR1 2019-09-10 09:12:11 -04:00
Renato Mefi
405a3b5b43 DBZ-1457 Do not commit when offset is null 2019-09-03 22:39:37 +02:00
Gunnar Morling
3215a3ce0a DBZ-1448 Misc. clean-up 2019-09-03 10:39:41 +02:00
garrett528
1aa7d70b0d DBZ-1448 Added support for source fields to be added to delete messages rewrites 2019-09-03 10:21:56 +02:00
Gunnar Morling
2a065686bd DBZ-1255 Exporting null value when temporal precision mode is "connect" and the value is out of the supported range 2019-08-21 07:50:40 +02:00
Gunnar Morling
fe9fc1c0dc DBZ-1255 Adjustments after rebase 2019-08-21 07:50:40 +02:00
Gunnar Morling
08ef1418d9 DBZ-DBZ-1255 Preventing value overflows for TIMESTAMP; 
* Generally avoiding conversion to nano-seconds to accomodate for larger values
* Generally avoiding the usage of long to convey temporal values internally:
 * Instant is used for TIMESTAMP
 * OffsetDateTime for TIMESTAMPTZ
 * Duration for TIME (LocalTime cannot be used as it doesn't support 24:00:00 as possible with Postgres)
 * OffsetTime for TIMETZ
* Avoiding usage of methods under test for calculating expected values in tests
 2019-08-21 07:50:40 +02:00
Gunnar Morling
94eb75257b DBZ-1255 Using Instant for representing timestamps 2019-08-21 07:50:40 +02:00
Jiri Pechanec
51c12d930d DBZ-1419 Support for Connect temporal types in SQL Server 2019-08-20 18:43:03 +02:00
Debezium Builder
4ae105bdce [maven-release-plugin] prepare for next development iteration 2019-08-16 03:42:55 -04:00
Debezium Builder
945ccf68cb [maven-release-plugin] prepare release v0.10.0.Beta4 2019-08-16 03:42:54 -04:00
Jiri Pechanec
540021cf68 DBZ-777 Minor fixes 2019-08-15 20:43:31 +02:00
Gunnar Morling
5ffe8123f1 DBZ-777 Further fixes 2019-08-15 20:43:31 +02:00
Gunnar Morling
63250d0c13 DBZ-777 Misc. adjustments 
* Avoiding repeated parsing of table id
* Making 'inconsistentSchemaHandler' field final in EventDispatcher
* Not exposing synchronizeTableSchema() on SPI level
 2019-08-15 20:43:31 +02:00
Jiri Pechanec
037d581844 DBZ-777 Fix heartbeats 2019-08-15 20:43:31 +02:00
Jiri Pechanec
d72afa8e9b DBZ-777 Skip empty messages 2019-08-15 20:43:31 +02:00
Jiri Pechanec
f4246df6e4 DBZ-777 PostgreSQL connector rewrite to the standard framework 2019-08-15 20:43:31 +02:00
Jiri Pechanec
8adb5e48ca DBZ-1385 Elevate payload for only headers setup 2019-08-12 10:36:52 +02:00
Jiri Pechanec
0991c70ac9 DBZ-1385 eventType can be configured as add field 2019-08-12 10:36:52 +02:00
Guillaume Rosauro
4b44e5f925 [DBZ-1254] Re-order the captured tables in the same order as the 
'table.whitelist' parameter
 2019-07-25 07:33:22 +02:00
Jiri Pechanec
0742e5775f Revert "[maven-release-plugin] prepare release v0.10.0.Beta4" 
This reverts commit c7340e5152.
 2019-07-23 14:54:55 +02:00
Jiri Pechanec
f7d20635ce Revert "[maven-release-plugin] prepare for next development iteration" 
This reverts commit 22879777e4.
 2019-07-23 14:54:49 +02:00
Jiri Pechanec
22879777e4 [maven-release-plugin] prepare for next development iteration 2019-07-23 14:10:03 +02:00
Jiri Pechanec
c7340e5152 [maven-release-plugin] prepare release v0.10.0.Beta4 2019-07-23 14:10:02 +02:00
Debezium Builder
71333fda98 [maven-release-plugin] prepare for next development iteration 2019-07-23 02:55:08 -04:00
Debezium Builder
20d006fac7 [maven-release-plugin] prepare release v0.10.0.Beta3 2019-07-23 02:55:08 -04:00
Adrian Kreuziger
00843cb0fb DBZ-1395 Update to use BoundedConcurrentHashMap for schema cache 2019-07-18 10:26:05 +02:00
Adrian Kreuziger
6c63c7daa0 DBZ-1395 Throw exception for missing source field 2019-07-18 10:26:05 +02:00
Adrian Kreuziger
63299022d7 DBZ-1395 Review feedback (keep field type, minor tweaks) 2019-07-18 10:26:05 +02:00
Adrian Kreuziger
dda17b9aa2 DBZ-1395 Undo accidental change to existing test 2019-07-18 10:26:05 +02:00
Adrian Kreuziger
c7684c351c DBZ-1395 Add ability to insert field from original source struct to unrwrapped record 2019-07-18 10:26:05 +02:00
Jiri Pechanec
3008339142 DBZ-916 Keyless tables have null key by default 2019-07-17 14:41:37 -04:00
Gunnar Morling
3b6e6b7719
Merge pull request #955 from jpechane/DBZ-1198 
DBZ-1198 Heartbeat for MongoDB connector
 2019-07-11 07:44:04 +02:00
Gunnar Morling
287551294f DBZ-1198 Adding comments 2019-07-11 07:43:32 +02:00
Renato Mefi
1b03fd3c46 DBZ-1388 Ensure Outbox SMT skips non CDC records 2019-07-10 22:32:23 +02:00
Jiri Pechanec
0316ac7fc0 DBZ-1198 Heartbeat for MongoDB connector 2019-07-10 11:16:26 +02:00
Gunnar Morling
369f74d875 DBZ-1320 Addressing review remarks 2019-07-09 21:07:18 +02:00
Brandon Brown
efff4f0809 DBZ-1320 Adding support for deletion events via new configurable property route.tombstone.on.empty.payload 2019-07-09 21:07:18 +02:00
Jiri Pechanec
67ca8a2d76 DBZ-794 Filter out savepoints from database history 2019-07-08 12:54:01 +02:00
Gunnar Morling
e2d8736a79 DBZ-1380 Misc. clean-up; 
* reducing visibility of some methods
* resetting interrupted state
 2019-07-05 21:08:35 +02:00
Gunnar Morling
02427a054b DBZ-1222 EventsInError -> ErroneousEvents 2019-07-04 21:31:32 +02:00
Jiri Pechanec
c08a5374fe DBZ-1222 Improve error event method name 2019-07-04 21:31:32 +02:00
Jiri Pechanec
2b365be63c DBZ-1222 EventsInError metric added 2019-07-04 21:31:32 +02:00
Jiri Pechanec
13d638fd43 DBZ-1356 Metrics for schema history (#947) 
* DBZ-1356 Metrics for schema history
 2019-07-02 13:26:17 +02:00
Jiri Pechanec
b1c1c05d1f DBZ-1363 Generate heartbeat periodically not upon event 2019-07-02 12:02:33 +02:00
Gunnar Morling
08c5d36789
Merge pull request #942 from jpechane/stab-lsn-flush-test 
DBZ-1362 Stabilize test executions on CI
 2019-07-01 09:34:24 +02:00
Jiri Pechanec
b546dc886e DBZ-1362 Fix Snapshot/streaming switch race condition 2019-06-28 09:09:18 +02:00
Gunnar Morling
254dba97ee DBZ-1358 Avoiding instantiation of SystemTime 2019-06-28 08:54:04 +02:00
Jiri Pechanec
a0df2c140b Use Kafka SystemTime implementation 2019-06-28 08:54:04 +02:00
Jiri Pechanec
53f4db06b9 DBZ-1358 Update to Kafka 2.3.0 2019-06-28 08:54:04 +02:00
Jiri Pechanec
7e03dbe87e DBZ-1362 Log test method executions 2019-06-28 05:41:02 +02:00
Jiri Pechanec
82d245acb1 DBZ-1362 Set longer ZooKeeper timeout 2019-06-28 05:33:49 +02:00
Gunnar Morling
a41fb30eaa DBZ-1361 Restoring compatibility with Apache Kafka 1.x 2019-06-28 05:07:52 +02:00
Jenkins user
e95d656bca [maven-release-plugin] prepare for next development iteration 2019-06-27 07:36:13 +00:00
Jenkins user
d95fd87311 [maven-release-plugin] prepare release v0.10.0.Beta2 2019-06-27 07:36:12 +00:00
Chris Cranford
d518fa59fe DBZ-1345 Should not snapshot materialized views 2019-06-25 12:44:00 +02:00
Cheng Pan
186babeabf DBZ-1346 Fixing description for state of snapshot 2019-06-24 10:52:16 +02:00
Gunnar Morling
d3e399e167 DBZ-1340 Avoiding repeated case conversion of incoming DML statements; 
Also adding startsWithIgnoreCase() method.
 2019-06-20 13:33:12 +02:00
Jiri Pechanec
3012524ea1 DBZ-1278 Rename to non-whitelisted table sends warn 2019-06-19 17:05:26 +02:00
Gunnar Morling
ee87f40f0c DBZ-1270 Avoiding usage of deprecated method; adding Stathis Souris to authors 2019-06-14 11:35:53 +02:00
Gunnar Morling
bb360e472c DBZ-1270 Logging improvements 2019-06-14 11:35:53 +02:00
ssouris
d513e2c757 DBZ-1270 - Fix KafkaDatabaseHistory throwing even after creating the topic in older brokers 2019-06-14 11:35:53 +02:00
Jiri Pechanec
9b5640ddde DBZ-835 Emit tombstone optionally 2019-06-12 21:39:13 +02:00
Jenkins user
5fdb0ca81b [maven-release-plugin] prepare for next development iteration 2019-06-11 11:20:46 +00:00
Jenkins user
61729b9e00 [maven-release-plugin] prepare release v0.10.0.Beta1 2019-06-11 11:20:46 +00:00
Gunnar Morling
5d01f409f0 DBZ-1317 Separating update and query methods for MongoDB's SourceInfo; 
* Avoids access to collection id after events which don't have one
* Pulling up struct() and schema() methods to common base class
 2019-06-11 10:07:36 +02:00
Chris Cranford
0aadaa10dc DBZ-1242 Fixed typo and added negative test checks 2019-06-05 13:31:25 -04:00
Chris Cranford
b3ca33287a DBZ-1242 Issue warning when filters produce an empty schema 2019-06-05 13:31:25 -04:00
Jenkins user
056730d06a [maven-release-plugin] prepare for next development iteration 2019-06-03 10:24:08 +00:00
Jenkins user
7aeaec236e [maven-release-plugin] prepare release v0.10.0.Alpha2 2019-06-03 10:24:08 +00:00
Gunnar Morling
246c1be305 DBZ-1283 Enforcing presence of database.server.name globally 2019-06-03 10:58:14 +02:00
Chris Cranford
5f0b44b4ec DBZ-1283 Only validate history topic name for affected connectors 2019-06-03 10:58:14 +02:00
Jiri Pechanec
ff51e99b6f DBZ-1295 Base SourceInfor for snapshotting 2019-05-31 10:56:05 +02:00
Jiri Pechanec
4b64c8e447 DBZ-1295 3state snapshot for MySQL 2019-05-31 10:56:05 +02:00
Jiri Pechanec
7f35d70d0e DBZ-1295 3state snapshot for SQL Server 2019-05-31 10:56:05 +02:00
Jiri Pechanec
348b2415d5 DBZ-1295 3state snapshot for PostgreSQL 2019-05-31 10:56:05 +02:00
Gunnar Morling
ca361bd122 DBZ-871 Clearly separating between DB and table events 2019-05-30 08:51:28 +02:00
Jiri Pechanec
e826599e2e DBZ-871 Add table(s) name to schema change event 2019-05-30 08:51:27 +02:00
Gunnar Morling
7759333fe3 DBZ-1092 Using ColumnNameFilter instead of Predicate<Column> 2019-05-29 15:49:49 +02:00
Jenkins user
ac5c76e431 [maven-release-plugin] prepare for next development iteration 2019-05-28 14:38:32 +00:00
Jenkins user
35f59ba460 [maven-release-plugin] prepare release v0.10.0.Alpha1 2019-05-28 14:38:32 +00:00
Gunnar Morling
eef37cb567 DBZ-1235 Misc adjustments; 
* Removing superfluous parameter from getSourceInfoStructMaker()
* JavaDoc
* Renaming field to "source.struct.version"
 2019-05-28 09:35:15 +02:00
Gunnar Morling
8f28f323e7 DBZ-1235 Using Instant to represent timestamps internally; 
Only "rendered" as epoch milli-seconds at the system boundaries.
 2019-05-28 09:35:15 +02:00
Jiri Pechanec
6f6c8ddf06 DBZ-1235 Refactored to unify the code 2019-05-28 09:35:15 +02:00
Jiri Pechanec
ea63dbf291 DBZ-1235 TableId added to SQL server connector 2019-05-28 09:35:15 +02:00
Jiri Pechanec
e6ed5f867a DBZ-1235 Make struct maker configured via enum 2019-05-28 09:35:15 +02:00
Jiri Pechanec
49910dcabb DBZ-1235 Pluggable source maker for SqlServer 2019-05-28 09:35:15 +02:00
Jiri Pechanec
f5757dbd9f DBZ-1235 Extract serverName to common source 2019-05-28 09:35:15 +02:00
Gunnar Morling
6f36eede61 DBZ-677 Adding missing header 2019-05-27 13:52:58 +02:00
Gunnar Morling
cf4db8c1a1 DBZ-677 Extracting shared configuration options for both new state extraction SMTs 2019-05-27 13:52:58 +02:00
Gunnar Morling
cb9e916616 DBZ-677 Renaming record state SMTs; 
Keeping old names in deprecated sub-classes for the time being.
 2019-05-27 13:52:58 +02:00
Gunnar Morling
4ed8b4636c DBZ-1224 Completing implementation; 
* Further unification of override handling;
* Undoing change related to SnapshotStatementFactory as it seems not needed
* Adding test
 2019-05-27 08:44:42 +02:00
Gunnar Morling
034739ab06 DBZ-1224 Making defaultSnapshotFetchSize a primitive 2019-05-27 08:44:42 +02:00
mokkara
b3de0250a9 DBZ-1224 Snapshot SELECT support for SQL Server 2019-05-27 08:44:42 +02:00
Gunnar Morling
a0e30b7c90 DBZ-1289 Making outbox router options more consistent 2019-05-24 13:18:55 +02:00
Jiri Pechanec
c1c4d3d149 DBZ-683 After review changes 2019-05-22 14:52:06 +02:00
Jiri Pechanec
540196091c DBZ-683 Snapshot supports storing only whitelisted tables setting 2019-05-22 14:52:06 +02:00
Chris Cranford
e2c74111ad DBZ-1234 Removed deprecated configuration options 2019-05-22 10:19:05 +02:00
Gunnar Morling
1ed8615434 DBZ-1234 Removing deprecated "drop.deletes" SMT option 2019-05-21 14:11:32 +02:00
Jiri Pechanec
a8e7104f18 DBZ-1209 Remove events skipped metric form common metrics 2019-05-21 10:26:22 +02:00
Jiri Pechanec
547ac819df DBZ-1257 Fixed typo 2019-05-21 10:11:57 +02:00
Jiri Pechanec
8c376d1795 DBZ-1257 Validate data against schema 2019-05-21 10:11:57 +02:00
Gunnar Morling
4751b266f3 DBZ-1164 Misc. improvements; 
* Moving stringToDuration() for the sake of re-use and testability
* Making pattern and durations constants
 2019-05-21 09:38:23 +02:00
Jenkins user
7748be6056 [maven-release-plugin] prepare for next development iteration 2019-05-02 16:04:56 +00:00
Jenkins user
5af083b86e [maven-release-plugin] prepare release v0.9.5.Final 2019-05-02 16:04:55 +00:00
Jiri Pechanec
b53f456912 DBZ-1245 Heartbeat only when offsets ready 2019-05-02 08:22:28 +02:00
Chris Cranford
c6aa02f813 DBZ-1226 Add support for enum/set values that contain commas or escaped characters. 2019-05-01 21:17:42 +02:00
Gunnar Morling
a84230447e DBZ-1247 Making defaultSnapshotFetchSize() abstract 2019-04-30 09:57:11 +02:00
jchipmunk
72b06366fe Removing extra initialisation of "config" variable in PG config 2019-04-30 09:57:11 +02:00
jchipmunk
9fe033ce24 DBZ-1247 Specifying default snapshot fetch size for each connector config 2019-04-30 09:57:11 +02:00
jchipmunk
a5cc83c0d1 DBZ-1247 Adding property to specify snapshot fetch size 2019-04-30 09:57:11 +02:00
krizhan
70c564b4c2 DBZ-212 Moved SERVER_NAME to RelationalDatabaseConnectorConfig 2019-04-23 12:29:44 +02:00
Jenkins user
cefc5ccfb9 [maven-release-plugin] prepare for next development iteration 2019-04-11 12:07:16 +00:00
Jenkins user
fc3026adc3 [maven-release-plugin] prepare release v0.9.4.Final 2019-04-11 12:07:15 +00:00