alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
1,225 Commits 3 Branches 0 Tags 51 MiB
d82372a6b2
Commit Graph

225 Commits

Author SHA1 Message Date
Jiri Pechanec
f844054f50 DBZ-696 Support nanoseconds in timestamp data 2018-05-22 11:33:50 +02:00
Jiri Pechanec
09b28c0913 DBZ-694 Support milliseconds for pre-epoch dates 2018-05-22 11:22:06 +02:00
Jiri Pechanec
37cfe622fc DBZ-697 Support for large type OIDs 2018-05-22 10:39:14 +02:00
Jiri Pechanec
2706858cf4 DBZ-676 Support testing against 8bit enc database 2018-04-06 18:26:45 +02:00
Gunnar Morling
9a29063ef4 DBZ-673 Converting tx id to long in one more place 2018-03-27 10:04:43 +02:00
listman
aa4bf5d367 DBZ-673 txId must be long in wal2jon decoder 2018-03-27 00:31:03 -05:00
Gunnar Morling
bdb1069b0d DBZ-638 Logging message on TRACE level instead of DEBUG 2018-03-23 16:38:05 +01:00
Jiri Pechanec
363921a7b1 DBZ-638 Chunk processing operates on byte array 2018-03-23 14:41:59 +01:00
Jiri Pechanec
4051a4a439 DBZ-638 Improved variable naming 2018-03-23 14:41:59 +01:00
Jiri Pechanec
ce5196dc3e DBZ-638 Keep non-streaming decoding as a fallback 2018-03-23 14:41:59 +01:00
Jiri Pechanec
24965dd076 DBZ-638 Process tx as stream not as batch 2018-03-23 14:41:59 +01:00
Jiri Pechanec
0743467102 DBZ-671 Date/time parsing covers more exotic formats 2018-03-23 08:55:24 +01:00
Jenkins user
f4e151b23a [maven-release-plugin] prepare for next development iteration 2018-03-20 08:14:19 +00:00
Jenkins user
93b3252332 [maven-release-plugin] prepare release v0.7.5 2018-03-20 08:14:19 +00:00
Jiri Pechanec
40a527b6ea DBZ-592 Make snapshot/init-sync false instead of null 2018-03-19 13:19:34 +01:00
Jenkins user
daf27207be [maven-release-plugin] prepare for next development iteration 2018-03-07 08:31:07 +00:00
Jenkins user
9c73774928 [maven-release-plugin] prepare release v0.7.4 2018-03-07 08:31:07 +00:00
Gunnar Morling
1d5d6b6f3a DBZ-635 Schema for geo-spatial array columns shouldn't be optional by default 2018-03-07 07:17:43 +01:00
Gunnar Morling
ff524695bc DBZ-635 Schema for NUMERIC columns shouldn't be optional by default 2018-03-07 07:17:43 +01:00
Gunnar Morling
6412e9e06e DBZ-605 Schema for BYTEA columns shouldn't be optional by default 2018-03-07 07:17:43 +01:00
Jiri Pechanec
327085164e DBZ-611 Special values supported for double 2018-03-06 16:55:24 +01:00
Jiri Pechanec
424aefbbb4 DBZ-611 Decimal-> String supported for MySQL 2018-03-06 16:55:24 +01:00
Gunnar Morling
6e29b82358 DBZ-351 Avoiding call to new BigDecimal() for NaN 2018-02-27 16:36:21 +01:00
Gunnar Morling
5786d44200 DBZ-351 Avoiding call to getBigDecimal() for NaN 2018-02-27 16:36:21 +01:00
Gunnar Morling
d040ec4427 DBZ-351, DBZ-606 Misc. clean-up; 
* Renaming DebeziumDecimal to SpecialValueDecimal
* Simplifying logic in PostgresValueConverter
 2018-02-27 16:36:21 +01:00
Jiri Pechanec
2534696b21 DBZ-606 Exception thrown for special values when mode handling is not string 2018-02-27 16:36:21 +01:00
Jiri Pechanec
5827a7ac1b DBZ-611 Decimals can be encoded as strings 2018-02-27 16:36:21 +01:00
Jiri Pechanec
c71707afc9 DBZ-351 wal2json usses unlimited precision too 2018-02-27 16:36:21 +01:00
Jiri Pechanec
0c0ac72568 DBZ-606 Type for handling special BigDecimals 2018-02-27 16:36:21 +01:00
Jiri Pechanec
ceaa7f8efe DBZ-351 Numeric is passed with unlimited precision 2018-02-27 16:36:21 +01:00
Jiri Pechanec
4623c1d8c4 DBZ-606 Numeric NaN represented as null 2018-02-27 16:36:21 +01:00
Gunnar Morling
c900c7fc92 DBZ-623 Formatting and indentation 2018-02-22 21:16:00 +01:00
Jiri Pechanec
01e5f8da8c DBZ-623 Extract parsing code to a separate method 2018-02-22 21:12:05 +01:00
Jiri Pechanec
80c74a9d7c DBZ-623 Fix NPE for invlid restored LSNs 2018-02-22 21:12:05 +01:00
Gunnar Morling
eef1ad7c2a DBZ-630 Refactoring around MongoDB task context; 
* Renaming ConnectorTaskContext to CdcSourceTaskContext
* Renaming ReplicationContext to MongoDbTaskContext
* Making relationship from MongoDbTaskContext to ConnectionContext has-a instead of is-a
 2018-02-21 12:04:41 +01:00
Gunnar Morling
bb12e521f8 DBZ-630 Pulling up getClock() to ConnectorTaskContext 2018-02-21 12:04:41 +01:00
Gunnar Morling
8264c20cf6 DBZ-630 Unifying common start-up logic across connectors 2018-02-21 12:04:41 +01:00
Jiri Pechanec
4e74e0a4ac Revert default Postgres decoder plugin for testing 2018-02-20 10:29:06 +01:00
Jiri Pechanec
ad181493da DBZ-626 Make caller method naming consistent 2018-02-20 09:26:47 +01:00
Gunnar Morling
7fe45db831 DBZ-626 Renaming AvroValidator to SchemaNameAdjuster; 
Making apparent that this functionality doesn't solely validate but returns a new name actually
 2018-02-20 09:26:47 +01:00
Gunnar Morling
cddd5fcc8a DBZ-626 Passing schema validator as AvroValidator instance instead of Function 2018-02-20 09:26:47 +01:00
Jiri Pechanec
40a5422998 DBZ-605 Support for BYTEA datatype 2018-02-20 08:55:56 +01:00
Jiri Pechanec
6e00924ee9 DBZ-625 Fix parsing of float without decimals 2018-02-20 08:47:43 +01:00
Gunnar Morling
8369f10d52 DBZ-628 Adding MAX_QUEUE_SIZE, MAX_BATCH_SIZE and POLL_INTERVAL_MS to CommonConnectorConfig; 
Also using these options in PG connector
 2018-02-20 06:34:42 +01:00
Gunnar Morling
ab11f48843 DBZ-620 Creating envelope schemas only once per table type 2018-02-19 12:18:37 +01:00
Jenkins user
6d0cd88e12 [maven-release-plugin] prepare for next development iteration 2018-02-15 04:15:34 +00:00
Jenkins user
7d1e1a989e [maven-release-plugin] prepare release v0.7.3 2018-02-15 04:15:34 +00:00
Gunnar Morling
cc64a7a616 DBZ-618 Removing unused method and field 2018-02-14 16:53:52 +01:00
Gunnar Morling
f54ed51897 DBZ-618 Removing superfluous method parameter 2018-02-14 16:43:52 +01:00
Jiri Pechanec
d0198e3e26 DBZ-618 Incorrect type retrieved by stream producer for time/date columns 2018-02-14 13:06:50 +01:00
Gunnar Morling
0f726b5f4e DBZ-616 Making PostgresType#equals() and hashCode() symmetric; logging improvements 2018-02-14 10:54:39 +01:00
Jiri Pechanec
2a08a718ba DBZ-616 Get default length and scale for types 2018-02-14 10:48:13 +01:00
Gunnar Morling
bda12b59ee DBZ-571 Misc. improvements; 
* More consistent variable names
* Making type registry truly immutable
* Avoiding call to instance method from constructor
 2018-02-13 16:15:10 +01:00
Jiri Pechanec
5a0c7c07b0 DBZ-609 DBZ-571 Refactor Postgres type handling 
TypeRegistry introduced for Postgres connector

JDBC column does not have a special componentType

JDBC column provide a database specific type id

OID is a primary type identifier to be used in Postgres connector code - dropping JDB/OID dichotomy
 2018-02-13 14:54:42 +01:00
Gunnar Morling
2cd1a43db8 DBZ-220 Removing println() call 2018-02-13 12:31:36 +01:00
Jiri Pechanec
682cabb84a DBZ-220 Generate heartbeat events in binlog thread 2018-02-13 12:24:51 +01:00
Gunnar Morling
f3ea0b5683 DBZ-582 Supporting TOMBSTONES_ON_DELETE option with Postgres connector 2018-02-13 10:19:18 +01:00
Gunnar Morling
a77c8d733a DBZ-580, DBZ-586 Making enqueue() and thus snapshots in Postgres interruptable; 
* ChangeEventQueue#enqueue() checks the interrupted state of the calling
thread now, raising an InterruptedException in case the interrupted flag
has been set (because the producer's thread executor has been stopped)
* RecordSnapshotProducer has been adjusted to check for the interrupted
regularly, aborting if it has been set
 2018-02-11 10:05:06 +01:00
Gunnar Morling
45a9847d42 DBZ-580 Initial implementation of dedicated change message queue: 
* To be used across connectors, unifying the enqueuing/polling logic and handling of related config options
* Using it for Postgres connector
 2018-02-11 10:05:06 +01:00
Jiri Pechanec
6150955a47 DBZ-590 Detect non-available offset 2018-02-05 12:20:47 +01:00
Gunnar Morling
712824e43f DBZ-593 Passing version explicitly from SourceInfos to base class instead of relying specific packaging structure 2018-02-02 13:16:43 +01:00
Jiri Pechanec
7ebee94169 DBZ-593 Add Debezium version to source in envelope 2018-02-02 13:16:43 +01:00
Jiri Pechanec
9b592204ac DBZ-587 Centralize and unify thread management 2018-02-01 10:04:20 +01:00
Jiri Pechanec
2c74dd74a3 DBZ-577 Numeric arrays correctly working 2018-01-29 15:14:11 +01:00
Jenkins user
04624341f5 [maven-release-plugin] prepare for next development iteration 2018-01-25 09:39:44 +00:00
Jenkins user
898f6884e1 [maven-release-plugin] prepare release v0.7.2 2018-01-25 09:39:44 +00:00
Robert Coup
e3fbf165ed DBZ-507 Temporarily disabling geometry/geography array support in postgres until array support is improved. 
Test tidyups.
 2018-01-24 16:51:54 +01:00
Robert Coup
f9d90a482f DBZ-507 Expanding support for geometry types; 
* Adding support for PostGIS geometry types
* Adding support for GEOMETRY, POLYGON and more in MySQL
* For all newly supported types, changes are represented using two new schema types Geometry and Geography, containing the WKB (binary geo data) ans srid (coord system identifier)
* The existing Point type also contains the new (optional) srid field
 2018-01-24 16:51:49 +01:00
Jiri Pechanec
5ff2cf4dd8 DBZ-558 Return correct array OID 2018-01-23 19:34:39 +01:00
Jiri Pechanec
fe16050cdb DBZ-521 SourceRecord is now associated with metadata 2018-01-19 21:18:55 +01:00
Gunnar Morling
6f6ce33958 DBZ-521 Misc. improvements and fixes; 
* Actually assing last processed LSN to commit()
* passing LSN to commit() instead of entire SourceRecord
* Avoiding exception in case of wal2json batch with exactly one element
* Using "Lsn" instead of "LSN" in method names
* JavaDoc clarifications
 2018-01-19 21:18:55 +01:00
Jiri Pechanec
0b5348339a DBZ-521 Record LSN for the last message committed to Connect 2018-01-19 21:18:55 +01:00
Jiri Pechanec
c3edf8ee9c DBZ-504 Type changes detected for constraints 2018-01-19 14:45:08 +01:00
Gunnar Morling
0c4190c493 DBZ-516 Using Duration instead of long in a few more places 2018-01-18 14:13:58 +01:00
Jiri Pechanec
24bdcaf059 DBZ-516 Return control to Connect periodically 2018-01-18 14:13:58 +01:00
Gunnar Morling
5c88431c07 DBZ-494 Making tests more lenient towards specific List implementations; 
also fixing a few typos.
 2018-01-15 10:40:50 +01:00
Jiri Pechanec
5756f6dc40 DBZ-494 Array elements goes through value conversion 2018-01-15 10:24:54 +01:00
Jiri Pechanec
a629591f1f DBZ-506 Support for char and varchar arrays 2018-01-05 13:52:19 +01:00
Jiri Pechanec
ac5ed3bd92 DBZ-510 snapshot.select.statement.overrides for Postgres 2018-01-05 04:15:36 +01:00
jchipmunk
8df63e894d DBZ-519 NullPointerException happened for PAUSED task 
PostgresConnectorTask throws java.lang.NullPointerException during commit for PAUSED connector after the restart of Kafka Connect application
 2018-01-02 10:54:21 +01:00
Jiri Pechanec
24e305ad57 DBZ-525 Timestamp supports optional microseconds part 2018-01-02 08:52:27 +01:00
Jenkins user
6bb34b42f9 [maven-release-plugin] prepare for next development iteration 2017-12-20 07:15:12 +00:00
Jenkins user
16dcd4c980 [maven-release-plugin] prepare release v0.7.1 2017-12-20 07:15:12 +00:00
Jiri Pechanec
42d103294e DBZ-518 Remove a leftover event 2017-12-20 06:06:41 +01:00
Jiri Pechanec
ecf6a86594 DBZ-517 Manually override RDS environment 2017-12-20 06:05:59 +01:00
Jiri Pechanec
ffce17484e DBZ-512 Need to use OID with the old Postgres connector version 2017-12-20 06:04:40 +01:00
Jenkins user
5e09932cb9 [maven-release-plugin] prepare for next development iteration 2017-12-15 05:10:23 +00:00
Jenkins user
6c1d61e03b [maven-release-plugin] prepare release v0.7.0 2017-12-15 05:10:23 +00:00
Gunnar Morling
4e8cedd094 DBZ-379 Postgres connector minimizes use of JDBC metadata 2017-12-13 12:20:37 +01:00
Jiri Pechanec
d4daf639f7 DBZ-498 Unknown types can be handled as binary data 2017-12-11 13:44:25 +01:00
Jiri Pechanec
104f1bc466 DBZ-501 Avoid race condition in stop of thread executor and task submission 2017-12-06 13:21:15 +01:00
rkerner
c7ac481c43 [DBZ-342] fix broken MySQL data type "TIME" handling 2017-11-29 20:34:12 +01:00
Gunnar Morling
4309164f27 DBZ-453 Improving description of configuration option; also 
* some JavaDoc adjustments
* removing some dead code
 2017-11-29 15:14:19 +01:00
Gunnar Morling
5dae38bfab DBZ-453 Keeping existing behavior of omitting fields of unsupported column types from change messages; 
Also removing confusing log message as those fields are not propagated as binary data actually.
 2017-11-29 15:14:19 +01:00
Robert Coup
65a8113cb7 Deal with non-builtin PG types. 
Fix DBZ-454 issue with mapping to the wrong OID.
Return byte[] as the standard approach
 2017-11-29 15:14:19 +01:00
Robert Coup
71d6a1bcb6 DBZ-453 add support for newer wal2json with verbose type specifiers. 2017-11-29 15:14:19 +01:00
Jiri Pechanec
b60ff5e863 DBZ-478 Fix null array handling for wal2json 2017-11-23 14:53:46 +01:00
Gunnar Morling
833e81a3a4 DBZ-478 Avoiding NPE in case of unsupported array column types for Postgres; 
Instead, just the warning about the unsupported type will be logged.
 2017-11-22 09:43:10 +01:00
Gunnar Morling
b1cb58f7cc DBZ-478 Correctly handling null values for array-typed columns 2017-11-22 09:43:10 +01:00
Jiri Pechanec
3fae495bc7 DBZ-259 Return correct value for null Duration 2017-11-14 13:04:25 +01:00