rkuchar
b4480c55b7
DBZ-252 parse database queries (create, alter, delete), parse name tokens without quotes, add new Mysql connector configuration field for choosing ddl parsing mode
2018-06-15 11:42:23 +02:00
rkuchar
5d911d511f
DBZ-252 signal event for truncate table into schema changes
2018-06-15 11:42:23 +02:00
rkuchar
32d181480d
DBZ-252 fix troubles with generalized system variables + add new data types that was missing in grammar
2018-06-15 11:42:23 +02:00
rkuchar
85e8146d1f
DBZ-252 implementation of scope synonym for local and session scope in MySQL
2018-06-15 11:42:23 +02:00
rkuchar
5851d1f07d
DBZ-252 fix initialization of system variables object + add default scope for variales in case that scope will no be set
2018-06-15 11:42:23 +02:00
rkuchar
9311c82bc5
DBZ-252 reformat code to not have anything after closing "}"
2018-06-15 11:42:23 +02:00
rkuchar
782ab75160
DBZ-252 move listener support from base to only legacy implementation, refactor system variables for possible use with other DBMSs + introduce data type resolver for antlr mysql parser
2018-06-15 11:42:23 +02:00
rkuchar
b92e8ef760
DBZ-252 exclude logging of parsed comment
2018-06-15 11:42:23 +02:00
rkuchar
30e158aa71
DBZ-252 create table and drop table listeners
2018-06-15 11:42:23 +02:00
rkuchar
785c346bcb
DBZ-252 Exclude reusable logic from LegacyDdlParser
2018-06-15 11:42:23 +02:00
rkuchar
36e2f33bf6
DBZ-252 - extract creation of DdlParser interface
2018-06-15 11:42:23 +02:00
Jiri Pechanec
29f8891b4f
DBZ-578 Process timestamps without timezones as in server timezone
2018-06-11 15:27:08 +02:00
Jiri Pechanec
de0e1ad4b5
DBZ-702 Mask SASL configuration
2018-06-08 08:57:50 +02:00
Jiri Pechanec
176dcbbc0b
DBZ-709 PostgreSQL uses scale for time precision not length
2018-06-05 15:51:35 +02:00
luobo
5b33d81f00
DBZ-191 support default value of column in mysql
2018-06-04 10:43:53 +02:00
Gunnar Morling
61f576bb90
DBZ-706 Misc. clean-up
2018-06-01 11:23:30 +02:00
Stephen Powis
40d872f48c
DBZ-706 General cleanup
2018-06-01 11:23:30 +02:00
Stephen Powis
867202e0ca
DBZ-706 Slight refactoring / shuffling of code to validate source query field in snapshot tests
2018-06-01 11:23:12 +02:00
Jiri Pechanec
764a1d0d58
DBZ-693 SQL parsing in separate method
2018-05-28 12:35:47 +02:00
Jiri Pechanec
45bc7b1536
DBZ-693 On connect statements supported for PostgreSQL
2018-05-28 12:35:47 +02:00
Jiri Pechanec
f74a9fe059
DBZ-693 Initial SQL statements
2018-05-28 12:35:47 +02:00
Jiri Pechanec
f844054f50
DBZ-696 Support nanoseconds in timestamp data
2018-05-22 11:33:50 +02:00
Jiri Pechanec
09b28c0913
DBZ-694 Support milliseconds for pre-epoch dates
2018-05-22 11:22:06 +02:00
Rao
15a90548fb
DBZ-666 Supporting ordered snapshot using tables.whitelist config
2018-05-17 06:23:31 +02:00
Jiri Pechanec
0f0a5d4cd4
DBZ-687 Kafka 1.1.0
2018-05-14 09:37:33 +02:00
Omar Al-Safi
8ef9267808
DBZ-668 Added unit test and changed the key field name
2018-03-23 10:50:42 +01:00
Omar Al-Safi
21d2e0b8a9
DBZ-668 Changed the key schema for the heartebat messages from STRING to STRUCT
2018-03-23 10:50:42 +01:00
Jiri Pechanec
2b5370de1a
DBZ-667 Sceintific numbers parsing
2018-03-20 14:42:55 +01:00
Gunnar Morling
00b63bb808
DBZ-669 Closing AdminClient instance after usage
2018-03-20 13:07:42 +01:00
Jenkins user
f4e151b23a
[maven-release-plugin] prepare for next development iteration
2018-03-20 08:14:19 +00:00
Jenkins user
93b3252332
[maven-release-plugin] prepare release v0.7.5
2018-03-20 08:14:19 +00:00
Gunnar Morling
5f61cb167b
DBZ-655 Using AssertJ asserts in UnwrapFromEnvelopTest
2018-03-19 09:28:30 +01:00
Gunnar Morling
5358167446
DBZ-655 Adding test
2018-03-19 09:28:30 +01:00
Maciej Bryński
d5abb8415c
DBZ-655 Use cache to avoid using regexp replace
2018-03-19 09:28:23 +01:00
Gunnar Morling
d73c27d9bd
DBZ-657 Adding test
2018-03-18 18:26:27 +01:00
Jiri Pechanec
87bd3e9c2f
DBZ-657 Handle JSON with control chars not according to specs
2018-03-18 18:03:56 +01:00
Jiri Pechanec
9884a5ca1d
DBZ-663 disable cleaning of history topic based on size
2018-03-16 16:14:12 +01:00
Jiri Pechanec
62c7fe12f9
Do not log FLUSH RELAY LOGS statements
2018-03-16 09:51:48 +01:00
Jenkins user
daf27207be
[maven-release-plugin] prepare for next development iteration
2018-03-07 08:31:07 +00:00
Jenkins user
9c73774928
[maven-release-plugin] prepare release v0.7.4
2018-03-07 08:31:07 +00:00
Jiri Pechanec
327085164e
DBZ-611 Special values supported for double
2018-03-06 16:55:24 +01:00
Gunnar Morling
1f385c21f9
DBZ-611 Typo fix and formatting
2018-03-06 16:55:24 +01:00
Jiri Pechanec
424aefbbb4
DBZ-611 Decimal-> String supported for MySQL
2018-03-06 16:55:24 +01:00
Gunnar Morling
401cbae852
DBZ-632 Removing methods from HistoryRecord which where only used in tests;
...
Also adding a new test for HistoryRecord (de-)serialization
2018-03-02 05:28:16 +01:00
Gunnar Morling
d040ec4427
DBZ-351, DBZ-606 Misc. clean-up;
...
* Renaming DebeziumDecimal to SpecialValueDecimal
* Simplifying logic in PostgresValueConverter
2018-02-27 16:36:21 +01:00
Jiri Pechanec
2534696b21
DBZ-606 Exception thrown for special values when mode handling is not string
2018-02-27 16:36:21 +01:00
Jiri Pechanec
5827a7ac1b
DBZ-611 Decimals can be encoded as strings
2018-02-27 16:36:21 +01:00
Jiri Pechanec
c71707afc9
DBZ-351 wal2json usses unlimited precision too
2018-02-27 16:36:21 +01:00
Jiri Pechanec
0c0ac72568
DBZ-606 Type for handling special BigDecimals
2018-02-27 16:36:21 +01:00
Jiri Pechanec
ceaa7f8efe
DBZ-351 Numeric is passed with unlimited precision
2018-02-27 16:36:21 +01:00
Gunnar Morling
d89f4e91c6
DBZ-632 Removing unused method parameter
2018-02-23 21:54:41 +01:00
Gunnar Morling
eef1ad7c2a
DBZ-630 Refactoring around MongoDB task context;
...
* Renaming ConnectorTaskContext to CdcSourceTaskContext
* Renaming ReplicationContext to MongoDbTaskContext
* Making relationship from MongoDbTaskContext to ConnectionContext has-a instead of is-a
2018-02-21 12:04:41 +01:00
Gunnar Morling
bb12e521f8
DBZ-630 Pulling up getClock() to ConnectorTaskContext
2018-02-21 12:04:41 +01:00
Gunnar Morling
8264c20cf6
DBZ-630 Unifying common start-up logic across connectors
2018-02-21 12:04:41 +01:00
Gunnar Morling
7fe45db831
DBZ-626 Renaming AvroValidator to SchemaNameAdjuster;
...
Making apparent that this functionality doesn't solely validate but returns a new name actually
2018-02-20 09:26:47 +01:00
Gunnar Morling
cddd5fcc8a
DBZ-626 Passing schema validator as AvroValidator instance instead of Function
2018-02-20 09:26:47 +01:00
Jiri Pechanec
6e00924ee9
DBZ-625 Fix parsing of float without decimals
2018-02-20 08:47:43 +01:00
Gunnar Morling
b5856f37c7
DBZ-628 Unrelated typo fix
2018-02-20 06:34:42 +01:00
Gunnar Morling
8369f10d52
DBZ-628 Adding MAX_QUEUE_SIZE, MAX_BATCH_SIZE and POLL_INTERVAL_MS to CommonConnectorConfig;
...
Also using these options in PG connector
2018-02-20 06:34:42 +01:00
Gunnar Morling
5bc62dc862
DBZ-620 Removing method only used in tests
2018-02-19 12:18:37 +01:00
Gunnar Morling
ab11f48843
DBZ-620 Creating envelope schemas only once per table type
2018-02-19 12:18:37 +01:00
Jenkins user
6d0cd88e12
[maven-release-plugin] prepare for next development iteration
2018-02-15 04:15:34 +00:00
Jenkins user
7d1e1a989e
[maven-release-plugin] prepare release v0.7.3
2018-02-15 04:15:34 +00:00
Gunnar Morling
b1362f9db9
DBZ-278 Extracting broker config retrieval into its own method
2018-02-13 17:12:11 +01:00
Jiri Pechanec
90e4aa0dea
DBZ-278 Fail if topic is not created
2018-02-13 16:48:42 +01:00
Jiri Pechanec
4541fc53c9
DBZ-278 Explicit history storage initialization
2018-02-13 16:48:42 +01:00
Jiri Pechanec
ad7b92310e
DBZ-278 Test for broker without auto-created topics
2018-02-13 16:48:42 +01:00
Jiri Pechanec
55e81c458b
DBZ-278 Create database history topic
2018-02-13 16:48:42 +01:00
Jiri Pechanec
5a0c7c07b0
DBZ-609 DBZ-571 Refactor Postgres type handling
...
TypeRegistry introduced for Postgres connector
JDBC column does not have a special componentType
JDBC column provide a database specific type id
OID is a primary type identifier to be used in Postgres connector code - dropping JDB/OID dichotomy
2018-02-13 14:54:42 +01:00
Jiri Pechanec
dbac1429b2
DBZ-581 Improve error handling for replicators
2018-02-13 14:40:54 +01:00
Jiri Pechanec
ecdce6529d
DBZ-220 Null Heartbeat object. Messages contains key
2018-02-13 12:26:48 +01:00
Jiri Pechanec
682cabb84a
DBZ-220 Generate heartbeat events in binlog thread
2018-02-13 12:24:51 +01:00
Gunnar Morling
96b4023839
DBZ-220 Misc. improvements;
...
* interpreting heartbeat interval as MS
* adding Configuration#getDuration()
2018-02-13 12:24:51 +01:00
Jiri Pechanec
3c1ea8206b
DBZ-220 Refactor heartbeat to a separate class
2018-02-13 12:24:51 +01:00
Gunnar Morling
2e0b9e5e33
DBZ-582 Moving TOMBSTONES_ON_DELETE to CommonsConnectorConfig for re-use
2018-02-13 10:19:18 +01:00
Jiri Pechanec
d0bd1560ff
DBZ-576 Make DDL filter internal parameter
2018-02-12 11:22:28 +01:00
Jiri Pechanec
3740aee4e8
DBZ-576 Internal parameters
2018-02-12 11:22:28 +01:00
Gunnar Morling
a77c8d733a
DBZ-580, DBZ-586 Making enqueue() and thus snapshots in Postgres interruptable;
...
* ChangeEventQueue#enqueue() checks the interrupted state of the calling
thread now, raising an InterruptedException in case the interrupted flag
has been set (because the producer's thread executor has been stopped)
* RecordSnapshotProducer has been adjusted to check for the interrupted
regularly, aborting if it has been set
2018-02-11 10:05:06 +01:00
Gunnar Morling
45a9847d42
DBZ-580 Initial implementation of dedicated change message queue:
...
* To be used across connectors, unifying the enqueuing/polling logic and handling of related config options
* Using it for Postgres connector
2018-02-11 10:05:06 +01:00
Gunnar Morling
2a724d9611
DBZ-537 Misc. adjustments:
...
* Renaming ConfigurationHelper to Instantiator
* Doc improvements and typo fixes
* Bringing getInstance() methods into consistent order
* Raising exception instead of logging error if instantion fails
2018-02-09 15:45:57 +01:00
Jiri Pechanec
5be55ae8ff
DBZ-537 OffsetCommitPolicy supports Configuration constructor initialization
2018-02-09 15:19:48 +01:00
Gunnar Morling
7b6db00db7
DBZ-593 JavaDoc
2018-02-02 13:16:43 +01:00
Gunnar Morling
712824e43f
DBZ-593 Passing version explicitly from SourceInfos to base class instead of relying specific packaging structure
2018-02-02 13:16:43 +01:00
Jiri Pechanec
7ebee94169
DBZ-593 Add Debezium version to source in envelope
2018-02-02 13:16:43 +01:00
Gunnar Morling
3a281d1185
DBZ-595 Making sure resources are cleaned up when snapshotting fails;
...
* shutting down the snapshotting thread and the DB history producer client
if the connector is stopped while trying to write to the history topic
* reducing the time that KafkaProducer#send() will block if Kafka isn't
available; this will release the producer thread quicker in case the
connector is stopped during snapshotting
* not returning from finally block (!) in case the TX is rolled back; This
prevented the failed state to be set by the outer catch clause in execute()
2018-02-02 09:06:32 +01:00
Jiri Pechanec
92740a3626
DBZ-587 Fix thread leak, thread names
2018-02-01 10:04:20 +01:00
Jiri Pechanec
9b592204ac
DBZ-587 Centralize and unify thread management
2018-02-01 10:04:20 +01:00
Jenkins user
04624341f5
[maven-release-plugin] prepare for next development iteration
2018-01-25 09:39:44 +00:00
Jenkins user
898f6884e1
[maven-release-plugin] prepare release v0.7.2
2018-01-25 09:39:44 +00:00
Gunnar Morling
8edcf9f3d8
DBZ-507 Making "wkb" optional in Point schema to keep compatability with previous version
2018-01-24 16:51:54 +01:00
Robert Coup
f9d90a482f
DBZ-507 Expanding support for geometry types;
...
* Adding support for PostGIS geometry types
* Adding support for GEOMETRY, POLYGON and more in MySQL
* For all newly supported types, changes are represented using two new schema types Geometry and Geography, containing the WKB (binary geo data) ans srid (coord system identifier)
* The existing Point type also contains the new (optional) srid field
2018-01-24 16:51:49 +01:00
Jiri Pechanec
01577b40c3
DBZ-541 Only whitelisted tables are recorded in history
2018-01-24 14:43:57 +01:00
Gunnar Morling
ea4b366b7f
DBZ-538 Capturing unparseable DDL for logging in one more place
2018-01-24 11:30:51 +01:00
Peter Goransson
7d78357087
DBZ-443 Adding db-history recovery mode: schema_only_recovery
2018-01-23 09:17:39 +01:00
Gunnar Morling
0c4190c493
DBZ-516 Using Duration instead of long in a few more places
2018-01-18 14:13:58 +01:00
Jiri Pechanec
24bdcaf059
DBZ-516 Return control to Connect periodically
2018-01-18 14:13:58 +01:00
Gunnar Morling
9f433b1e24
DBZ-544 Comment fix
2018-01-17 15:16:37 +01:00
Jiri Pechanec
cdf44faba4
DBZ-544 Log matching DDL filter
2018-01-17 15:16:37 +01:00
Gunnar Morling
4d1d016acb
DBZ-392 Making table map and set dedicated classes just with the needed API
2018-01-17 11:21:02 +01:00
Jiri Pechanec
9f0f0fe5d4
DBZ-392 Support for MySQL running on lowercase filesystems
2018-01-17 11:21:02 +01:00