Commit Graph

2450 Commits

Author SHA1 Message Date
Gunnar Morling
92b044d405 DBZ-1292 ☁️ Adding documentation for CloudEvents converter 2020-01-16 08:02:51 +01:00
Gunnar Morling
8c33a4e147 DBZ-1292 Catering for the differences in data schema;
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
2020-01-16 08:01:56 +01:00
Gunnar Morling
8531adbefd DBZ-1292 Formatting 2020-01-16 08:00:45 +01:00
Gunnar Morling
2ba1d615fb DBZ-1292 Distinct names for data and envelope schema for Avro/Avro 2020-01-16 08:00:45 +01:00
Gunnar Morling
8591dd669b DBZ-1292 Avoiding usage of reflection 2020-01-16 08:00:45 +01:00
Gunnar Morling
7c18a6d8d5 DBZ-1292 Removing static state in CloudEventsConverterTest 2020-01-16 08:00:45 +01:00
Gunnar Morling
366382ddad DBZ-1292 Refactoring of options;
* Avoiding hard dependency to Avro
* Passing through all options from JSON and Avro converters by means of "json." and "avro." sub-namespaces
2020-01-16 08:00:45 +01:00
Gunnar Morling
12e43a89f4 DBZ-1292 Always adding "before" and "after" 2020-01-16 08:00:45 +01:00
Gunnar Morling
a861dae432 DBZ-1292 Clean-up around data schema URI 2020-01-16 08:00:45 +01:00
Gunnar Morling
1a18bdbc81 DBZ-1292 Misc. refactorings;
* Protecting against Avro as CE format and JSON as data format
* Reducing mutability
* Single Avro client
2020-01-16 08:00:45 +01:00
Gunnar Morling
4e4800cb56 DBZ-1292 Some clean-up in CloudEventsMaker;
* Avoiding non-final static fields
* Removing unused methods
* Reducing visibility
2020-01-16 08:00:45 +01:00
Gunnar Morling
fe8c5fe27d DBZ-1292 Adding schema URI in case of Avro 2020-01-16 08:00:45 +01:00
Gunnar Morling
a25d148a82 DBZ-1292 Adding logical name to CE source attribute value 2020-01-16 08:00:45 +01:00
Gunnar Morling
342a448053 DBZ-1292 Using "iodebezium" prefix for extension attributes;
Simplifying implementation a bit.
2020-01-16 08:00:45 +01:00
Gunnar Morling
390c8f8090 DBZ-1292 Wrapping up work on schema and value conversion;
* There were a few attributes missing in the schema of the CE event
* Conversion of extension attributes now correctly handles optional attributes
* Removed guards against missing and duplicate fields, as the only caller is this class itself, so it seems superfluous.
2020-01-16 08:00:45 +01:00
GraySmog
de2655a89e DBZ-1292 promoting op, ts_ms and sub-fields in source to extension attributes 2020-01-16 08:00:45 +01:00
GraySmog
d0e4b3c0af DBZ-1292 Delete data.schema.registry.url config option 2020-01-16 08:00:45 +01:00
GraySmog
8b7c67cbdd DBZ-1292 Using formatted timestamp for CE time field 2020-01-16 08:00:45 +01:00
Gunnar Morling
87ffe0c44e DBZ-1292 Representing data as JSON struct instead of binary 2020-01-16 08:00:45 +01:00
Gunnar Morling
6356784cee DBZ-1292 dataschema value should not be empty or null if key is present;
* CloudEvents spec version is 1.0 now
2020-01-16 08:00:45 +01:00
GraySmog
915c8cafd9 DBZ-1292 CloudEvents converter for JSON and Avro format 2020-01-16 08:00:45 +01:00
Gunnar Morling
e5717b84a6 DBZ-1478 Avoiding hard-coded image path 2020-01-16 07:31:28 +01:00
Gunnar Morling
e44e1f271a DBZ-1478 Outbox doc updates; adding visual 2020-01-16 07:31:28 +01:00
Chris Cranford
1ec377224a DBZ-1712 MySQL connector use default port when database.port option not specified 2020-01-15 21:24:55 +01:00
Chris Cranford
8f9817cd1c DBZ-1478 Fix Travis build 2020-01-15 10:06:13 -05:00
Gunnar Morling
bf539c352a DBZ-1478 Avoiding split package between runtime and deployment modules 2020-01-15 10:48:06 +01:00
Gunnar Morling
a86c148834 DBZ-1478 Removing Quarkus parent POM for now 2020-01-15 10:48:06 +01:00
Chris Cranford
55be5ce40f DBZ-1478 Renamed deployment package 2020-01-15 10:48:06 +01:00
Chris Cranford
8124412ff1 DBZ-1478 Fixed Travis CI configs and more POM cleanup 2020-01-15 10:48:06 +01:00
Chris Cranford
98fa50a538 DBZ-1478 Document Outbox Quarkus Extension 2020-01-15 10:48:06 +01:00
Chris Cranford
afdc883329 DBZ-1478 Various fixes
* Removed and consolidated unnecessary poms
* Cleaned up build dependencies
* Added checkstyle exclusions for auto generated files
* Added outbox extension to Travis CI
* Aligned naming convention for build-time configuration options
2020-01-15 10:48:06 +01:00
Chris Cranford
d7208791bd DBZ-1478 Dynamic mapping and configuration support & cleaned up code 2020-01-15 10:48:06 +01:00
Gunnar Morling
dace9da957 DBZ-1478 Misc. changes;
* Internal/public package split
* Parameterizing ExportedEvent
2020-01-15 10:48:06 +01:00
Chris Cranford
a4bfa24d07 DBZ-1478 Changed timestamp to use Instant rather than Long 2020-01-15 10:48:06 +01:00
Chris Cranford
45a464a64f DBZ-1478 Fix bom version typos 2020-01-15 10:48:06 +01:00
Chris Cranford
7bfff2dbbe DBZ-1478 Debezium Quarkus Extensions module with Outbox pattern 2020-01-15 10:48:06 +01:00
Gunnar Morling
07e89de91d DBZ-1707 Ensuring correct Kafka record timestamp for outbox events;
Depending on the width of the configured TIMESTAMP column, a microsecond or nanosecond timestamp could have been returned before, whereas this should always be milliseconds.
2020-01-15 07:32:55 +01:00
Chris Cranford
1d41d53636 DBZ-1685 Document and add support for column.mask.with for PostgreSQL connector 2020-01-14 09:30:34 +01:00
Chris Cranford
9fc1eada11 DBZ-1600 Remove deprecated "slot.drop_on_stop" postgres configuration option 2020-01-14 09:27:32 +01:00
Chris Cranford
4a27746dad DBZ-1703 Fix typo after renaming configuration option 2020-01-14 09:24:53 +01:00
Chris Cranford
4fa0f22ac7 DBZ-1703 Add option to JSON SerDes for ignoring unknown properties 2020-01-14 09:24:53 +01:00
Chris Cranford
7fd3059d3a Update documentation component version to 1.1 [ci-skip] 2020-01-13 15:05:50 -05:00
Jiri Pechanec
dfb91b779e DBZ-1691 Support for SIGNAL statement 2020-01-12 00:08:25 +01:00
Jiri Pechanec
88e280d89e DBZ-1693 Replace other instances of schema with catalog 2020-01-10 22:02:49 +01:00
Jiri Pechanec
6163f46585 DBZ-1693 Use corrent TableId component 2020-01-10 22:02:49 +01:00
Chris Cranford
1079f7a23c DBZ-1699 Support MySQL CAST as JSON grammar syntax 2020-01-10 00:53:02 +01:00
Chris Cranford
9f1173980f Update README about testing PG connector with all 3 plugins 2020-01-09 17:22:45 +01:00
Chris Cranford
cf60466b02 DBZ-1684 Make sure publication initialized prior to slot
This is to avoid the need to restart the connector when streaming begins due to
an error that the publication can't be found.  It would seem based on testing
that since we create the replication slot early on when it does not exist, then
when streaming starts its confused about trying to marry a newly created
publication to an slot.  By creating the publication before the slot, this
works around the problem.
2020-01-09 15:55:22 +01:00
Gunnar Morling
eacc624001
Adding section on Prometheus/Grafana to monitoring docs 2020-01-09 07:39:45 +01:00
Chris Cranford
3413d674fb DBZ-1684 Create missing publication when replication slot exists 2020-01-07 15:41:15 +01:00