alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
8,297 Commits 3 Branches 0 Tags 51 MiB
910394f3c3
Commit Graph

8297 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jiri Pechanec
98dcdb8f55 DBZ-6023 Remove nnecessary code 2023-03-06 10:25:59 +01:00
PlugaruT
3e05965d24 DBZ-6023 Add integration tests 2023-03-06 10:25:59 +01:00
PlugaruT
7d0492fee5 DBZ-6023 Unit tests for buildChunkQuery and buildMaxPrimaryKeyQuery methods 2023-03-06 10:25:59 +01:00
PlugaruT
472162e46e DBZ-6023 Add support for providing a surrogate key when triggering incremental snapshots 
For tables that have a composite Primary Key, SQL queries for incremental snapshot perform bad. This change allows to provide a surrogate key that will be used for the queries. The key should be unique in order for the snapshot to guarantee consistency.
 2023-03-06 10:25:59 +01:00
Jiri Pechanec
0585c6beb8 DBZ-823 Add NULL instance for the class 2023-03-03 12:47:15 +01:00
Jiri Pechanec
fef5fa26f3 DBZ-823 Mark parallel snapshotting as incubating in documentation 2023-03-03 12:47:15 +01:00
Jiri Pechanec
d492ec892c DBZ-823 Use enum for enumeration 2023-03-03 12:47:15 +01:00
Jiri Pechanec
3da2434c6c DBZ-823 Restrict the type with generics 2023-03-03 12:47:15 +01:00
Jiri Pechanec
5e666f00ee DBZ-823 Add JavaDoc to new interfaces 2023-03-03 12:47:15 +01:00
Jiri Pechanec
7d92dc0211 DBZ-823 Don't use getter based name 2023-03-03 12:47:15 +01:00
Jiri Pechanec
0f4adb9fe6 DBZ-823 Use better name for CF with main connection 2023-03-03 12:47:15 +01:00
ggaborg
e875e784a0 DBZ-823 CR changes 2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
Jiri Pechanec
0656de70c9 DBZ-6156 Add an extra test case 2023-03-03 11:20:21 +01:00
Gunnar Morling
e9c6429154 [docs] Removing redundant TX ids from CloudEvents docs 2023-03-03 05:50:00 +01:00
ggaborg
72647e92db DBZ-6171 Github workflows not working for Cassandra job (step Build Debezium Connector Cassandra) 2023-03-03 05:49:18 +01:00
jcechace
aedb4fdd6a DBZ-6032 Making MongoDbConnectorConfig.REPLICA_SETS internal 2023-03-03 05:46:33 +01:00
jcechace
7d3cca89bd DBZ-6032 MongoConnection allways rethrows InterruptedException 2023-03-03 05:46:33 +01:00
jcechace
67d3f5b373 DBZ-6032 Removing obsolete retry configuration 2023-03-03 05:46:33 +01:00
jcechace
f305bcd9ab DBZ-6032 Further simplifying connection logic 2023-03-03 05:46:33 +01:00
jcechace
ecdb4729af DBZ-6032 Introducing connection package to mongo connector 2023-03-03 05:46:33 +01:00
jcechace
922191cdd7 DBZ-6032 Connection management refactoring 2023-03-03 05:46:33 +01:00
Jeremy Ford
2f44fcc064 [docs] Add additional properites for http sink 2023-03-02 13:28:49 +01:00
Jiri Pechanec
f499d92064 DBZ-5951 Init Maven repo with DSE artifacts 2023-03-02 08:30:02 +01:00
harveyyue
ee9e5f3419 DBZ-6144 Upgrade impsort-maven-plugin from 1.7.0 to 1.8.0 2023-03-01 10:12:25 -05:00
Bobby Tiernay
fe3135f28d DBZ-6131: Support change stream filtering using MongoDBs aggregation pipeline step. 2023-02-28 20:17:05 +01:00
Anisha Mohanty
a46bc2903b DBZ-6115 Oracle CI on pull request events 2023-02-28 13:53:33 +01:00
Bob Roldan
621dae76f2 DBZ-6073 Move note text and eliminate embedded community conditional 2023-02-28 13:40:11 +01:00
Chris Cranford
a9d4663456 DBZ-6163 Properly handle zoned timestamp within PostgreSQL 2023-02-28 13:32:57 +01:00
harveyyue
440192851d DBZ-6156 Add hostname validator to connector configuration 2023-02-28 13:22:14 +01:00
Bob Roldan
e0f2fc4095 DBZ-6130 Remove references to using properties files to configure SMTs 2023-02-27 13:22:01 -05:00
Chris Cranford
7384a1695e DBZ-6150 Upgrade to Quarkus 2.16.3.Final 2023-02-27 12:39:45 +01:00
Bobby Tiernay
37a6fea350 DBZ-6152: Remove hardcoded list of system database exclusions that are not required for change streaming. 2023-02-24 09:43:39 +01:00
Bobby Tiernay
5d80712781 DBZ-5201: Add MongoDB connector support for server-side filtering of replica set change streams. 
This change migrates from doing client-side filtering of streaming
change events to performing it server-side via MongoDB's support
for aggregation pipelines. This can drastically cut down on the amount
of data sent between the client and server. In addition, a new approach
to heartbeating has been added which relies on the `postBatchResumeToken`
to advance the the cursor even when no changes occur on the pipeline.
 2023-02-23 18:14:08 +01:00
Vojtech Juranek
fcb0e77bbb DBZ-3594 Warn when obtaning table schema which should be alread present 
We load all the schemas of the captured tables when the connector
starts. If we process a record from a table which schema is not
available, this means we have some bug in the intial schema loading.
Don't fail in such case, but print a warning about that.
 2023-02-23 09:26:07 -05:00
Vojtech Juranek
0868bfd55e DBZ-3594 Remove unused deprecated method 2023-02-23 09:26:07 -05:00
Chris Cranford
e320abc834 DBZ-6143 Unify Oracle TIMESTAMP WITH TIME ZONE format 
When taking a snapshot, the Oracle connector was converting the TIMESTAMP
WITH TIME ZONE value to GMT and per the documentation, the value should
be emitted in the time zone of the data.

The snapshot emitted value in GMT is temporally accurate, so there is no
data inconsistency, but the emitted format itself was inconsistent when
looking at how the column data was emitted during a snapshot versus in a
streaming event.
 2023-02-23 10:43:38 +01:00
Xinbin Huang
76a8f8dbe1 DBZ-6118: Update ExtractNewDocumentState to parse change stream output 2023-02-23 09:09:04 +01:00
Xinbin Huang
2c57b93384 DBZ-6118: Cleanup Mongo oplog code logic 2023-02-23 09:09:04 +01:00
Vojtech Juranek
ffc9c2f80d [docs] Fix poll.interval.ms default value 2023-02-22 13:49:40 -05:00
Chris Cranford
24fe8fe572 DBZ-6136 Add toJson to TestContainers ConnectorConfiguration impl 2023-02-21 18:31:57 +01:00
Eugene Abramchuk
fcc44edf0b DBZ-6113 Correct max reconnect attempts 
Originally there are max+1 attempts
 2023-02-21 08:10:26 +01:00
dependabot[bot]
a587b3b7ef [ci] Bump tj-actions/changed-files from 35.5.2 to 35.5.6 
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.5.2 to 35.5.6.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.5.2...v35.5.6)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-02-21 07:52:16 +01:00
Xinbin Huang
a3d75e798a DBZ-6116: Support String type for key in Mongo incremental snapshot 2023-02-20 13:55:54 +01:00
Chris Cranford
dd9ca95bec DBZ-6125 Fix potential stale offsets when using PDBs 
DBZ-5648 introduced a regression where transaction start, commit, and rollback
events were only being read from within the scope of the configured PDB that
the connector was capturing changes instead of the entire Oracle database.
This can lead to situations where the offsets may not be advanced as quickly
in a low traffic PDB environment, potentially causing stale offsets.
 2023-02-20 13:29:11 +01:00
Chris Cranford
a89212efef DBZ-6120 Correctly handle quoting table/schema names 2023-02-20 13:26:49 +01:00
Mehmet Firat KOMURCU
4c9ab87704 DBZ-6123 fix typo "evemts" to "events" in docs. 
fix typo in sql server docs
 2023-02-20 08:29:54 +01:00
Debezium Builder
bf347da71a [release] Development version for testing module deps 2023-02-16 11:35:58 +00:00
Debezium Builder
2245ceda44 [maven-release-plugin] prepare for next development iteration 2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a [maven-release-plugin] prepare release v2.2.0.Alpha2 2023-02-16 11:28:25 +00:00