alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
10,814 Commits 3 Branches 0 Tags 51 MiB
2c0eea6b25
Commit Graph

1565 Commits

Author SHA1 Message Date
Debezium Builder
55d65e9618 [maven-release-plugin] prepare for next development iteration 2023-03-08 11:38:17 +00:00
Debezium Builder
6d183c3dc1 [maven-release-plugin] prepare release v2.2.0.Alpha3 2023-03-08 11:38:16 +00:00
Jiri Pechanec
3da2434c6c DBZ-823 Restrict the type with generics 2023-03-03 12:47:15 +01:00
Jiri Pechanec
5e666f00ee DBZ-823 Add JavaDoc to new interfaces 2023-03-03 12:47:15 +01:00
Jiri Pechanec
7d92dc0211 DBZ-823 Don't use getter based name 2023-03-03 12:47:15 +01:00
Jiri Pechanec
0f4adb9fe6 DBZ-823 Use better name for CF with main connection 2023-03-03 12:47:15 +01:00
ggaborg
e875e784a0 DBZ-823 CR changes 2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
Chris Cranford
a9d4663456 DBZ-6163 Properly handle zoned timestamp within PostgreSQL 2023-02-28 13:32:57 +01:00
Debezium Builder
2245ceda44 [maven-release-plugin] prepare for next development iteration 2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a [maven-release-plugin] prepare release v2.2.0.Alpha2 2023-02-16 11:28:25 +00:00
Yang Wu
d7ab7146f0 DBZ-6089 Expose sequence in postgres parser 2023-02-08 10:13:19 +01:00
harveyyue
57b902ff8c DBZ-5743 Introduce alternative AVRO_UNICODE mode for field name selector 2023-02-02 13:21:45 +01:00
Jiri Pechanec
8f3ca36e23 DBZ-6026 Don't update last offsets in statistics 2023-01-24 14:26:05 +01:00
Vojtech Juranek
f00f2a8735 DBZ-5917 Fix querying column metadata for tables with back slash in the name 
If the table contains back slash, which is ANSI SQL escape chracter,
in its name, querying column metadata would fail in some cases (*)
which would result into NPE. Fix table name before the query and
escape escape character if the table name contains it.

Default backslash works for all currently supported databases as it's
ANSI SQL standard,

(*) everything works when we collect column metadata for all tables,
i.e. when there are no excluded tables
 2023-01-20 00:01:11 +01:00
Debezium Builder
04f5291a2d [maven-release-plugin] prepare for next development iteration 2023-01-19 11:32:10 +00:00
Debezium Builder
027527963e [maven-release-plugin] prepare release v2.2.0.Alpha1 2023-01-19 11:32:10 +00:00
Anil Dasari
e1f9d64fbb DBZ-5852:Snapshotter#snapshotCompleted is invoked regardless of snapshot result 2023-01-19 09:24:02 +01:00
Jeremy Ford
8da86b78e8 DBZ-5879 Fix unit tests 2023-01-18 14:46:14 +01:00
Jeremy Ford
f2a6f0b8db DBZ-5879 Support retrying database connection failures during connector start 
Reworked when task requests start from subclasses
Add support for restarting
 2023-01-18 14:46:14 +01:00
Jiri Pechanec
1ee4850273 DBZ-6012 Allow skipping of LSN check failure 2023-01-18 10:34:56 +01:00
Jiri Pechanec
107f09a2e7 DBZ-6001 DBZ-5991 Use strict class for money 2023-01-17 14:52:03 +01:00
harveyyue
93b82ab7b4 DBZ-6001 Postgresql connector parses the null of the money type into 0 2023-01-17 14:52:03 +01:00
harveyyue
bde7af1423 DBZ-5991 There is a problem with postgresql connector parsing the boundary value of money type 2023-01-17 14:52:03 +01:00
Jiri Pechanec
bcd6787cdc DBZ-6008 Revert "DBZ-3653 Introduce incremental.snapshot.isolation.mode config" 
This reverts commit 6d8bcd42fd.
 2023-01-17 10:40:20 +01:00
Animesh Kumar
90cd3fdb6d DBZ-5988 Impose null check on schema and name values prior to applying lowercase operation 2023-01-11 09:04:31 +01:00
govi20
6d8bcd42fd DBZ-3653 Introduce incremental.snapshot.isolation.mode config 2023-01-11 08:55:33 +01:00
Jiri Pechanec
8ca5e0a9b5 DBZ-4669 Reformat after plugin version consolidation 2023-01-11 06:44:53 +01:00
Mark Lambert
e5d16b14a6 DBZ-2439 Remove redundant modifiers 2023-01-11 06:44:53 +01:00
erdinc
5a063867df DBZ-5976 Use as much as possible "replace" method rather than "replaceAll" 2023-01-05 07:30:49 +01:00
rajdangwal
b03b4cdd19 DBZ-5915: correctly determine the startStreamingLsn with messageType 2023-01-04 14:50:14 +01:00
rajdangwal
5dde1ab3b5 DBZ-5915: correctly determine the startStreamingLsn 2023-01-04 14:50:14 +01:00
Debezium Builder
cf1720e4cb [maven-release-plugin] prepare for next development iteration 2022-12-22 10:11:54 +00:00
Debezium Builder
b4ea9b46cd [maven-release-plugin] prepare release v2.1.0.Final 2022-12-22 10:11:53 +00:00
jchipmunk
189f3c023e DBZ-5949 Support partitioned tables when updating PG publication 
PostgresConnection.getAllTableIds(String) method was added to unify getting all tables in database catalog, including partitioned tables.
 2022-12-20 09:28:05 +01:00
Praveen Burgu
31745a7dd5 DBZ-5936 Add test for json[] column 2022-12-20 09:18:34 +01:00
Praveen Burgu
48e1db8fc3 DBZ-5936 Add Javadoc 2022-12-20 09:18:34 +01:00
Jiri Pechanec
fff4719fb1 DBZ-5936 Remove separate config option 2022-12-20 09:18:34 +01:00
Praveen Burgu
4cada81661 DBZ-5936 Handle json and jsonb arrays 2022-12-20 09:18:34 +01:00
Praveen Burgu
28d12a836f DBZ-5936 Move all placeholder logic into one class 2022-12-20 09:18:34 +01:00
Praveen Burgu
54c0cfc14a DBZ-5936 Handle TOASTed int and bigint array columns 2022-12-20 09:18:34 +01:00
Debezium Builder
177a60a9d3 [maven-release-plugin] prepare for next development iteration 2022-12-16 09:33:38 +00:00
Debezium Builder
f805db8c3c [maven-release-plugin] prepare release v2.1.0.Beta1 2022-12-16 09:33:38 +00:00
Praveen Burgu
0b4769c793 DBZ-5944 Toasted varchar array is not correctly processed 2022-12-16 08:50:32 +01:00
Praveen Burgu
b4be663168 DBZ-4941 add a comment 2022-12-14 14:26:17 +01:00
Praveen Burgu
e61a75ff4e DBZ-4941 Create a separate table for test 2022-12-14 14:26:17 +01:00
Praveen Burgu
4bdcd66d48 DBZ-4941 Handle Toasted array columns 2022-12-14 14:26:17 +01:00
xiaowu
08119e5368 Clean up useless methods 2022-12-14 08:34:44 +01:00
Vojtech Juranek
9494552a3a DBZ-5838 Add missing Apicurio converter dependency 2022-12-12 14:44:05 +01:00
Vojtech Juranek
68b624cf7b DBZ-5811 DBZ-5914 Don't manipulate with LSN when LSN flushing LSN is disabled 
Befre we start streamig, we adjust `confirmed_flush_lsn` in Postgres to
the position where we determined that the streaming should start. When
user disables LSN flushing, which is not desired as it's the user
reponsibility to flush LSN in Postgres.

Also adjust related tests, as when LSN flushing is not disabled, flushed
LSN in Postgres may change (as we e.g. determined start of streaming
from offset or from `xlogpos`) and can result in the test failure. When
flushing is enabled, only LSNs after start of streaming can be compared.
 2022-12-09 21:03:19 +01:00
Jiri Pechanec
7f05ef44f9 DBZ-5895 Remove hard-coded plugin 2022-12-09 21:03:19 +01:00
Jiri Pechanec
67ff871569 DBZ-5895 Wait for REPLICA IDENTITY set completed 2022-12-09 21:03:19 +01:00
Jiri Pechanec
f437788325 DBZ-5895 Remove race condition between table reading and re-creating 2022-12-09 21:03:19 +01:00
Marcelo Avancini
7754163c5d DBZ-2432: Fixing misuse of assertj 
- Some usages of assertj was not callig the actual assert of the DSL, fixing it
- Changing the Assertions to be staticlly imported
 2022-12-08 13:10:26 +01:00
Vojtech Juranek
e1b65cd6f7 DBZ-5889 Run integration tests in specified order 
Run the tests alwyas in thr same order to make it more easy to debug
failures. If needed, the order can be changed (e.g. to `random`) by
overriding propeperty `runOrder`.
 2022-12-08 13:00:41 +01:00
Jiri Pechanec
574c1b0015 DBZ-5811 Use validate method 2022-12-06 13:35:52 +01:00
subodh
66fb51b55a DBZ-5811 Implement support for skipping LSN commit on postgres source based on config 2022-12-06 13:35:52 +01:00
Debezium Builder
81896ed334 [maven-release-plugin] prepare for next development iteration 2022-11-30 07:52:24 +00:00
Debezium Builder
1aac97b87c [maven-release-plugin] prepare release v2.1.0.Alpha2 2022-11-30 07:52:23 +00:00
Praveen Burgu
2158ea22d4 DBZ-5739 Pass the exception as argument to the logger 2022-11-30 06:55:35 +01:00
Praveen Burgu
ad6ec2be6a DBZ-5739 Handle permission error from RDS Postgres 2022-11-30 06:55:35 +01:00
Jiri Pechanec
5eb147129d DBZ-5874 Fix syntax errors 2022-11-25 11:43:49 +01:00
Gunnar Morling
e7aba47a24 DBZ-5874 Making sure trace message gets logged 2022-11-25 11:43:49 +01:00
Praveen Burgu
2b73ad6216 DBZ-5739 Seek to LSN based on lastCommitStoredLsn 2022-11-22 14:50:11 +01:00
Praveen Burgu
00321ccb4d DBZ-5739 Fix remaining failing tests 2022-11-22 14:50:11 +01:00
Praveen Burgu
cb535d2ce6 DBZ-5739 Fix another test with expected error message 2022-11-22 14:50:11 +01:00
Praveen Burgu
8e3867f23f DBZ-5739 Fix other failing tests 2022-11-22 14:50:11 +01:00
Praveen Burgu
1a0576e340 DBZ-5739 auto close statement 2022-11-22 14:50:11 +01:00
Praveen Burgu
2aed6b55ba DBZ-5739 Fix test PostgresConnectorIT#shouldRegularlyFlushLsnWithTxMonitoring by not dropping the slot 2022-11-22 14:50:11 +01:00
Praveen Burgu
895d651841 DBZ-5739 Fix test DebeziumEngineIT.testOffsetsCommitAfterStop() by not dropping the slot 2022-11-22 14:50:11 +01:00
Jiri Pechanec
b4c076a27c DBZ-5739 Make validation mandatory; more robust tests 2022-11-22 14:50:11 +01:00
Praveen Burgu
822f87147c DBZ-5739 Postgres connector results in silent data loss if replication slot is recreated 
Detect replication slot recreation and fail the connector
 2022-11-22 14:50:11 +01:00
Debezium Builder
e311dd1a67 [maven-release-plugin] prepare for next development iteration 2022-11-10 13:29:06 +00:00
Debezium Builder
e3bf53440a [maven-release-plugin] prepare release v2.1.0.Alpha1 2022-11-10 13:29:05 +00:00
Vojtech Juranek
96e4326d35 DBZ-2131 Use system property to determine if Apicurio should be used 2022-11-09 08:44:45 +01:00
Vojtech Juranek
391c1b921d DBZ-2131 Add Apicurion profile for Postgres 2022-11-09 08:44:45 +01:00
Vojtech Juranek
1e86ab7c7a DBZ-2131 Unify intendation in Postgres pom.xml 2022-11-09 08:44:45 +01:00
rajdangwal
2350442a8c DBZ-5792: minor nit 2022-11-09 08:28:17 +01:00
rajdangwal
7bf889006f DBZ-5792: Handle TRUNCATE type 2022-11-09 08:28:17 +01:00
rajdangwal
ea2983c8d8 DBZ-5792: Fix for - Message with LSN XYZ not present among LSNs seen in the location phase 2022-11-09 08:28:17 +01:00
Jiri Pechanec
4ccf91d70d DBZ-5800 Disable test failing on CI 2022-11-08 12:10:19 +01:00
harveyyue
506311b469 DBZ-5783 Suppress logging of undetermined optionality for explicitly excluded columns 2022-11-04 10:46:29 -04:00
jcechace
e887670a8e DBZ-5779 Migrated debezium-connector-postgres to AssertJ 2022-11-02 08:50:26 +01:00
Jiri Pechanec
53731e5662 DBZ-5370 Support for PostgreSQL 15 2022-10-18 12:04:55 +02:00
Debezium Builder
4d35fb8011 [maven-release-plugin] prepare for next development iteration 2022-10-14 11:26:32 +00:00
Debezium Builder
7bd1551c99 [maven-release-plugin] prepare release v2.0.0.Final 2022-10-14 11:26:32 +00:00
Vojtech Juranek
820b9d10d5 DBZ-5329 Add LSN to Postgres transation ID 
Add `EventDispatcher` constructor which accepts `TransactionMonior`
instance as a parameter and in case of Postgres pass into
`EventDispatcher` custom `PostgresTransactionMonitor` which adjusts
transactions IDs by adding LSN, i.e. Postgres transaction is now of
form `txId:LSN`.
 2022-10-11 15:38:33 +02:00
Vojtech Juranek
44dfa893ae DBZ-5329 Remove unsed PostgresEventDispatcher constructors 2022-10-11 15:38:33 +02:00
Debezium Builder
884254aba1 [maven-release-plugin] prepare for next development iteration 2022-10-07 09:27:52 +00:00
Debezium Builder
a0f3263fa6 [maven-release-plugin] prepare release v2.0.0.CR1 2022-10-07 09:27:51 +00:00
harveyyue
f6b72f060c DBZ-5671 Remove logic name parameter from sub connector config 2022-10-03 11:40:17 -04:00
Vojtech Juranek
97532042b3 DBZ-5657 Allow to use Docker maven plugin external properties 
Allow to override Docker maven plugin properties [1] from command line
to be able to change various Docker parameters more easily when starting
the container.

[1] https://dmp.fabric8.io/#combining-property-config
 2022-09-29 05:41:09 +02:00
Jiri Pechanec
1d423d7f09 DBZ-5597 Record LSNs seen the location phase 2022-09-22 11:12:04 -04:00
harveyyue
d1153e8ad4 DBZ-5594 Clean up "logical name" config 2022-09-22 14:29:37 +02:00
harveyyue
288c93434f DBZ-5585 Remove classloader parameter from JdbcConnection 2022-09-19 17:15:29 +02:00
Debezium Builder
218d414552 [maven-release-plugin] prepare for next development iteration 2022-09-16 06:36:40 +00:00
Debezium Builder
567f57c47b [maven-release-plugin] prepare release v2.0.0.Beta2 2022-09-16 06:36:39 +00:00
Vojtech Juranek
acc6be6df3 DBZ-5043 Move TOPIC_PREFIX into CommonConnectorConfig 
`TOPIC_PREFIX` is now mandatory to all connectors therefore it make
sense to have it in common config. Beside that, it also makes it more
easy to use it in Debezium UI without any workarounds - if the field is
not member of the given connector config, the field has to be
explicitely added into known fields otherwise is invisible for UI.
 2022-09-13 09:25:54 +02:00
Anisha Mohanty
f41b6dd458 DBZ-5044 Get rid of schema factory instances 2022-09-08 10:35:20 +02:00
Anisha Mohanty
b0dc7e557a DBZ-5044 Update schemaHistoryColumnSchema to add new fields 2022-09-08 10:35:20 +02:00
Anisha Mohanty
ec792527e9 DBZ-5044 Use SchemaFactory for centralizing Postgres schemas 2022-09-08 10:35:20 +02:00
Vojtech Juranek
0823cedf25 DBZ-5043 Replace database.server.name with topic.prefix 2022-09-07 12:57:31 +02:00
Vojtech Juranek
161a7229b6 DBZ-5043 Use topic prefix as the logical name 
With this change the user cannot direcly set connector logical name and
thus in the future it can be remove without breaking user config.
If the turn out that the logical name is useful and user should be able
to configure it, dedicated config option can be added.

Originally it was prposed in the Jira to replace it with connector name,
but it turned out that logical name defaults to `database.server.name`
and is heavily used in the tests and JMX, so it would require another
big refactoring. Thus, use topic prefix for now. Once we know further
direction (remove logical name or add new option), do this refactoring.
 2022-09-07 12:57:31 +02:00
Vadzim Ramanenka
917de37a01 DBZ-5557: Supply partition when comiting offsets with source database 
Keep track of partitions offsets being committed belong to in
`BaseSourceTask`. Supply the partition along with the offset in calls to
`commitOffset`.
 2022-09-05 14:04:23 +02:00
ggaborg
244de2bd96 DBZ-3293 Add signal table automatically to include list 2022-09-01 20:16:47 +02:00
Marek Winkler
1c9ea5166c DBZ-3007: limit 'Streaming requested from LSN' logging 2022-08-31 11:45:47 -04:00
Jiri Pechanec
de53591dba DBZ-5244 Retry all communication exceptions by default 2022-08-31 09:45:09 -04:00
pkgonan
b031770300 DBZ-5544 Support BASE64_URL_SAFE in BinaryHandlingMode 2022-08-24 09:50:23 +02:00
Sergei Morozov
1c99437890 DBZ-5470: Remove the dependency of JdbcConnection on DatabaseSchema 2022-08-19 11:06:59 +02:00
Chris Cranford
37b97970a6 DBZ-5497 Skip truncate operations by default 
* Promote truncate skip default from PostgreSQL to core library
* Adjust behavior for Oracle with truncates skipped by default
 2022-08-19 11:05:29 +02:00
Vojtech Juranek
db446f85c4 DBZ-4329 Don't send fileds with obsolete values 
During incremental snapshot fields `xmin`, `lsn` and `txId` are not
updated and therefore we stream obsolete values from previous records
in `source` struct. Don't include these obsolete value in the `source`
struct during incremental snapshot.
 2022-08-05 10:23:47 -04:00
Vojtech Juranek
c7d8353d7b DBZ-4727 Add snapshot paused JXM metrics 
Add two JXM objects:
* `snapshotPaused` - detemines if the incremental snapshot is paused
  or not
* `snapshotPausedDurationInSeconds` - overall time when the incremental
  snapshot was paused. The time adds up - if the snapshot was paused
  e.g. two times, the `snapshotPausedDurationInSeconds` is the sum of
  these two paused times.
 2022-07-29 12:41:58 -04:00
harveyyue
5f430f1a8e DBZ-5457 Deprecate legacy topic selector for all connectors 2022-07-28 12:58:59 -04:00
Debezium Builder
1ab51ae8d0 [maven-release-plugin] prepare for next development iteration 2022-07-26 18:13:10 +00:00
Debezium Builder
d247a48b79 [maven-release-plugin] prepare release v2.0.0.Beta1 2022-07-26 18:13:09 +00:00
harveyyue
187ccb25db DBZ-5398 The column is referenced as PRIMARY KEY, but a matching column is not defined in table 2022-07-25 10:11:43 -04:00
Vojtech Juranek
3527479cd8 DBZ-5408 Make sure streaming is fully running before dropping connection 2022-07-14 11:10:22 -04:00
Chris Cranford
67dbd189a6 DBZ-5403 Convert timestamps with tz default values to GMT 2022-07-14 08:23:06 +02:00
harveyyue
6ea7abc8fc DBZ-4180 Pluggable topic selector 2022-07-13 14:45:25 +02:00
harveyyue
7af6037078 DBZ-5384 org.postgresql.util.PSQLException: Bad value for type timestamp/date/time: CURRENT_TIMESTAMP 2022-07-12 17:29:15 +02:00
Vojtech Juranek
5573bb51ed DBZ-5048 Rename GH repo with containes 
Besides updating links to renamed GH repo, update also documentation and
replace 'Docker' with 'containers' when possible.
 2022-07-12 13:16:53 +02:00
Chris Cranford
d2a76a7ffc DBZ-5295 Reselect LOB columns on primary key update 2022-07-12 11:59:34 +02:00
Chris Cranford
bb0a640219 DBZ-5340 Add test case 2022-07-08 06:54:18 +02:00
Chris Cranford
c909dd78d2 DBZ-5340 Allow schema prefix on default value function calls 2022-07-08 06:54:18 +02:00
Debezium Builder
6fd1441af3 [maven-release-plugin] prepare for next development iteration 2022-07-01 09:21:49 +00:00
Debezium Builder
99402af634 [maven-release-plugin] prepare release v2.0.0.Alpha3 2022-07-01 09:21:48 +00:00
yangrong688
774d1e4141 [docs] Fix typo for javadoc newSlotInfo 2022-06-30 12:27:06 +02:00
Vojtech Juranek
499aece7eb DBZ-5240 Add partitioned tables into supported table types 
Postgres supports partitioned tables. Debezium requires tables to have
primary key to be able to snapshot them. Primary key support for
partitioned was added in Postgres 11, see [1]. Add partitioned table
type into supported table tables so that Debezium fetches the schema
and can do the snapshot for partitioned tables.

N.B.: On Postgres < 11 is still possible to define primary key
constraint on partitioned sub-tables. In such cases sub-tables are
snapshotted, but parent table is not.

Fix RecordsSnapshotProducerIT#shouldGenerateSnapshotsForPartitionedTables
test after adding support for partitioned tables. Test assumed that
the parent table is not snapshotted and filters out duplicate records
which results into lossing `LAST` snapshot record. Keepting original
test by filtering parent table.

[1] https://www.postgresql.org/docs/11/release-11.html
 2022-06-30 10:46:54 +02:00
Mickael Maison
5ff71aa992 DBZ-5335 Fix formatting issues in the connectors configdefs 2022-06-30 09:35:54 +02:00
harveyyue
20dc353262 DBZ-5170 Mysql Commit Timestamp 2022-06-27 15:50:52 +02:00
kanha gupta
1b17372d2d DBZ-4902 Replace long durations with Duration 2022-06-27 14:29:51 +02:00
Vojtech Juranek
e15f148deb DBZ-5070 Don't reset lsn when lastCommitLsn is null 
Currently we update first `lsn` and then update `lastCommitLsn` in
`PostgresOffsetContext` constructor. However, when `lastCommitLsn`
is for whatever reason `null`, previously updated `lsn` is reset to
`null` as `updateLastCommit()` updates also `lsn`. This can have
unwanted consequences like streaming again records which were already
streamed. To prevent this, update `lsn` in `updateLastCommit()` only
when `lastCommitLsn` is not `null`.
 2022-06-22 13:55:17 +02:00
Jiri Pechanec
4fc4c8c374 DBZ-5031 Stop connector on failure to find resume LSN 2022-06-20 12:00:05 +02:00
Oskar Polak
3e288b8385 DBZ-5031 Additional logging when offset flushing is not allowed 2022-06-20 12:00:05 +02:00
Jiri Pechanec
38cd6907ae DBZ-3942 Load correct last commit LSN from offsets 2022-06-17 14:49:44 +02:00
Jiri Pechanec
04c474bac7 DBZ-5031 Enable LSN flushing only after processed message 2022-06-17 12:39:56 +02:00
Jiri Pechanec
5721dd7ace DBZ-5031 Emit warning if not exact LSN is found 2022-06-17 12:39:56 +02:00
Jun Zhao
29fbdc03bf DBZ-5031 Stop skipping message if last received lsn is higher or equal to the startStreamingLsn in WalPositionLocation 2022-06-17 12:39:56 +02:00
Chris Cranford
3fb5bf1339 DBZ-4451 Introduce SchemaChangeEvent factory methods 2022-06-16 09:19:41 +02:00
Chris Cranford
863abcd081 DBZ-4451 Store previous table id in alter schema change events 
When a table is renamed with the ALTER TABLE statement, the schema
history record not only will reference the current table's unique id
in the "id" metadata, but will also refer to the old table name in
the "previousId" metadata field.
 2022-06-16 09:19:41 +02:00
Chris Cranford
20bb2adea5 DBZ-4834 Fix incremental snapshot of table added to include list 2022-06-16 08:39:16 +02:00
Debezium Builder
6fff3a2876 [maven-release-plugin] prepare for next development iteration 2022-06-09 11:49:26 +00:00
Debezium Builder
b2e2e351df [maven-release-plugin] prepare release v2.0.0.Alpha2 2022-06-09 11:49:26 +00:00
Chris Cranford
660e391851 DBZ-5204 Do not cache connection details in TypeRegistry. 2022-06-08 09:21:04 +02:00
Vojtech Juranek
4a48eb33df DBZ-5045 Remove legacy V1 source info 2022-06-08 09:11:00 +02:00
Vojtech Juranek
7b8cb693ed DBZ-5045 Remove deprecated Postgres TOASTED_VALUE_PLACEHOLDER 2022-06-08 09:11:00 +02:00
Vojtech Juranek
1eacbdc590 DBZ-5045 Remove deprecated Postgres EXPORTED snapshot option 2022-06-08 09:11:00 +02:00
Vojtech Juranek
83dfd9f638 DBZ-5045 Remove deprecated Postgres TRUNCATE_HANDLING_MODE 2022-06-08 09:11:00 +02:00
Vojtech Juranek
b0b3066ed5 DBZ-5045 Remove deprecated COLUMN_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
5031594b75 DBZ-5045 Remove deprecated COLUMN_WHITELIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
f84893a8b4 DBZ-5045 Remove deprecated SCHEMA_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
261188482f DBZ-5045 Remove deprecated SCHEMA_WHITELIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
6abbcee6a3 DBZ-5045 Remove deprecated TABLE_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
db08e894fc DBZ-5045 Remove deprecated TABLE_WHITELIST 2022-06-08 09:11:00 +02:00
harveyyue
acb743bd34 DBZ-5206 Remove the deprecated monitored tables metrics 2022-06-07 16:13:29 -04:00
Chris Cranford
9d71296b5c DBZ-4251 Support stopping incremental snapshots 2022-06-02 07:30:07 +02:00
Jiri Pechanec
88b7ae2050 DBZ-5136 Move sourceInfo to common class 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
c64b8af31a DBZ-5136 reintroduce the CommonOffsetContext class and refactor common functionality into it 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
2d72dae649 DBZ-5136 further refining of the algorithm for determining position in snapshot and IT test fixes 2022-06-01 16:56:29 +02:00
Jiri Pechanec
08e8c3d795 DBZ-5136 Move common class to common package 2022-06-01 16:56:29 +02:00
Andrew Walker
d0759461a4 DBZ-5136: Convert RelationalOffsetContext to CommonOffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
b6222d42bf DBZ-5136: Add first flag and refactor OffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
593c2769e6 DBZ-5136: Add last in table flag 2022-06-01 16:56:29 +02:00
Vojtech Juranek
0757c966d0 DBZ-5042 Add DB name logging support into Postgres connector 2022-05-27 14:20:30 -04:00
Chris Cranford
7d8c9486d6 DBZ-5119 Move Heartbeat creation to ConnectorConfig & descendants 2022-05-25 09:59:59 +02:00
Chris Cranford
7ff7826743 DBZ-5119 Pull heartbeat.action.query support into debezium-core 2022-05-24 12:54:40 +02:00
Chris Cranford
7eee39800f DBZ-5038 Fix test failures 2022-05-23 11:46:15 +02:00
Chris Cranford
2a4c76cabe DBZ-5038 Support default values for PostgreSQL enum types 2022-05-23 11:46:15 +02:00
Jiri Pechanec
a11767d05b DBZ-3921 Remove incorrect comment 2022-05-17 14:56:05 +02:00
troeselereos
836632e5dd DBZ-3921 fixed logging 
DBZ-3921:  update message

Co-authored-by: Chris Cranford <ccranfor@redhat.com>
 2022-05-17 14:56:05 +02:00
roeselert
6b72d22be8 DBZ-3921: fix postgres existing publication is not updated with the new table 2022-05-17 14:56:05 +02:00
Jiri Pechanec
cc90b1cfeb DBZ-5014 Fix delete tests 2022-05-09 08:53:59 +02:00
Cesar Martinez
61a77c2467 DBZ-5014 Remove unused import 2022-05-09 08:53:59 +02:00
Cesar Martinez
c0ac30593c DBZ-5014 Uncomment validations 2022-05-09 08:53:59 +02:00
Cesar Martinez
72e51e02c7 DBZ-5014 Remove invalid line 2022-05-09 08:53:59 +02:00
Cesar Martinez
6994c1db56 DBZ-5014 Test case for delete register with infinity date 2022-05-09 08:53:59 +02:00
Cesar Martinez
840979a454 DBZ-5014 Add AbstractRecordsProducerTest.tableIdFromDeleteStmt(String) 2022-05-09 08:53:59 +02:00
Cesar Martinez
46f6db2d50 DBZ-5014 Add infinity date constants (Date & LocalDate 2022-05-09 08:53:59 +02:00
Cesar Martinez
24173cc548 DBZ-5014 Parse infinity date on delete 2022-05-09 08:53:59 +02:00
Cesar Martinez
b1f7fa1a47 DBZ-5014 Add test case for (+/-)infinity date 2022-05-09 08:53:59 +02:00
Jiri Pechanec
6e092d39f2 DBZ-5074 No separate connection for pgoutput decoder 2022-05-06 16:36:28 +02:00
Jiri Pechanec
88dab4d8d3 DBZ-5074 Track connections by name; close heartbeat connection by default 2022-05-06 16:36:28 +02:00
Mark Allanson
0edb86d861 DBZ-5097: Add tests to cover PostgresErrorHandler behaviour 
The error handler had no unit tests at all, so I thought it might be a good idea
to add some tests to verify the behaviour given there's a bunch of different
ways to determine if something is retryable.
 2022-05-06 09:55:06 -04:00
Mark Allanson
dd815f5226 DBZ-5097: Add two new retryable postgresql error messages 
These two error messages can occur when running inside docker and the
postgres container is either killed (sigtermed) or brought down
using `docker stop`.

In both cases these are retryable as the postgres server can be
restarted shortly thereafter.
 2022-05-06 09:55:06 -04:00
Debezium Builder
901825810a [maven-release-plugin] prepare for next development iteration 2022-04-28 13:51:13 +00:00
Debezium Builder
05dcb45647 [maven-release-plugin] prepare release v2.0.0.Alpha1 2022-04-28 13:51:12 +00:00
Jiri Pechanec
d186ec800f DBZ-703 Remove support for messages without metadata 2022-04-22 09:57:15 +02:00
Jiri Pechanec
d299c9e707 DBZ-4156 Remove wal2json support 2022-04-22 09:57:15 +02:00
Mohammad Yousuf Minhaj Zia
6f706fc087 DBZ-4948 Added connection has been closed PSQLException as retriable 2022-04-07 12:35:27 +02:00
Debezium Builder
4a6de64c25 [maven-release-plugin] prepare for next development iteration 2022-04-05 14:49:52 +00:00
Debezium Builder
683851fd90 [maven-release-plugin] prepare release v1.9.0.Final 2022-04-05 14:49:51 +00:00
Jiri Pechanec
1355067ef0 DBZ-4814 Use schema not catalog in table id 2022-03-31 15:26:12 +02:00
zalmane
1f64e8f8da DBZ-4814 exclude spatial_ref_sys 2022-03-30 20:08:38 +02:00
Debezium Builder
ab7fe3b96a [maven-release-plugin] prepare for next development iteration 2022-03-25 16:45:06 +00:00
Debezium Builder
d19fc234ee [maven-release-plugin] prepare release v1.9.0.CR1 2022-03-25 16:45:06 +00:00
Sergei Morozov
b258674782 DBZ-3535: Introduce schema.name.adjustment.mode 2022-03-24 09:37:05 +01:00
Sergei Morozov
3a03ff0186 DBZ-3535: Remove unused EventDispatcher constructor parameter 2022-03-24 09:37:05 +01:00
Clément Loiselet
ba33e483ae DBZ-4861: change log for schema snapshot postgres 
Update debezium-connector-postgres/src/main/java/io/debezium/connector/postgresql/PostgresSnapshotChangeEventSource.java
 2022-03-16 09:51:15 +01:00
Gunnar Morling
d20a6f00e7 DBZ-4801 Using JdbcConfiguration in JdbcConnection 2022-03-07 17:53:45 +01:00
Gunnar Morling
c1c322ecf0 DBZ-4801 Simplifying JdbcConnection constructors 2022-03-07 17:53:45 +01:00
Debezium Builder
fece16039c [maven-release-plugin] prepare for next development iteration 2022-03-03 17:00:08 +00:00
Debezium Builder
e0d8a0d809 [maven-release-plugin] prepare release v1.9.0.Beta1 2022-03-03 17:00:08 +00:00
Sergei Morozov
6d0aa9408c DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces 2022-02-16 11:31:38 +01:00
Jiri Pechanec
54ba2cd598 DBZ-4736 Handle string NULL default values correctly 2022-02-11 12:06:55 +01:00
Jiri Pechanec
b8bafdb4c6 DBZ-2306 Avoid long running TX for publication query 2022-02-10 15:50:37 +01:00
Debezium Builder
7a47f478a4 [maven-release-plugin] prepare for next development iteration 2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e [maven-release-plugin] prepare release v1.9.0.Alpha2 2022-02-09 07:23:10 +00:00
Andrei Isac
4dee34922e DBZ-4710: fix replication role check on RDS Postgres 
According to Debezium documentation[1], on AWS RDS, the `rds_replication` role
is enough to read the wal_log. However, on the connection validation step,
this case is omitted and the connector cannot start. The issue is pressent
starting at least v1.4.x.Final.

[1] https://debezium.io/documentation/reference/1.8/connectors/postgresql.html#postgresql-on-amazon-rds
 2022-02-08 08:42:32 +01:00
Chris Cranford
06d682707f DBZ-4701 Fix PostgreSQL tests DDL execution 2022-02-07 06:21:11 +01:00
Debezium Builder
33e2f5cd0f [maven-release-plugin] prepare for next development iteration 2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e [maven-release-plugin] prepare release v1.9.0.Alpha1 2022-01-26 19:00:20 +00:00
Chris Cranford
35ef67852c DBZ-4562 Reduce log verbosity 2022-01-25 18:41:06 +01:00
Jiri Pechanec
58469cd381 DBZ-4592 Make OID not found exception retriable 2022-01-24 14:55:15 +01:00
Chris Cranford
62e2fd48c4 DBZ-4419 Fix test failure 2022-01-22 00:33:21 +01:00
Chris Cranford
383f619ce1 DBZ-4419 Map truncate handling mode internally to skipped ops 2022-01-22 00:33:21 +01:00
Chris Cranford
9b6ade3165 DBZ-4419 Fix field validation test error 2022-01-22 00:33:21 +01:00
Chris Cranford
27fe106912 DBZ-4419 Default skipped.operations to "t" for PostgreSQL, add tests 2022-01-22 00:33:21 +01:00
Chris Cranford
773debc340 DBZ-4419 Deprecate TruncateHandlingMode, favor skipped.operations 2022-01-22 00:33:21 +01:00
Gunnar Morling
0c62da2aa5 DBZ-4520 Making static collections immutable 2022-01-21 18:03:57 +01:00
Gunnar Morling
9b35294fe8 DBZ-4520 Making collection immutable 2022-01-21 13:39:09 +01:00
Jiri Pechanec
6a89f1ee6a DBZ-4520 Add backend errors among retriable 2022-01-21 13:26:48 +01:00
Jiri Pechanec
f1b03c176e DBZ-3953 Mark wal2json plugin as deprecated 2022-01-21 11:21:17 +01:00
Jiri Pechanec
664d989e42 DBZ-4577 Provide custom error message handling 2022-01-21 10:24:19 +01:00
Jiri Pechanec
632a61ee98 DBZ-4517 Enable correct config opts for retrying 2022-01-19 16:17:10 +01:00
Jiri Pechanec
9509e5976a DBZ-4566 Used topic names for Debezium Engine converters 2022-01-19 11:32:45 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Jiri Pechanec
3f957aa02e DBZ-4131 Test with PostgreSQL 10 by default 2022-01-14 15:48:00 +01:00
Anisha Mohanty
d6c5ad2e7c DBZ-4460 Renaming all openapi occurrences to schema 2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f DBZ-4460 Set default values for format & output directory 2022-01-07 15:05:34 +01:00
Gunnar Morling
a4497cae96 DBZ-3657 Enabling export of domain type array columns via include.unknown.datatypes 2022-01-06 20:23:08 +01:00
sarumont
edbee2e8f6 DBZ-3657: add null check when building array converters 2022-01-06 20:23:08 +01:00
harveyyue
291e8ac221 DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation 2022-01-06 19:03:46 +01:00
harveyyue
792187f669 DBZ-4472 Make connector task partition readability for log 2021-12-20 15:58:14 +01:00
Jiri Pechanec
967432ad08 DBZ-4469 Test should run with any Postgres version 2021-12-17 13:57:53 +01:00
Debezium Builder
67c9663c98 [maven-release-plugin] prepare for next development iteration 2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f [maven-release-plugin] prepare release v1.8.0.Final 2021-12-16 10:11:28 +00:00
Chris Cranford
63731a2a09 DBZ-3940 Unify EventRouter tests for connectors 2021-12-13 13:52:31 +01:00
Jiri Pechanec
740b6b21f6 DBZ-4298 Support non-JDBC logical values in keys for incremental snapshots 
Incremental snapshot source gets the PK values after they are processed
by value converter. This is usally correct solution. The values are
passed to chunk queries. There are few datatypes like unconstrained
NUMERIC in PostgreSQL that must be converted to a Debezium specific
class to keep and enrich the value. Such class is not known to JDBC
driver. This commit intorduce a marker interface that enables the code
to identify the value not recognized by JDBC and provides a method to
obtain the original value.
 2021-12-13 12:29:21 +01:00
Gunnar Morling
0023cb10a5
DBZ-4393 Create a Debezium Schema Generator for Debezium connectors 
* added an API generator for Debezium connectors and static API definitions for connectors in a separate module
* added Maven plug-in
* added GH workflow for debezium-schema-generator

Co-authored-by: rkerner <rkerner.mobil@gmail.com>
Co-authored-by: Anisha Mohanty <anishamohanty23@gmail.com>
 2021-12-10 12:35:09 +01:00
Debezium Builder
f53e6c00df [maven-release-plugin] prepare for next development iteration 2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a [maven-release-plugin] prepare release v1.8.0.CR1 2021-12-09 20:16:04 +00:00
Chris Cranford
c095cb7090 DBZ-2792 Remove test 2021-12-07 14:57:23 +01:00
Debezium Builder
b5439b54bf [maven-release-plugin] prepare for next development iteration 2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2 [maven-release-plugin] prepare release v1.8.0.Beta1 2021-11-30 09:38:47 +00:00
Chris Cranford
2347b58250 DBZ-4272 Added javadoc 2021-11-30 09:28:44 +01:00
Chris Cranford
0a10d5b484 DBZ-4272 Trigger schema refresh before snapshot; only for PostgreSQL 2021-11-30 09:28:44 +01:00
Chris Cranford
652f41f7fb DBZ-4272 Add drop column schema change to test 2021-11-30 09:28:44 +01:00
Gunnar Morling
74bb80aae7 DBZ-2363 Removing unused methods 2021-11-29 14:55:49 +01:00
Gunnar Morling
a8cda23ef2 DBZ-4370 Only setting "messages" option on PG 14+; 
Also avoiding setting stream options repeatedly.
 2021-11-29 14:55:49 +01:00
Gunnar Morling
2157256398 DBZ-4364 Awaiting table metadata to become queryable 2021-11-29 09:23:18 +01:00
Gunnar Morling
a041a6bd5c DBZ-4364 Removing unused methods 2021-11-29 09:23:18 +01:00
Gunnar Morling
5866056a41 DBZ-2363 Using prefix as message key 2021-11-26 18:15:25 +01:00
Gunnar Morling
560ef2babd DBZ-2363 Misc. adjustments; 
* Adding Strings::isBlank()
* Simplifying test
* Using long in cases where we know it's present
* Removing some unused code
* Testing binary handling mode
* Avoiding TX id value overflow
* Assigning names to schemas to avoid issues as in DBZ-650
 2021-11-26 14:29:15 +01:00
Gunnar Morling
b85a9d2f20 DBZ-2363 Extracting separate test class for logical decoding message tests 2021-11-26 14:29:15 +01:00
Lairen Hightower
450998b49e DBZ-2363 Replace logicalDecodingMessageHandlingMode with a prefix filtering configuration 2021-11-26 14:29:15 +01:00
Gunnar Morling
fcfc9bc785 DBZ-2363 Misc. adjustments; 
* Removing unused method
* Unifying update() handling
* Member ordering
* Avoiding NPE in error handler
 2021-11-26 14:29:15 +01:00
lairen
a0898ed440 DBZ-2363 Adding support for pg_logical_emit messages in Postgres connector for the pgoutput plugin 2021-11-26 14:29:15 +01:00
Jiri Pechanec
dc3ee488f1 DBZ-4343 Use schema component for incremental snapshot TableId 2021-11-24 10:25:33 +01:00
Andrey Yegorov
b6d2c41fb0 DBZ-4309 Avoid calling 'LoggerFactory.getLogger(getClass())' for each new instance of the RelationalChangeRecordEmitter 2021-11-18 22:37:51 +01:00
Vojtech Juranek
c0a65743f8 DBZ-1042 Allow Postgres connector to use numeric slot names 
To be able to use numeric slot names, the slot name has to be quoted.
This may be consider as s bug in Postgres driver as Debezium passes the
slot name as string. To workaround this issue, quote the slot name on
the Debezium side.
 2021-11-18 10:27:48 +01:00
Vojtech Juranek
1ca917a428 DBZ-1042 Allow numeric slot names 2021-11-18 10:27:48 +01:00
Vojtech Juranek
50da5e31dc DBZ-1931 Allow to specify number of fraction digits for the money type 2021-11-17 09:30:15 +01:00
Vojtech Juranek
6f286fe50c DBZ-1931 Reflect decimal.handling.mode in money conversion 2021-11-17 09:30:15 +01:00
Chris Cranford
e3da449303 DBZ-4276 Expose unavailable value placeholder for PG and Oracle only 2021-11-16 20:29:59 +01:00
Chris Cranford
ca17352221 DBZ-4276 Unify unavailable value placeholder handling 
Deprecate the `toasted.value.placeholder` option in PostgreSQL in favor
of the new `unavailable.value.placeholder` option that is shared by all
relational connectors.
 2021-11-16 20:29:59 +01:00
Kate
44073cf7d8 DBZ-4196 Support schema changes during incremental snapshot 2021-11-16 14:56:06 +01:00
Debezium Builder
f93e901dce [maven-release-plugin] prepare for next development iteration 2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19 [maven-release-plugin] prepare release v1.8.0.Alpha2 2021-11-11 09:21:59 +00:00
Kate
992ae537c8 DBZ-4244 Quote signal table name in MySQL connector 2021-11-10 10:18:26 +01:00
Chris Cranford
5ec9381702 DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL) 2021-11-10 09:43:25 +01:00
harveyyue
aa3ae05e22 DBZ-4107 Incremental snapshot doesn't work without primary key 2021-11-05 13:31:26 +01:00
Gunnar Morling
1226c3b2ab DBZ-4029 Misc. clean-up; 
* Exposing heartbeatInterval() on CommonConnectorConfig
* Closing heartbeat connection
* Making test more resilient
* Correct member ordering and visibility
* Doc fixes
 2021-11-05 13:27:09 +01:00
ahodavdekar
91b7ef2c36 DBZ-4029 Adding support for heartbeat action queries to MySQL connector 2021-11-05 13:27:09 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Gunnar Morling
9a4d0ad363 DBZ-4137 Test clean-up 2021-11-02 16:50:26 +01:00
Andrey Yegorov
b174927a52 DBZ-4137 Postgres defaults handling misses decimal mode configuration and cannot handle numerics with default NULL values 2021-11-02 16:50:26 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Anisha Mohanty
9f7ede0e06 DBZ-3626 Renaming master branches to main 2021-10-28 09:33:32 +02:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
Gunnar Morling
33764b2adc DBZ-4150 Using set instead of list 2021-10-19 12:32:16 +02:00
Hossein Torabi
6027d762a6 DBZ-4150 Trim numerical defaultValue before converting postgres-connector 2021-10-19 12:27:26 +02:00
Jiri Pechanec
0ccc83db21 DBZ-3860 Provide correct boundaries for multi PK tables 2021-10-14 17:26:50 +02:00
Anisha Mohanty
310a0b6ef3 DBZ-4145 Skip failing test for wal2json 2021-10-14 13:17:08 +02:00
Gunnar Morling
c3eed6051b DBZ-3993 Skipping object size based test on Java 16+ 2021-10-13 10:59:23 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names 
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
 2021-10-12 15:40:02 +02:00
Gunnar Morling
015b219c58 DBZ-4046 Some testing clean-up; 
* Fixing mixed up order of expected and actual value
* Using more expressive var names
 2021-10-11 06:04:42 +02:00
Judah Rand
5d23b30f67 DBZ-4046 Update isVariableScaleDecimal 
This puts the method in line with
https://github.com/pgjdbc/pgjdbc/issues/2188
where expected value was changed from `131089` to `0`.
However, for numeric arrays the issue remains and so
`131089` remains the correct value for them.
 2021-10-08 10:42:21 +02:00
Jiri Pechanec
d5eafd3ecf DBZ-3919 Add logs to test 2021-10-06 09:36:21 +02:00
Jiri Pechanec
dae384baf4 DBZ-4081 Close leaking connections 2021-10-05 12:52:03 +02:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00
Jiri Pechanec
6d0760df45 DBZ-4060 Remove race condition 2021-10-01 11:25:14 +02:00
Judah Rand
6ad791bedc DBZ-4060 Add default value mapper for smallserial 2021-10-01 11:25:14 +02:00
Jiri Pechanec
a2c6058404 DBZ-4057 Initialize Postgres schema before incremental snapshot restart 2021-09-30 09:10:49 +02:00
Debezium Builder
bec0b6b67e [maven-release-plugin] prepare for next development iteration 2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725 [maven-release-plugin] prepare release v1.7.0.CR2 2021-09-23 06:31:25 +00:00
Naveen Kumar KR
d07643d60f DBZ-3887 PostgresMetricsIT Test fix 
* Remove redundant oneRecordInQueue test
* Rename test method from twoRecordsInQueue -> oneRecordInQueue to reflect the actual assertion done
 2021-09-22 19:12:21 +02:00
Debezium Builder
c15e0b303b [maven-release-plugin] prepare for next development iteration 2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121 [maven-release-plugin] prepare release v1.7.0.CR1 2021-09-16 08:10:44 +00:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set; 
Also adding missing descriptions.
 2021-09-09 13:35:41 +02:00
Gunnar Morling
7c150de943 DBZ-2525 Don't qualify selected columns with table name; 
It shouldn't be needed as we select from a single table, and it caused the columns to not be found for the Db2 connector.
 2021-08-31 17:39:36 +05:30
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors; 
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
 2021-08-30 12:20:56 +02:00
Gunnar Morling
11ed86a807 DBZ-3889 Reducing logging of serializers 2021-08-30 12:20:55 +02:00
Jiri Pechanec
82b151d0b9 DBZ-3935 Invalid validation of truncate handling mode 2021-08-30 09:47:55 +02:00
Debezium Builder
2ce6bcb2ab [maven-release-plugin] prepare for next development iteration 2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423 [maven-release-plugin] prepare release v1.7.0.Beta1 2021-08-25 05:20:56 -04:00
rkerner
52333596de DBZ-3364 add additional metadata to fields for API spec generator for the Debezium UI 
part of https://issues.redhat.com/browse/DBZ-3364
DBZ-2653 User rollback from parent class
 2021-08-23 17:57:38 +02:00
Gunnar Morling
36af61b789 DBZ-3889 Moving ContainerImageVersions to core for broader re-use and using it in two more places 2021-08-23 12:34:03 +02:00
Gunnar Morling
0fedadd77e DBZ-3889 Avoiding some log noise 2021-08-23 12:34:03 +02:00
Naveen Kumar KR
9527843974 DBZ-3870 Performance Improvements in PostgresChangeRecordEmitter 
1) Reuse parsed TableId to avoid expensive PostgresSchema.parse() call
2) Immediate conditional return in synchronizeTableSchema() call
 2021-08-13 22:11:48 +02:00
Sergei Morozov
a40ad7132d DBZ-2975: Remove partition from offset context 2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12 DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets 2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52 DBZ-2975: Move Partition to io.debezium.pipeline.spi 2021-08-11 07:34:37 +02:00
Jiri Pechanec
b0e0052a9c DBZ-3828 Update event LSN for commits 2021-08-10 20:41:37 +02:00
Gunnar Morling
85e6d262ea DBZ-3816 Wording changes 2021-08-09 10:08:47 +02:00
Jiri Pechanec
305c15132f DBZ-3816 Workaround for Kafka Connect bug 2021-08-09 10:08:47 +02:00
Gunnar Morling
bf9f7f5596 DBZ-3801 Allocating sequence list with correct size 2021-08-04 10:25:09 +02:00
Brennan Vincent
b03d9d1fa6 DBZ-3801: Address code review comments 2021-08-04 10:25:09 +02:00
Brennan Vincent
975f1690f2 DBZ-3801 Fix calculation of sequence numbers for Postgres 2021-08-04 10:25:09 +02:00
Debezium Builder
d3c4482d06 [maven-release-plugin] prepare for next development iteration 2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426 [maven-release-plugin] prepare release v1.7.0.Alpha1 2021-07-30 02:39:08 -04:00
Kate
9b66ab374a DBZ-3577 Support read-only MySQL incremental snapshots 2021-07-29 07:10:46 +02:00
Jiri Pechanec
b387775448 DBZ-3655 Connection liveness check triggers replication earlier 2021-07-27 11:07:52 -04:00
Jiri Pechanec
f46e0ca9a6 DBZ-3655 Commit check connection query 2021-07-27 15:32:35 +02:00
Gunnar Morling
09ebc833f3 DBZ-3655 Gracefully handling DB shutdown 2021-07-27 10:21:54 +02:00
Chris Cranford
9f5c49246f DBZ-3769 Remove TODO and change log message level 2021-07-27 09:31:51 +02:00
bep7520
9e9c2fc2ab DBZ-3769 Throw sqlexception from postgres message decoder 2021-07-27 09:31:51 +02:00
Naveen Kumar KR
7844b59c2f DBZ-3770 Optimize ObjectMapper initialization by replacing repeated initialization with one time initilization 
- Performance Improvement of approx 5% - 15%
 2021-07-21 14:44:09 -04:00
Chris Cranford
ed31ea9ffb DBZ-3668 Adjust ServiceLoader for SPI change 2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d DBZ-3668 Extracting SPI package 2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110 DBZ-3668 Add ServiceLoader hook CloudEvents converter 2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba DBZ-2975: Add partition awareness to source task components 
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
 2021-07-03 10:56:34 +02:00
Gunnar Morling
5b76bf1b71 DBZ-3632 Pulling up getJdbcConfig() to RelationalDatabaseConnectorConfig 2021-07-01 15:11:01 +02:00
Jiri Pechanec
ee0bd2f7da DBZ-3685 Postgres keepalive thread uses correct name 2021-07-01 11:40:59 +02:00
Debezium Builder
9d3f6b2a86 [maven-release-plugin] prepare for next development iteration 2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56 [maven-release-plugin] prepare release v1.6.0.Final 2021-06-30 03:45:06 -04:00
Debezium Builder
ae053414ac [maven-release-plugin] prepare for next development iteration 2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74 [maven-release-plugin] prepare release v1.6.0.CR1 2021-06-24 01:50:07 -04:00
Debezium Builder
48ca58a609 [maven-release-plugin] prepare for next development iteration 2021-06-10 06:03:12 -04:00
Debezium Builder
0961517859 [maven-release-plugin] prepare release v1.6.0.Beta2 2021-06-10 06:03:12 -04:00
Gunnar Morling
a2f927c2db DBZ-3608 Avoiding repeated closing actions 2021-06-10 07:39:49 +02:00
Gunnar Morling
205c63a56a DBZ-3608 Fixing version handling; 
- wrong minor version for Postgres
- minor/patch versions of -1 were not actually ignored in comparison
 2021-06-10 07:39:49 +02:00
Gunnar Morling
dc865cd82d DBZ-2975 Formatting 2021-06-09 16:02:33 +02:00
Gunnar Morling
1ce65fa628 DBZ-2975 Avoiding raw types in some places; 
Also parameterizing offset loader contract, so to avoid casts later on.
 2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542 DBZ-2975: Extract offset context from object states to method signatures 2021-06-09 16:02:33 +02:00
Gunnar Morling
2c5e10b848 DBZ-3596 Using single connection in PgOutputMessageDecoder 2021-06-09 13:41:43 +02:00
Gunnar Morling
4aef8669fb DBZ-3596 Removing unused "exported" flag 2021-06-09 13:41:43 +02:00