Commit Graph

1210 Commits

Author SHA1 Message Date
Jiri Pechanec
574c1b0015 DBZ-5811 Use validate method 2022-12-06 13:35:52 +01:00
subodh
66fb51b55a DBZ-5811 Implement support for skipping LSN commit on postgres source based on config 2022-12-06 13:35:52 +01:00
Debezium Builder
81896ed334 [maven-release-plugin] prepare for next development iteration 2022-11-30 07:52:24 +00:00
Debezium Builder
1aac97b87c [maven-release-plugin] prepare release v2.1.0.Alpha2 2022-11-30 07:52:23 +00:00
Praveen Burgu
2158ea22d4 DBZ-5739 Pass the exception as argument to the logger 2022-11-30 06:55:35 +01:00
Praveen Burgu
ad6ec2be6a DBZ-5739 Handle permission error from RDS Postgres 2022-11-30 06:55:35 +01:00
Jiri Pechanec
5eb147129d DBZ-5874 Fix syntax errors 2022-11-25 11:43:49 +01:00
Gunnar Morling
e7aba47a24 DBZ-5874 Making sure trace message gets logged 2022-11-25 11:43:49 +01:00
Praveen Burgu
2b73ad6216 DBZ-5739 Seek to LSN based on lastCommitStoredLsn 2022-11-22 14:50:11 +01:00
Praveen Burgu
00321ccb4d DBZ-5739 Fix remaining failing tests 2022-11-22 14:50:11 +01:00
Praveen Burgu
cb535d2ce6 DBZ-5739 Fix another test with expected error message 2022-11-22 14:50:11 +01:00
Praveen Burgu
8e3867f23f DBZ-5739 Fix other failing tests 2022-11-22 14:50:11 +01:00
Praveen Burgu
1a0576e340 DBZ-5739 auto close statement 2022-11-22 14:50:11 +01:00
Praveen Burgu
2aed6b55ba DBZ-5739 Fix test PostgresConnectorIT#shouldRegularlyFlushLsnWithTxMonitoring by not dropping the slot 2022-11-22 14:50:11 +01:00
Praveen Burgu
895d651841 DBZ-5739 Fix test DebeziumEngineIT.testOffsetsCommitAfterStop() by not dropping the slot 2022-11-22 14:50:11 +01:00
Jiri Pechanec
b4c076a27c DBZ-5739 Make validation mandatory; more robust tests 2022-11-22 14:50:11 +01:00
Praveen Burgu
822f87147c DBZ-5739 Postgres connector results in silent data loss if replication slot is recreated
Detect replication slot recreation and fail the connector
2022-11-22 14:50:11 +01:00
Debezium Builder
e311dd1a67 [maven-release-plugin] prepare for next development iteration 2022-11-10 13:29:06 +00:00
Debezium Builder
e3bf53440a [maven-release-plugin] prepare release v2.1.0.Alpha1 2022-11-10 13:29:05 +00:00
Vojtech Juranek
96e4326d35 DBZ-2131 Use system property to determine if Apicurio should be used 2022-11-09 08:44:45 +01:00
Vojtech Juranek
391c1b921d DBZ-2131 Add Apicurion profile for Postgres 2022-11-09 08:44:45 +01:00
Vojtech Juranek
1e86ab7c7a DBZ-2131 Unify intendation in Postgres pom.xml 2022-11-09 08:44:45 +01:00
rajdangwal
2350442a8c DBZ-5792: minor nit 2022-11-09 08:28:17 +01:00
rajdangwal
7bf889006f DBZ-5792: Handle TRUNCATE type 2022-11-09 08:28:17 +01:00
rajdangwal
ea2983c8d8 DBZ-5792: Fix for - Message with LSN XYZ not present among LSNs seen in the location phase 2022-11-09 08:28:17 +01:00
Jiri Pechanec
4ccf91d70d DBZ-5800 Disable test failing on CI 2022-11-08 12:10:19 +01:00
harveyyue
506311b469 DBZ-5783 Suppress logging of undetermined optionality for explicitly excluded columns 2022-11-04 10:46:29 -04:00
jcechace
e887670a8e DBZ-5779 Migrated debezium-connector-postgres to AssertJ 2022-11-02 08:50:26 +01:00
Jiri Pechanec
53731e5662 DBZ-5370 Support for PostgreSQL 15 2022-10-18 12:04:55 +02:00
Debezium Builder
4d35fb8011 [maven-release-plugin] prepare for next development iteration 2022-10-14 11:26:32 +00:00
Debezium Builder
7bd1551c99 [maven-release-plugin] prepare release v2.0.0.Final 2022-10-14 11:26:32 +00:00
Vojtech Juranek
820b9d10d5 DBZ-5329 Add LSN to Postgres transation ID
Add `EventDispatcher` constructor which accepts `TransactionMonior`
instance as a parameter and in case of Postgres pass into
`EventDispatcher` custom `PostgresTransactionMonitor` which adjusts
transactions IDs by adding LSN, i.e. Postgres transaction is now of
form `txId:LSN`.
2022-10-11 15:38:33 +02:00
Vojtech Juranek
44dfa893ae DBZ-5329 Remove unsed PostgresEventDispatcher constructors 2022-10-11 15:38:33 +02:00
Debezium Builder
884254aba1 [maven-release-plugin] prepare for next development iteration 2022-10-07 09:27:52 +00:00
Debezium Builder
a0f3263fa6 [maven-release-plugin] prepare release v2.0.0.CR1 2022-10-07 09:27:51 +00:00
harveyyue
f6b72f060c DBZ-5671 Remove logic name parameter from sub connector config 2022-10-03 11:40:17 -04:00
Vojtech Juranek
97532042b3 DBZ-5657 Allow to use Docker maven plugin external properties
Allow to override Docker maven plugin properties [1] from command line
to be able to change various Docker parameters more easily when starting
the container.

[1] https://dmp.fabric8.io/#combining-property-config
2022-09-29 05:41:09 +02:00
Jiri Pechanec
1d423d7f09 DBZ-5597 Record LSNs seen the location phase 2022-09-22 11:12:04 -04:00
harveyyue
d1153e8ad4 DBZ-5594 Clean up "logical name" config 2022-09-22 14:29:37 +02:00
harveyyue
288c93434f DBZ-5585 Remove classloader parameter from JdbcConnection 2022-09-19 17:15:29 +02:00
Debezium Builder
218d414552 [maven-release-plugin] prepare for next development iteration 2022-09-16 06:36:40 +00:00
Debezium Builder
567f57c47b [maven-release-plugin] prepare release v2.0.0.Beta2 2022-09-16 06:36:39 +00:00
Vojtech Juranek
acc6be6df3 DBZ-5043 Move TOPIC_PREFIX into CommonConnectorConfig
`TOPIC_PREFIX` is now mandatory to all connectors therefore it make
sense to have it in common config. Beside that, it also makes it more
easy to use it in Debezium UI without any workarounds - if the field is
not member of the given connector config, the field has to be
explicitely added into known fields otherwise is invisible for UI.
2022-09-13 09:25:54 +02:00
Anisha Mohanty
f41b6dd458 DBZ-5044 Get rid of schema factory instances 2022-09-08 10:35:20 +02:00
Anisha Mohanty
b0dc7e557a DBZ-5044 Update schemaHistoryColumnSchema to add new fields 2022-09-08 10:35:20 +02:00
Anisha Mohanty
ec792527e9 DBZ-5044 Use SchemaFactory for centralizing Postgres schemas 2022-09-08 10:35:20 +02:00
Vojtech Juranek
0823cedf25 DBZ-5043 Replace database.server.name with topic.prefix 2022-09-07 12:57:31 +02:00
Vojtech Juranek
161a7229b6 DBZ-5043 Use topic prefix as the logical name
With this change the user cannot direcly set connector logical name and
thus in the future it can be remove without breaking user config.
If the turn out that the logical name is useful and user should be able
to configure it, dedicated config option can be added.

Originally it was prposed in the Jira to replace it with connector name,
but it turned out that logical name defaults to `database.server.name`
and is heavily used in the tests and JMX, so it would require another
big refactoring. Thus, use topic prefix for now. Once we know further
direction (remove logical name or add new option), do this refactoring.
2022-09-07 12:57:31 +02:00
Vadzim Ramanenka
917de37a01 DBZ-5557: Supply partition when comiting offsets with source database
Keep track of partitions offsets being committed belong to in
`BaseSourceTask`. Supply the partition along with the offset in calls to
`commitOffset`.
2022-09-05 14:04:23 +02:00
ggaborg
244de2bd96 DBZ-3293 Add signal table automatically to include list 2022-09-01 20:16:47 +02:00