Commit Graph

517 Commits

Author SHA1 Message Date
Chris Egerton
1dae3831ec DBZ-6734: Add new STOPPED and RESTARTING states for connectors
[KIP-875](https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect) added a new `STOPPED` state for connectors that causes the `Connector` instance to be paused and all `Task` instances to be shut down (as opposed to left ready-but-idling, which is the case for the `PAUSED` state).

Tasks will never appear in the `STOPPED` state, only connectors.

This PR adds that state to the testcontainers library to make custom testing easier (e.g., with `DebeziumContainer::ensureConnectorState`).

I'm unsure about the backporting policy here but if this change is approved, it may also be suitable to port over to the 2.4 branch. Happy to re-target this PR at 2.4 or open up a separate PR against that branch if it helps.

Additionally, the RESTARTING state is added to prevent IllegalArgumentExceptions from being thrown when trying to parse connector/task states into the Connector.State enum.
2023-08-02 06:52:58 +02:00
Debezium Builder
97c35f4ddd [release] Development version for testing module deps 2023-07-17 10:48:58 +00:00
Debezium Builder
267dfda8a6 [maven-release-plugin] prepare for next development iteration 2023-07-17 10:40:52 +00:00
Debezium Builder
0d3cef6a29 [maven-release-plugin] prepare release v2.4.0.Alpha1 2023-07-17 10:40:52 +00:00
Debezium Builder
9f005c72be [release] Stable 2.4.0.Alpha1 for testing module deps 2023-07-17 10:38:32 +00:00
jcechace
318c55cc74 DBZ-6659 Fixing junit dependencies 2023-07-14 09:11:10 +02:00
Martin Medek
8592440201
DBZ-6538 Implement sharded mongo ocp deployment and integration tests (#4636)
* DBZ-6538 added mongo sharded deployment, fixture and test cases for sharded mongo
2023-07-13 15:52:55 +02:00
Martin Medek
50071f2a64
DBZ-6535 Cleanup duplicit jobs from jenkins (#4625)
* DBZ-6535 deleted jobs already migrated to gitlab
* DBZ-6535 removed upstream strimzi prepare job and deleted whole strimzi.kc.build=false option from testsuite, only artifact server option remains
2023-07-11 12:26:31 +02:00
jcechace
5cb579bf12 DBZ-6525 Removing runtime dependency on core for testcontainers module in order to prevent logback.xml downstream conflicts 2023-07-11 12:07:04 +02:00
jcechace
fa78e77797 DBZ-6596 Support authentication for ReplicaSet testcontainers deployments 2023-06-26 07:53:46 +02:00
Debezium Builder
d744c6f4c2 [release] Development version for testing module deps 2023-06-20 13:31:58 +00:00
Debezium Builder
60f730d383 [maven-release-plugin] prepare for next development iteration 2023-06-20 13:21:31 +00:00
Debezium Builder
150396e4c8 [maven-release-plugin] prepare release v2.3.0.Final 2023-06-20 13:21:31 +00:00
Debezium Builder
682d8f9f4c [release] Stable 2.3.0.Final for testing module deps 2023-06-20 13:19:36 +00:00
Debezium Builder
6a9e9653f3 [release] Development version for testing module deps 2023-06-09 09:32:41 +00:00
Debezium Builder
5d1b00588a [maven-release-plugin] prepare for next development iteration 2023-06-09 09:23:38 +00:00
Debezium Builder
d1e6107517 [maven-release-plugin] prepare release v2.3.0.CR1 2023-06-09 09:23:37 +00:00
Debezium Builder
8171f86aa7 [release] Stable 2.3.0.CR1 for testing module deps 2023-06-09 09:20:49 +00:00
Debezium Builder
3a6537bf55 [release] Development version for testing module deps 2023-05-26 10:44:30 +00:00
Debezium Builder
aa5b2131fc [maven-release-plugin] prepare for next development iteration 2023-05-26 10:35:20 +00:00
Debezium Builder
9cc9b3c29a [maven-release-plugin] prepare release v2.3.0.Beta1 2023-05-26 10:35:20 +00:00
Debezium Builder
24c2d67040 [release] Stable 2.3.0.Beta1 for testing module deps 2023-05-26 10:32:25 +00:00
Martin Medek
97a6171536 DBZ-3202 Added postgresql replica DB instance and test case for debezium streaming from replica 2023-05-22 09:30:10 +02:00
ani-sha
e91f483062 DBZ-5339 Enable Jolokia using DebeziumContainer class 2023-05-18 11:08:03 -04:00
Debezium Builder
34d4a73829 [release] Development version for testing module deps 2023-05-11 11:13:35 +00:00
Debezium Builder
a5b44767bc [maven-release-plugin] prepare for next development iteration 2023-05-11 11:05:24 +00:00
Debezium Builder
1b1a7531f2 [maven-release-plugin] prepare release v2.3.0.Alpha1 2023-05-11 11:05:24 +00:00
Debezium Builder
7ba7d07692 [release] Stable 2.3.0.Alpha1 for testing module deps 2023-05-11 11:03:11 +00:00
Martin Medek
1347fca0af DBZ-1661 added mysql replication example images to release-pipeline job 2023-05-03 12:22:21 +02:00
Martin Medek
08ff44874c DBZ-1661 mysql replication tests refactor 2023-05-03 12:22:21 +02:00
Martin Medek
6919486175 DBZ-1661 moved the mysql replication test to its own class, fixed namespace preparation validation 2023-05-03 12:22:21 +02:00
Martin Medek
e7f38e9f27 DBZ-1661 refactor mysql init in ocp, mysql replication test is skipped in docker tests 2023-05-03 12:22:21 +02:00
Martin Medek
c7db4aee92 DBZ-1661 Added mysql replica instance and integration test for reading from mysql slave 2023-05-03 12:22:21 +02:00
jcechace
21e3c14491 DBZ-6363 Support for MongoDB tests in UI build with Debezium 2.2 2023-05-01 11:35:47 -04:00
Debezium Builder
751e155a94 [release] Development version for testing module deps 2023-04-20 09:09:43 +02:00
Debezium Builder
bb1b79f3bd [maven-release-plugin] prepare for next development iteration 2023-04-20 09:09:43 +02:00
Debezium Builder
5483b4de99 [maven-release-plugin] prepare release v2.2.0.Final 2023-04-20 09:09:43 +02:00
Debezium Builder
ff67356e78 [release] Stable 2.2.0.Final for testing module deps 2023-04-20 09:09:43 +02:00
jcechace
8e1d83ce88 DBZ-4427 Added sharding log messages to container infrastructure 2023-04-19 12:05:59 +02:00
Debezium Builder
5941541f6b [release] Development version for testing module deps 2023-04-14 08:54:18 +00:00
Debezium Builder
976a47a3a3 [maven-release-plugin] prepare for next development iteration 2023-04-14 08:46:06 +00:00
Debezium Builder
1ca8399e8b [maven-release-plugin] prepare release v2.2.0.CR1 2023-04-14 08:46:06 +00:00
Debezium Builder
9050669920 [release] Stable 2.2.0.CR1 for testing module deps 2023-04-14 08:43:46 +00:00
Vojtech Juranek
44f2f40c56 DBZ-6216 Update testcontainers to use quay.io images
When needed update also version.
Update also leftovers in readme files.
2023-04-12 14:07:35 +02:00
ani-sha
434833e179 DBZ-6306 Use connection string configuration in ConnectorConfiguration#forMongoDbContainer 2023-04-11 22:57:35 +02:00
Chris Cranford
bcc7d49519 DBZ-6305 Allow specifying DockerImageName reference for MongoDB 2023-04-04 15:25:50 +02:00
Jiri Pechanec
063a65e4ac DBZ-6304 Upgrade MySQL driver and change Maven coordinates 2023-04-04 10:46:54 +02:00
Debezium Builder
4db744d247 [release] Development version for testing module deps 2023-03-31 10:08:54 +00:00
Debezium Builder
5c650fd054 [maven-release-plugin] prepare for next development iteration 2023-03-31 10:00:16 +00:00
Debezium Builder
68ffc4833b [maven-release-plugin] prepare release v2.2.0.Beta1 2023-03-31 10:00:16 +00:00
Debezium Builder
5b14601f64 [release] Stable 2.2.0.Beta1 for testing module deps 2023-03-31 09:57:38 +00:00
jcechace
2fdd3fbc86 DBZ-6170 Added basic test scenario for running mongodb connector with sharded mongodb cluster 2023-03-27 10:31:47 +02:00
jcechace
99b9349587 DBZ-6247 More resilient image version handling for MongoDbContainer and related tests 2023-03-23 16:15:03 +01:00
Chris Cranford
9307019441 DBZ-6244 Support ImageFromDockerfile syntax with testcontainers 2023-03-22 19:58:48 +01:00
Debezium Builder
c8d4dcc007 [release] Development version for testing module deps 2023-03-08 11:46:24 +00:00
Debezium Builder
55d65e9618 [maven-release-plugin] prepare for next development iteration 2023-03-08 11:38:17 +00:00
Debezium Builder
6d183c3dc1 [maven-release-plugin] prepare release v2.2.0.Alpha3 2023-03-08 11:38:16 +00:00
Debezium Builder
7225f61374 [release] Stable 2.2.0.Alpha3 for testing module deps 2023-03-08 11:36:15 +00:00
jcechace
922191cdd7 DBZ-6032 Connection management refactoring 2023-03-03 05:46:33 +01:00
Chris Cranford
24fe8fe572 DBZ-6136 Add toJson to TestContainers ConnectorConfiguration impl 2023-02-21 18:31:57 +01:00
Debezium Builder
bf347da71a [release] Development version for testing module deps 2023-02-16 11:35:58 +00:00
Debezium Builder
2245ceda44 [maven-release-plugin] prepare for next development iteration 2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a [maven-release-plugin] prepare release v2.2.0.Alpha2 2023-02-16 11:28:25 +00:00
Debezium Builder
0fce13b4e9 [release] Stable 2.2.0.Alpha2 for testing module deps 2023-02-16 11:26:07 +00:00
Martin Medek
2add1f4c20 DBZ-3832 refactor, added test parameter to skip namespace and strimzi preparation
DBZ-3832 refactor

DBZ-3832 Removing redundant jenkins jobs

DBZ-3832 Refactor, moved operator deployment to standalone fixtures

DBZ-3832 Removed isRunningFromOcp hooks from kafka/kafkaConnect deployment, removed operator and namaespace preparation from system_pipeline

DBZ-3832 Modified OCP system tests to not create namespaces and operators

DBZ-3832 Moved namespace cleanup to NamespaceCleanupListener to be executed after all test classes, refactor

DBZ-3832 added strimzi, apicurio operators creation to testsuite.
Added maven property to set strimzi/apic subscription channel
Added namespace and clusterRoleBinding preparation into testsuite
2023-02-08 11:47:57 +01:00
Debezium Builder
afdebfe13c [release] Development version for testing module deps 2023-01-19 11:41:49 +00:00
Debezium Builder
04f5291a2d [maven-release-plugin] prepare for next development iteration 2023-01-19 11:32:10 +00:00
Debezium Builder
027527963e [maven-release-plugin] prepare release v2.2.0.Alpha1 2023-01-19 11:32:10 +00:00
Debezium Builder
e0ea7b084e [release] Stable 2.2.0.Alpha1 for testing module deps 2023-01-19 11:29:33 +00:00
Jiri Pechanec
8ca5e0a9b5 DBZ-4669 Reformat after plugin version consolidation 2023-01-11 06:44:53 +01:00
Mark Lambert
e5d16b14a6 DBZ-2439 Remove redundant modifiers 2023-01-11 06:44:53 +01:00
Jiri Pechanec
debb1d5bdf DBZ-5282 Keep Apicurio version for product 2023-01-10 08:37:29 +01:00
Jeremy Ford
8392d5e3ad DBZ-5282 Debezium is not working with apicurio and custom truststores
Update to latest version of apicurio
Force apicurio docker image to 2.3.1 temporarily
2023-01-10 08:37:29 +01:00
erdinc
0e8163daca DBZ-5976 Use as much as possible "replace" method rather than "replaceAll" 2023-01-05 07:30:49 +01:00
Debezium Builder
6cb73401a8 [release] Development version for testing module deps 2022-12-22 10:22:00 +00:00
Debezium Builder
cf1720e4cb [maven-release-plugin] prepare for next development iteration 2022-12-22 10:11:54 +00:00
Debezium Builder
b4ea9b46cd [maven-release-plugin] prepare release v2.1.0.Final 2022-12-22 10:11:53 +00:00
Debezium Builder
db04564feb [release] Stable 2.1.0.Final for testing module deps 2022-12-22 10:08:44 +00:00
Debezium Builder
44e7cbc45a [release] Development version for testing module deps 2022-12-16 09:43:50 +00:00
Debezium Builder
177a60a9d3 [maven-release-plugin] prepare for next development iteration 2022-12-16 09:33:38 +00:00
Debezium Builder
f805db8c3c [maven-release-plugin] prepare release v2.1.0.Beta1 2022-12-16 09:33:38 +00:00
Debezium Builder
752e4c5236 [release] Stable 2.1.0.Beta1 for testing module deps 2022-12-16 09:30:38 +00:00
jcechace
d2437411e2 DBZ-5857 Temporarily disabling tc test for sharded cluster due to ci errors 2022-12-16 08:43:25 +01:00
jcechace
82643e9d26 DBZ-5857 Fake DNS resolver allowing the use of MongoDB containers under Docker Desktop without hots file modifications 2022-12-16 08:43:25 +01:00
jcechace
86fea445a5 DBZ-5857 Improved logging for MongoDB containers running under Docker Desktop 2022-12-16 08:43:25 +01:00
jcechace
7177518ae4 DBZ-5857 Ability to run MongoDB containers with static ports on docker desktop 2022-12-16 08:43:25 +01:00
Martin Medek
de7d84b172 DBZ-2193 fixed test tags on DockerMongoRhelConnectorIT, removed redundant test classes, refactor
fixed default sqlserver test parameters in pom
2022-12-13 15:45:34 +01:00
Martin Medek
4a9e2816d6 DBZ-2193 replaced kafkaCluster loadBalancer with route, port forward local port is now chosen as first free random port. 2022-12-13 15:45:34 +01:00
Martin Medek
ed99a88fdb DBZ-2193 Created interface for the port forwardble database controller, moved the methods to be called explicitly in test setup and cleanup
Fixed mongo parameters in ConnectorFactories
2022-12-13 15:45:34 +01:00
Martin Medek
e4f713e018 DBZ-2193 Refactored testsuite to use port forwarding instead of loadBalanced services to access DBs 2022-12-13 15:45:34 +01:00
Vojtech Juranek
e1b65cd6f7 DBZ-5889 Run integration tests in specified order
Run the tests alwyas in thr same order to make it more easy to debug
failures. If needed, the order can be changed (e.g. to `random`) by
overriding propeperty `runOrder`.
2022-12-08 13:00:41 +01:00
Debezium Builder
5ac42e0bf5 [release] Development version for testing module deps 2022-11-30 08:04:47 +00:00
Debezium Builder
81896ed334 [maven-release-plugin] prepare for next development iteration 2022-11-30 07:52:24 +00:00
Debezium Builder
1aac97b87c [maven-release-plugin] prepare release v2.1.0.Alpha2 2022-11-30 07:52:23 +00:00
Debezium Builder
30192a8be0 [release] Stable 2.1.0.Alpha2 for testing module deps 2022-11-30 07:48:30 +00:00
Bobby Tiernay
294ca6a7db DBZ-4339 Fix unused import. 2022-11-30 07:00:56 +01:00
Bobby Tiernay
adb672a87c DBZ-4339 Migrate from JUnit 4 to 5, rename utility class, fix formatting. 2022-11-30 07:00:56 +01:00
Bobby Tiernay
950a2a8bdf DBZ-4339 Migrate MongoDB Testcontainer support to debezium-testing-testcontainers module. 2022-11-30 07:00:56 +01:00
Debezium Builder
a68649cece [release] Development version for testing module deps 2022-11-10 13:40:30 +00:00
Debezium Builder
e311dd1a67 [maven-release-plugin] prepare for next development iteration 2022-11-10 13:29:06 +00:00