Commit Graph

7360 Commits

Author SHA1 Message Date
Vojtech Juranek
402df78381 DBZ-5043 Rename schema.history to schema.history.internal 2022-09-07 12:57:31 +02:00
Vojtech Juranek
0235d4aad5 DBZ-5582 Fix RedisDatabaseHistoryIT tests
`RedisSchemaHistoryIT` tests are not reliable as
`testDatabaseHistoryIsSaved` makes assumption about the number of
entries in the database history stream, while
`testRedisConnectionRetry` deletes whole stream at the beginning of
the test. If `testDatabaseHistoryIsSaved` is executed after
`testRedisConnectionRetry`, `testDatabaseHistoryIsSaved` starts to fail.

Don't delete the stream in `testRedisConnectionRetry` and introduce
constant with initial number of entries in the schema history stream.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
2f8391ea13 DBZ-5043 Update documentation after DatabaseHistory rename 2022-09-07 12:57:31 +02:00
Vojtech Juranek
8d7611bfcb DBZ-5043 Remove unused DB_HISTORY_PATH constant 2022-09-07 12:57:31 +02:00
Vojtech Juranek
b797201263 DBZ-5043 Rename DB_HISTORY_PATH to SCHEMA_HISTORY_PATH 2022-09-07 12:57:31 +02:00
Vojtech Juranek
b6c31f3da5 DBZ-5043 Replace 'database history' with 'database schema history'
Reflect renaming database history to schema history in comments,
configuration descriptions and log and error messages.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
5bffd7839a DBZ-5043 Change default schema history suffix
Change default schema history name from `$LOGICAL_NAME-dbhistory` to
`$LOGICAL_NAME-schemahistory`.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
0494a16a79 DBZ-5043 Rename DatabaseHistory to SchemaHistory
Rename also all related classes and varibales.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
853f43c5de DBZ-5043 Update documentation ot use topic.prefix instead of database.server.name 2022-09-07 12:57:31 +02:00
Vojtech Juranek
eb6e2648f4 DBZ-5043 Replace mongodb.name with topic.prefix
To be consistent with specifying topic prefix, replace also MongoDB
`mongodb.name` with `topic.prefix`.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
0823cedf25 DBZ-5043 Replace database.server.name with topic.prefix 2022-09-07 12:57:31 +02:00
Vojtech Juranek
161a7229b6 DBZ-5043 Use topic prefix as the logical name
With this change the user cannot direcly set connector logical name and
thus in the future it can be remove without breaking user config.
If the turn out that the logical name is useful and user should be able
to configure it, dedicated config option can be added.

Originally it was prposed in the Jira to replace it with connector name,
but it turned out that logical name defaults to `database.server.name`
and is heavily used in the tests and JMX, so it would require another
big refactoring. Thus, use topic prefix for now. Once we know further
direction (remove logical name or add new option), do this refactoring.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
3dfdf395f2 DBZ-5043 Update documentation for driver pass-through parameters 2022-09-07 12:57:31 +02:00
Vojtech Juranek
a7a293c5c8 DBZ-5043 Move driver pass-through parameters into dedicated namespace
Currently we mix database parameters like DB hostname, username or
password with other JDBC driver parameters which are passed to JDBC
driver as it is. Move these pass-through parameters into dedicated
namespace `driver.*` to separate them from common database parameters.
JDBC parameters which are defined on the connector level still stay
in `database` namespace.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
3cdcf795d8 DBZ-5043 Use 'database schema history' wording in the documentation
Once we switch to `schema.history` prefix, it can be confusing for the
users to read about 'database history'. Use 'database schema history'
instead.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
04acf048cf DBZ-5043 Update documentation to use schame.history namespace 2022-09-07 12:57:31 +02:00
Vojtech Juranek
5d1b72e95f DBZ-5043 Simplify code after renaming database.history namespace
Filtering `database.history` namespace from pass-through parameters is now
not needed as it doesn't interfere with other `database.*` parameters.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
25aa6c4acc DBZ-5043 Change namespace to database.history to schema.history 2022-09-07 12:57:31 +02:00
harveyyue
48d37857b6 DBZ-5588 Field validation errors are misleading for positive, non-zero expectations 2022-09-07 09:18:38 +02:00
harveyyue
58f4d3d912 DBZ-5480 Augment a uniqueness key filed/value in regex topic naming strategy 2022-09-06 14:58:57 +02:00
Claus Ibsen
1f48bfc515
[docs] Typo in description (remove space before dot) 2022-09-06 09:48:57 +02:00
Alexey Loubyansky
c4b95f4ea2 DBZ-5561 Use TCCL to load configuration classes by default 2022-09-06 08:42:45 +02:00
Jannik Steinmann
9f811a6f64 [docs] Note about replication in managed cloud providers
I've added a note saying that some managed offerings actually replicate the replication slot.

I found this information very critical when evaluating reliability of Debezium. I'll look for links in the docs tomorrow. [Patroni](https://patroni.readthedocs.io/en/latest/) also seems to support this feature.
2022-09-06 07:15:37 +02:00
ggaborg
196d24f2be DBZ-4441 tests for default redis message format 'compact' 2022-09-06 06:21:58 +02:00
ggaborg
f97e30bfdb DBZ-4441 make 'compact' the default redis message format for backward compatibility 2022-09-06 06:21:58 +02:00
ggaborg
8b20eebe77 DBZ-4441 documentation about redis message format 2022-09-06 06:21:58 +02:00
ggaborg
e500cad38f DBZ-4441 placeholders for messages 2022-09-06 06:21:58 +02:00
ggaborg
9243fae507 DBZ-4441 Redis Sink - Change the format of the message sent to the stream 2022-09-06 06:21:58 +02:00
Vadzim Ramanenka
917de37a01 DBZ-5557: Supply partition when comiting offsets with source database
Keep track of partitions offsets being committed belong to in
`BaseSourceTask`. Supply the partition along with the offset in calls to
`commitOffset`.
2022-09-05 14:04:23 +02:00
Jiri Pechanec
6e53798407 DBZ-5538 Remove duplicated formatting message 2022-09-05 10:35:55 +02:00
harveyyue
f4c7b52451 DBZ-5538 Unclear validation error when required field is missing 2022-09-05 10:35:55 +02:00
Jiri Pechanec
450fc2bc0e [release] Add contributors 2022-09-05 10:00:37 +02:00
Nitin Chhabra
3bb1d1ca2f DBZ-5410 Added documentation for Cassandra 4 real-time streaming 2022-09-05 09:46:20 +02:00
ggaborg
664fd9e1b0 DBZ-3293 unit tests for filters 2022-09-01 20:16:47 +02:00
ggaborg
244de2bd96 DBZ-3293 Add signal table automatically to include list 2022-09-01 20:16:47 +02:00
harveyyue
8d6e5b2735 DBZ-5574 Upgrade mysql-binlog-connector-java library version 2022-09-01 20:15:09 +02:00
Alexander Schwartz
fa9aa96568 DBZ-5573 fix source positional attributes 2022-09-01 11:23:53 +02:00
Chris Cranford
004fef10bb DBZ-5439 Update contributors / COPYRIGHT.txt 2022-09-01 09:32:17 +02:00
Chris Cranford
b5754a19ec DBZ-5439 Remove rsid and ssn from CommitScn format 2022-09-01 09:32:17 +02:00
Chris Cranford
c0f92e24ea DBZ-5439 Updated tests, use TreeSet trx id deterministic order 2022-09-01 09:32:17 +02:00
thangdc94
57210095d2 DBZ-5439 Fix testcase 2022-09-01 09:32:17 +02:00
thangdc94
c755720637 DBZ-5439 Backward compatible with old commit scn 2022-09-01 09:32:17 +02:00
thangdc94
cfa8b780ed DBZ-5439 Add transaction id associate with commit scn 2022-09-01 09:32:17 +02:00
Henry Cai
722b1fe187 DBZ-5382: Add the doc for offset.storage.per.task mode
offset.storage.per.task mode allows the vitess connector to launch
multiple tasks and have each task persists the offsets in offset storage
by task id.
2022-08-31 13:37:19 -04:00
Marek Winkler
1c9ea5166c DBZ-3007: limit 'Streaming requested from LSN' logging 2022-08-31 11:45:47 -04:00
Jiri Pechanec
de53591dba DBZ-5244 Retry all communication exceptions by default 2022-08-31 09:45:09 -04:00
harveyyue
7ccd40129c DBZ-5569 Oracle connector's max.queue.size.in.bytes is invalid 2022-08-31 09:39:29 -04:00
Jiri Pechanec
1c291d75fd DBZ-5568 Use only Java 11 for tests 2022-08-31 09:19:23 +02:00
Bob Roldan
390d0d3d62 DBZ-5565 Formatting characters no longer render in published doc 2022-08-31 09:17:16 +02:00
druud
06c254b98f [docs] Typos in MySqlUnsignedIntegerConverter.java
Just fixed some typos.
2022-08-31 09:05:46 +02:00