Commit Graph

5159 Commits

Author SHA1 Message Date
gvaquez-ubi
03cb907d85 DBZ-3068 Allow several tries on createReplicationStream to get replication slot 2021-06-04 15:11:57 +02:00
Derek Moore
2677723aef DBZ-3546 remove duplicate integration test, test both modes with 1 test
Signed-off-by: Derek Moore <derek.moore@dell.com>
2021-06-04 07:20:48 +02:00
jackey.zhang
c32e290fac DBZ-3587 fix NPE when builder is null 2021-06-04 07:19:15 +02:00
Derek Moore
ed0b0693b8 DBZ-3546 fix typo & formatting in Pravega sink docs
Signed-off-by: Derek Moore <derek.moore@dell.com>
2021-06-04 06:50:17 +02:00
Sara Fonseca
53af545839 Update CONTRIBUTE.md to reflect the new version of required tools and github pull request path 2021-06-03 15:50:43 +02:00
Vadzim Ramanenka
f27984e7ee DBZ-3586: No viable alternative at input "add COLUMN optional"
MySQL permits "optional" keyword to be used as an identifier.
2021-06-03 14:07:06 +02:00
Jiri Pechanec
1dd825a05e [jenkins-jobs] New Oracle version for snapshot releases 2021-06-03 13:08:09 +02:00
Derek Moore
814630232b DBZ-3546 Implement Pravega sink for Debezium Server
Signed-off-by: Derek Moore <derek.moore@dell.com>
2021-06-03 09:56:24 +02:00
chriscollingwood
6225e124bb DBZ-3522 Ensure that there is an active session on the replica set mongo client before using clusterDescription and ServerDescriptions to determine primary node. 2021-06-03 08:28:58 +02:00
Jiri Pechanec
91aa5a8fa6 [docs] Align deprecation message for MonitoredTables 2021-06-03 07:59:03 +02:00
Bob Roldan
d0c331617d DBZ-3582 Update downstream MySQL doc to refer to streaming metrics 2021-06-02 20:12:16 -04:00
roldanbob
f122378279
[docs] Rename second MonitoredTables entry
Corrected misnamed attribute in the sixth row of the table,  which incorrectly repeated the `MonitoredTable` name from the preceding row.
2021-06-02 14:27:22 -04:00
Jiri Novotny
cdd2468bb3 DBZ-3201 testsuite docker container 2021-06-02 16:55:59 +02:00
Gunnar Morling
ece44f4c7d DBZ-3557 Apply suggestions from code review 2021-06-02 15:58:23 +02:00
Chris Cranford
fa3b7fd758 DBZ-3557 Fix test failures 2021-06-02 15:58:23 +02:00
Chris Cranford
078b8f7270 DBZ-3557 Remove exclusive from SnapshotLockingMode, use shared as default 2021-06-02 15:58:23 +02:00
Chris Cranford
d9d2706a17 DBZ-3557 Fix typo 2021-06-02 15:58:23 +02:00
Chris Cranford
047c505bc1 DBZ-3557 Add snapshot.locking.mode option for Oracle 2021-06-02 15:58:23 +02:00
Gunnar Morling
e3b1d6f7f4 DBZ-3506 Formatting fix 2021-06-02 14:06:38 +02:00
Bingqin Zhou
934b77fc6b DBZ-3506 Update docs for schema evolution. 2021-06-02 14:06:38 +02:00
Gunnar Morling
c4f5cbca6c DBZ-3328 Removing unused field 2021-06-02 12:18:48 +02:00
Chris Cranford
0af3959c2d DBZ-3328 Use object arrays to write column values
Previously we used a wrapper class, LogMinerColumnValueImpl, to store
both the column name and value; however this introduced some overhead
in object allocation.  This change mostly focused on the removal of
that implementation and its interface in favor of creating object
arrays up-front and writing the column values directly.

Included as well as the following changes:

* Deprecated LogMinerColumnValue, impl, and wrapper
* Removed SEQUENCE# from LogMiner query, no longer needed
* Adapted tests to runtime changes with object arrays
2021-06-02 12:18:48 +02:00
Chris Cranford
f178a6e235 DBZ-3328 Remove superfluous state from LogMinerDmlEntryImpl 2021-06-02 12:18:48 +02:00
Chris Cranford
7dd980e505 DBZ-3328 Fix test failures 2021-06-02 12:18:48 +02:00
Gunnar Morling
4dcda868b5 DBZ-3328 Adding factory methods for LogMinerDmlEntryImpl 2021-06-02 12:18:48 +02:00
Chris Cranford
19e650dc25 DBZ-3328 Updated comment 2021-06-02 12:18:48 +02:00
Chris Cranford
49f3ee6172 DBZ-3328 Performance cleanup
* Use loop rather than streams
* Remove usage of Optional
* No need to add superfluous null-valued columns
2021-06-02 12:18:48 +02:00
Chris Cranford
52906cf154 DBZ-3328 Avoid copying in Oracle LogMiner DML parser 2021-06-02 12:18:48 +02:00
Chris Cranford
3149a95112 DBZ-3565 Undocument internal log.mininng.history.xxx options 2021-06-02 10:47:54 +02:00
Chris Cranford
ae9a32ab83 DBZ-3565 Make log.mining.history.xxx options internal 2021-06-02 10:47:54 +02:00
Chris Cranford
fd5afb04ea DBZ-3565 Fix formatting 2021-06-02 10:47:54 +02:00
Chris Cranford
eb22eaf85f DBZ-3565 Always use NeverHistoryRecorder if retention hours are 0 2021-06-02 10:47:54 +02:00
Chris Cranford
68c2c40097 DBZ-3565 Rename Oracle LogMiner history retention hours option
* Moved option to `log.mining.` namespace rather than `database.`
* Updated the documentation and field description accordingly.
2021-06-02 10:47:54 +02:00
roldanbob
11821b4832
[docs] Move anchor ID, correct xref link
The inclusion of two consecutive anchor links breaks processing when files are fetched and split for downstream use. Testing downstream shows that rather than deleting the  second anchor ID `[[mongodb-tailing-the-oplog]]` that is associated with the heading *Streaming changes*, move it to follow the heading. 
Also inserted missing `debezium` string into the anchor ID in the downstream xref that links to `default-names-of-kafka-topics-that-receive-debezium-mongodb-change-event-records`
2021-06-01 18:07:23 -04:00
roldanbob
5c8dd0e907
[docs] Fix typo in link to streaming metrics capturedtables property
In the table of streaming metrics properties, append an underscore `_` in the link to the `connectors-strm-metric-capturedtables` property.
2021-06-01 16:37:11 -04:00
roldanbob
b013d90057
[docs] Fix type in link
In the table of snapshot properties, remove the extra underscore `_` in the link to the `connectors-snaps-metric-capturedtables` property.
2021-06-01 16:17:10 -04:00
Jiri Pechanec
afca2f6943 DBZ-3568 Column optionallity of signalling table 2021-06-01 08:52:25 +02:00
Jiri Pechanec
31e1e79ede DBZ-3572 Binlog metrics were renamed to streaming 2021-06-01 08:36:00 +02:00
Anisha Mohanty
58fbf88a4a DBZ-400 Add a system property for number of allowed runs when no records are consumed 2021-05-31 10:05:44 +02:00
Chris Cranford
9a5d48524a DBZ-3556 Remove ByteBuffer usage and refactor
* Combines BLOB chunks into a single hex-string for conversion
* Moved several strings to static variables
2021-05-31 10:03:24 +02:00
Jiri Pechanec
7afcd1bdc6 DBZ-3559 Support MySQL JSON functions 2021-05-31 09:49:56 +02:00
Sergei Morozov
213d9ffdcc DBZ-3562: Revert test changes from DBZ-3427 2021-05-27 11:03:30 +02:00
Sergei Morozov
92e0488874 DBZ-3562: Allow hyphen in database.server.name 2021-05-27 11:03:30 +02:00
Bob Roldan
6fd22957c0 DBZ-3525 Fix link, standardize intro and prereqs in Deploying topics. 2021-05-26 16:50:05 -04:00
Gunnar Morling
28e36d55b1 DBZ-3554 Formatting 2021-05-26 13:04:25 +02:00
Chris Cranford
abb19d7437 DBZ-3554 Exclude ORA_TEMP_% tables from LogMiner DDL detection 2021-05-26 12:56:09 +02:00
Chris Cranford
8ab52ffe67 DBZ-3554 Support DDL alter table partition clauses 2021-05-26 12:56:09 +02:00
Jiri Pechanec
5fbebf7593
DBZ-3515 Execute periodic TX commits
* DBZ-3515 Execute periodic TX commits

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-05-26 12:52:25 +02:00
Jiri Pechanec
d8b77bbf9d DBZ-3466 Dcument impact of setting container hostname 2021-05-26 12:48:24 +02:00
Gunnar Morling
50bfd93e64 DBZ-3556 Moving getHexToRawByteArray() to value converters 2021-05-26 09:10:55 +02:00