alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
10,081 Commits 3 Branches 0 Tags 51 MiB
c3a8ba4afb
Commit Graph

1382 Commits

Author SHA1 Message Date
Chris Cranford
6842f701f1 DBZ-5759 Log online redo log sizes 2022-11-10 07:31:28 +01:00
Chris Cranford
22593e5fe1 DBZ-5648 Move LogMiner RegEx handling into Java 2022-11-10 07:23:52 +01:00
Vojtech Juranek
97138bb3e8 DBZ-5791 Make ORA-01089 retriable based on its message 2022-11-09 10:55:56 -05:00
Vojtech Juranek
96e4326d35 DBZ-2131 Use system property to determine if Apicurio should be used 2022-11-09 08:44:45 +01:00
Vojtech Juranek
df2ad6d3c1 DBZ-2131 Add Apicurion profile for Oracle 2022-11-09 08:44:45 +01:00
Vojtech Juranek
54b5582130 DBZ-2131 Unify intendation in Oracle pom.xml 2022-11-09 08:44:45 +01:00
Chris Cranford
54bde9b3bb DBZ-5773 Correctly discard LOB_ERASE events 2022-11-08 17:37:38 -05:00
Vojtech Juranek
15308b8d78 DBZ-5738 Skip nested tables and their parent tables 
Nested tables are currently not supported.
 2022-11-08 15:37:26 -05:00
Vojtech Juranek
f347c1c844 DBZ-5626 Don't check ofsset for AWLAYS mode 
While `ALWAYS` mode allows also snapshot on schema error, it allows
snapshot also on other ocassions. Don't throw exception when offset
is missing and schema is set to `ALWAYS`.
 2022-11-08 11:03:05 -05:00
Vojtech Juranek
28aa715867 DBZ-5626 Do the snapshot also in case of schema history errors 
`ALWAYS` should mean always and also this should be in line with Postgres
`ALWAYS` option.
 2022-11-03 15:41:29 +01:00
Vojtech Juranek
3fcfd9a0e8 DBZ-5626 Add ALWAYS snapshot mode for Oracle connector 
For AWLAYS snapshot mode it's important to obtain up-to-date SCN,
therefore offset, if exists, is ignored during snapshot.
 2022-11-03 08:59:27 +01:00
Chris Cranford
993a547c2f DBZ-5756 Add Compression Advisor tables as system-excluded tables 2022-11-02 13:58:25 +01:00
jcechace
6aa7331888 DBZ-5779 Migrated debezium-connector-oracle to AssertJ 2022-11-02 08:50:26 +01:00
Chris Cranford
dc5de5ae87 DBZ-5760 Only log full row data at TRACE level 2022-10-26 08:13:34 +02:00
Chris Cranford
93e4eb0092 DBZ-5482 TransactionBoundaryMode ALL mode more reliable 2022-10-19 13:31:00 +02:00
Chris Cranford
7c07c3faaf DBZ-5682 Allow unique index NULL values in trx reconciliation 2022-10-19 13:28:40 +02:00
Debezium Builder
4d35fb8011 [maven-release-plugin] prepare for next development iteration 2022-10-14 11:26:32 +00:00
Debezium Builder
7bd1551c99 [maven-release-plugin] prepare release v2.0.0.Final 2022-10-14 11:26:32 +00:00
thangdc94
f6be36612f DBZ-5276 Remove redundant import 2022-10-14 08:22:56 +02:00
thangdc94
c53af41deb DBZ-5276 Fix wrong log switching condition 2022-10-14 08:22:56 +02:00
thangdc94
4a9539266d DBZ-5276 Fix Group by condition for thread 2022-10-14 08:22:56 +02:00
thangdc94
d233e969e7 DBZ-5276 Prevent add duplicate log file 2022-10-14 08:22:56 +02:00
Debezium Builder
884254aba1 [maven-release-plugin] prepare for next development iteration 2022-10-07 09:27:52 +00:00
Debezium Builder
a0f3263fa6 [maven-release-plugin] prepare release v2.0.0.CR1 2022-10-07 09:27:51 +00:00
Chris Cranford
8ec0846deb
DBZ-5541 Fix Oracle test compatibility failure 2022-10-05 13:25:08 -04:00
harveyyue
f6b72f060c DBZ-5671 Remove logic name parameter from sub connector config 2022-10-03 11:40:17 -04:00
Vojtech Juranek
97532042b3 DBZ-5657 Allow to use Docker maven plugin external properties 
Allow to override Docker maven plugin properties [1] from command line
to be able to change various Docker parameters more easily when starting
the container.

[1] https://dmp.fabric8.io/#combining-property-config
 2022-09-29 05:41:09 +02:00
Chris Cranford
4e3b4ebae7 DBZ-5645 Skip rollback trx cache when LOB is disabled 2022-09-22 18:09:33 -04:00
Chris Cranford
79ca0becae DBZ-5635 Reduce undo trx log verbosity when LOB enabled 2022-09-22 13:18:06 +02:00
Ismail Simsek
b966f4b65b DBZ-5591 Snapshot process setting source.ts_ms 2022-09-20 17:12:54 -04:00
Chris Cranford
13bfcc8270 DBZ-5581 Extend test cases with NULL assignment 2022-09-20 08:35:59 +02:00
Chris Cranford
5484948127 DBZ-5581 Apply unavailable value placeholder on when parsing SELECT_LOB_LOCATOR event types 2022-09-20 08:35:59 +02:00
harveyyue
288c93434f DBZ-5585 Remove classloader parameter from JdbcConnection 2022-09-19 17:15:29 +02:00
harveyyue
20d56734d4 DBZ-5585 Modify the Instantiator to not require classloader 2022-09-19 17:15:29 +02:00
Debezium Builder
218d414552 [maven-release-plugin] prepare for next development iteration 2022-09-16 06:36:40 +00:00
Debezium Builder
567f57c47b [maven-release-plugin] prepare release v2.0.0.Beta2 2022-09-16 06:36:39 +00:00
Jiri Pechanec
3dc16b722b DBZ-4842 LogMiner specific test 2022-09-16 05:27:43 +02:00
harveyyue
f21ebc98fe DBZ-5609 Oracle connector couldn't parse type_name mdsys.sdo_geometry 2022-09-14 15:57:41 -04:00
Vojtech Juranek
acc6be6df3 DBZ-5043 Move TOPIC_PREFIX into CommonConnectorConfig 
`TOPIC_PREFIX` is now mandatory to all connectors therefore it make
sense to have it in common config. Beside that, it also makes it more
easy to use it in Debezium UI without any workarounds - if the field is
not member of the given connector config, the field has to be
explicitely added into known fields otherwise is invisible for UI.
 2022-09-13 09:25:54 +02:00
Anisha Mohanty
9fd204b383 DBZ-5044 Introduce respective SchemaFactory for all connectors 2022-09-08 10:35:20 +02:00
Vojtech Juranek
402df78381 DBZ-5043 Rename schema.history to schema.history.internal 2022-09-07 12:57:31 +02:00
Vojtech Juranek
b797201263 DBZ-5043 Rename DB_HISTORY_PATH to SCHEMA_HISTORY_PATH 2022-09-07 12:57:31 +02:00
Vojtech Juranek
b6c31f3da5 DBZ-5043 Replace 'database history' with 'database schema history' 
Reflect renaming database history to schema history in comments,
configuration descriptions and log and error messages.
 2022-09-07 12:57:31 +02:00
Vojtech Juranek
0494a16a79 DBZ-5043 Rename DatabaseHistory to SchemaHistory 
Rename also all related classes and varibales.
 2022-09-07 12:57:31 +02:00
Vojtech Juranek
0823cedf25 DBZ-5043 Replace database.server.name with topic.prefix 2022-09-07 12:57:31 +02:00
Vojtech Juranek
161a7229b6 DBZ-5043 Use topic prefix as the logical name 
With this change the user cannot direcly set connector logical name and
thus in the future it can be remove without breaking user config.
If the turn out that the logical name is useful and user should be able
to configure it, dedicated config option can be added.

Originally it was prposed in the Jira to replace it with connector name,
but it turned out that logical name defaults to `database.server.name`
and is heavily used in the tests and JMX, so it would require another
big refactoring. Thus, use topic prefix for now. Once we know further
direction (remove logical name or add new option), do this refactoring.
 2022-09-07 12:57:31 +02:00
Vojtech Juranek
25aa6c4acc DBZ-5043 Change namespace to database.history to schema.history 2022-09-07 12:57:31 +02:00
Vadzim Ramanenka
917de37a01 DBZ-5557: Supply partition when comiting offsets with source database 
Keep track of partitions offsets being committed belong to in
`BaseSourceTask`. Supply the partition along with the offset in calls to
`commitOffset`.
 2022-09-05 14:04:23 +02:00
ggaborg
244de2bd96 DBZ-3293 Add signal table automatically to include list 2022-09-01 20:16:47 +02:00
Chris Cranford
b5754a19ec DBZ-5439 Remove rsid and ssn from CommitScn format 2022-09-01 09:32:17 +02:00
Chris Cranford
c0f92e24ea DBZ-5439 Updated tests, use TreeSet trx id deterministic order 2022-09-01 09:32:17 +02:00
thangdc94
57210095d2 DBZ-5439 Fix testcase 2022-09-01 09:32:17 +02:00
thangdc94
c755720637 DBZ-5439 Backward compatible with old commit scn 2022-09-01 09:32:17 +02:00
thangdc94
cfa8b780ed DBZ-5439 Add transaction id associate with commit scn 2022-09-01 09:32:17 +02:00
harveyyue
7ccd40129c DBZ-5569 Oracle connector's max.queue.size.in.bytes is invalid 2022-08-31 09:39:29 -04:00
Chris Cranford
92ca57d731 DBZ-5229 Restore Kafka-based database history options in SchemaGenerator 2022-08-30 10:32:12 -04:00
pkgonan
b031770300 DBZ-5544 Support BASE64_URL_SAFE in BinaryHandlingMode 2022-08-24 09:50:23 +02:00
Chris Cranford
14c9f8855b DBZ-5327 Fix Oracle/Db2 test failures 2022-08-19 11:33:01 -04:00
Chris Cranford
176529e83b DBZ-5521 Fix concatenation operator handling in LogMiner DML parser 2022-08-19 11:19:45 +02:00
Chris Cranford
37b97970a6 DBZ-5497 Skip truncate operations by default 
* Promote truncate skip default from PostgreSQL to core library
* Adjust behavior for Oracle with truncates skipped by default
 2022-08-19 11:05:29 +02:00
Vivek Wassan
d89e71ebeb DBZ-5327 Smart Backfills 2022-08-17 10:05:55 +02:00
Chris Cranford
41a9324044 DBZ-5441 Gracefully skip Oracle non-relational tables 2022-07-29 12:56:27 -04:00
harveyyue
5f430f1a8e DBZ-5457 Deprecate legacy topic selector for all connectors 2022-07-28 12:58:59 -04:00
Debezium Builder
1ab51ae8d0 [maven-release-plugin] prepare for next development iteration 2022-07-26 18:13:10 +00:00
Debezium Builder
d247a48b79 [maven-release-plugin] prepare release v2.0.0.Beta1 2022-07-26 18:13:09 +00:00
Chris Cranford
412498db41
DBZ-5295 Avoid NPE With Xstream emitter 2022-07-26 11:05:17 -04:00
Chris Cranford
2c2cb9213a DBZ-5248 Avoid NumberFormatException in OracleConnectorIT tests 2022-07-20 13:21:59 -04:00
Chris Cranford
f8d097ebc3
DBZ-5419 Fix OracleSchemaMigrationIT (non-CDB) test failure 2022-07-19 09:23:16 -04:00
Anisha Mohanty
04941330c3 DBZ-5390 Reorder relational_property definition to give priority to out_of_line_constraint 2022-07-14 08:55:21 +02:00
Chris Cranford
f62fab4364 DBZ-5404 Use fail from fest assertions 2022-07-14 08:40:42 +02:00
harveyyue
6ea7abc8fc DBZ-4180 Pluggable topic selector 2022-07-13 14:45:25 +02:00
Jiri Pechanec
d8baac7c46 DBZ-5229 Reorganize code for inheritance use 2022-07-12 17:31:19 +02:00
Hossein Torabi
1ea02be9c2 DBZ-5229 define centralized and modular aproach for debezium storage 2022-07-12 17:31:19 +02:00
Chris Cranford
35e3eae52f DBZ-5295 Add delete row test case 2022-07-12 11:59:34 +02:00
Chris Cranford
843f133d4d DBZ-5295 Use connection quote method, rework unavailable value check 2022-07-12 11:59:34 +02:00
Chris Cranford
5f443dd9e1 DBZ-5295 Fix format errors 2022-07-12 11:59:34 +02:00
Chris Cranford
6735904075 DBZ-5295 Cache LOB column status in schema model 2022-07-12 11:59:34 +02:00
Chris Cranford
32947ae512 DBZ-5295 Remove unnecessary test output 2022-07-12 11:59:34 +02:00
Chris Cranford
d2a76a7ffc DBZ-5295 Reselect LOB columns on primary key update 2022-07-12 11:59:34 +02:00
Chris Cranford
deaa34d71e DBZ-5356 Avoid NPE during index evaluation 2022-07-12 11:01:10 +02:00
Chris Cranford
ddbd682d8d DBZ-5381 Add a pretty loggable format for commit_scn 2022-07-12 06:55:13 +02:00
Chris Cranford
f7696ffac7 DBZ-5358 Rename to "user_name", position at end of struct 2022-07-11 10:10:21 -04:00
Nathan Smit
28ce4f0aa2 DBZ-5358 added name of user who executed transaction to source info block 2022-07-11 10:10:21 -04:00
Chris Cranford
28c26741d6 DBZ-5351 Add warning for LogMiner rows with unsupported op type 2022-07-06 17:23:45 -04:00
Chris Cranford
9cca260197 DBZ-5373 Propagate Oracle Xstream commit timestamp to transaction metadata 2022-07-06 16:25:18 -04:00
Debezium Builder
6fd1441af3 [maven-release-plugin] prepare for next development iteration 2022-07-01 09:21:49 +00:00
Debezium Builder
99402af634 [maven-release-plugin] prepare release v2.0.0.Alpha3 2022-07-01 09:21:48 +00:00
Chris Cranford
30d95358b8 DBZ-5245 Track commit scn per redo thread 2022-07-01 06:39:19 +02:00
Chris Cranford
406e060df4 DBZ-5234 Rename oracle-ide to oracle-all 2022-07-01 06:08:31 +02:00
Chris Cranford
c651996861 DBZ-5250 Update Oracle README.md, clarifying 11g requirements 2022-06-30 17:09:45 -04:00
Chris Cranford
2be190bcdd DBZ-5281 Use separate connection for snapshot-based LogMiner queries 2022-06-30 10:37:32 +02:00
Chris Cranford
65fa2c73a5 DBZ-5281 Fix test compatibility with Oracle non-CDB 2022-06-30 10:37:32 +02:00
Mickael Maison
5ff71aa992 DBZ-5335 Fix formatting issues in the connectors configdefs 2022-06-30 09:35:54 +02:00
Chris Cranford
cf1e711299
DBZ-5266 Skip tests when using Oracle Xstream 2022-06-29 19:59:35 -04:00
harveyyue
20dc353262 DBZ-5170 Mysql Commit Timestamp 2022-06-27 15:50:52 +02:00
Chris Cranford
fd296557b5 DBZ-5266 Correctly advance commit_scn with LOB support 2022-06-27 15:24:11 +02:00
Chris Cranford
811ba8a4af
DBZ-4902 Fix compatibility with Oracle connector 2022-06-27 08:45:37 -04:00
Chris Cranford
cfc63776fa DBZ-5300 Exclude ADT indices as relational primary keys 2022-06-27 10:38:56 +02:00
Chris Cranford
5d4d659b37 DBZ-5285 Fix store.only.captured.tables.ddl to work during streaming 2022-06-27 09:02:22 +02:00
Chris Cranford
ced5cc6827 DBZ-5234 Add oracle-ide profile, simplifies IDE integrations 
Some IDE environments do not support maven-compiler-plugin include/exclude
filter configurations well and this profile is meant to bridge that gap by
enabling all sources and dependencies for IDE compiles.
 2022-06-27 06:04:58 +02:00
Chris Cranford
f4b6cfafe6 DBZ-5234 Update documentation references 2022-06-24 12:19:23 +02:00
Chris Cranford
124bc6a515 DBZ-5234 Align GitHub actions with Oracle profile changes 
* Removed oracle-ci profile entirely, no longer required
  The default build with no profiles explicitly uses the previous oracle-ci behavior.
* Removed the use of the oracle profile, the Oracle connector enabled by default
* Removed the xstream-dependency usage, Xstream dependencies aren't enabled by default.
 2022-06-24 12:19:23 +02:00
Chris Cranford
35f4c232a3 DBZ-5234 Rework Oracle build profiles 
* Oracle will always be built with LogMiner by default
* Oracle tests are always compiled, integration tests skipped by default
* Integration tests require oracle-tests profile to be executed
* Xstream requires oracle-xstream profile
* Instant client dependencies are excluded by default
* The assembly profile enables Xstream bits automatically
 2022-06-24 12:19:23 +02:00
Chris Cranford
a1d35b402e DBZ-5303 Rework SkipOnDatabaseOption, allow for enabled/disabled toggles 2022-06-23 18:58:05 -04:00
Chris Cranford
cab3c664a1 DBZ-5301 FIx LogMinerHelperIT to work on Oracle RAC with multiple nodes 2022-06-23 18:54:57 -04:00
Jiri Pechanec
44107961e5 DBZ-4367 Align test with new schema changes behaviour 2022-06-17 08:53:47 +02:00
Jiri Pechanec
86abed2f9b DBZ-4834 Fix test 2022-06-16 14:52:47 +02:00
Chris Cranford
263ba5aad6 DBZ-5256 Add internal.log.mining.transaction.snapshot.boundary.mode option 
This internal option is meant to replace the old `log.mining.query.logs.for.snapshot.offset`.
This now enum-based setting provides much more flexibility by being able to completely
disable the in-progress transaction check (now the default), only grab transactions that are
in-progress from V$TRANSACTION, or finally be able to grab all in-progress transactions that
are both from V$TRANSACTION and by scanning the logs.
 2022-06-16 12:44:45 +02:00
Chris Cranford
3fb5bf1339 DBZ-4451 Introduce SchemaChangeEvent factory methods 2022-06-16 09:19:41 +02:00
Chris Cranford
b6549670c8 DBZ-4451 Allow test to be extended by connectors 2022-06-16 09:19:41 +02:00
Chris Cranford
863abcd081 DBZ-4451 Store previous table id in alter schema change events 
When a table is renamed with the ALTER TABLE statement, the schema
history record not only will reference the current table's unique id
in the "id" metadata, but will also refer to the old table name in
the "previousId" metadata field.
 2022-06-16 09:19:41 +02:00
Chris Cranford
20bb2adea5 DBZ-4834 Fix incremental snapshot of table added to include list 2022-06-16 08:39:16 +02:00
Chris Cranford
44159c95be DBZ-5225 Add EVENT_SCN_KEY key 2022-06-16 08:27:32 +02:00
Bob Roldan
18688077bf DBZ-5225 Align source.scn with the event's scn 2022-06-16 08:27:32 +02:00
Chris Cranford
4d30e6be47 DBZ-5257 Source info table order deterministic for rename schema changes 2022-06-16 08:19:38 +02:00
Chris Cranford
14a3b46ee5 DBZ-5258 Fix test assertions using static database names 2022-06-15 18:05:56 -04:00
Chris Cranford
46bef9c3ae DBZ-4890 BigDecimal scale match Field when column uses negative scale 2022-06-15 12:27:56 +02:00
Chris Cranford
e142203a86 DBZ-5226 Improve test wait-time performance 2022-06-09 15:15:22 -04:00
Debezium Builder
6fff3a2876 [maven-release-plugin] prepare for next development iteration 2022-06-09 11:49:26 +00:00
Debezium Builder
b2e2e351df [maven-release-plugin] prepare release v2.0.0.Alpha2 2022-06-09 11:49:26 +00:00
Vojtech Juranek
bbb625f29e DBZ-5045 Use correct buffer type value after deprecated infinispan was removed 2022-06-08 14:32:07 +02:00
Vojtech Juranek
ec9625bd70 DBZ-5045 Remove deprecated Oracle DB ORACLE_VERSION option 2022-06-08 09:11:00 +02:00
Vojtech Juranek
ff5ddd7959 DBZ-5045 Remove deprecated FIELD_PAYLOAD_ID 
`table.field.event.payload.id` is replaced by `table.field.event.key`.
Also fix default value of `table.field.event.key` which was missing.
 2022-06-08 09:11:00 +02:00
Vojtech Juranek
01d8e4fe27 DBZ-5045 Remove deprecated Oracle LOG_MINING_BUFFER_LOCATION option 2022-06-08 09:11:00 +02:00
Vojtech Juranek
091e2f3162 DBZ-5045 Remove deprecated Oracle INFINISPAN option 2022-06-08 09:11:00 +02:00
Vojtech Juranek
f84893a8b4 DBZ-5045 Remove deprecated SCHEMA_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
261188482f DBZ-5045 Remove deprecated SCHEMA_WHITELIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
6abbcee6a3 DBZ-5045 Remove deprecated TABLE_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
db08e894fc DBZ-5045 Remove deprecated TABLE_WHITELIST 2022-06-08 09:11:00 +02:00
Jiri Pechanec
7d16c879f3 DBZ-5202 Extract constants; Use Java 8 API 2022-06-07 09:04:03 +02:00
Chris Cranford
310e788c22 DBZ-5202 Add retry/delay to offset transaction id resolution 2022-06-07 09:04:03 +02:00
Chris Cranford
ec940e8220 DBZ-5085 Enforce read-consistency determining snapshot offsets 2022-06-02 08:29:13 +02:00
Jiri Pechanec
b61d99d0c6 DBZ-5136 Fix Oracle tests 2022-06-02 07:41:00 +02:00
Chris Cranford
9d71296b5c DBZ-4251 Support stopping incremental snapshots 2022-06-02 07:30:07 +02:00
Chris Cranford
f3671afaf7 DBZ-5139 Apply threshold to all processors, added tests 2022-06-01 17:52:44 -04:00
Ethan Zou
1ac6abf63e DBZ-5139 Abandon transaction who has too many events according to new configuration 'log.mining.buffer.memory.transaction.events.threshold' 2022-06-01 17:52:44 -04:00
Jiri Pechanec
88b7ae2050 DBZ-5136 Move sourceInfo to common class 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
c64b8af31a DBZ-5136 reintroduce the CommonOffsetContext class and refactor common functionality into it 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
2d72dae649 DBZ-5136 further refining of the algorithm for determining position in snapshot and IT test fixes 2022-06-01 16:56:29 +02:00
Jiri Pechanec
08e8c3d795 DBZ-5136 Move common class to common package 2022-06-01 16:56:29 +02:00
Andrew Walker
d23735c658 DBZ-5136: Fix missing reference 2022-06-01 16:56:29 +02:00
Andrew Walker
d0759461a4 DBZ-5136: Convert RelationalOffsetContext to CommonOffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
b6222d42bf DBZ-5136: Add first flag and refactor OffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
593c2769e6 DBZ-5136: Add last in table flag 2022-06-01 16:56:29 +02:00
Chris Cranford
15e9231c30 DBZ-5179 Use LRUCacheMap to avoid high memory usage 2022-06-01 15:53:55 +02:00
Chris Cranford
a900ababcd DBZ-5042 Use PDB name when set in Oracle configuration 2022-05-27 14:20:30 -04:00
Vojtech Juranek
fa07f67cdb DBZ-5042 Add DB name logging support into Oracle connector 2022-05-27 14:20:30 -04:00
Chris Cranford
1ae7bec46e DBZ-5146 Remove log.mining.view.fetch.size, use query.fetch.size instead. 2022-05-26 19:26:14 -04:00
Chris Cranford
60b1b3cc1d DBZ-5147 Fix test failures 2022-05-26 18:37:24 -04:00
Chris Cranford
2978898641 DBZ-5147 Adjust log levels, apply test rules 2022-05-26 18:37:24 -04:00
Chris Cranford
7ab0cea8f1 DBZ-5147 Add event.processing.failure.handling.mode for Oracle 2022-05-26 18:37:24 -04:00
Chris Cranford
7d8c9486d6 DBZ-5119 Move Heartbeat creation to ConnectorConfig & descendants 2022-05-25 09:59:59 +02:00
Chris Cranford
7ff7826743 DBZ-5119 Pull heartbeat.action.query support into debezium-core 2022-05-24 12:54:40 +02:00
Chris Cranford
15eb7807c4 DBZ-5119 Add heartbeat.action.query support for Oracle 2022-05-24 12:54:40 +02:00
Chris Cranford
2b78fca8ce DBZ-5148 Retry starting Oracle LogMiner after ORA-01291 2022-05-23 10:30:18 +02:00
Chris Cranford
7577500696 DBZ-5140 Do not log transaction warning when lob-enabled is true 2022-05-18 14:11:36 -04:00
Chris Cranford
9a81339b54 DBZ-4782 Rework if-branches 2022-05-13 12:51:38 +02:00
Chris Cranford
e1579f8738 DBZ-4782 Flush SCN values upon schema changes 2022-05-13 12:51:38 +02:00
Chris Cranford
d0c6b59527 DBZ-4973 Cleanup logging calls 2022-05-10 11:33:33 -04:00
Chris Cranford
db9a104ea4 DBZ-4973 Remove unused code 2022-05-10 11:33:33 -04:00
Chris Cranford
035d6b4c14 DBZ-5090 Improve test use case 2022-05-10 09:45:34 -04:00
Chris Cranford
0d595025fd DBZ-5090 Undo events across multiple mining sessions 2022-05-10 09:45:34 -04:00
Debezium Builder
901825810a [maven-release-plugin] prepare for next development iteration 2022-04-28 13:51:13 +00:00
Debezium Builder
05dcb45647 [maven-release-plugin] prepare release v2.0.0.Alpha1 2022-04-28 13:51:12 +00:00
Chris Cranford
43ae067ef8 DBZ-5006 Add suggested test coverage 2022-04-27 08:52:29 -04:00
Chris Cranford
7e845f83cb DBZ-3318 Scope tests to Oracle LogMiner adapter 2022-04-27 08:52:29 -04:00
Chris Cranford
cea4b51a3b DBZ-4963 Scope tests to Oracle LogMiner adapter 2022-04-27 08:52:29 -04:00
Chris Cranford
09e58c5a5c DBZ-5006 Allow "/" characters in Oracle table names 2022-04-27 08:52:29 -04:00
Jan Doms
f698a59481 DBZ-5005 adjust LogMiner batch size based on comparison with currently used batch size 2022-04-26 14:08:00 -04:00
Chris Cranford
9e08093900 DBZ-5029 Scope several OracleConnectorIT tests to LogMiner only 
* shouldCaptureChangeForTableWithUnsupportedColumnType
* shouldContinueToUpdateOffsetsEvenWhenTableIsNotChanged
 2022-04-21 16:10:39 +02:00
Chris Cranford
cee77e5b96 DBZ-5028 Scope OracleOffsetContextTest to the LogMiner adapter 2022-04-21 15:51:02 +02:00
Chris Cranford
5f9b2fa822 DBZ-4963 Use Optional & Stopwatch, disable lengthy test by default 2022-04-21 08:05:59 +02:00
Chris Cranford
c804509673 DBZ-4963 Introduce log.mining.session.max.ms config option for Oracle 2022-04-21 08:05:59 +02:00
Chris Cranford
f24be1f533 DBZ-4994 Fix LOB locator event parsing with escaped single quotes 2022-04-19 09:07:36 +02:00
Chris Cranford
f667402fe0 DBZ-4987 Propagate up all exceptions from LCR handler 2022-04-19 07:23:39 +02:00
Chris Cranford
89fb497602 DBZ-4976 Add unit test 2022-04-14 11:58:50 +02:00
Chris Cranford
0ffd2e2ec3 DBZ-4976 Rework null checks & add nullability comments 2022-04-14 11:58:50 +02:00
Anisha Mohanty
736a3b149b DBZ-4976 Handle NPEs for column definitions of Oracle DDL statements 2022-04-14 11:58:50 +02:00
Chris Cranford
1d68c8ed53 DBZ-4978 Avoid NPE during Oracle connector shutdown 2022-04-14 10:18:40 +02:00
Chris Cranford
7b95aa7bcb DBZ-4953 Correctly handle TRUNCATE when LOB is enabled 2022-04-11 07:45:12 +02:00
Chris Cranford
e984754c2a DBZ-4932 Use LCR v1 format with Oracle 12.0 and 12.1 2022-04-11 07:09:39 +02:00
Chris Cranford
a793d9e2ca DBZ-4936 Restrict test to only memory-based buffer 2022-04-08 14:21:17 -04:00
Chris Cranford
22d300731f DBZ-3318 Add integration test for database.url 2022-04-08 11:14:30 -04:00
Chris Cranford
c7e1006dd3 DBZ-4879 Correctly resolve archive-log-only SCN mining range 2022-04-08 12:05:57 +02:00
Chris Cranford
3740d27366 DBZ-4936 Don't re-emit transaction on restart with commit SCN equal to offset commit SCN 2022-04-08 09:21:38 +02:00
Debezium Builder
4a6de64c25 [maven-release-plugin] prepare for next development iteration 2022-04-05 14:49:52 +00:00
Debezium Builder
683851fd90 [maven-release-plugin] prepare release v1.9.0.Final 2022-04-05 14:49:51 +00:00
Chris Cranford
785623658c DBZ-4937 Correctly read/write snapshot_scn and snapshot_pending_trx offsets 2022-04-01 13:56:04 -04:00
Chris Cranford
13a96549bc DBZ-4907 Increment Commit SCN when any COMMIT is detected 2022-03-31 10:02:38 -04:00
Chris Cranford
36ad6f23db
DBZ-4891 Remove unused variable 2022-03-30 16:06:04 -04:00
Chris Cranford
6f7fa743ed
DBZ-4862 Correctly parse double single-quotes in SEL_LOB_LOCATOR events 2022-03-30 16:06:04 -04:00
asibanovs
1fe8dbb1cd
DBZ-4891 Fix Oracle Logminer's escaped single quotes parsing in DMLs, related unit test and fix for the old DBZ-3414 test. 2022-03-30 16:06:04 -04:00
Debezium Builder
ab7fe3b96a [maven-release-plugin] prepare for next development iteration 2022-03-25 16:45:06 +00:00
Debezium Builder
d19fc234ee [maven-release-plugin] prepare release v1.9.0.CR1 2022-03-25 16:45:06 +00:00
Sergei Morozov
b258674782 DBZ-3535: Introduce schema.name.adjustment.mode 2022-03-24 09:37:05 +01:00
Jiri Pechanec
60b80f6365 DBZ-4869 Add hint to warn message 2022-03-23 10:50:03 +01:00
Chris Cranford
64f22e3498 DBZ-4869 Log warning rather than exception on incorrect table-level logging level 2022-03-23 10:50:03 +01:00
Jiri Pechanec
71ffde5eaa DBZ-4900 Use Duration instead of millis 2022-03-23 09:01:59 +01:00
Chris Cranford
2dd488effb DBZ-4900 Use exponential back-off for log availability check 2022-03-23 09:01:59 +01:00
Ethan Zou
efdb5d21fc DBZ-4850 Add several retriable SQL error codes 2022-03-22 11:52:27 -04:00
Chris Cranford
80cda74e63 DBZ-4897 Suggested edits 2022-03-22 16:47:21 +01:00
Chris Cranford
337305f0e6 DBZ-4897 Parse Oracle character-based column default values with parens 2022-03-22 16:47:21 +01:00
Chris Cranford
45648632f3 DBZ-4880 Correctly interpret NCLOB in Oracle DDL parser 2022-03-18 11:05:36 +01:00
Chris Cranford
c90993a652 DBZ-4852 DBZ-4853 DDL parser pass unsupported column types as OracleTypes.OTHER 2022-03-18 11:05:36 +01:00
Jiri Pechanec
341ec1260e DBZ-4878 Add partition to Oracle xstream 2022-03-18 07:55:43 +01:00
kate
d2899a276a DBZ-4878 Add partition to Oracle logminer 2022-03-18 07:55:43 +01:00
Chris Cranford
c8ecea8df9 DBZ-4842 Relax supplemental log check when table does not exist 2022-03-17 09:52:47 +01:00
Gunnar Morling
d20a6f00e7 DBZ-4801 Using JdbcConfiguration in JdbcConnection 2022-03-07 17:53:45 +01:00
Chris Cranford
fd38f771fa DBZ-4819 Correct timing concerns to get FlushStrategyIT stable 2022-03-04 11:28:27 -05:00
Debezium Builder
fece16039c [maven-release-plugin] prepare for next development iteration 2022-03-03 17:00:08 +00:00
Debezium Builder
e0d8a0d809 [maven-release-plugin] prepare release v1.9.0.Beta1 2022-03-03 17:00:08 +00:00
Chris Cranford
252549c674 DBZ-4287 Remove redundant getCurrentRedoLogSequences usage 2022-03-03 07:48:12 -05:00
Willie Zhu
66007df053 DBZ-4287 set the currentRedoLogSequences at the time when we update the redo log file list 2022-03-03 07:48:12 -05:00
Chris Cranford
7de14775ee DBZ-4635 Prevent NPE from offsets during Oracle connector upgrade 2022-02-28 21:55:23 +01:00
Chris Cranford
9103a220b7 DBZ-4744 Correctly parse signal table name when using domain name 2022-02-22 15:27:21 +01:00
Chris Cranford
0ed2defc93 DBZ-4718 Process transaction retention on each mining iteration 2022-02-22 14:50:23 +01:00
Dominique Chanet
10dfc3be87 DBZ-4737 rename hasNoLogFilesStartingBeforeOrAtScn to hasLogFilesStartingBeforeOrAtScn 2022-02-16 09:10:51 -05:00
Dominique Chanet
fe523359f9 DBZ-4737 fix SqlUtils test 2022-02-16 09:10:51 -05:00
Dominique Chanet
49323423ac DBZ-4737 fix log file discovery 2022-02-16 09:10:51 -05:00
Sergei Morozov
2d14b5b09f DBZ-4478: Multi-partition metrics for SQL Server 2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces 2022-02-16 11:31:38 +01:00
Chris Cranford
e1d9544599 DBZ-4715 Use ZoneOffset rather than long for database offset seconds 2022-02-15 09:39:08 +01:00
Chris Cranford
76e4420d30 DBZ-4715 Fix stream event's source timestamp tz resolution 2022-02-15 09:39:08 +01:00
Dominique Chanet
26b53bbf22 DBZ-4737 Fix error when rewinding to oldest archive log SCN 
In LogMinerStreamingChangeEventSource, the `startScn` variable is used
as an exclusive lower bound for log mining sessions. The meaning of this
variable was a little muddled, sometimes (incorrectly) being considered
an inclusive lower bound. This PR aims to rectify that and avoid future
confusion on the matter.
 2022-02-14 13:17:57 -05:00
limer2
3af5f0a4f0
DBZ-4723 Correct typo mistake to make use of property "log.mining.view.fetch.size". 2022-02-09 03:03:26 -05:00
Debezium Builder
7a47f478a4 [maven-release-plugin] prepare for next development iteration 2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e [maven-release-plugin] prepare release v1.9.0.Alpha2 2022-02-09 07:23:10 +00:00
Chris Cranford
7ec2abd89e DBZ-4305 Skip test when using Oracle 21 2022-02-08 23:15:15 -05:00
Chris Cranford
47b2a53a90 DBZ-4701 Align Oracle to adhere to executeWithoutCommitting semantics 2022-02-08 13:19:50 -05:00
René Kerner
8b47bf2d8f
DBZ-4665 Extend Debezium Schema Generator; 
* finish renaming of API/APIFormat occurences to use Schema instead
* add creation of directory structure per connector when creating descriptors: `postgres.json` --> `postgres/postgres.json`
* add configuration to add a schema filename prefix (`postgres.json` --> `debezium-postgres.json`)
* add configuration to add a schema filename suffix (`postgres.json` --> `postgres-1.9.0-SNAPSHOT.json`)
* add some minor logging (available schema formats, selected format, processed connectors) and throw errors on failed state (no schema formats found, no connectors found)
* remove Oracle connector schema generation as it is not annotated yet
* automatically resolving all dependencies required by the schema generator

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
 2022-02-07 16:19:50 +01:00
Chris Cranford
57934a0838 DBZ-4367 Fix test failure due to auto-commit state 2022-02-05 11:32:14 -05:00
Chris Cranford
c59e749a15 DBZ-4367 Fix Xstream compilation problem 2022-02-05 11:32:14 -05:00
Dominique Chanet
38266e7ead DBZ-4367 process initial review comments 2022-02-05 11:32:14 -05:00
Dominique Chanet
9cc059beb5 DBZ-4367: LogMiner mine from oldest pending TX instead of snapshot SCN 
Start mining from the start SCN of the oldest still-pending transaction
at the time the initial snapshot was taken. This ensures that no events
get lost when that transaction is committed post-snapshot.
 2022-02-05 11:32:14 -05:00
Chris Cranford
176a5d6dc3 DBZ-4703 Enable DEBUG logging for LcrEventHandler for tests 2022-02-04 19:33:00 -05:00
Chris Cranford
74f75867e4 DBZ-4702 Document & fix test - XStream does not support ROWID data type 2022-02-04 18:57:11 -05:00
Mark Drilling
8a5279d304
DBZ-4314 Define Oracle category grouping and ordering (#3151) 2022-02-02 15:33:01 -06:00
Chris Cranford
56a30bcb1d DBZ-4650 Mark incompatible Xstream tests as LogMiner-only 2022-02-01 08:54:19 -05:00
Chris Cranford
dcd8607108 DBZ-4584 Support case-sensitive Oracle incremental snapshots 2022-01-31 09:14:46 +01:00
Debezium Builder
33e2f5cd0f [maven-release-plugin] prepare for next development iteration 2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e [maven-release-plugin] prepare release v1.9.0.Alpha1 2022-01-26 19:00:20 +00:00
Chris Cranford
0f22958369 DBZ-4595 Support Oracle ROWID data type 2022-01-25 08:43:35 +01:00
Chris Cranford
c95ef56fb8 DBZ-4567 DDL and DML events exclude built-in schemas 2022-01-25 08:25:34 +01:00
nathan-smit-1
d188366c3d DBZ-4404 Added signal table support for Oracle 11G 2022-01-24 18:19:37 -05:00
Gunnar Morling
0c62da2aa5 DBZ-4520 Making static collections immutable 2022-01-21 18:03:57 +01:00
Jiri Pechanec
664d989e42 DBZ-4577 Provide custom error message handling 2022-01-21 10:24:19 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Chris Cranford
532fdd3972 DBZ-4536 Rework checks based on feedback 2022-01-18 07:43:58 +01:00
Chris Cranford
3887dca5bf DBZ-4536 Make OracleErrorHandler more flexible of retriable errors 2022-01-18 07:43:58 +01:00
Chris Cranford
8f53b7abea
DBZ-4366 Re-organize code, re-use static values 2022-01-17 16:14:49 -05:00
Dominique Chanet
eb7c5b02c6
DBZ-4366 basic support for DBMS_LOB package 
Make less assumptions about the order of SELECT_LOB_LOCATOR and
LOB_WRITE events when a LOB value is constructed. The current approach
also supports interleaved LOB creation (piecemeal creation of 2 large
LOB values in different rows or columns at the same time).

There is still no support for partial LOB manipulations (trimming a LOB,
appending a couple of bytes, overwriting just a couple of bytes in the
middle, ...). To properly support that, a wholly different approach is
needed.

The internal representation of BLOB values for LogMiner has been changed
from `HEXTORAW('...')` and `BlobChunkList` to a simple byte array for
efficiency.
 2022-01-17 16:14:49 -05:00
Sergei Morozov
17fba7258b DBZ-4541: Promote failure to register metrics to exception 2022-01-14 19:50:57 +01:00
Chris Cranford
8e7c47b407 DBZ-4542 Fix LogMinerHelperIT test failure w GH Oracle CI 2022-01-12 14:09:15 -05:00
Jiri Pechanec
5f11790920 DBZ-732 Execute Oracle ITs on CI 2022-01-12 13:00:54 -05:00
Sergei Morozov
0329859cda DBZ-4459: Introduce interfaces and default implementations for change event source metrics 2022-01-12 14:32:19 +01:00
Chris Cranford
6ea3688f46 DBZ-4526 Relax cache name limitations on Infinispan embedded cache configs 2022-01-11 14:20:45 +01:00
Chris Cranford
2ce8921872 DBZ-4408 Remove log.mining.log.file.query.max.retries 2022-01-11 14:06:45 +01:00
Anisha Mohanty
d6c5ad2e7c DBZ-4460 Renaming all openapi occurrences to schema 2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f DBZ-4460 Set default values for format & output directory 2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691 DBZ-4460 Apply the plug-in to all connector modules 2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221 DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation 2022-01-06 19:03:46 +01:00
poonam-meghnani
26cbf7d2e7
DBZ-4499 fixed check style issues 2022-01-06 11:29:41 -05:00
poonam-meghnani
9955a019fa
DBZ-4499 fixed checkstyle issues 2022-01-06 11:29:41 -05:00
poonam-meghnani
34505b385e
DBZ-4499 checkstyle change 2022-01-06 11:29:41 -05:00
poonam-meghnani
b55a8ea06f
DBZ-4499 Enable Oracle connector to execute INITIAL_ONLY snapshot.mode 2022-01-06 11:29:41 -05:00
harveyyue
792187f669 DBZ-4472 Make connector task partition readability for log 2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98 [maven-release-plugin] prepare for next development iteration 2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f [maven-release-plugin] prepare release v1.8.0.Final 2021-12-16 10:11:28 +00:00
Jiri Pechanec
d3e53dfa3a DBZ-4446 Option to disable Infinispan in Oracle 2021-12-13 13:59:06 +01:00
Chris Cranford
63731a2a09 DBZ-3940 Unify EventRouter tests for connectors 2021-12-13 13:52:31 +01:00
Chris Cranford
f99ad7512f DBZ-3940 Add connector-driven EventRouter configuration 2021-12-13 13:52:31 +01:00
Chris Cranford
33c0266dcf DBZ-4426 Log message when Oracle schema locks are disabled by configuration 2021-12-11 01:17:46 -05:00
Debezium Builder
f53e6c00df [maven-release-plugin] prepare for next development iteration 2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a [maven-release-plugin] prepare release v1.8.0.CR1 2021-12-09 20:16:04 +00:00
Chris Cranford
950ee4d212 DBZ-4425 Fix Oracle Infinispan unavailable value serialization 2021-12-08 20:43:19 -05:00
Chris Cranford
cdf31f67c2 DBZ-4422 Fix inconsistencies with XStream LOB handling 2021-12-08 20:43:19 -05:00
Chris Cranford
141c034a20 DBZ-4385 Javadoc fixes 2021-12-08 15:00:53 -05:00
Chris Cranford
e3141556f8 DBZ-4385 Don't specify mining strategy in tests 2021-12-08 15:00:53 -05:00
Tom Billiet
ec9f122e0a DBZ-4385 Truncate support for Oracle 2021-12-08 15:00:53 -05:00
Chris Cranford
8f007e08a2 DBZ-4388 Don't set default value if resolution fails 2021-12-07 16:38:22 +01:00
Chris Cranford
b6377d565c DBZ-3635 Made option internal & undocumented 2021-12-07 14:48:03 +01:00
Chris Cranford
9f9758c6d3 DBZ-3635 Allow fetching of transaction logs to be retried. 2021-12-07 14:48:03 +01:00
Chris Cranford
975c2a1e32 DBZ-4400 Fix not-null CLOB column support when LOB disabled 2021-12-06 07:29:35 -05:00
Chris Cranford
51eec83564 DBZ-4400 Fix not-null BLOB column support when LOB disabled 2021-12-06 07:29:35 -05:00
Chris Cranford
e26b240117 DBZ-4400 Support binary.handling.mode for Oracle 2021-12-06 07:29:35 -05:00
Chris Cranford
60945b426a DBZ-4376 Fix NPE when database.dbname or database.pdb.name is in non-uppercase 2021-12-01 22:34:15 +01:00
Chris Cranford
54cb7bea25 DBZ-4384 Correctly skip emitting events when LOB_ERASE is detected 2021-12-01 14:04:48 +01:00
Debezium Builder
b5439b54bf [maven-release-plugin] prepare for next development iteration 2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2 [maven-release-plugin] prepare release v1.8.0.Beta1 2021-11-30 09:38:47 +00:00
Chris Cranford
652f41f7fb DBZ-4272 Add drop column schema change to test 2021-11-30 09:28:44 +01:00
Chris Cranford
3a8d1ff838 DBZ-4272 Incrementally snapshot after schema change without NPE 2021-11-30 09:28:44 +01:00
Chris Cranford
707dac863c DBZ-4360 Correctly parse default values with trailing spaces 2021-11-29 14:19:04 +01:00
Chris Cranford
d7a9784c82 DBZ-1539 Remove field group 2021-11-29 12:54:50 +01:00
Chris Cranford
de15807a11 DBZ-1539 Cleanup tests 2021-11-29 12:54:50 +01:00
Tom Billiet
46b47a42b2 DBZ-1539 Add interval.handling.mode to oracle connector 2021-11-29 12:54:50 +01:00
Chris Cranford
e39ef147f0 DBZ-4276 Extend LOB tests when LOB is disabled 2021-11-24 11:21:39 +01:00
Chris Cranford
b8b803defe DBZ-4236 Unify Oracle LogMiner event processors 2021-11-22 12:17:23 +01:00
Chris Cranford
f600efdffb DBZ-4169 Consolidate rollback and recently committed trx caches 2021-11-18 20:47:09 +01:00
Chris Cranford
e0065536f0 DBZ-4169 Suggested changes 2021-11-18 20:47:09 +01:00
Chris Cranford
5599938669 DBZ-4169 Enforce existence of Hotrod client server list option when necessary 2021-11-18 20:47:09 +01:00
Chris Cranford
1f06f1a038 DBZ-4169 Extract strings to constants 2021-11-18 20:47:09 +01:00
Chris Cranford
bcbff0b7e3 DBZ-4169 Raise error when using log.mining.buffer.location option 2021-11-18 20:47:09 +01:00
Chris Cranford
48b5602ead DBZ-4169 Cleanup Oracle POM 2021-11-18 20:47:09 +01:00
Chris Cranford
9e52ae8137 DBZ-4169 Consolidate CacheProvider impls into Processor impls 2021-11-18 20:47:09 +01:00
Chris Cranford
ab40b77120 DBZ-4169 Flush out configuration options; fix ConfigDef test 2021-11-18 20:47:09 +01:00
Chris Cranford
cc130b9f56 DBZ-4169 Cleanup cache creation 2021-11-18 20:47:09 +01:00
Chris Cranford
640d5cbd18 DBZ-4169 Cleanup TestHelper 2021-11-18 20:47:09 +01:00
Chris Cranford
f42c47b63b DBZ-4169 Support remote Infinispan caches 2021-11-18 20:47:09 +01:00
Chris Cranford
97f08a0de3 DBZ-4308 Avoid NPE during table/column length checks 2021-11-17 17:14:26 -05:00
Chris Cranford
e3da449303 DBZ-4276 Expose unavailable value placeholder for PG and Oracle only 2021-11-16 20:29:59 +01:00
Chris Cranford
d1453eb954 DBZ-4276 Improve map initialization 2021-11-16 20:29:59 +01:00
Chris Cranford
ca17352221 DBZ-4276 Unify unavailable value placeholder handling 
Deprecate the `toasted.value.placeholder` option in PostgreSQL in favor
of the new `unavailable.value.placeholder` option that is shared by all
relational connectors.
 2021-11-16 20:29:59 +01:00
Chris Cranford
0fbfd88f6c DBZ-4276 Add unavailable.value.placeholder support for Oracle 2021-11-16 20:29:59 +01:00
Chris Cranford
7720c653e5 DBZ-4279 For test compatibility with Xstream 2021-11-14 16:47:51 -05:00
Debezium Builder
f93e901dce [maven-release-plugin] prepare for next development iteration 2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19 [maven-release-plugin] prepare release v1.8.0.Alpha2 2021-11-11 09:21:59 +00:00
Gunnar Morling
a03de4e9d0 DBZ-3611 Clarifying purpose of test 2021-11-11 09:24:05 +01:00
Chris Cranford
85101f0ad7 DBZ-3611 Avoid NPE with database include/exclude lists 2021-11-11 09:24:05 +01:00
Chris Cranford
d77098c3f0 DBZ-3710 Emit SYSDATE as 1970-01-01T00:00:00Z for zone-based temporal values 2021-11-10 09:43:25 +01:00
Chris Cranford
5c2523cd73 DBZ-3710 Suggested changes 2021-11-10 09:43:25 +01:00
Chris Cranford
5afda302ec DBZ-3710 Javadoc updates 2021-11-10 09:43:25 +01:00
Chris Cranford
78f79afff3 DBZ-3710 Change mapper methods to static scope 2021-11-10 09:43:25 +01:00
Chris Cranford
5ec9381702 DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL) 2021-11-10 09:43:25 +01:00
Chris Cranford
3fd784c51d DBZ-4208 Add test case for sequence-based defaults 2021-11-10 09:43:25 +01:00
Chris Cranford
343318b5d4 DBZ-3710 Support Oracle column default values 2021-11-10 09:43:25 +01:00
Chris Cranford
b30fe481eb DBZ-4255 Reduce verbosity of logging Oracle memory metrics 2021-11-09 14:10:17 -05:00
Chris Cranford
b3faab170a DBZ-4222 Correctly assign min metrics values when unset 2021-11-09 10:08:49 +01:00
Chris Cranford
14f6114dd0 DBZ-4222 Initialize log names/status in metrics when streaming starts 2021-11-09 10:08:49 +01:00
Chris Cranford
ed59438b89 DBZ-4222 Correctly update last and total batch duration metrics 2021-11-09 10:08:49 +01:00
Chris Cranford
04e3e6be64 DBZ-4222 Do not recalculate fetch query metrics twice 2021-11-09 10:08:49 +01:00
Chris Cranford
0c3d4f31ef DBZ-4230 Gracefully handle ORA-00310 during streaming 2021-11-08 15:23:12 +01:00
Chris Cranford
64f030da14 DBZ-4252 Remove unused code 2021-11-06 10:30:39 +01:00
harveyyue
aa3ae05e22 DBZ-4107 Incremental snapshot doesn't work without primary key 2021-11-05 13:31:26 +01:00
Chris Cranford
b650a5cfa9 DBZ-4240 Resolve asterisk precision as default number precision 2021-11-05 08:24:17 +01:00
Chris Cranford
403ddb54c9 DBZ-4204 Allow ORA-04030 exceptions to be retried 2021-11-05 08:13:16 +01:00
Chris Cranford
84aa46fb27 DBZ-4159 Make Oracle Infinispan trx cache layout forward compatible 2021-11-05 08:10:45 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Chris Cranford
ce28e939d6 DBZ-4159 Javadoc updates 2021-11-03 18:17:49 +01:00
Chris Cranford
954b81a75f DBZ-4159 Cache LogMinerEvent instances in separate cache 2021-11-03 18:17:49 +01:00
Chris Cranford
4f69443ad8 DBZ-4233 CHAR / NCHAR precision not derived from DDL 2021-11-03 07:11:00 +01:00
Chris Cranford
d0c96f440b DBZ-4077 Fix NPE with Oracle test suite 2021-11-03 07:08:35 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4 DBZ-2975 Using Offsets in recover() contract; 
Keeping legacy method until the legacy MySQL connector implementation has been removed.
 2021-11-01 10:17:49 +01:00
Chris Cranford
833791ffa4 DBZ-4194 Extend alias support for DELETE statements 2021-10-28 01:33:50 -04:00
harveyyue
a9cbb8f2ae DBZ-4194 DML statement couldn't be parsed 2021-10-28 01:33:50 -04:00
Chris Cranford
c25963fbd7 DBZ-4206 Parse Oracle DDL using SDO_GEOMETRY data types 2021-10-28 07:28:20 +02:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
Chris Cranford
acfd5123c7 DBZ-4161 Restrict test to LogMiner only 2021-10-26 16:00:44 -04:00
Chris Cranford
2a6df35dbb DBZ-3978 Restrict test to LogMiner only 2021-10-26 16:00:18 -04:00
Chris Cranford
9f27cddbc5 DBZ-4186 Fix OracleSchemaMigrationIT test failures for Xstream 2021-10-22 09:01:56 +02:00
Chris Cranford
2db345d1ed DBZ-4036 Adjust DEFAULT_SCN_GAP_SIZE 2021-10-21 17:42:11 -04:00
Chris Cranford
36c0dfd1ab DBZ-4036 Only pass one SCN to the timestamp function 2021-10-21 17:42:11 -04:00
Willie Zhu
f4297f99b3 DBZ-4036 move scn_to_timestamp to a seperate function. 2021-10-21 17:42:10 -04:00
Willie Zhu
f30e40ddf7 DBZ-4036 extract configuration 2021-10-21 17:42:10 -04:00
Willie Zhu
365532379d DBZ-4036 handle SCN gap. 2021-10-21 17:42:10 -04:00
Jiri Pechanec
a956aa53bc DBZ-4188 Skip LogMiner tests while using XStream 2021-10-21 11:31:15 -04:00
harveyyue
90e9bea93f DBZ-4000 Support parse table and columns comment 2021-10-20 15:19:31 +02:00
Chris Cranford
54df559438 DBZ-3807 Make Oracle connector build with infinispan-buffer profile stable 2021-10-20 09:38:51 +02:00
Chris Cranford
78dedc080a
DBZ-3834 Do not use row hashing for event duplication detection; 
Also delaying event parsing until after duplication check.

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
 2021-10-19 16:54:13 +02:00
Chris Cranford
8424a58dea DBZ-4161 Merge logging and object name length checks 2021-10-19 12:26:02 +02:00
Chris Cranford
c6d753526b DBZ-4161 Log warning on long table/column names 2021-10-18 13:59:55 +02:00
Gunnar Morling
188d94c867 DBZ-4140 scn -> SCN in messages 2021-10-18 12:12:30 +02:00
Chris Cranford
0ae985e5f8 DBZ-4140 Avoid NPE with getMaxArchiveLogScn by using query retries 2021-10-18 12:12:30 +02:00
Chris Cranford
c86a7cba60 DBZ-4064 Fix test failures 2021-10-15 09:17:43 +02:00
Chris Cranford
38fc16c869 DBZ-4064 Fix NullPointerException with LogMinerEventRow initialization 2021-10-15 09:17:43 +02:00
Chris Cranford
7494a1cd29 DBZ-4151 Prevent possible OutOfMemoryError with tracking schema changes 2021-10-14 16:47:22 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names 
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
 2021-10-12 15:40:02 +02:00
Zongwen Li
636c09e040 DBZ-3986 [oracle] Add the SCHEMA_ONLY_RECOVERY snapshot mode 2021-10-12 15:03:01 +02:00
Chris Cranford
e3294146b5 DBZ-4118 Do not write multiple rows to flush table 2021-10-12 10:29:10 +02:00
Chris Cranford
150f45354a DBZ-4135 Fix handling of alter table MODIFY column DDL 2021-10-12 10:11:08 +02:00
Chris Cranford
abc3bb42d6 DBZ-4106 Don't continuously reconfigure DatabaseHistory 2021-10-05 20:15:58 +02:00
Gunnar Morling
477efc4033 DBZ-4078 Making sure base lifecycle hook is called 2021-10-04 10:09:51 +02:00
Chris Cranford
6482733915 DBZ-3978 Fix formatting 2021-10-01 14:14:39 -04:00
Willie Zhu
33def4cb48 DBZ-3978 only skip dispatching event for excluded user name 2021-10-01 14:14:39 -04:00
Chris Cranford
d94951ea62 DBZ-3978 Move integration test 2021-10-01 14:14:39 -04:00
Chris Cranford
806246edb0 DBZ-3978 Change loglevel to trace 2021-10-01 14:14:39 -04:00
Chris Cranford
16267cee23 DBZ-3978 Make fields final 2021-10-01 14:14:39 -04:00
Willie Zhu
0a9fced8bb DBZ-3978 add userName as a constructor argument.Add integration test. 2021-10-01 14:14:39 -04:00
Willie Zhu
0fa6f9f464 DBZ-3978 Exclude usernames at transaction level 2021-10-01 14:14:39 -04:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00
Chris Cranford
582a169f92 DBZ-4067 Correctly calculate mining session boundaries 
It is not guaranteed that the flush strategy will force all LGWR buffer entries
to be written to the redo logs in which case the mining boundaries must then be
calculated based on the lastProcessedScn rather than the current batch endScn.
This prevents event loss between mining sessions when this timing scenario
occurs.
 2021-10-01 09:15:04 +02:00
Chris Cranford
5d05fadf04 DBZ-3712 Add poll interval configuration option 2021-09-29 11:52:27 -04:00
Chris Cranford
e85b6e1780 DBZ-3712 Support start/change archive.log.only.mode gracefully 2021-09-28 17:52:35 +02:00
Chris Cranford
7cca4aaa75
DBZ-4037 Gracefully handle unsupported RAW data types 2021-09-28 11:57:23 +02:00
Debezium Builder
bec0b6b67e [maven-release-plugin] prepare for next development iteration 2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725 [maven-release-plugin] prepare release v1.7.0.CR2 2021-09-23 06:31:25 +00:00
Chris Cranford
a14e13ff01 DBZ-4010 Allow ORA-01327 exceptions to be retried 2021-09-21 13:44:26 +02:00
Debezium Builder
c15e0b303b [maven-release-plugin] prepare for next development iteration 2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121 [maven-release-plugin] prepare release v1.7.0.CR1 2021-09-16 08:10:44 +00:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set; 
Also adding missing descriptions.
 2021-09-09 13:35:41 +02:00
Chris Cranford
093408bba8 DBZ-3954 Restrict capturing change events to configured PDB 2021-09-02 09:06:28 +02:00
Chris Cranford
47c3273985 DBZ-3892 Reuse precompiled pattern instance 2021-09-01 13:10:00 -04:00
Chris Cranford
8dc4a08c70 DBZ-3892 Correctly parse concatenated UNISTR values 2021-09-01 13:10:00 -04:00
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors; 
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
 2021-08-30 12:20:56 +02:00
Chris Cranford
0f07b43012 DBZ-3898 Skip excluded schema DDL events 2021-08-26 09:20:33 +02:00
Debezium Builder
2ce6bcb2ab [maven-release-plugin] prepare for next development iteration 2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423 [maven-release-plugin] prepare release v1.7.0.Beta1 2021-08-25 05:20:56 -04:00
Chris Cranford
5263bbe2ec DBZ-3911 Fix SQLException due to column name typo 2021-08-24 21:41:02 +02:00
Chris Cranford
7e588c6173 DBZ-3896 Support multi-statement table DDLs 2021-08-23 22:48:52 +02:00
Chris Cranford
973fa248ed DBZ-3902 Fix test failure shouldNotEmitDdlEventsForNonTableObjects 2021-08-23 11:44:14 -04:00
Chris Cranford
b6244591d7 DBZ-3893 Make allocation more explicit 2021-08-23 10:00:20 -04:00
Chris Cranford
26b70316b9 DBZ-3893 Treat EMPTY_XLOB() as an empty LOB value instead of NULL 2021-08-23 10:00:20 -04:00
李宗文
b0c0d879e5 DBZ-3876 Improve the SCN update method in MemoryLogMinerEventProcessor 2021-08-23 09:29:31 -04:00
Chris Cranford
82e09ecd60 DBZ-3813 Change error message 2021-08-18 10:00:06 +02:00
Chris Cranford
b898c6031f DBZ-3813 Fix method name typo 2021-08-18 10:00:06 +02:00
Chris Cranford
f695bacf6f DBZ-3813 Add recommended tests 2021-08-18 10:00:06 +02:00
Chris Cranford
7242284b1e DBZ-3813 Add rac.nodes port validation 2021-08-18 10:00:06 +02:00
Sergei Morozov
a40ad7132d DBZ-2975: Remove partition from offset context 2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12 DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets 2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52 DBZ-2975: Move Partition to io.debezium.pipeline.spi 2021-08-11 07:34:37 +02:00
Debezium Builder
d3c4482d06 [maven-release-plugin] prepare for next development iteration 2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426 [maven-release-plugin] prepare release v1.7.0.Alpha1 2021-07-30 02:39:08 -04:00
Chris Cranford
e2c0c1d3c0 DBZ-3692 Fix NullPointerException 
This NPE check effectively only enables Incremental Snapshot behavior for Oracle
if a signal data collection id is provided; otherwise its disabled
 2021-07-30 06:12:10 +02:00
Chris Cranford
e1b003c4f4 DBZ-3752 Formatting fix 2021-07-30 06:12:10 +02:00
Chris Cranford
492008d771 DBZ-3752 Fix test mocks after rebase 2021-07-30 06:12:10 +02:00
Chris Cranford
709a50a652 DBZ-3752 More suggested changes 
* Added `infinispan-buffer` profile for testing with infinispan
* Made `online_catalog` the default for testing
* Added protostream-processor back to the POM
 2021-07-30 06:12:10 +02:00
Chris Cranford
1c0b4fd5af DBZ-3752 Suggested changes 2021-07-30 06:12:10 +02:00
Chris Cranford
0cbce95a0c DBZ-3752 Memory & Infinispan Buffering implementations 2021-07-30 06:12:10 +02:00
Chris Cranford
26461bc07d DBZ-3692 Introduce completion callback for incremental snapshots 2021-07-29 13:51:42 +02:00
Chris Cranford
393a44a55f DBZ-3692 Oracle incremental snapshot support 2021-07-29 13:51:42 +02:00
Chris Cranford
10ab20a157 DBZ-2552 Refactor & introduce LogWriterFlushStrategy 2021-07-28 13:25:03 +02:00
Chris Cranford
1fd68e6fa9 DBZ-2552 Refactored several methods to connection class 2021-07-28 13:25:03 +02:00
Chris Cranford
6a1267b26c DBZ-2552 Refactored constants usage 2021-07-28 13:25:03 +02:00
Chris Cranford
a7498ca340 DBZ-2552 Remove non-runtime code 2021-07-28 13:25:03 +02:00
Chris Cranford
0fa869388e DBZ-2552 Minor code cleanup 2021-07-28 13:25:03 +02:00
Chris Cranford
bd0dd5ec9c DBZ-2552 Refactored database state capture logic 2021-07-28 13:25:03 +02:00
Chris Cranford
48b01dd837 DBZ-2552 Refactored supplemental logging logic 2021-07-28 13:25:03 +02:00
Chris Cranford
e49e3f9211 DBZ-2552 Refactored getting current redo log filenames 2021-07-28 13:25:03 +02:00
Chris Cranford
60a90851c6 DBZ-2552 Refactored mining session ending SCN logic 2021-07-28 13:25:03 +02:00
Chris Cranford
5898dc4b0a DBZ-2552 Refactored start/end mining session logic 2021-07-28 13:25:03 +02:00
Chris Cranford
e02c2eb912 DBZ-2552 Remove unused or irrelevant code 2021-07-28 13:25:03 +02:00
Chris Cranford
8eed85037f DBZ-2552 Refactored SCN queries 2021-07-28 13:25:03 +02:00
Chris Cranford
b8c2d6e64a DBZ-2552 Refactored getting database system time 2021-07-28 13:25:03 +02:00
Chris Cranford
4ca93c6ff8 DBZ-2552 Refactored setting NLS parameters for mining session 2021-07-28 13:25:03 +02:00
Chris Cranford
a0e1acdf3e DBZ-2552 Refactored create flush table logic 2021-07-28 13:25:03 +02:00
Chris Cranford
9a1e181ed7 DBZ-2552 Refactored build data dictionary logic 2021-07-28 13:25:03 +02:00
Chris Cranford
fe499bf3d2 DBZ-2552 Refactored Oracle LGWR flush logic 2021-07-28 13:25:03 +02:00
Chris Cranford
d450f58b37 DBZ-3756 Add UGA/PGA memory statistics to JMX metrics 2021-07-16 11:07:48 -04:00
Chris Cranford
52e198e3b5 DBZ-3683 Relax restrictions on connector user 2021-07-16 16:28:31 +02:00
Gunnar Morling
cbb5a78a6d DBZ-3671 More concise variable name 2021-07-05 12:27:04 +02:00
Gunnar Morling
bc21c14489 DBZ-3671 Apply suggestions from code review 2021-07-05 12:26:59 +02:00
Chris Cranford
4e0c54d782 DBZ-3671 Add test for user exclusion SQL condition 2021-07-05 12:26:59 +02:00
Chris Cranford
ddf25b144c DBZ-3671 Remove trailing space in query 2021-07-05 12:26:59 +02:00
Patrick Chu
77f268abe6 DBZ-3671 Add property to exclude users in logminer query 2021-07-05 12:26:59 +02:00
Chris Cranford
ed31ea9ffb DBZ-3668 Adjust ServiceLoader for SPI change 2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d DBZ-3668 Extracting SPI package 2021-07-03 16:31:52 +07:00