CRS-6706: Oracle Clusterware Release patch level (‘2565072065’) does not match Software patch level (‘277169099’)

Today on a dirt and quick patching session I end up with the following error when restarting the Oracle Restart Grid Infratructure.

The complete error was:

oracle@anjovm1: [+ASM] crsctl start has
CRS-6706: Oracle Clusterware Release patch level ('2565072065') does not match Software patch level ('277169099'). Oracle Clusterware cannot be started.
CRS-4000: Command Start failed, or completed with errors.

This was because I’ve installed the OJVM RU to the Grid home. The solution was simply:

oracle@anjovm1: ~oracle/ [+ASM] /u00/app/grid/18.0.0/OPatch/opatch rollback -id 28790647

And then I could restart:

oracle@anjovm1:~oracle/ [+ASM] crsctl start has
CRS-4123: Oracle High Availability Services has been started.

Index columns query

Query to show all indexes, its characteristics and respective columns from a table.
Note: It does not filter on owner.

select c.index_name,
       c.table_name||'('||listagg(column_name,',') within group (order by column_position)||')' as columns,
       decode(status,'VALID',null,status||' ')
       ||decode(visibility,'VISIBLE',null,visibility||' ')
       ||decode(segment_created,'YES',null,'EMPTY ')
       ||decode(uniqueness,'NONUNIQUE',null,uniqueness||' ')
       ||funcidx_status as STATUS
 from dba_ind_columns c, dba_indexes i
where i.table_name=c.table_name and i.index_name=c.index_name
  and c.table_name='&TABLE_NAME'
group by c.table_name,c.index_name,i.status,visibility, segment_created,uniqueness,funcidx_status
order by c.table_name,c.index_name;

Example of output:

INDEX_NAME                     COLUMNS                                 STATUS  
------------------------------ --------------------------------------- ----------
IDX_LIB_VERSION_PROFILE_ID     LIB_VERSION(PROFILE_ID)                       
INX_LIB_VERSION_SRC            LIB_VERSION(DATA_RESOURCE,SOURCE)             
LIB_VERSION_NAME_IDX           LIB_VERSION(VERSION_NAME)                     
LIB_VERSION_PK                 LIB_VERSION(ID)                         UNIQUE
LIB_VERSION_UK1                LIB_VERSION(PROFILE_ID,VERSION_NAME)    UNIQUE

Find NOSEGMENT indexes that you forgot to delete

Err is human and I, as human, I do forget sometimes to clean-up some tests.

Recently this happen with NOSEGMENT indexes. Yesterday I received an email from a colleague, reporting some errors he received with Datapump:

ORA-08114: can not alter a fake index
Failing sql is:
ALTER INDEX "SUPERAPP"."IDX_POSITION_TEST" NOPARALLEL
ORA-39083: Object type INDEX failed to create with error:
ORA-08114: can not alter a fake index

The indexes created with NOSEGMENT do not appear in DBA_INDEXES (don’t get fool by the SEGMENT_CREATED column).
They do appear on DBA_OBJECTS, but there they look like any other index.

The solution is to match the two tables. So to find the NOSEGMENT indexes that you forgot to delete you can use the following query:

SELECT 'DROP INDEX '||owner||'.'||object_name||';' cmd, created FROM dba_objects 
WHERE object_type='INDEX' 
AND object_name NOT IN (SELECT index_name FROM  dba_indexes);

If you wonder what are NOSEGMENT indexes, a good source is Oracle-Base.


Dataguard – convert from MaxPerformance to MaxAvailability

We just found that one of the setups was wrongly configured as MaxPerformance. Since Oracle 11.2 it is possible to increase the protection mode without restarting the primary (if going from MaxPerformance to MaxProtection you need to do in two steps, through MaxPerformance).

Here how to move from MaxPerformance to MaxAvailability in a config with DataGuard Broker (removed some lines to make it shorter):

DGMGRL> connect /
Connected.

DGMGRL> show configuration

Configuration - azores

  Protection Mode: MaxPerformance
  Databases:
    azores_site1 - Primary database
    azores_site2 - (*) Physical standby database

Fast-Start Failover: ENABLED

Configuration Status:
SUCCESS

DGMGRL> EDIT CONFIGURATION SET PROTECTION MODE AS MAXAVAILABILITY;
Error: ORA-16654: fast-start failover is enabled

Failed.

DGMGRL> stop observer
Done.
DGMGRL> show configuration

Configuration - azores

  Protection Mode: MaxPerformance
  Databases:
    azores_site1 - Primary database
      Warning: ORA-16819: fast-start failover observer not started

    azores_site2 - (*) Physical standby database
      Warning: ORA-16819: fast-start failover observer not started

Fast-Start Failover: ENABLED

Configuration Status:
WARNING

DGMGRL>  DISABLE FAST_START FAILOVER
Disabled.
DGMGRL> show configuration

Configuration - azores

  Protection Mode: MaxPerformance
  Databases:
    azores_site1 - Primary database
    azores_site2 - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:
SUCCESS

DGMGRL> EDIT CONFIGURATION SET PROTECTION MODE AS MAXAVAILABILITY;
Error: ORA-16627: operation disallowed since no standby databases would remain to support protection mode
Failed.

DGMGRL> show database verbose azores_site1

Database - azores_site1

  Role:            PRIMARY
  Intended State:  TRANSPORT-ON
  Instance(s):
    azores

  Properties:
    DGConnectIdentifier             = 'azores_site1.portugal'
    ObserverConnectIdentifier       = ''
    LogXptMode                      = 'async'
	...
	
Database Status:
SUCCESS

DGMGRL> show database verbose azores_site2

Database - azores_site2

  Role:            PHYSICAL STANDBY
  Intended State:  APPLY-ON
  Transport Lag:   0 seconds (computed 2 seconds ago)
  Apply Lag:       0 seconds (computed 2 seconds ago)
  Apply Rate:      1.84 MByte/s
  Real Time Query: OFF
  Instance(s):
    azores

  Properties:
    DGConnectIdentifier             = 'azores_site2.portugal'
    ObserverConnectIdentifier       = ''
    LogXptMode                      = 'async'
	...
	
Database Status:
SUCCESS

DGMGRL> edit database azores_site2 set state=APPLY-OFF;
Succeeded.
DGMGRL> edit database azores_site2 set property LogXptMode='SYNC';
Property "logxptmode" updated
DGMGRL> edit database azores_site1 set property LogXptMode='SYNC';
Property "logxptmode" updated
DGMGRL> EDIT CONFIGURATION SET PROTECTION MODE AS MAXAVAILABILITY;
Succeeded.
DGMGRL> show configuration;

Configuration - azores

  Protection Mode: MaxAvailability
  Databases:
    azores_site1 - Primary database
    azores_site2 - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:
SUCCESS

DGMGRL> enable fast_start failover;
Enabled.

DGMGRL> edit database azores_site2 set state=APPLY-ON;
Succeeded.

DGMGRL> show database verbose azores_site2

Database - azores_site2

  Role:            PHYSICAL STANDBY
  Intended State:  APPLY-ON
  Transport Lag:   0 seconds (computed 1 second ago)
  Apply Lag:       0 seconds (computed 1 second ago)

Database Status:
SUCCESS

DGMGRL> show configuration;

Configuration - azores

  Protection Mode: MaxAvailability
  Databases:
    azores_site1 - Primary database
    azores_site2 - (*) Physical standby database

Fast-Start Failover: ENABLED

Configuration Status:
SUCCESS

Query DGMGRL silently from observer site

When the observer is “checking” several dataguard configurations, we can use this server to easily make queries on all of them, for instance using:

for db in `ps -ef | grep observer | awk -F '/' '{print $6}' | sort`; do
conn=`sed -n 1p /u00/app/oracle/admin/${db}/observer/fsfo_${db}.conf`
conndb=`echo $conn | cut -d "@" -f2`
dgmgrl -silent ${conn} "show configuration" | grep -E 'Primary'
done;

It does for every observed configuration:

  1. gets the DB name
  2. find the connection string in the config file
  3. connects to DGMGRL in silent more and runs a command

Index Logical Corruption!

Arriving to my client on Monday, I see the local DBA already with two people behind and him concerned about something. He was doing a new failover of a critical database that had problems during the weekend due to a change on a firewall. The timeline was somehow like this:

  • Friday afternoon – firewall change
  • Saturday morning – many syslog errors and almost impossible to use the DB (due to audit to OS level)
  • Saturday afternoon – failover of the database to secondary site + set syslogd to restart every 5 minutes
  • Sunday morning – reinstate old primary as standby (firewall change was fixed/rolledback)
  • Monday morning – failover of database to primary site + reinstate DB on secondary site

All looked back fine by end of the morning, we were happy that the reinstate worked fine, even though it was necessary to do it using sqlplus, as the broker was giving errors.

Monday midday the users complaint they are receiving ORA-01555 for some queries.

Mon Aug 20 11:21:35 2018
ORA-01555 caused by SQL statement below (SQL ID: cg61q9avtk3ta, Query Duration=1 sec, SCN: 0x01a9.3ae6da9e):
delete from child_table where parent_id = :parent and child_id in (:child1)

We check alertlog and see the ORA-01555 on two queries filtering on the same key-value pair. Probably a wrong plan was generated and undo exploded, I think. But the undo tablespace is not even half used. And query duration is 1 second, on the alertlog message.

This is strange. Also more strange is that few time after we also get ORA-00600 on the alertlog:

Mon Aug 20 16:16:54 2018
Errors in file /u00/app/oracle/diag/rdbms/db1_site1/DB1/trace/DB1_ora_13217.trc  (incident=1543593):
ORA-00600: internal error code, arguments: [ktbdchk1: bad dscn], [], [], [], [], [], [], [], [], [], [], []
Incident details in: /u00/app/oracle/diag/rdbms/db1_site1/DB1/incident/incdir_1543593/DB1_ora_13217_i1543593.trc

This is case for Metalink. And there we find the reason:

ALERT Bug 22241601 ORA-600 [kdsgrp1] / ORA-1555 / ORA-600 [ktbdchk1: bad dscn] / ORA-600 [2663] due to Invalid Commit SCN in INDEX (Doc ID 1608167.1)

Index corruption, nice. It could be worse, the workaround is to recreate the problematic indexes.

Ok, then we should run DB Verify to validate all indexes. There is this new option to run DBV on specific segments, which is great, and DBV was even enhanced to find this specific corruption:

Bug 7517208 – DBV enhanced to identify Logical SCN Block corruptions (Doc ID 7517208.8)

But trying to do on datafiles on ASM is not easy, does not seem to work… until we discover that:

Bug 18353157 – DBVERIFY (DBV) does not show SCN mismatch for datafiles in ASM (Doc ID 18353157.8)

Next step is to try to do with a simple ANALYZE INDEX. After some minutes the alert log starts showing a lot of:

Tue Aug 21 10:36:43 2018
ORA-01555 caused by SQL statement below (SQL ID: 6c3gh913k55pr, SCN: 0x01a9.3b4ea9e1):
ANALYZE INDEX USER1.IX_ABC VALIDATE STRUCTURE ONLINE
ORA-01555 caused by SQL statement below (SQL ID: 6c3gh913k55pr, SCN: 0x01a9.3b4ea9ee):
ANALYZE INDEX USER1.IX_ABC VALIDATE STRUCTURE ONLINE
…

Unfortunately the errors do not appear on sqlplus, so we need to have a tail -f on the alertlog, keep the eyes open and then cancel the ANALYZE INDEX.

As there seemed to be corruption to several indexes of USER1, we decided that it was just easier to directly rebuild all of them. The index rebuild need to be ONLINE. Not because we can’t support having locks on the tables of the application, but because only the ONLINE rebuild will do a full table scan to recreate the index. A normal rebuild uses the index itself, which is not good when it has some corruption.

One mistake we did at some point was to ANALYZE the primary key of one table and start an INDEX REBUILD ONLINE of an index on the same table. The ANALYZE and INDEX REBUILD, were locking each other (or advancing very slowly). So it is better not to perform both at the same time.

When we tried to rebuild online the primary key, we got the error:

ORA-08108: may not build or rebuild this type of index online

First we tought it would be due the fact it is a Primary Key, but soon we tumbled upon Jonnathan Lewis blog entry about this: https://jonathanlewis.wordpress.com/2012/09/04/online-rebuild-2/

Our Primary key is DEFERRABLE! Oups! The only option is now to change or deactivate the constraint, rebuild the index and go on. But this is not possible with the application running. So it implies an emergency change and a lot of actions. Here the technical summary on this Oracle Restart environment:

-- Stop service:
$ srvctl stop service -d db1_site1 -s db1_service_rw
$ srvctl status service -d db1_site1

-- Kill sessions using service and/or from users:
set pages 0
spool /tmp/to_kill.sql
select 'alter system disconnect session '''||sid||','||serial#||''' immediate;' from v$session where service_name='DB1_SERVICE_RW';
spool off

$ vi /tmp/to_kill.sql

SQL> @/tmp/to_kill.sql

-- Confirm no other sessions:
SQL> select username, program,machine from v$session where service_name='DB1_SERVICE_RW';

-- Recreate index:
SET TIME ON
SET TIMING ON
ALTER SYSTEM SET job_queue_processes=0;
ALTER SESSION ENABLE PARALLEL DDL;
ALTER TABLE user1.child_table DISABLE CONSTRAINT pk_child_table KEEP INDEX;
ALTER INDEX user1.pk_child_table REBUILD ONLINE PARALLEL 12;
ALTER TABLE user1.child_table ENABLE CONSTRAINT pk_child_table;
ALTER INDEX user1.pk_child_table NOPARALLEL;
ALTER SYSTEM SET job_queue_processes=10;

-- Restart service:
$ srvctl start service -d db1_site1 -s db1_service_rw
$ srvctl status service -d db1_site1

After all this finally we hoped that our database was back to normal. Application reconnects, we cross our fingers and since then no more errors. We are happy that this was just a light corruption.


Oracle licensing options usage – report from Oracle support

Less than a month ago, Oracle support released a major update of the reporting script for options/features/packs usage. It can be found at:

Database Options/Management Packs Usage Reporting for Oracle Databases 11gR2, 12c, 12cR2 and 18c (Doc ID 1317265.1)

It is a simple script that takes no time to execute. It will show both product and feature usage, including parameters that enable packs, like control_management_pack_access (Diagnostics and Tuning part) and enable_ddl_logging (Lifecycle Management pack). When run on a container database, it will show the feature usage per PDB.

It is important to know that it is based on DBA_FEATURE_USAGE_STATISTICS view, which is updated once a week. You can trigger an manual update using the information at How to Manually Refresh Dba_feature_usage_statistics (Doc ID 1629485.1)

SQL> connect / as sysdba
SQL> alter session set "_SWRF_TEST_ACTION"=53;
SQL> alter session set NLS_DATE_FORMAT='DD/MM/YYYY HH24:MI:SS';
SQL> select MAX(LAST_SAMPLE_DATE) from dba_feature_usage_statistics;

More details on each paid feature of Oracle Database Options and Packs can be found in the Oracle 12.2 Database Licensing Information guide (same for 11.2, 12.1 and 18c).

An example of the output of the script can be found below:

Database Options/Management Packs Usage Reporting for Oracle Databases 11gR2, 12c, 12cR2 and 18c (Doc ID 1317265.1)

SQL> @options_packs_usage_statistics.sql
OVERALL INFORMATION

HOST_NAME                               |INSTANCE_NAME   |DATABASE_NAME |OPEN_MODE       |DATABASE_ROLE   |CREATED            |      DBID|VERSION    |BANNER
----------------------------------------|----------------|--------------|----------------|----------------|-------------------|----------|-----------|--------------------------------------------------------------------------------
anjovm1                                 |ANJOCDB         |ANJOCDB       |READ WRITE      |PRIMARY         |2018.01.31_08.47.22| 380093466|12.2.0.1.0 |Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production

PARAMETER                     |VALUE
------------------------------|--------------------
control_management_pack_access|DIAGNOSTIC
enable_ddl_logging            |FALSE


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
MULTITENANT INFORMATION (Please ignore errors in pre 12.1 databases)
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

CON_ID|NAME                          |OPEN_MODE       |RESTRICTED|REMARKS
------|------------------------------|----------------|----------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
     1|CDB$ROOT                      |READ WRITE      |NO        |*CURRENT CONTAINER is CDB$ROOT. Information for all open PDBs will be listed.
     2|PDB$SEED                      |READ ONLY       |NO        |
     3|ANJOPDB1                      |READ WRITE      |NO        |

The multitenant architecture with one user-created pluggable database (single tenant) is available in all editions without the Multitenant Option.
If more than one PDB containers are created, then Multitenant Option licensing is needed



++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Selecting from CDB_FEATURE_USAGE_STATISTICS


DBA_FEATURE_USAGE_STATISTICS (DBA_FUS) INFORMATION - MOST RECENT SAMPLE BASED ON LAST_SAMPLE_DATE

CON_ID|LAST_DBA_FUS_DBID|LAST_DBA_FUS_VERS|LAST_DBA_FUS_SAMPLE|SYSDATE            |REMARKS
------|-----------------|-----------------|-------------------|-------------------|--------------------------------------------------------------------
     1|        380093466|12.2.0.1.0       |2018.09.01_06.37.39|2018.09.06_09.19.25|
     3|        380093466|12.2.0.1.0       |2018.09.01_18.37.40|2018.09.06_09.19.25|


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
PRODUCT USAGE
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

CON_NAME                      |PRODUCT                                            |USAGE                   |LAST_SAMPLE_DATE   |FIRST_USAGE_DATE   |LAST_USAGE_DATE
------------------------------|---------------------------------------------------|------------------------|-------------------|-------------------|-------------------
--ALL--                       |Active Data Guard                                  |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Advanced Analytics                                 |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Advanced Compression                               |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Advanced Security                                  |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Database In-Memory                                 |CURRENT_USAGE           |2018.09.01_18.37.40|2018.06.02_06.28.39|2018.09.01_18.37.40
--ALL--                       |Database Vault                                     |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Diagnostics Pack                                   |CURRENT_USAGE           |2018.09.01_18.37.40|2018.05.26_12.27.59|2018.09.01_06.37.39
--ALL--                       |Label Security                                     |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Multitenant                                        |NO_USAGE                |2018.09.01_06.37.39|                   |
--ALL--                       |OLAP                                               |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Partitioning                                       |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |RAC or RAC One Node                                |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Real Application Clusters                          |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Real Application Clusters One Node                 |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Real Application Testing                           |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Spatial and Graph                                  |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |Tuning Pack                                        |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |.Database Gateway                                  |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |.Exadata                                           |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |.GoldenGate                                        |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |.HW                                                |NO_USAGE                |2018.09.01_18.37.40|                   |
--ALL--                       |.Pillar Storage                                    |NO_USAGE                |2018.09.01_18.37.40|                   |

CON_NAME                      |PRODUCT                                            |USAGE                   |LAST_SAMPLE_DATE   |FIRST_USAGE_DATE   |LAST_USAGE_DATE
------------------------------|---------------------------------------------------|------------------------|-------------------|-------------------|-------------------
CDB$ROOT                      |Active Data Guard                                  |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Advanced Analytics                                 |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Advanced Compression                               |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Advanced Security                                  |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Database In-Memory                                 |CURRENT_USAGE    |2018.09.01_06.37.39|2018.06.02_06.28.39|2018.09.01_06.37.39
CDB$ROOT                      |Database Vault                                     |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Diagnostics Pack                                   |CURRENT_USAGE           |2018.09.01_06.37.39|2018.05.26_12.27.59|2018.09.01_06.37.39
CDB$ROOT                      |Label Security                                     |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Multitenant                                        |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |OLAP                                               |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Partitioning                                       |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |RAC or RAC One Node                                |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Real Application Clusters                          |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Real Application Clusters One Node                 |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Real Application Testing                           |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Spatial and Graph                                  |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |Tuning Pack                                        |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |.Database Gateway                                  |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |.Exadata                                           |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |.GoldenGate                                        |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |.HW                                                |NO_USAGE                |2018.09.01_06.37.39|                   |
CDB$ROOT                      |.Pillar Storage                                    |NO_USAGE                |2018.09.01_06.37.39|                   |

CON_NAME                      |PRODUCT                                            |USAGE                   |LAST_SAMPLE_DATE   |FIRST_USAGE_DATE   |LAST_USAGE_DATE
------------------------------|---------------------------------------------------|------------------------|-------------------|-------------------|-------------------
ANJOPDB1                      |Active Data Guard                                  |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Advanced Analytics                                 |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Advanced Compression                               |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Advanced Security                                  |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Database In-Memory                                 |CURRENT_USAGE           |2018.09.01_18.37.40|2018.06.02_18.28.39|2018.09.01_18.37.40
ANJOPDB1                      |Database Vault                                     |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Diagnostics Pack                                   |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Label Security                                     |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |OLAP                                               |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Partitioning                                       |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |RAC or RAC One Node                                |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Real Application Clusters                          |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Real Application Clusters One Node                 |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Real Application Testing                           |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Spatial and Graph                                  |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |Tuning Pack                                        |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |.Database Gateway                                  |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |.Exadata                                           |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |.GoldenGate                                        |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |.HW                                                |NO_USAGE                |2018.09.01_18.37.40|                   |
ANJOPDB1                      |.Pillar Storage                                    |NO_USAGE                |2018.09.01_18.37.40|                   |


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
FEATURE USAGE DETAILS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

CON_NAME                      |PRODUCT                                            |FEATURE_BEING_USED                                      |USAGE                   |LAST_SAMPLE_DATE   |      DBID|VERSION    |DETECTED_USAGES|TOTAL_SAMPLES|CURRENTLY_USED|FIRST_USAGE_DATE   |LAST_USAGE_DATE    |EXTRA_FEATURE_INFO
------------------------------|---------------------------------------------------|--------------------------------------------------------|------------------------|-------------------|----------|-----------|---------------|-------------|--------------|-------------------|-------------------|--------------------------------------------------------------------------------
CDB$ROOT                      |Active Data Guard                                  |Active Data Guard - Real-Time Query on Physical Standby |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Active Data Guard                                  |Global Data Services                                    |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Analytics                                 |Data Mining                                             |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |Advanced Index Compression                              |SUPPRESSED_DUE_TO_BUG   |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |Backup HIGH Compression                                 |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |Backup LOW Compression                                  |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |Backup MEDIUM Compression                               |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |Backup ZLIB Compression                                 |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |Data Guard                                              |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |HeapCompression                                         |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |Heat Map                                                |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |Hybrid Columnar Compression Row Level Locking           |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |Information Lifecycle Management                        |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |Oracle Advanced Network Compression Service             |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |Oracle Utility Datapump (Export)                        |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |             10|           31|TRUE          |2018.05.19_10.21.15|2018.09.01_06.37.39|compression used: 0 times
CDB$ROOT                      |Advanced Compression                               |Oracle Utility Datapump (Import)                        |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |SecureFile Compression (user)                           |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Compression                               |SecureFile Deduplication (user)                         |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Security                                  |Data Redaction                                          |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Security                                  |Encrypted Tablespaces                                   |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Security                                  |Oracle Utility Datapump (Export)                        |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |             10|           31|TRUE          |2018.05.19_10.21.15|2018.09.01_06.37.39|encryption used: 0 times
CDB$ROOT                      |Advanced Security                                  |Oracle Utility Datapump (Import)                        |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Security                                  |SecureFile Encryption (user)                            |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Advanced Security                                  |Transparent Data Encryption                             |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Database In-Memory                                 |In-Memory Aggregation                                   |CURRENT_USAGE           |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |             14|           31|TRUE          |2018.06.02_06.28.39|2018.09.01_06.37.39|
CDB$ROOT                      |Database In-Memory                                 |In-Memory Column Store                                  |CURRENT_USAGE           |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |             14|           31|TRUE          |2018.06.02_06.28.39|2018.09.01_06.37.39|
CDB$ROOT                      |Database Vault                                     |Oracle Database Vault                                   |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Database Vault                                     |Privilege Capture                                       |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Diagnostics Pack                                   |ADDM                                                    |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Diagnostics Pack                                   |AWR Baseline                                            |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Diagnostics Pack                                   |AWR Baseline Template                                   |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Diagnostics Pack                                   |AWR Report                                              |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Diagnostics Pack                                   |Automatic Workload Repository                           |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Diagnostics Pack                                   |Baseline Adaptive Thresholds                            |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Diagnostics Pack                                   |Baseline Static Computations                            |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Diagnostics Pack                                   |EM Performance Page                                     |CURRENT_USAGE           |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              5|           31|TRUE          |2018.05.26_12.27.59|2018.09.01_06.37.39|
CDB$ROOT                      |Label Security                                     |Label Security                                          |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Multitenant                                        |Oracle Multitenant                                      |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |             31|           31|TRUE          |2018.01.31_15.38.04|2018.09.01_06.37.39|AUX_COUNT=1
CDB$ROOT                      |OLAP                                               |OLAP - Analytic Workspaces                              |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |OLAP                                               |OLAP - Cubes                                            |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Partitioning                                       |Partitioning (user)                                     |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Partitioning                                       |Zone maps                                               |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |RAC or RAC One Node                                |Quality of Service Management                           |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Real Application Clusters                          |Real Application Clusters (RAC)                         |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Real Application Clusters One Node                 |Real Application Cluster One Node                       |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Real Application Testing                           |Database Replay: Workload Capture                       |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Real Application Testing                           |Database Replay: Workload Replay                        |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Real Application Testing                           |SQL Performance Analyzer                                |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Spatial and Graph                                  |Spatial                                                 |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Tuning Pack                                        |SQL Access Advisor                                      |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Tuning Pack                                        |SQL Monitoring and Tuning pages                         |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Tuning Pack                                        |SQL Profile                                             |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |Tuning Pack                                        |SQL Tuning Advisor                                      |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.Database Gateway                                  |Gateways                                                |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.Database Gateway                                  |Transparent Gateway                                     |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.Exadata                                           |Cloud DB with EHCC                                      |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.Exadata                                           |Exadata                                                 |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.GoldenGate                                        |GoldenGate                                              |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.HW                                                |Hybrid Columnar Compression                             |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.HW                                                |Hybrid Columnar Compression Conventional Load           |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.HW                                                |Hybrid Columnar Compression Row Level Locking           |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.HW                                                |Sun ZFS with EHCC                                       |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.HW                                                |ZFS Storage                                             |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.HW                                                |Zone maps                                               |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.Pillar Storage                                    |Pillar Storage                                          |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
CDB$ROOT                      |.Pillar Storage                                    |Pillar Storage with EHCC                                |NO_CURRENT_USAGE        |2018.09.01_06.37.39| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |

CON_NAME                      |PRODUCT                                            |FEATURE_BEING_USED                                      |USAGE                   |LAST_SAMPLE_DATE   |      DBID|VERSION    |DETECTED_USAGES|TOTAL_SAMPLES|CURRENTLY_USED|FIRST_USAGE_DATE   |LAST_USAGE_DATE    |EXTRA_FEATURE_INFO
------------------------------|---------------------------------------------------|--------------------------------------------------------|------------------------|-------------------|----------|-----------|---------------|-------------|--------------|-------------------|-------------------|--------------------------------------------------------------------------------
ANJOPDB1                      |Active Data Guard                                  |Active Data Guard - Real-Time Query on Physical Standby |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Active Data Guard                                  |Global Data Services                                    |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Analytics                                 |Data Mining                                             |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Advanced Index Compression                              |SUPPRESSED_DUE_TO_BUG   |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Backup HIGH Compression                                 |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Backup LOW Compression                                  |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Backup MEDIUM Compression                               |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Backup ZLIB Compression                                 |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Data Guard                                              |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |HeapCompression                                         |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Heat Map                                                |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Hybrid Columnar Compression Row Level Locking           |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Information Lifecycle Management                        |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Oracle Advanced Network Compression Service             |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Oracle Utility Datapump (Export)                        |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |Oracle Utility Datapump (Import)                        |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              5|           31|FALSE         |2018.02.17_09.22.16|2018.03.17_11.41.30|
ANJOPDB1                      |Advanced Compression                               |SecureFile Compression (user)                           |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Compression                               |SecureFile Deduplication (user)                         |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Security                                  |Data Redaction                                          |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Security                                  |Encrypted Tablespaces                                   |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Security                                  |Oracle Utility Datapump (Export)                        |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Security                                  |Oracle Utility Datapump (Import)                        |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              5|           31|FALSE         |2018.02.17_09.22.16|2018.03.17_11.41.30|
ANJOPDB1                      |Advanced Security                                  |SecureFile Encryption (user)                            |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Advanced Security                                  |Transparent Data Encryption                             |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Database In-Memory                                 |In-Memory Aggregation                                   |CURRENT_USAGE           |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |             14|           31|TRUE          |2018.06.02_18.28.39|2018.09.01_18.37.40|
ANJOPDB1                      |Database In-Memory                                 |In-Memory Column Store                                  |CURRENT_USAGE           |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |             14|           31|TRUE          |2018.06.02_18.28.39|2018.09.01_18.37.40|
ANJOPDB1                      |Database Vault                                     |Oracle Database Vault                                   |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Database Vault                                     |Privilege Capture                                       |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Diagnostics Pack                                   |ADDM                                                    |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Diagnostics Pack                                   |AWR Baseline                                            |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Diagnostics Pack                                   |AWR Baseline Template                                   |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Diagnostics Pack                                   |AWR Report                                              |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Diagnostics Pack                                   |Automatic Workload Repository                           |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Diagnostics Pack                                   |Baseline Adaptive Thresholds                            |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Diagnostics Pack                                   |Baseline Static Computations                            |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Diagnostics Pack                                   |EM Performance Page                                     |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Label Security                                     |Label Security                                          |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |OLAP                                               |OLAP - Analytic Workspaces                              |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |OLAP                                               |OLAP - Cubes                                            |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Partitioning                                       |Partitioning (user)                                     |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Partitioning                                       |Zone maps                                               |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |RAC or RAC One Node                                |Quality of Service Management                           |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Real Application Clusters                          |Real Application Clusters (RAC)                         |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Real Application Clusters One Node                 |Real Application Cluster One Node                       |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Real Application Testing                           |Database Replay: Workload Capture                       |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Real Application Testing                           |Database Replay: Workload Replay                        |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Real Application Testing                           |SQL Performance Analyzer                                |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Spatial and Graph                                  |Spatial                                                 |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Tuning Pack                                        |SQL Access Advisor                                      |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Tuning Pack                                        |SQL Monitoring and Tuning pages                         |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Tuning Pack                                        |SQL Profile                                             |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |Tuning Pack                                        |SQL Tuning Advisor                                      |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.Database Gateway                                  |Gateways                                                |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.Database Gateway                                  |Transparent Gateway                                     |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.Exadata                                           |Cloud DB with EHCC                                      |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.Exadata                                           |Exadata                                                 |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.GoldenGate                                        |GoldenGate                                              |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.HW                                                |Hybrid Columnar Compression                             |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.HW                                                |Hybrid Columnar Compression Conventional Load           |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.HW                                                |Hybrid Columnar Compression Row Level Locking           |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.HW                                                |Sun ZFS with EHCC                                       |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.HW                                                |ZFS Storage                                             |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.HW                                                |Zone maps                                               |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.Pillar Storage                                    |Pillar Storage                                          |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |
ANJOPDB1                      |.Pillar Storage                                    |Pillar Storage with EHCC                                |NO_CURRENT_USAGE        |2018.09.01_18.37.40| 380093466|12.2.0.1.0 |              0|           31|FALSE         |                   |                   |

USER is "SYS"

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
DESCRIPTION:
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
The two reports, PRODUCT USAGE and FEATURE USAGE DETAILS, provide usage statistics for Database Options, Management Packs
and their corresponding features.
Information is extracted from DBA_FEATURE_USAGE_STATISTICS view.

DBA_FEATURE_USAGE_STATISTICS view is updated once a week, so it may take up to 7 days for the report to reflect usage changes.
DBA_FEATURE_USAGE_STATISTICS view contains a different set of entries for each VERSION and DBID occurring in the database history.
The weekly refresh process updates only the current row set.

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
NOTES:
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
The report lists all detectable products and features, used or not used.
The CURRENTLY_USED column in the DBA_FEATURE_USAGE_STATISTICS view indicates if the feature in question was used during the last sampling interval
or is used at the refresh moment.
CURRENT_USAGE represents usage tracked over the last sample period, which defaults to one week.
PAST_OR_CURRENT_USAGE example: Datapump Export entry indicates CURRENTLY_USED='TRUE' and FEATURE_INFO "compression used" counter
indicates a non zero value that could have been triggered by past or current (last week) usage.
For historical details check FIRST_USAGE_DATE, LAST_USAGE_DATE, LAST_SAMPLE_DATE, TOTAL_SAMPLES, DETECTED_USAGES columns
Leading dot (.) denotes a product that is not a Database Option or Database Management Pack

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
DISCLAIMER:
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Information provided by the reports is to be used for informational purposes only and does not represent your license entitlement or requirement.
The usage data may indicate, in some cases, false positives.
This may be due to inclusion of usage by sample schemas (such as HR, PM, SH...) or system/internal usage.

Please refer to MOS DOC ID 1317265.1 and 1309070.1 for more information.

End of script (v 18.1 Apr-2018)

Oracle 12.1 – Find OCR Master Node

I’ve been dealing with a problem where, sometimes, a rebooted RAC node is unable to join back the cluster. The issue seems to be with the “Master Node”, which refuses to accept the node.

So I’ve to know which is the “Master Node” (the current known solution is to reboot it, and then all nodes join the cluster).

There is the Oracle note: How to Find OCR Master Node (Doc ID 1281982.1)

And there is this blog entry: 11G R2 RAC: How to identify the master node in RAC

In my case I’m using Oracle 12.1.0.2, the location of the files is a bit different. The location of the OCR Master Node can be found on this version using one of the following ways:

  • Check the crsd logs for “OCR MASTER”
grep "OCR MASTER" ${ORACLE_BASE}/diag/crs/`hostname`/crs/trace/crsd*

and, if the logs did not rotate too much yet, you should see one of the two below:

/u00/app/oracle/diag/crs/anjovm1/crs/trace/crsd_73.trc:2018-01-13 14:05:30.535186 :  OCRMAS:3085: th_master:13: I AM THE NEW OCR MASTER at incar 2. Node Number 1

/u00/app/oracle/diag/crs/anjovm2/crs/trace/crsd_71.trc:2018-01-13 14:05:32.823231 :  OCRMAS:3085: th_master: NEW OCR MASTER IS 1
  • Check the location of the OCR automatic backups

the cluster node currently keeping the backups, is the OCR master node. If you see older backups on other nodes, it was when they were OCR master nodes on its turn.

ls -l /u00/app/12.1.0.2/grid/cdata/<cluster_name>
-rw-r--r--    1 root     system      943266 Jan  14 00:01 backup00.ocr
-rw-r--r--    1 root     system      943266 Jan 13 20:01 backup01.ocr
-rw-r--r--    1 root     system      943266 Jan 13 16:01 backup02.ocr
-rw-r--r--    1 root     system      943266 Jan 13 00:00 day.ocr
-rw-r--r--    1 root     system      943266 Jan  14 00:01 day_.ocr
-rw-r--r--    1 root     system      943266  Dec 31 23:55 week.ocr
-rw-r--r--    1 root     system      943266 Jan 07 23:59 week_.ocr

Note: do not confuse the OCR master node with the Cluster Health Monitor repository master node, which you get using the command:

/u00/app/12.1.0.2/grid/bin/oclumon manage -get MASTER

 


Check Advanced Compression option usage on Oracle database

To check if the “advanced compression” Oracle database option was used on your environment is not so easy, as there are several activities that can activate this option.

For example for a mix Oracle 11.2.0.4 and 12.1.0.2 environment we can use the following query:

select * from DBA_FEATURE_USAGE_STATISTICS
where ((name like '%Compress%' and name not in ('Backup BASIC Compression','Backup BZIP2 Compression','SecureFile Compression (system)')) 
  and detected_usages>0)
or (name='Data Guard' and FEATURE_INFO like '%Compression used: TRUE%')
or (name in ('Oracle Utility Metadata API','Oracle Utility Datapump (Export)','Oracle Utility Datapump (Import)') 
  and version like '11.2.%' and feature_info not like '%compression used: 0 times%')
or (name in ('Oracle Utility Metadata API','Oracle Utility Datapump (Import)') 
  and version like '12.%' and feature_info like '%compression%')
or (name in ('Oracle Utility Datapump (Export)') 
  and version like '12.%' and feature_info not like '%compression used: 0 times%');

Why do we need so many filters? Because the text that shows if compression was used changes depending on the utility and Oracle version!
Below 3 different examples when compression was not used:

Version Utilities FEATURE_INFO text
12.1 Oracle Utility Datapump (Export) invoked: 1 times, compression used: 0 times (BASIC algorithm used: 0 times, LOW algorithm used: 0 times, MEDIUM algorithm used: 0 times, HIGH algorithm used: 0 times), encryption used: 0 times (AES128 algorithm used: 0 times, AES192 algorithm used: 0 times, AES256 algorithm used: 0 times, PASSWORD mode used: 0 times, DUAL mode used: 0 times, TRANSPARENT mode used: 0 times), parallel used: 0 times, full transportable used: 0 times
12.1 Oracle Utility Datapump (Import)

Oracle Utility Metadata API

invoked: 1 times, parallel used: 0 times, full transportable used: 0 times
11.2 Oracle Utility Metadata API invoked: 1 times, compression used: 0 times, encryption used: 0 times

Also, seems that for “Data Guard” utility the text has capital letters “%Compression used: TRUE%”.

More information about which features enable the usage of Advanced Compression option can be find here.

And how to avoid the usage of the Advanced Compression option by error on Mathias Zarick blog.


Goldengate 12.2 – ERROR OGG-00041 Data source not specified.

While testing the new Goldengate 12.2 with a training material I’ve been doing, I got the error:

2016-03-29 15:36:00 ERROR OGG-00041 Data source not specified. 
2016-03-29 15:36:00 ERROR OGG-01668 PROCESS ABENDING.

This when configuring the most simple integrated extract.

Looking at the ggserr.log did not gave any other idea.

After opening a SR with Oracle, I decided to try the same configuration on Goldengate 12.1. And to my surprise the error was “clearer”:

2016-03-29 16:15:51 ERROR OGG-00303 Unrecognized parameter (EXTRACT e_hr).

Immediatly it come to my mind that the problem was related to my copy/paste from powerpoint (training material I’m doing) to the putty window. Doing ‘:set list’ in vi did not show any strange character, but after recreating the extract parameter file from scratch with exactly the same parameters, it worked like a charm.

Go back test on Goldengate 12.2 and no error either.

So, if you have OGG-00041 error, it can be just that Goldengate is not interpreting well the parameter file.

Meanwhile, another problem on Goldengate 12.2 is that it crashes when you delete an extract while connected to a database.