Oracle Apps DBA

My Photo
More than 5+ Years of IT Experience in administering Enterprise wide Multi Vendor UNIX Servers, Oracle Databases (8i to 11gR2), Middle-tiers, Applications and Clusters. I am a Sun Certified System Administrator (SCSA) for Solaris 10, oracle 10g database certified associate(OCA), Oracle 10g Database certified professional (OCP) and Oracle E-Business suite R12 certified professionl(OCP)

Oracle Database and Applications

Monday, 13 October 2014

UPLOAD_SYSTEM Threshold (UploadMaxNumberXML: 5000) exceeded with 5698 files) EM 12c Agent

I was facing  Issues on Oracle Enterprise Manager cloud control agent with Error "UPLOAD_SYSTEM Threshold (UploadMaxNumberXML: 5000) exceeded with 5698 files)" for command "emctl status agent"

I tried to stop/start agent but failed to communicate with OMS Server.

This Issue occurred because of incorrect configuration of open files. You need to properly configure the value for open files. I encountered this Issue on Oracle Solaris 10 OS. This Issue can also be encountered on other unix/linux flavour .

Output for command "emctl status agent":

[oemagent@oradb01][/oem/OEMAGENT/agent/agent_inst/bin]# ./emctl status agent
Oracle Enterprise Manager Cloud Control 12c Release 2
Copyright (c) 1996, 2012 Oracle Corporation.  All rights reserved.
---------------------------------------------------------------
Agent Version     : 12.1.0.2.0
OMS Version       : (unknown)
Protocol Version  : 12.1.0.1.0
Agent Home        : /oem/OEMAGENT/agent/agent_inst
Agent Binaries    : /oem/OEMAGENT/agent/core/12.1.0.2.0
Agent Process ID  : 23697
Parent Process ID : 23413
Agent URL         : https://oradb01:3872/emd/main/
Repository URL    : https://oemserver1.orasol.com:4901/empbs/upload
Started at        : 2014-10-12 08:49:40
Started by user   : oemagent
Last Reload       : (none)
Last successful upload                       : (none)
Last attempted upload                        : (none)
Total Megabytes of XML files uploaded so far : 0
Number of XML files pending upload           : 5,719
Size of XML files pending upload(MB)         : 5.48
Available disk space on upload filesystem    : 50.79%
Collection Status                            : [COLLECTIONS_HALTED(
  UPLOAD_SYSTEM Threshold (UploadMaxNumberXML: 5000) exceeded with 5698 files)]
Heartbeat Status                             : Agent is blocked
Last attempted heartbeat to OMS              : 2014-10-12 09:40:33
Last successful heartbeat to OMS             : (none)
Next scheduled heartbeat to OMS              : 2014-10-12 09:43:33

---------------------------------------------------------------
Agent is Running and Ready



Solution:

1) Stop agent
2) Increase ulimit value
3) unblock agent
4) start agent
5) upload to OMS
6) check agent status


1) Stop agent

[oemagent@oradb01][/oem/OEMAGENT/agent/agent_inst/bin]# ./emctl stop agent
Oracle Enterprise Manager Cloud Control 12c Release 2
Copyright (c) 1996, 2012 Oracle Corporation.  All rights reserved.
Stopping agent .......... stopped.


2) Increase ulimit value

- Current Value of open files:

[oemagent@oradb01][/oem/OEMAGENT/agent/agent_inst/bin]# ulimit -a
core file size        (blocks, -c) unlimited
data seg size         (kbytes, -d) unlimited
file size             (blocks, -f) unlimited
open files                    (-n) 256
pipe size          (512 bytes, -p) 10
stack size            (kbytes, -s) 8192
cpu time             (seconds, -t) unlimited
max user processes            (-u) 29995
virtual memory        (kbytes, -v) unlimited 

- Increase Value of open files:


[oemagent@oradb01][/oem/OEMAGENT/agent/agent_inst/bin]# ulimit -n 65536
[oemagent@oradb01][/oem/OEMAGENT/agent/agent_inst/bin]# ulimit -a
core file size        (blocks, -c) unlimited
data seg size         (kbytes, -d) unlimited
file size             (blocks, -f) unlimited
open files                    (-n) 65536
pipe size          (512 bytes, -p) 10
stack size            (kbytes, -s) 8192
cpu time             (seconds, -t) unlimited
max user processes            (-u) 29995
virtual memory        (kbytes, -v) unlimited
[oemagent@oradb01][/oem/OEMAGENT/agent/agent_inst/bin]#

3) unblock agent

Navigate to Setup >> Manage clound control >> agent >> 

- Select block agent and unblock target




4) start agent

[oemagent@oradb01][/oem/OEMAGENT/agent/agent_inst/bin]# ./emctl start agent
Oracle Enterprise Manager Cloud Control 12c Release 2
Copyright (c) 1996, 2012 Oracle Corporation.  All rights reserved.
Starting agent ........................................................................................................................... started but not ready.


5) upload to OMS

[oemagent@oradb01][/oem/OEMAGENT/agent/agent_inst/bin]# ./emctl upload

6) check agent status 

[oemagent@oradb01][/oem/OEMAGENT/agent/agent_inst/bin]# ./emctl status agent
Oracle Enterprise Manager Cloud Control 12c Release 2
Copyright (c) 1996, 2012 Oracle Corporation.  All rights reserved.
---------------------------------------------------------------
Agent Version     : 12.1.0.2.0
OMS Version       : 12.1.0.2.0
Protocol Version  : 12.1.0.1.0
Agent Home        : /oem/OEMAGENT/agent/agent_inst
Agent Binaries    : /oem/OEMAGENT/agent/core/12.1.0.2.0
Agent Process ID  : 12790
Parent Process ID : 12532
Agent URL         : https://oradb01:3872/emd/main/
Repository URL    : https://oemserver1.orasol.com:4901/empbs/upload
Started at        : 2014-10-12 11:24:50
Started by user   : oemagent
Last Reload       : (none)
Last successful upload                       : 2014-10-12 11:35:14
Last attempted upload                        : 2014-10-12 11:35:14
Total Megabytes of XML files uploaded so far : 0.03
Number of XML files pending upload           : 146
Size of XML files pending upload(MB)         : 0.17
Available disk space on upload filesystem    : 50.83%
Collection Status                            : Collections enabled
Heartbeat Status                             : Ok
Last attempted heartbeat to OMS              : 2014-10-12 11:35:06
Last successful heartbeat to OMS             : 2014-10-12 11:35:06
Next scheduled heartbeat to OMS              : 2014-10-12 11:36:06

---------------------------------------------------------------
Agent is Running and Ready
[oemagent@oradb01][/oem/OEMAGENT/agent/agent_inst/bin]#

Now the agent is successfully able to communicate with OMS and upload XML.

Thanks for reading.

regards,
X A H E E R

Wednesday, 1 October 2014

using "oracle-rdbms-server-12cR1-preinstall" in Oracle Solaris 11.2

Oracle Solaris 11.2 introduced new package in IPS  "oracle-rdbms-server-12cR1-preinstall".

Users need to check all packages exists on the system before starting the Installation. This preinstall package was first introduced in Oracle Enterprise Linux and now available in Oracle Solaris 11.2. In Oracle Solaris 11.2  its very easy for administrators to install this package and they are not required to check dependencies/version of each and every package.

For Installing "oracle-rdbms-server-12cR1-preinstall"  package your solaris IPS repository should be configured. IPS can be configured via Internet or can be configured on your local file system.

For more information on configuring IPS locally please refer my earlier blogpost:

Configure IPS on Oracle Solaris11.2 Locally

Check for IPS repository publisher

root@solaris11-2:~# pkg publisher
PUBLISHER                   TYPE     STATUS P LOCATION
solaris                     origin   online F file:///IPS/
root@solaris11-2:~# 

Search for Preinstall package for Database 12c


root@solaris11-2:~# pkg search 12c
INDEX       ACTION VALUE                                        PACKAGE
pkg.summary set    Prerequisite package for Oracle Database 12c pkg:/group/prerequisite/oracle/oracle-rdbms-server-12cR1-preinstall@0.5.11-0.175.2.0.0.37.4


Install "oracle-rdbms-server-12cR1-preinstall" package:


root@solaris11-2:~# pkg install oracle-rdbms-server-12cR1-preinstall
           Packages to install:  1
       Create boot environment: No
Create backup boot environment: No

DOWNLOAD                                PKGS         FILES    XFER (MB)   SPEED
Completed                                1/1           3/3      0.0/0.0    0B/s

PHASE                                          ITEMS
Installing new actions                         13/13
Updating package state database                 Done 
Updating package cache                           0/0 
Updating image state                            Done 
Creating fast lookup database                   Done 
Updating package cache                           1/1 
root@solaris11-2:~# 


Verify  "oracle-rdbms-server-12cR1-preinstall" package:


root@solaris11-2:~# pkg info oracle-rdbms-server-12cR1-preinstall
          Name: group/prerequisite/oracle/oracle-rdbms-server-12cR1-preinstall
       Summary: Prerequisite package for Oracle Database 12c
   Description: Provides the set of Oracle Solaris packages required for
                installation and operation of Oracle Database 12.
      Category: Meta Packages/Group Packages
         State: Installed
     Publisher: solaris
       Version: 0.5.11
 Build Release: 5.11
        Branch: 0.175.2.0.0.37.4
Packaging Date: April 23, 2014 04:44:39 PM 
          Size: 5.46 kB
          FMRI: pkg://solaris/group/prerequisite/oracle/oracle-rdbms-server-12cR1-preinstall@0.5.11,5.11-0.175.2.0.0.37.4:20140423T164439Z
root@solaris11-2:~# 


Installation of "oracle-rdbms-server-12cR1-preinstall" now we will verify the installer pre-requisite check for Grid as well as database.

Execute Installer for 12cR1 Grid Infrastructure & 12cR1 Database

:






- The Installer has passed for all package checks for Grid Infrastructure and Database.

Thanks for reading.

regards,
X A H E E R

Sunday, 28 September 2014

Configure IPS Repository on Oracle Solaris 11.2

Its been some time now Oracle released new version of Solaris "Oracle Solaris 11.2".  There are litlle changes in the configuration of repository on Solaris 11.2 compare to Solaris 11.1.

In this article i will demonstrate configuration of  Local IPS repository on Oracle Solaris 11.2

Steps:

1) Download files required for building a repository:

http://www.oracle.com/technetwork/server-storage/solaris11/downloads/local-repository-2245081.html



- Download all files

2)  Create ISO image for all downloaded files. 




- We can use "winscp" or virtualbox "share folder" option as well to move these files to the server.

3) Copy files into a single directory  from the media:







- All files has been copied in /sw_home/sol11_2_images directory

4)  Execute script "install-repo.ksh" for building repository

This "install-repo.ksh" script is introduced in solaris 11.2 whereas in solaris 11.1 we need to manually concatenate both image files.





- Execute the script from directory where all files are located.

options:
 
 - d is destination directory where repository will be created
 - I will create an ISO image
 - v will verify

5) Configure the repository:

By default repository is configured to http://pkg.oracle.com/solaris. We will change this location to a directory where repo is build.





The repository is configured and packages are now available to install from the repo.

Thanks for reading.

regards,
X A H E E R