Oracle Apps DBA

My photo
More than 5+ Years of IT Experience in administering Enterprise wide Multi Vendor UNIX Servers, Oracle Databases (8i to 11gR2), Middle-tiers, Applications and Clusters. I am a Sun Certified System Administrator (SCSA) for Solaris 10, oracle 10g database certified associate(OCA), Oracle 10g Database certified professional (OCP) and Oracle E-Business suite R12 certified professionl(OCP)

Oracle Database and Applications

Thursday, 3 January 2019

EBS R12.2 addnode.sh - RC-50208: Exception in method TimedProcessProcess.run


Oracle EBS R12.2 is a highly scalable software package and the application can be scale up to multiple servers based on the business requirements. I encountered below error message while adding additonal server to an newly cloned EBS Environment.



Verifying: pairsfile /apps/appspre/UAT/fs2/inst/apps/UAT_erpnode1/appl/admin/pairsnode02.txt


Verifying: Run file system AdminServer is running

Validated the passed arguments for the option ebs-get-serverstatus
AdminServer is in RUNNING mode.

.end std out.

.end err out.

Script Executed in 2302 milliseconds, returning status 0
run AdminServer is RUNNING
Verifying: Patch file system AdminServer is running
RC-50208: Exception  in method TimedProcessProcess.run
Raised by oracle.apps.ad.util.TimedProcess$TimedProcessProcess: java.io.IOException: Cannot run program "/apps/NTISPROD/fs1/F
MW_Home/webtier/perl/bin/perl": error=2, No such file or directory

Exception in TimedProcess...Failed to  execute command = /apps/NTISPROD/fs1/FMW_Home/webtier/perl/bin/perl  -I/apps/NTISPROD/
fs1/FMW_Home/webtier/perl/lib/5.10.0 -I/apps/NTISPROD/fs1/FMW_Home/webtier/perl/lib/site_perl/5.10.0 -I/apps/NTISPROD/fs1/EBS
apps/appl/au/12.0.0/perl -I/apps/NTISPROD/fs1/FMW_Home/webtier/ohs/mod_perl/lib/site_perl/5.10.0/x86_64-linux-thread-multi /a
pps/NTISPROD/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/adProvisionEBS.pl ebs-get-serverstatus -contextfile=/apps/appspre/NTISP
RE/fs2/EBSapps/comn/clone/context/apps/patch/CTXORIG.xml -logfile=/apps/appspre/UAT/fs2/EBSapps/comn/clone/bin/../FMW/log
s/sfslog/run/RCloneSFSAddNode_05011230.log -servername=AdminServer -promptmsg=hide
Script Executed in 101 milliseconds, returning status -1
ERROR: patch file system AdminServer is not running
ERROR: run addNode Failed in validation stageerifying: pairsfile /apps/appspre/UAT/fs2/inst/apps/UAT_erpnode1/appl/admin/pairsnode02.txt


As per the error message  admin server on patch file system is not running, but actually its running on patch fs.

Cause:

The root cause for this problem is adpreclone.pl file is not executed on source system, here source system means your "primary" application node.

Execute "adpreclone.pl" on both RUN and PATCH file system and then proceed with  the addnode procedure.

Hope it helps :)

Thanks for reading.

regards,
X A H E E R



Thursday, 15 November 2018

INS - 40937 The following host names are invalid

We are trying to install and configure two node Oracle Grid infrastructure 12.1.0.2 for one of our customer, but there was an issue with on of the cluster node and installation cannot proceed further.

All pre-reqs checks were successful, we tested ssh it was working fine. Even nodes communication was working without any issues from both the nodes.

Error Screen Shot:


Its a very generic error that points to invalid hostname, but honestly hostname was defined correctly.

After lot of troubleshooting we found solution, there was problem with "hostname -i", when we see the hostname IP address it was pointing to IP Address + MAC address which is not correct.

After fixing this issue installation completed with any issues.

Hope it helps, thanks for reading. 


Monday, 2 February 2015

adcfgclone.pl on appsTier failed with "AC-50207: Fatal: Failed to execute one or more of the config tools during Context Value Management"

Oracle EBS R12.1.3 clone configuration script failing while configuring config tools. This issue is reported on OracleEBS running on IBM-AIX 6.1.

Environment details:

OS Version             => IBM-AIX 6.1 (64-Bit)
EBS version           => R12,1.3
Database Version   => 11.2.0.1

Error Stack while running adcfgclone.pl on appsTier:
Setting LIBPATH to /oratest/R12_app/apps_st/comn/clone/oui/lib/aix

Beginning application tier Apply - Mon Feb  2 11:11:30 2015

/oratest/R12_app/apps_st/comn/clone/bin/../jre/bin/java -Xmx600M -DCONTEXT_VALIDATED=true  -Doracle.installer.oui_loc=/oui -classpath /oratest/R12_app/apps_st/comn/clone/jlib/xmlparserv2.jar:/oratest/R12_app/apps_st/comn/clone/jlib/ojdbc14.jar:/oratest/R12_app/apps_st/comn/clone/jlib/java:/oratest/R12_app/apps_st/comn/clone/jlib/oui/OraInstaller.jar:/oratest/R12_app/apps_st/comn/clone/jlib/oui/ewt3.jar:/oratest/R12_app/apps_st/comn/clone/jlib/oui/share.jar:/oratest/R12_app/apps_st/comn/clone/jlib/oui/srvm.jar:/oratest/R12_app/apps_st/comn/clone/jlib/ojmisc.jar  oracle.apps.ad.clone.ApplyAppsTier -e /oratest/R12_app/inst/apps/test_testerp/appl/admin/test_testerp.xml -stage /oratest/R12_app/apps_st/comn/clone    -showProgress
APPS Password : Log file located at /oratest/R12_app/inst/apps/test_testerp/admin/log/ApplyAppsTier_02021111.log
  -     50% completed
AC-50207: Fatal: Failed to execute one or more of the config tools during Context Value Management
Deactivating Context Value Management System.
Restored the Context file in :
        /oratest/R12_app/inst/apps/test_testerp/appl/admin/test_testerp.xml

Aborting the running of Context Value Management
Error occured before Context Value Management could be completed
  -     73% completed


ERROR while running Apply...
Mon Feb  2 11:23:23 2015

 ERROR: Failed to execute /oratest/R12_app/apps_st/comn/clone/bin/adclone.pl

 Please check logfile.
[oratest@testerp[/oratest/R12_app/apps_st/comn/clone/bin]#

Error stack from ApplyAppsTier logfile:
Executing script in InstantiateFile:
/oratest/R12_app/tech_st/10.1.2/appsutil/clone/adlnktools.sh

script returned:
****************************************************

adlnktools.sh started at Mon Feb  2 11:15:12 SAUST 2015
Log file located at /oratest/R12_app/inst/apps/test_testerp/logs/ora/10.1.2/install/make_02021115.log

Error while running adlnktools.sh.
  return code = .16.17.18.21.22.23.24.25.32.33.34.36.37.38
Please check logfile located at /oratest/R12_app/inst/apps/test_testerp/logs/ora/10.1.2/install/make_02021115.log


.end std out.

SCRIPT RETURNED:
##########################################################################
                   Handle Appl_Top name changes, if any...
##########################################################################
ERROR: Invalid java version found:
        Unhandled exception
Type=Segmentation error vmState=0xffffffff
J9Generic_Signal_Number=00000004 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000033
Handler1=F227F230 Handler2=F227A7F0
R0=FFFFFFFF R1=30111F20 R2=F20083C4 R3=30133F08
R4=00080000 R5=301351F8 R6=30135250 R7=301352A8
R8=30135300 R9=30135358 R10=301353B0 R11=30135460
R12=D8F6A4DC R13=F22714A0 R14=10011B48 R15=3000EEA0
R16=0000653D R17=7953697A R18=656D6F72 R19=6563744D
R20=78446972 R21=FFFFFFF8 R22=00000014 R23=00000010
R24=30115AE0 R25=F227B7B8 R26=00000002 R27=F2272078
R28=00000000 R29=00000000 R30=00000000 R31=00000000
IAR=D8F6A4E0 LR=D8F6A4DC MSR=0000D032 CTR=00000000
CR=42000224 FPSCR=00000000 XER=00000000 TID=00000000
MQ=00000000
FPR0 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR1 ffffffffffffffff (f: 4294967296.000000, d: -NaNQ)
FPR2 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR3 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR4 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR5 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR6 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR7 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR8 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR9 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR10 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR13 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
FPR16 0000000000000000 (f: 0.000000, d: 0.000000e+00)

Error Stack in make logfile:
make: The error code from the last command is 255.


Stop.
Failed linking target nmei on Mon Feb  2 11:18:22 SAUST 2015...
/oratest/R12_app/tech_st/10.1.2/sysman/lib
        ld  -o /oratest/R12_app/tech_st/10.1.2/sysman/lib/emagtm -L/oratest/R12_app/tech_st/10.1.2/lib32/ -L/oratest/R12_app/tech_st/10.1.2/sysman/lib32/ -L/
oratest/R12_app/tech_st/10.1.2/lib32/stubs/   -lld -lm `cat /oratest/R12_app/tech_st/10.1.2/lib32/sysliblist`  -lm  `if [ "\`/usr/bin/uname -v\`" = "4" ]; \
        then echo "-bI:/oratest/R12_app/tech_st/10.1.2/lib/pw-syscall.exp"; fi;` -brtl -bexpall /oratest/R12_app/tech_st/10.1.2/sysman/lib32//s0nmum.o -lnmum
  -lttsh10 -L/oratest/R12_app/tech_st/10.1.2/lib32  -L/oratest/R12_app/tech_st/10.1.2/sysman/lib32/ -lnmemso -L/oraprod/R12/apps/tech_st/10.1.2/jdk/jre/bin/c
lassic -L/oraprod/R12/apps/tech_st/10.1.2/jdk/jre/bin -blazy -ljava -ljvm
ld: 0706-006 Cannot find or open library file: -l java
        ld:open(): No such file or directory
ld: 0706-006 Cannot find or open library file: -l jvm
        ld:open(): No such file or directory
make: The error code from the last command is 255.


Cause:
It was unable perform re-linking of libraries from 10.1.2 home and hence adcfgclone.pl error-ed out and unable to configure the config home (10.1.2/10.1.3)

On Investigation we found that "LDR_CNTRL" environment variable is set and due to this clone script was unable to perform re-linking of the libraries.

Solution:
unset the environment variable  "LDR_CNTRL" and re run adcfgclone.pl appTier. It should solve the Issue. Please verify log files for errors.

[oratest@testerp[/oratest]#echo $LDR_CNTRL
MAXDATA=0x40000000

- In my environment this value was configured in .profile file. Simply comment these entries

[oratest@testerp[/oratest]#grep LDR_CNTRL .profile
#LDR_CNTRL="MAXDATA=0x40000000"
#export LDR_CNTRL
[oratest@testerp[/oratest]#

- Make sure the below command does not return any value

[oratest@testerp[/oratest]#echo $LDR_CNTRL

[oratest@testerp[/oratest]#

- Re run adcfgclone.pl script:

[oratest@testerp[/oratest/R12_app/apps_st/comn/clone/bin]#perl adcfgclone.pl appsTier /oratest/R12_app/inst/apps/test_testerp/appl/admin/test_testerp.xml

                     Copyright (c) 2002 Oracle Corporation
                        Redwood Shores, California, USA

                        Oracle Applications Rapid Clone

                                 Version 12.0.0

                      adcfgclone Version 120.31.12010000.8

Enter the APPS password :


Running Rapid Clone with command:
perl /oratest/R12_app/apps_st/comn/clone/bin/adclone.pl java=/oratest/R12_app/apps_st/comn/clone/bin/../jre mode=apply stage=/oratest/R12_app/apps_st/comn/clone component=appsTier method=CUSTOM appctxtg=/oratest/R12_app/inst/apps/test_testerp/appl/admin/test_testerp.xml showProgress contextValidated=false
Running:
perl /oratest/R12_app/apps_st/comn/clone/bin/adclone.pl java=/oratest/R12_app/apps_st/comn/clone/bin/../jre mode=apply stage=/oratest/R12_app/apps_st/comn/clone component=appsTier method=CUSTOM appctxtg=/oratest/R12_app/inst/apps/test_testerp/appl/admin/test_testerp.xml showProgress contextValidated=false
APPS Password :
Setting LIBPATH to /oratest/R12_app/apps_st/comn/clone/oui/lib/aix

Beginning application tier Apply - Mon Feb  2 11:36:20 2015

/oratest/R12_app/apps_st/comn/clone/bin/../jre/bin/java -Xmx600M -DCONTEXT_VALIDATED=false  -Doracle.installer.oui_loc=/oui -classpath /oratest/R12_app/apps_st/comn/clone/jlib/xmlparserv2.jar:/oratest/R12_app/apps_st/comn/clone/jlib/ojdbc14.jar:/oratest/R12_app/apps_st/comn/clone/jlib/java:/oratest/R12_app/apps_st/comn/clone/jlib/oui/OraInstaller.jar:/oratest/R12_app/apps_st/comn/clone/jlib/oui/ewt3.jar:/oratest/R12_app/apps_st/comn/clone/jlib/oui/share.jar:/oratest/R12_app/apps_st/comn/clone/jlib/oui/srvm.jar:/oratest/R12_app/apps_st/comn/clone/jlib/ojmisc.jar  oracle.apps.ad.clone.ApplyAppsTier -e /oratest/R12_app/inst/apps/test_testerp/appl/admin/test_testerp.xml -stage /oratest/R12_app/apps_st/comn/clone    -showProgress
APPS Password : Log file located at /oratest/R12_app/inst/apps/test_testerp/admin/log/ApplyAppsTier_02021136.log
  |      0% completed
Log file located at /oratest/R12_app/inst/apps/test_testerp/admin/log/ApplyAppsTier_02021136.log
  -     78% completed

Completed Apply...
Mon Feb  2 11:51:30 2015


Do you want to startup the Application Services for test? (y/n) [y] : n

Services not started

[oratest@testerp[/oratest/R12_app/apps_st/comn/clone/bin]#

This time clone configuration script completed successfully without any Issues. This issue may be specific to AIX Operating system. Similar Issue can be reported on AIX systems for Oracle EBS R12.2/R12.1/R12.0 while running autoconfig. So make sure that listed above environment variable is not configured while running adconfig.sh/adautocfg.sh script.

thanks for reading :)

regards,
X A H E E R