ADADMIN UTILITY



ADADMIN UTILITY

In order to ensure that Oracle Applications system runs smoothly, we must perform routine maintenance tasks. We run maintenance tasks from the command line using AD Administration. Once we start this utility, it presents the tasks in menu form, grouped generally by type of activity you will perform. For example, the tasks associated with compiling and reloading Applications database entities are grouped on the same menu.
We can use AD Administration to complete some runtime tasks during or after an installation or upgrade, or any time thereafter.
On a broad level the tasks performed by adadmin can be categorized into database activities and Applications file system management tasks.
Similar to AutoInstall and AutoPatch, adadmin can run parallel workers for most database tasks and some filesystem tasks.

Preliminary Tasks before running Adadmin:
1.      Logging in as applmgr.

2.      Running the environment file.

3.      Verifying if ORACLE_HOME is set properly.

4.      Verifying if ORACLE_SID or TWO_TASK identifies the correct database.

5.      Ensuring that ORACLE_HOME/bin and AD_TOP/bin are in PATH.

6.      Shutting down concurrent managers when relinking certain files or performing certain database tasks.

7.      Ensuring sufficient temporary disk space.




Running Adadmin:
AD Administration asks you some initial questions.
1.      It confirms your APPL_TOP is correct.
Ex: APPL_TOP is set to /u01/oaprod/oaprodappl
2.      It asks for the name of the log file.
By default this is adadmin.log
3.      It asks if we want to receive an email message if adadmin encounters a failure.
4.      Some SQL scripts perform row set processing. Adadmin asks us to set the number of rows these scripts process.

5.      It asks us the type of files we currently have.
Ex: Do you currently have files used for installing or upgrading the database installed in this APPL_TOP [YES] ? YES *


Do you currently have Java and HTML files for HTML-based functionality installed in this APPL_TOP [YES] ? YES *


Do you currently have Oracle Applications forms files installed
in this APPL_TOP [YES] ? YES *


Do you currently have concurrent program files installed in this APPL_TOP [YES] ? YES *

6.      It asks us to confirm the database and database home directory.
7.      It asks for the SYSTEM password. It then determines the username for your Application Object Library user.
8.      It determines the AOL Schema from information in data dictionary and asks for the password of AOL schema.
9.      Adadmin determines other installation information.





ADADMIN MAIN MENU:
The main menu of adadmin presents you with the following six choices

AD Administration Main Menu

--------------------------------------------------

1. Generate Applications Files menu

2. Maintain Applications Files menu

3. Compile/Reload Applications Database Entities menu

4. Maintain Applications Database Entities menu

5. Change Maintenance Mode

6. Exit AD Administration

first two options are related to maintaining applications file system the second two options relate to database activities, the fifth option here is used to put the system in maintenance mode and bring it back from maintenance mode.


1.      Generate Applications Files:

If system users are having difficulty accessing messages, forms, or reports, you may be able to resolve the issue by generating the associated files. Or, when you apply a patch that adds or changes product functionality, you may want to generate the associated files after you apply the patch, instead of running the generate driver during the patching downtime. The generate files tasks may be performed on any server, as required.










Under the Generate Applications Files Menu you can perform the following tasks

Generate Applications Files
----------------------------------------

1. Generate message files

2. Generate form files

3. Generate report files

4. Generate graphics files

5. Generate product JAR files

6. Return to Main Menu



a)      Generate Message Files:
Oracle Applications uses these files to display messages. This task generates message binary files (extension .msb) from Oracle Application Object Library tables.
Caution: Run this task only when instructed to do so in a patch readme file, or by Oracle Support Services


b)      Generate form files: Generates executable Oracle form files (extension .fmx) from the binary forms definition files (extension .fmb). The definition files are located under AU_TOP, and the executable files are stored under each product’s directory.


c)      Generate report files: Generates the binary Oracle Reports report files (extension .rdf).






Adadmin Prompts for following information :
■ Ask for the number of workers and generate selected objects for selected products in parallel.
■ Display the current character set (from NLS_LANG) and ask if you want to generate form or report objects in this character set.
■ Ask if you want to regenerate Oracle Forms PL/SQL library files, menu files, and executable files. (Form files only.)
■ Ask for the products associated with the form or report objects.
■ Ask if you want to generate specific form or report objects for each selected product.
■ Display the current set of installed languages and ask if you want to generate form or report files in these languages.
■ Create a list of all objects to generate.
■ Display the list of objects to be generated. (Specific objects or all objects.)

d)     Generate Product JAR Files:
Generate Java archive (JAR) files whenever you upgrade the Developer technology stack or when recommended by Oracle Support Services. It signs JAR files (if on the Web server) and does the following:

■ Generates product JAR files in JAVA_TOP and copies them to APPL_TOP.
■ Generates other Java-related files under APPL_TOP and JAVA_TOP.
■ Recreates Java libraries (appsborg.zip and appsborg2.zip) under APPL_TOP and JAVA_TOP.

When you run the task, it prompts: Do you wish to force generation of all jar files? [No] If you choose No, it generates only JAR files that are missing or out-of-date. If you choose Yes, all JAR files are generated.

Note: If AD Administration displays a list of warnings or errors and objects that did not generate successfully and asks if you want to continue as if successful, review the log file to determine if the problems require attention. If you choose not to continue and restart your session at a later time, AD Administration attempts to regenerate only the files that did not generate successfully.

e)      Generate Graphics files:
This task generates Oracle graphics files for all installed languages. Extension of the file name like (*.ogd).


2.      Maintain Applications Files :

Certain maintenance tasks are required to keep your Applications files up to date. For example, you may need to copy product files to a central location or convert files in the APPL_TOP to another character set. These tasks are grouped on the Maintain Applications Files menu.

Under the Maintain Applications Files menu you can perform the following tasks

Maintain Applications Files
----------------------------------------

1. Relink Applications programs

2. Create Applications environment file

3. Copy files to destinations

4. Convert character set

5. Maintain snapshot information

6. Check for missing files

7. Return to Main Menu

a)      Relink Applications programs

Relinks Oracle Applications executable programs with the Oracle server libraries so that they function with the Oracle database. For each product, choose whether to link all executables or only specific ones.
Note: The default is to relink without debug information. Use the debug option only when requested to do so by Oracle Support Services.

b)     Copy files to destinations

Copies files from each product area to central locations where they can be easily referenced by non-Applications programs. This option uses revision-based copy logic to ensure that the destination file versions are the same as, or higher than, the source file versions.

Note: We recommend that you do not use the force option to overwrite existing files unless instructed by Oracle Support Services. Copying files with this option updates all JAR files. JInitiator then downloads required JAR files to each client again, causing runtime performance degradation.


The file types and their respective destinations are shown in the following table:

These files:                                               copied to (UNIX)
Java files                                                   $JAVA_TOP
HTML files                                                $OAH_TOP
Media files                                                 $OAM_TOP

Note: When this option is used to copy reports or graphics files, the default destination is under AU_TOP.

c)      Convert character set:

Prepares the files in the APPL_TOP for conversion to another character set, and then performs the conversion.

When you choose this option, AD Administration presents another submenu, which contains options for scanning your files in preparation for the conversion. The scan searches for exceptions — files that will have incomplete (lossy) conversions — so that you can fix potential problems before you actually convert the character set. Choose one of the following scan options.

1.       Scan the APPL_TOP for exceptions. Scans the APPL_TOP and creates three files in the admin\<SID>\out directory.

File                                                      Contents
admanifest_excp.lst               Lists files that will not be converted because of lossy conversion. admanifest.lst                             Lists files that can be converted.         
admanifest_lossy.lst                   Lists files with lossy conversions, including line by line detail.

Review the files listed in admanifest_excp.lst. Fix files that report lossy conversion before you convert the character set. Repeat this task until there are no entries in admanifest_excp.lst. If you need to see more detail, review admanifest_lossy.lst.

2.       Scan a CUSTOM directory for exceptions. Collects the same information as the first task, but scans custom Applications directories rather than the APPL_TOP directory.
3.       Convert character set. Run this task only if admanifest_excp.lst has no entries. It prompts you for the manifest file (admanifest.lst) created when you ran the scan option(s).

The utility backs up the product source files and the APPL_TOP/admin source files. It saves product files in the <PROD>_TOP directories in the format <prod>_ s_<char_set>.zip. It saves admin source files in the APPL_TOP/admin directory in the format admin_s_<char_set>.zip

d)     Maintain snapshot information:

There are two types of snapshots: APPL_TOP snapshots and global snapshots. An APPL_TOP snapshot lists patches and versions of files in the APPL_TOP. A global snapshot lists patches and latest versions of files in the entire Applications system (that is, across all APPL_TOPs).

Both APPL_TOP snapshots and global snapshots may be either current view snapshots or named view snapshots. A current view snapshot is created once and updated when appropriate to maintain a consistent view. A partial view snapshot allows you to synchronize only selected files from a current view. A named view snapshot is a copy of the current view snapshot at a particular time (not necessarily the latest current view snapshot) and is not updated.

Patch Wizard uses the information contained in the global current view snapshot to determine which patches have already been applied. AutoPatch uses the APPL_TOP current view snapshot to determine if all prerequisite patches have been applied to that APPL_TOP. Snapshot information is stored in the AD_SNAPSHOTS, AD_ SNAPSHOT_FILES, and AD_SNAPSHOT_BUGFIXES tables.

During a new installation, Rapid Install creates a current snapshot as a baseline. And, each time you run AutoPatch, it automatically creates a new (updated) snapshot so that the information is current as of the application of the patch.

Maintain Snapshot Information menu options :

■ List snapshots (stored in the system)
■ Update current view snapshot (full or partial APPL_TOP and global)
■ Create named snapshot (select a current view snapshot to copy and name)
■ Export snapshot to file (select one to export to a text file)
■ Import snapshot from (a text) file
■ Delete named snapshot (select a snapshot for deletion)



Maintain current view snapshot information: When you maintain a current view snapshot, you can choose to synchronize selected files — maintaining a partial snapshot — instead of synchronizing all files for the entire APPL_TOP. Use this option when you have copied only a few files to the APPL_TOP.
1.        Select the Update Current View Snapshot option from the Maintain Snapshot Information menu.
2.        From the Maintain Current View Snapshot Information menu, select one of the following options:
■ Update Complete APPL_TOP This is the original functionality of the Update Current View Snapshot option. It synchronizes all the files in your APPL_TOP.

■ Update JAVA_TOP only Synchronizes only the files in the JAVA_TOP. At the prompt, enter the path to the JAVA_TOP subdirectory where the files were copied. If the files were copied to more than one directory, press Enter. AD Administration scans the entire JAVA_TOP and updates the information in both the current view and the global view snapshots.

■ Update a <PRODUCT>_TOP Synchronizes only the files in a specific <PRODUCT>_TOP. Enter the product abbreviation, then provide the subdirectory information at the prompt. Enter the path to a single subdirectory in the <PRODUCT>_TOP. If the files were copied to more than one directory in the <PRODUCT>_TOP, press Enter. AD Administration scans the entire <PRODUCT>_TOP and updates the information in both the current and the global view snapshots.

e)      Check for Missing Files:
 Verifies that all files needed to run Oracle Applications for the current configuration are in the current APPL_TOP. Choose this task if you suspect there are files missing in your APPL_TOP.



3.  Compile/Reload Applications Database Entities:
To compile or reload database entities, choose the Compile/Reload Applications Database Entities Menu option from the AD Administration Main Menu.           
You run the tasks on this menu any time you need to compile or reload database objects. For example, after you upload new menu entries or apply a patch that changes the setup of flexfields. Run these tasks only on the node where the core AD technology directories (the administration server) are located.
Under the Compile/Reload Applications Database Entities menu you can perform the following tasks

Compile/Reload Applications Database Entities
---------------------------------------------------

1. Compile APPS schema

2. Compile menu information

3. Compile flexfields

4. Reload JAR files to database

5. Return to Main Menu


a)      Compile APPS schema

Spawns parallel workers to compile invalid database objects in the APPS schema.

Note: The need for a separate MRC schema has been removed in this release, as has the associated prompt to run Invoker Rights.

b)     Compile menu information

Compiles menu data structures. Choose this task after you have uploaded menu entries to the FND_MENU_ENTRIES table, or if Compile Security concurrent requests submitted from the Menus form (after changing menu entries) fail for any reason.

AD Administration asks if you want to force compilation of all menus. If you choose the default (No), only menus with changes are compiled. If you enter Yes, all menus are compiled. Compiling all menus is generally not advised.


c)      Compile flexfields

Compiles flexfield data structures in Oracle Application Object Library (FND) tables. Choose this task after you apply a patch that changes the setup of flexfields. Patches usually indicate when you should perform this step.
Flexfields automatically compile data when you use them for the first time, so running this task is not required. However, compiling flexfield data at a specific time (for example, when system use is low), rather than automatically at first use, can alleviate potential runtime performance issues.

d)     Reload JAR files to database

Reloads all appropriate Oracle Applications JAR files into the database. Choose this task if all Oracle Applications Java classes are removed from your database, for example, if the database Java Virtual Machine (JVM) is reloaded because of a corrupt database.



4. Maintain Applications Database Entities:
During normal system use, the integrity of your database can be compromised, for example through user error or after you apply a large patch. It’s a good idea to verify the integrity of database entities as a regular maintenance procedure, or whenever the behavior of your system indicates that database entities may have been corrupted.
Some tasks on this menu report on issues, or potential issues, with database entities, and others actually remedy the issues. Run these tasks only on the node where the core AD technology directories (the administration server) are located.




Under the Maintain Applications Database Entities menu you can perform the following tasks

Maintain Applications Database Entities
---------------------------------------------------

1. Validate APPS schema

2. Re-create grants and synonyms for APPS schema

3. Maintain multi-lingual tables

4. Check DUAL table

5. Maintain Multiple Reporting Currencies schema

6. Return to Main Menu

a)      Validate APPS schema

Verifies the integrity of the APPS schema. It produces a report named <APPS schema name>.lst that lists issues and potential issues, grouped by the action required:

■ Issues you MUST fix (not specific to the APPS schema)
■ Issues you MUST fix (specific to the APPS schema)
■ Issues you may want to address (specific to the APPS schema).

 The report is located in $APPL_TOP/admin/<SID>/out (UNIX), where <SID> is the value of the ORACLE_SID or TWO_TASK variable, or in %APPL_ TOP%\admin\<SID>\out (Windows), where <SID> is the value of the LOCAL variable. Each section of the file contains instructions for resolving the issues that are listed. Most issues can be fixed by either compiling invalid database objects or recreating grants and synonyms.

b)     Re-create grants and synonyms for APPS schema

This task recreates grants and synonyms for the Oracle Applications public schema (APPLSYSPUB), recreates grants on some packages from SYSTEM to APPS, and spawns parallel workers to recreate grants and synonyms linking sequences and tables in the base schemas to the APPS schema.

Typically, you run this task after the Validate APPS schema task has reported issues with missing grants and synonyms.

c)      Maintain multi-lingual tables

Run this task after you add a language. It prompts you for the number of workers, then updates all multilingual tables.

d)     Check DUAL table

Some Oracle Applications products must access the DUAL table. It must exist in the SYS schema and contain exactly one row. This tasks verifies the existence of this table and the single row.

e)      Maintain Multiple Reporting Currencies schema
It invokes PL/SQL packages which maintain database objects for these features. (See admntmls.pls and admntmcr.pls in $AD_TOP/admin/sql)

MRC and MLS are both implemented using "adjunct APPS schemas", meaning a
complete copy of the objects in each APPS schema is replicated (and enhanced,
in some cases) into an APPS_MRC and/or APPS_MLS schema. Whenever a
change is made to an APPS schema, the modifications must be reflected in the
adjunct schemas; otherwise, MRC and MLS functions may fail.
This task is only displayed on the Database Objects menu if you have
Multilingual (MLS) or Multiple Reporting Currency (MRC) functionality currently
installed.

5. Change Maintenance Mode:
Maintenance mode controls the system downtime period by managing user logons. You toggle maintenance mode from enabled to disabled from the Change Maintenance Mode menu.


Under the Change Maintenance Mode you can do the following

Change Maintenance Mode
----------------------------------------

Maintenance Mode is currently: [Disabled].


Maintenance mode should normally be enabled when patching Oracle Applications and disabled when users are logged on to the system. See the Oracle Applications Maintenance Utilities manual for more information about maintenance mode.

Please select an option:

1. Enable Maintenance Mode

2. Disable Maintenance Mode

3. Return to Main Menu

If you notice the message this menu selection also shows the maintenance status (disabled in our case) of the system.

You can also forcefully exit adadmin at any point of time by typing 'abort’, This will however result in a unclean exit of adadmin and the next time when you run adadmin you will be prompted with the option to start fresh or continue with the previous session as described earlier.







The arguments and options that you can use to refine the operation of a utility are listed, along with a brief description of how they work. Here’s an excerpt from the command line help for AD Administration.


* <localworkers> = Used in Distributed AD. The number of workers to run on the local machine.
* <flags> = Generic flags passed to AD utilities. The available values for Adadmin are hidepw and trace.
* <defaultsfile> = The defaults file name that is located under $APPL_TOP/admin/SID/ directory.
* <menu_option> = Skips the menu in Adadmin and executes the task

Usage:  adadmin [help=y]

adadmin [printdebug=y|n][localworkers=<localworkers>]
   [flags=hidepw|trace]

adadmin Non-Interactive mode
[defaultsfile=<$APPL_TOP/admin/SID/defaultsfile>]   [logfile=<logfile>][interactive=y|n]                                       [workers=<workers>][menu_option=<TASK_NAME>][restart=y|n]






The following table lists the menu options and the corresponding menu tasks:

Menu Option                                     Corresponding AD Administration Menu Choice
GEN_MESSAGES                            Generate message files
GEN_FORMS                                    Generate form files
GEN_REPORTS                                Generate reports files
GEN_JARS                                        Generate product JAR files
RELINK                                             Relink Applications programs
COPY_FILES                                    Copy files to destinations
CONVERT_CHARSET                    Convert character set
SCAN_APPLTOP                              Scan the APPL_TOP for exceptions
SCAN_CUSTOM_DIR                     Scan a CUSTOM directory for exceptions
LIST_SNAPSHOT                             List snapshots
UPDATE_CURRENT_VIEW          Update current view snapshot
CREATE_SNAPSHOT                     Create named snapshot
EXPORT_SNAPSHOT                     Export snapshot to file
IMPORT_SNAPSHOT                      Import snapshot from file
DELETE_SNAPSHOT                      Delete named snapshot
CHECK_FILES                                 Check for missing files
CMP_INVALID                                Compile APPS schema
CMP_MENU                                      Compile menu information
CMP_FLEXFIELDS                                     Compile flexfield data in AOL tables
RELOAD_JARS                                Reload JAR files to database
VALIDATE_APPS                            Validate APPS schema
CREATE_GRANTS                          Recreate grants and synonyms for APPS schema
Menu Option                                     Corresponding AD Administration Menu Choice
MAINTAIN_MLS                             Maintain multi-lingual tables
CHECK_DUAL                                 Check DUAL table
ENABLE_MAINT_MODE               Enable Maintenance Mode
DISABLE_MAINT_MODE                         Disable Maintenance Mode


Output Post Processor (OPP) in Oracle Applications R12 and 11i



Output Post Processor (OPP) in Oracle Applications R12 and 11i


What is Output Post Processor?

Concurrent Processing now uses the Output Post Processor (OPP) to enforce post-processing actions for concurrent requests.Post-processing actions are actions taken on

concurrent request output. An example of a post-processing action is that used in Concurrent Processing support of XML Publisher.

If a request is submitted with an XML Publisher template specified as a layout for the concurrent request output, then after the concurrent manager finishes running

the concurrent program, it will contact the OPP to apply the XML Publisher template and create the final output.

OPP runs as a service that can be managed through Oracle Applications Manager (OAM) from the System Activity page (Navigation: Applications Dashboard > Applications

Service (from the dropdown list) > Go).

How to Increase the number of Output Post Processors?
1.Log on to Applications with “System Administrator” responsibility.
2.Navigate to Concurrent -> Manager -> Define.
3.Query for the “Output Post Processor” service.
4.Click on “Work Shifts” and increase the number of processes

How to get OPP manager log file location?

$APPLCSF/log/<SID>/FNDOPP####.txt       OR
1,System Administrator > Concurrent > Manager > Administer
2,Search for ‘Output Post Processor’
3,Click the ‘Processes’ button .
4,Click the Manager Log button. This will open the ‘OPP’
Upload the OPP log file.

In some cases, Output Post Processor is not start up and it shows Actual and Target are showing different values when we query for Output Post Processor.
The log files shows that no error message.In this case apply the following possible solution for starting the OPP.


1. Shutdown the internal manager by using adcmctl.sh stop apps/apps
2. Make sure there is no FNDLIBR processe running:
$ ps -ef| grep FNDLIBR OR ps -ef|grep applprod|grep FNDLIBR
3. If there is any FNDLIBR processe please kill it $ kill -9 pid
4. Run cmclean.sql script as document from Note 134007.1
5. Restart the internal manager by using adcmctl.sh start apps/apps

or How to kill and start Output Post Processor (OPP) Background:
This article explains how to kill OPP and restart the same

Solution:
1,System Administator > Concurrent > Manager > Administer
2,Query "Output Post Processor" -> Processes button
Get the sytem id of "Output Post Processor"
3,ps -ef|grep [system id]
4,kill -9 [system id] in Unix
5,System Administator > Concurrent > Manager > Administer
6,Query "Output Post Processor" -> Restart button

Fixing Output Post-processor actions failed issues in EBS R12

Environment: Oracle EBS 12.1.3, Oracle Database 11gR2, RedHat Linux5
Symptoms:

Users unable to open the out files.

Concurrent requests failed with “Post-processing of request failed error message”

One or more post-processing actions failed. Consult the OPP service log for details.

No further attempts will be made to post-process this request.

Cause:

The concurrent manager process was able to successfully invoke the Output Post-Processor (OPP) but encountered a timeout as the OPP takes longer than the value

assigned to complete the job.

 Solution:

1,Increase the value of profile Concurrent: OPP Response Timeout . Bounce Apache and retest.
2,If the issue still exists, perform the following steps.
3,Increase the number of Output Post Processors as follows:
4,Increase the number of processes for Output Post Processor.
5,Additionally, ensure there is a setting of  oracle.apps.fnd.cp.opp.OPPServiceThread:2:0:max_threads=5 under Parameters.


For more details Please  check metalink I.E oracle.support
 


Concurrent Requests Fail Due to Output Post Processing (OPP) Timeout [ID 352518.1]
Ouput Post Processing Fails Due To java.lang.ThreadDeath [ID 427233.1]
Why Does OPP Intermittently Completes With Warnings and Error 'java.lang.OutOfMemoryError'? [ID 978495.1]


To know more this post is very nice http://knoworacleappsdba.blogspot.in/2012/07/all-about-output-post-processor-opp-in.html


How to start the Output Post Processing (OPP) in 11i
At least one OPP process active in the system. The concurrent processing uses the Output Post Processor (OPP) to enforce post-processing actions for concurrent requests. For example, post-processing action is that used in publishing concurrent requests with XML Publisher.

Actually when you have submit a request with XML Publisher template specified as a layout for the concurrent request output. Once finishes the concurrent manager concurrent program, it will contact the OPP to apply the XML Publisher template and create the final output

To activate the OPP follow these setps

The Profile Option "Concurrent: GSM Enabled" must be set to Y

Then:
1. Login to Apps with sysadmin responsibility
2. Navigate to: Concurrent -> Managers -> Define
3. Query for
Manager = 'Output Post Processor%'
or Short Name = FNDCPOPP
4. Check the checkbox "Enable" .
5. Click on 'Work Shifts button
6. see Work Shift of the OPP and
Set Processes = 1
and Parameters = oracle.apps.fnd.cp.opp.OPPServiceThread:2:0:max_threads=5
and Sleep Second = 30
7. Save

How to restart Oracle Apps 11i OPP via non unix command

It can be done using adcmctl.sh script only and there is no specific script for OPP. You can restart it from the application via (System Administrator responsibility > Concurrent > Manager > Administer), select "Output Post Processor" and click on the "Restart" button.


OPP Issue while generating the XML Output in apps 11i


Problem Description:
1, Few XML type concurrent programs taking long time and completed with warning OPP log file registered below error
      Caused by: java.lang.ThreadDeath
2, CPU utilization taking 100% constantly while running the concurrent programs.


Cause
The java.lang.ThreadDeath error indicates that the Output Post Processor has reached its processing timeout.

Solution
The following configuration changes are recommended to optimize the environment for these type of reports:
1. Increase the value of the Concurrent: OPP Timeout profile option to 10800 seconds.

2. Enable the scalability feature of XML Publisher:

1. Login as SYSADMIN
2. Responsibility: XML Publisher Administrator
3. Function: Administration
4. Set the following properties:
5. Temporary Directory
6. Use XML Publisher's XSLT processor: True
7. Enable scalable feature of XSLT processor: True   -- By default it’s false
8. Enable XSLT runtime optimization: True

> After changing the value also the problem still exist. As per the SR suggestion, we increased the java heap size from 1024M to 2048M.

a. Bring down the concurrent managers.

b. Use the Update statement below, for example:
update FND_CP_SERVICES
set DEVELOPER_PARAMETERS =
'J:oracle.apps.fnd.cp.gsf.GSMServiceController:-mx2048m'
where SERVICE_ID = (select MANAGER_TYPE from FND_CONCURRENT_QUEUES
where CONCURRENT_QUEUE_NAME = 'FNDCPOPP');

c. Bring concurrent managers up again

Please check below note's from oracle support

427233.1  :Output Post Processing Fails Due To java.lang.ThreadDeath
1268217.1: Output Post Processor (OPP) Log Contains Error “java.lang.OutOfMemoryError: Java heap space"
1266368.1: Output Post Processor (OPP) Log Contains Error   "java.lang.OutOfMemoryError"
978495.1: Why Does OPP Intermittently Completes With Warnings and Error 'java.lang.OutOfMemoryError'?
352518.1 :Concurrent Requests Fail Due to Output Post Processing (OPP) Timeout
364547.1 :Troubleshooting Oracle XML Publisher For The Oracle E-Business Suite

R12.1.X File system:

R12.1.X File system:
======================


How to apply patch while you are in the middle of ADPATCH

How to apply patch while you are in the middle of ADPATCH
=================================================


1.  Using the adctrl utility, shutdown the workers.
    a. adctrl
    b. Select option 3 "Tell worker to shutdown/quit"
2.  Backup the FND_INSTALL_PROCESSES table which is owned by the APPLSYS schema
    a. sqlplus applsys/<password>
    b. create table fnd_Install_processes_back
       as select * from fnd_Install_processes;
    c. The 2 tables should have the same number of records.
       select count(*) from fnd_Install_processes_back;
       select count(*) from fnd_Install_processes;
3.  Backup the AD_DEFERRED_JOBS table.
    a. sqlplus applsys/<password>
    b. create table AD_DEFERRED_JOBS_back
       as select * from AD_DEFERRED_JOBS;
    c. The 2 tables should have the same number of records.
       select count(*) from AD_DEFERRED_JOBS_back;
       select count(*) from AD_DEFERRED_JOBS;
4.  Backup the .rf9 files located in $APPL_TOP/admin/<SID>/restart directory.
    At this point, the adpatch session should have ended and the cursor should
    be back at the Unix prompt.
    a. cd $APPL_TOP/admin/<SID>
    b. mv restart restart_back
    c. mkdir restart
5.  Drop the FND_INSTALL_PROCESSES table and the AD_DEFERRED_JOBS table.
    a. sqlplus applsys/<password>
    b. drop table FND_INSTALL_PROCESSES;
    c. drop table AD_DEFERRED_JOBS;
6.  Apply the new patch.
7.  Restore the .rf9 files located in $APPL_TOP/admin/<SID>/restart_back
    directory.
    a. cd $APPL_TOP/admin/<SID>
    b. mv restart restart_<patchnumber>
    c. mv restart_back restart
8. Restore the FND_INSTALL_PROCESSES table which is owned by the APPLSYS
    schema.
    a. sqlplus applsys/<password>
    b. create table fnd_Install_processes
       as select * from fnd_Install_processes_back;
    c. The 2 tables should have the same number of records.
       select count(*) from fnd_Install_processes;
       select count(*) from fnd_Install_processes_back;
9. Restore the AD_DEFERRED_JOBS table.
    a. sqlplus applsys/<password>
    b. create table AD_DEFERRED_JOBS
       as select * from AD_DEFERRED_JOBS_back;
    c. The 2 tables should have the same number of records.
       select count(*) from AD_DEFERRED_JOBS_back;
       select count(*) from AD_DEFERRED_JOBS;
10. Re-create synonyms
    a. sqlplus apps/apps
    b. create synonym AD_DEFERRED_JOBS for APPLSYS.AD_DEFERRED_JOBS;
    c. create synonym FND_INSTALL_PROCESSES FOR APPLSYS.FND_INSTALL_PROCESSES;
11. Start adpatch, it will resume where it stopped previously.


How to apply patch while you are in the middle of patching:
=============================================                                              
Summary

Sometimes when you are in the middle of applying a patch you may get adworkers errors or you can find out that a patch is missing.

So you need to apply a second patch (which solves the problem) in the middle of a running patch.

1. Use adctrl (option 3) to tell all the existing workers to QUIT

2. Use adctrl (option 5) to tell managers that all workers have QUIT. (Adpatch session ends!)

3. Backup tables applsys.ad_deferred_jobs and applsys.fnd_install_processes.
Login as APPLSYS user and execute:
ALTER "TABLE" applsys.ad_deferred_jobs "RENAME" TO ad_deferred_jobs_old;
ALTER "TABLE" applsys.fnd_install_processes "RENAME" TO fnd_install_processes_old;
ALTER "INDEX" applsys.ad_deferred_jobs_u1 "RENAME" TO ad_deferred_jobs_u1_old;
ALTER "INDEX" applsys.fnd_install_processes_u1 "RENAME" TO fnd_install_processes_u1_old;
4. Go to $APPL_TOP/admin/SID/ for example $APPL_TOP/admin/TEST/ and rename the existing directory "restart"

$mv restart restart.old

5. Use adpatch to apply the second/other patch.

6. Login as APPLSYS and revert back to the original tables, ad_deferred_jobs and fnd_install_processes
ALTER "TABLE" applsys.ad_deferred_jobs_old "RENAME" TO ad_deferred_jobs;
ALTER "TABLE" applsys.fnd_install_processes_old "RENAME" TO fnd_install_processes;
ALTER "INDEX" applsys.ad_deferred_jobs_u1_old "RENAME" TO ad_deferred_jobs_u1;
ALTER "INDEX" applsys.fnd_install_processes_u1_old "RENAME" TO fnd_install_processes_u1;
CREATE SYNONYM FND_INSTALL_PROCESSES FOR APPLSYS.FND_INSTALL_PROCESSES;
CREATE SYNONYM AD_DEFERRED_JOBS FOR APPLSYS.AD_DEFERRED_JOBS;
7. Replace the original restart directory:

cd $APPL_TOP/admin/SID/ for example $APPL_TOP/admin/TEST/
mv restart restart_new
mv restart.old restart

8. Run adpatch to continue the first patch (with continue session?Yes)

9. Use adctrl (option 2, will change status to “Fixed/Restart”) to restart the failed workers for first patch

What to do if a worker fails during adpatch application on R12:

=====================================================================
In a different window constantly monitor the patch worker using adctrl command.

1. set the application environment file of R12

2. run adctrl

check the status of the worker using option 1 [Show worker status].

If a worker fails. 

1. Check adwork01.log [check the failed worker number] file under $APPL_TOP/admin//log directory for details about the error.

2. Fix the issue mentioned in worker file.

3. Use Option 2 [Tell worker to restart a failed job] to restart the failed job in adctrl window.

4. If the issue is fixed properly the worker will start and complete the job and your adpatch will continue executing.


Sometimes, you need to restart all the workers and exit the adpatch session and restart it from the failed location will do your job.

OACORE fails to start after increasing the JVM processes in Oracle R12

OACORE fails to start after increasing the JVM processes in Oracle R12:
========================================================

Issue: OACORE processes are not starting.

Recent changes: Increased the JVM processes in the context file.
Error:
adoacorectl.sh: exiting with status 206
Solution:

1)  Stop the middle tier processes:

adopmnctl.sh stop

2) Kill any runaway/zombie processes.

3) Remove the following jms lock files:

$ORA_CONFIG_HOME/10.1.3/j2ee/forms/persistence/forms_default_group_1/jms.state.lock,

$ORA_CONFIG_HOME/10.1.3/j2ee/oacore/persistence/oacore_default_group_1/jms.state.lock

$ORA_CONFIG_HOME/10.1.3/j2ee/oafm/persistence/oafm_default_group_1jms.state.lock

4) Restart middle tier:
adopmnctl.sh start

-----------------

Executing service control script:
/u01/applR12/inst/apps/TEST_linuxerp1/admin/scripts/adoacorectl.sh start
script returned:
****************************************************

You are running adoacorectl.sh version 120.13

Starting OPMN managed OACORE OC4J instance  ...

adoacorectl.sh: exiting with status 204

adoacorectl.sh: check the logfile /u01/applR12/inst/apps/TEST_linuxerp1/logs/appl/admin/log/adoacorectl.txt for more information ...




[applerp@linuxerp1 scripts]$ adopmnctl.sh status

You are running adopmnctl.sh version 120.6

Checking status of OPMN managed processes...

Processes in Instance: TEST_linuxerp1.linuxerp1.orasol.com
---------------------------------+--------------------+---------+---------
ias-component                    | process-type       |     pid | status
---------------------------------+--------------------+---------+---------
OC4JGroup:default_group          | OC4J:oafm          |   12478 | Alive
OC4JGroup:default_group          | OC4J:forms         |   12394 | Alive
OC4JGroup:default_group          | OC4J:oacore        |     N/A | Down
HTTP_Server                      | HTTP_Server        |   12147 | Alive


adopmnctl.sh: exiting with status 0

adopmnctl.sh: check the logfile /u01/applR12/inst/apps/TEST_linuxerp1/logs/appl/admin/log/adopmnctl.txt for more information ...

[applerp@linuxerp1 scripts]$


Error Stack when trying to stop:


Executing service control script:
/u01/applR12/inst/apps/TEST_linuxerp1/admin/scripts/adoacorectl.sh stop
script returned:
****************************************************

You are running adoacorectl.sh version 120.13

Stopping OPMN managed OACORE OC4J instance ...

adoacorectl.sh: exiting with status 150

adoacorectl.sh: check the logfile /u01/applR12/inst/apps/TEST_linuxerp1/logs/appl/admin/log/adoacorectl.txt for more information ...




Solution:
=> Stop application services
=> Clear contents of the persistence directory 
=> Start application services

[applerp@linuxerp1 scripts]$ cd $ORA_CONFIG_HOME/10.1.3/j2ee/oacore


[applerp@linuxerp1 oacore]$ ls
application-deployments  config  persistence  tldcache
[applerp@linuxerp1 oacore]$ rm -rf persistence/
You have new mail in /var/spool/mail/applerp
[applerp@linuxerp1 oacore]$ mkdir persistence 





[applerp@linuxerp1 scripts]$ adopmnctl.sh status

You are running adopmnctl.sh version 120.6

Checking status of OPMN managed processes...

Processes in Instance: TEST_linuxerp1.linuxerp1.orasol.com
---------------------------------+--------------------+---------+---------
ias-component                    | process-type       |     pid | status
---------------------------------+--------------------+---------+---------
OC4JGroup:default_group          | OC4J:oafm          |   13872 | Alive
OC4JGroup:default_group          | OC4J:forms         |   13804 | Alive
OC4JGroup:default_group          | OC4J:oacore        |   13723 | Alive
HTTP_Server                      | HTTP_Server        |   13671 | Alive


adopmnctl.sh: exiting with status 0

adopmnctl.sh: check the logfile /u01/applR12/inst/apps/TEST_linuxerp1/logs/appl/admin/log/adopmnctl.txt for more information ...

[applerp@linuxerp1 scripts]$

------------

 adoacorectl.sh: exiting with status 150
Error:

[oracle@svrebsal2 scripts]$ ./adoacorectl.sh stop
You are running adoacorectl.sh version 120.13
Stopping OPMN managed OACORE OC4J instance ...

adoacorectl.sh: exiting with status 206

(OR)

adoacorectl.sh: exiting with status 150

Solution :

stop all R12 procs

rm -rf $ORA_CONFIG_HOME/10.1.3/j2ee/oacore/persistence/*
rm -rf $ORA_CONFIG_HOME/10.1.3/j2ee/oafm/persistence/*
rm -rf $ORA_CONFIG_HOME/10.1.3/j2ee/forms/persistence/*

start all service again (Start the oc4j using opmnctl startall)


++++++1177323.1, 1313955.1,1557461.1+++++++++

 OACORE fails to start after increasing the JVM processes in Oracle R12



Issue: OACORE processes are not starting.


Recent changes: Increased the JVM processes in the context file.


Error:

adoacorectl.sh: exiting with status 206


Solution:

1)  Stop the middle tier processes:

adopmnctl.sh stop

2) Kill any runaway/zombie processes.

3) Remove the following jms lock files:

$ORA_CONFIG_HOME/10.1.3/j2ee/forms/persistence/forms_default_group_1/jms.state.lock,

$ORA_CONFIG_HOME/10.1.3/j2ee/oacore/persistence/oacore_default_group_1/jms.state.lock

$ORA_CONFIG_HOME/10.1.3/j2ee/oafm/persistence/oafm_default_group_1jms.state.lock

4) Restart middle tier:
adopmnctl.sh start

----------------------
\
SOLUTION:

To implement the solution, the recommendation is to:
1. $FF_TOP/bin/FFXBCP APPS/passwd 0 Y -W %% %%
2. sqlplus APPS/passwd @$FF_TOP/patch/115/sql/ffgenwrap.sql

This will recompile all formulas, then regenerate the formula wrappers. It is not recommended to
skip 1.    
-----------------

Solution

1) Oracle Fast Formulas can be compiled in bulk with the following command:

$FF_TOP/bin/FFXBCP <appsuser>/<appspassword> 0 Y %% %%

Example:
$FF_TOP/bin/FFXBCP apps/apps 0 Y %% %%

NOTE: 0 = zero

2) Or Groups of Formulae may be compiled. For example 'VERTEX':

$FF_TOP/bin/FFXBCP apps/apps 0 Y %% %VERTEX%

3) Formulas can also be compiled through the Oracle Payroll application by running the concurrent process Bulk Compile of Formulas.

Navigate: Processes and Reports -> Submit Processes and Reports
Select Bulk Compile of Formulas
How To Compile Oracle Fast Formulas (Doc ID 155737.1)

---------------------

 adoafmctl.sh: exiting with status 204
One of our site i need to change SERVER IP address in Oracle application r12 on linux 5.

I changed IP address on both server ( we have two server 1. db server 2. application server)

after changing the server IP when we are trying to start application service, application service ended with below error message:
adoafmctl.sh: exiting with status 204

Cause: Server IP address change

Solution: 
Step:
1. logon to application server with applmgr user
2. go to $INST_TOP
3.  stop application services ($ cd $INST_TOP/admin/scripts )
4. delete following files
rm -rf $INST_TOP/ora/10.1.3/j2ee/oacore/persistence/*
rm -rf $INST_TOP/ora/10.1.3/j2ee/oafm/persistence/*
rm -rf $INST_TOP/ora/10.1.3/j2ee/forms/persistence/*

4. execute autoconfig on application tier 
$cd $INST_TOP/admin/scripts
$. ./autoconfig {hit enter}

5. start all application services
6. re-test the issue

----------------------------------------------------------------------------
Unable to start oafm using adstrtal.sh. Running adoafmctl.sh ends with timeout.

You are running adoafmctl.sh version 120.6.12000000.3
Starting OPMN managed OAFM OC4J instance ...
adoafmctl.sh: exiting with status 152
adoafmctl.sh: check the logfile
/opt/apphcm/inst/apps/SID_machine/logs/appl/admin/log/adoafmctl.txt for more information

adoafmctl.txt showing:

ias-component/process-type/process-set:
default_group/oafm/default_group/
Error
--> Process (index=1,uid=349189076,pid=15039)
time out while waiting for a managed process to start
Log:
/opt/apphcm/inst/apps/SID_machine/logs/ora/10.1.3/opmn/default_group~oafm~default_group~1
07/31/09-09:14:28 :: adoafmctl.sh: exiting with status 152
================================================================================
07/31/09-09:14:40 :: adoafmctl.sh version 120.6.12000000.3
07/31/09-09:14:40 :: adoafmctl.sh: Checking the status of OPMN managed OAFM OC4J instance
Processes in Instance: SID_machine.machine.domain
-------------------+--------------------+---------+---------
ias-component | process-type | pid | status
-------------------+--------------------+---------+---------
default_group | oafm | N/A | Down 

CAUSE
Existing JSP Tag Library Cache content was preventing the TLD Cache for the mapviewer app from initialising correctly.

Solution:
=======To implement the solution, please execute the following steps:

Clear the TLD cache:

- stop all middle tier services

- Delete/backup the file:

$COMMON_TOP/_TldCache

- start all middle tier services