RAC ASM instances crash with ORA-29702 when multiple ASM instances start(ed) [ID 733262.1]

RAC ASM instances crash with ORA-29702 when multiple ASM instances start(ed) [ID 733262.1]
		修改时间 21-JAN-2011     类型 PROBLEM     状态 PUBLISHED

In this Document
  Symptoms
  Cause
  Solution

---

Applies to:

Oracle Server - Enterprise Edition - Version: 10.1.0.2 to 11.1.0.7 - Release: 10.1 to 11.1
Information in this document applies to any platform.
***Checked for relevance on 21-Jan-2011***

Symptoms

On a new RAC installation, 1) cannot startup all 3 ASM instances or 2) if these are started, they
(or some ASM instances) do crash.

1) If attempting to restart an ASM instance:

    From srvctl, it gives

    From sqlplus, it gives:


2) The alert log for any of the ASM instance that crash, shows:
.

Cause

Using not bonded, multiple NICs for the cluster interconnect.

From any of the ASM instance's alert logs, watch for multiple entries like 'Interface type 1 ...
configured from OCR for use as a cluster interconnect':

Note: IP addresses have been replaced by 'x' characters for privacy.


This is causing peer-to-peer failure between the clustered ASM instances, since the two NICs used
for the cluster interconnect are not bonded.

.

Solution

In this case it was not the intent to use more than one NIC for the Oracle Cluster interconnect, so steps for properly bonding NICs to be used for cluster interconnect will not be discussed.

To implement the solution, please execute the following steps:

1)  Follow the following article to first query all devices configured for the interconnect
     and then to delete the unnecessary device:

     Note 283684.1 (How to Change Interconnect/Public Interface IP Subnet in a 10g Cluster)

     Example:

      Note: IP addresses have been replaced by 'x' characters for privacy.

2.) Stop the ASM instances in all nodes.

3.) Start the ASM instance in order (node1, node2 and then node3)