性能优化/故障排除/长期代维
找 云库管
www.yundba.com
有网友在oracle rac上,手工修改了listener.ora文件的内容,导致crs在启停时报错
现象如下:
"crsctl stop crs" fails stopping listener:
# crsctl stop crs
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'racnode2'
CRS-2673: Attempting to stop 'ora.crsd' on 'racnode2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'racnode2'
......
CRS-2677: Stop of 'ora.racnode2.vip' on 'racnode2' succeeded
......
CRS-5014: Agent "/u01/app/grid/product/11.2.0.2/grid/bin/oraagent.bin" timed out starting process "/u01/app/grid/product/11.2.0.2/grid/bin/lsnrctl" for action "check": details at "(:CLSN00009:)" in "/u01/app/grid/product/11.2.0.2/grid/log/racnode2/agent/crsd/oraagent_oracle/oraagent_oracle.log"
CRS-5017: The resource action "ora.LISTENER.lsnr check" encountered the following error:
(:CLSN00009:)Utils:execCmd aborted
CRS-2675: Stop of 'ora.LISTENER.lsnr' on 'racnode2' failed
CRS-2679: Attempting to clean 'ora.LISTENER.lsnr' on 'racnode2'
CRS-5014: Agent "/u01/app/grid/product/11.2.0.2/grid/bin/oraagent.bin" timed out starting process "/u01/app/grid/product/11.2.0.2/grid/bin/lsnrctl" for action "clean": details at "(:CLSN00009:)" in "/u01/app/grid/product/11.2.0.2/grid/log/racnode2/agent/crsd/oraagent_oracle/oraagent_oracle.log"
CRS-5017: The resource action "ora.LISTENER.lsnr clean" encountered the following error:
(:CLSN00009:)Utils:execCmd aborted
......
CRS-2678: 'ora.LISTENER.lsnr' on 'racnode2' has experienced an unrecoverable failure
CRS-0267: Human intervention required to resume its availability.
CRS-2673: Attempting to stop 'ora.racnode1.vip' on 'racnode2'
CRS-2677: Stop of 'ora.racnode1.vip' on 'racnode2' succeeded
CRS-2799: Failed to shut down resource 'ora.LISTENER.lsnr' on 'racnode2'
CRS-2799: Failed to shut down resource 'ora.racnode2.LISTENER_racnode2.lsnr' on 'racnode2'
CRS-2794: Shutdown of Cluster Ready Services-managed resources on 'racnode2' has failed
CRS-2675: Stop of 'ora.crsd' on 'racnode2' failed
CRS-2799: Failed to shut down resource 'ora.crsd' on 'racnode2'
CRS-2795: Shutdown of Oracle High Availability Services-managed resources on 'racnode2' has failed
CRS-4687: Shutdown command has completed with errors.
CRS-4000: Command Stop failed, or completed with errors.
导致问题的原因是手工增加了
listener.ora in <Grid_Home> has the following entries for LISTENER:
ENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER = ON
LISTENER =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = IPC)(KEY = LISTENER))
(ADDRESS = (PROTOCOL = TCP)(HOST =racnode2-vip)(PORT=1521))
)
)
解决方法:
方法一、去掉手工加入部分 eg:
LISTENER =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = IPC)(KEY =LISTENER))
)
)
方法二、(可选的方法)
用OCR中正确的定义重置重新生成listener.ora endpoints_listener.ora 文件内容
1. Stop the listener(s) on allnodes:
$ $GI_HOME/bin/srvctl stop listener
$ $GI_HOME/bin/srvctl stop scan_listener
2. Remove the listener.or andendpoints_listener.ora from the $GI_HOME/dbs directory on ALL nodes
3. Restart the listener on allnodes:
$ $GI_HOME/bin/srvctl start listener
$ $GI_HOME/bin/srvctl start scan_listener
具体可参看官方文档
GridInfrastructure 11gR2 "crsctl stop crs" Fails at Stopping Listener(Doc ID 1284916.1)