联系:手机/微信(+86 17813235971) QQ(107644445)
作者:惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
在11.2或者12.1的RAC中,ocr和votedisk可以放到asm中,而很多人安装系统把ocr和votedisk放到一个单独的asm 磁盘组里面,但是如果这个磁盘组坏了,而数据所在的磁盘组是好的,这个时候该怎么恢复呢?这里的恢复分两种情况,一种是有ocr备份的恢复,另外一种是无ocr备份的恢复。但是在一般情况下ocr是每4个小时自动备份一份,因此大部分的系统中都会有ocr的备份。本blog主要对于oracle 12c rac在有ocr备份,存储ocr,votedisk的asm磁盘组异常恢复
确定ocr,votedisk,asm spfile存在一个独立asm diskgroup中
[grid@xifenfei ~]$ ocrcheck Status of Oracle Cluster Registry is as follows : Version : 4 Total space (kbytes) : 409568 Used space (kbytes) : 1360 Available space (kbytes) : 408208 ID : 2132096904 Device/File Name : +DG_SYS Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check bypassed due to non-privileged user SQL> show parameter spfile; NAME TYPE VALUE ------------------------------------ ----------- ------------------------------ spfile string +DG_SYS/xff-cluster/ASMPARAMET ERFILE/registry.253.825628977 [grid@xifenfei ~]$ crsctl query css votedisk ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 3e20d13ae98a4fcfbffa489ab4df68a3 (/dev/sdc2) [DG_SYS] Located 1 voting disk(s). ASMCMD> lsdsk -t -G dg_sys Create_Date Mount_Date Repair_Timer Path 08-SEP-13 08-SEP-13 0 /dev/sdc2
查看当前rac状态
[grid@xifenfei ~]$ crsctl status res -t -------------------------------------------------------------------------------- Name Target State Server State details -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.ASMNET1LSNR_ASM.lsnr ONLINE ONLINE xifenfei STABLE ora.DATA.dg ONLINE ONLINE xifenfei STABLE ora.LISTENER.lsnr ONLINE ONLINE xifenfei STABLE ora.net1.network ONLINE ONLINE xifenfei STABLE ora.ons ONLINE ONLINE xifenfei STABLE ora.proxy_advm ONLINE OFFLINE xifenfei STABLE -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE xifenfei STABLE ora.MGMTLSNR 1 ONLINE ONLINE xifenfei 169.254.196.108 10.1 0.30.22,STABLE ora.asm 1 ONLINE ONLINE xifenfei Started,STABLE 2 OFFLINE OFFLINE STABLE 3 OFFLINE OFFLINE STABLE ora.cdb.db 1 ONLINE ONLINE xifenfei Open,STABLE ora.cvu 1 ONLINE ONLINE xifenfei STABLE ora.oc4j 1 ONLINE ONLINE xifenfei STABLE ora.scan1.vip 1 ONLINE ONLINE xifenfei STABLE ora.xifenfei.vip 1 ONLINE ONLINE xifenfei STABLE --------------------------------------------------------------------------------
kfed查看磁盘头
[grid@xifenfei ~]$ kfed read /dev/sdc2 kfbh.endian: 1 ; 0x000: 0x01 kfbh.hard: 130 ; 0x001: 0x82 kfbh.type: 1 ; 0x002: KFBTYP_DISKHEAD kfbh.datfmt: 1 ; 0x003: 0x01 kfbh.block.blk: 0 ; 0x004: blk=0 kfbh.block.obj: 2147483648 ; 0x008: disk=0 kfbh.check: 2879801080 ; 0x00c: 0xaba646f8 kfbh.fcn.base: 0 ; 0x010: 0x00000000 kfbh.fcn.wrap: 0 ; 0x014: 0x00000000 kfbh.spare1: 0 ; 0x018: 0x00000000 kfbh.spare2: 0 ; 0x01c: 0x00000000 kfdhdb.driver.provstr: ORCLDISK ; 0x000: length=8 kfdhdb.driver.reserved[0]: 0 ; 0x008: 0x00000000 kfdhdb.driver.reserved[1]: 0 ; 0x00c: 0x00000000 kfdhdb.driver.reserved[2]: 0 ; 0x010: 0x00000000 kfdhdb.driver.reserved[3]: 0 ; 0x014: 0x00000000 kfdhdb.driver.reserved[4]: 0 ; 0x018: 0x00000000 kfdhdb.driver.reserved[5]: 0 ; 0x01c: 0x00000000 kfdhdb.compat: 202375168 ; 0x020: 0x0c100000 kfdhdb.dsknum: 0 ; 0x024: 0x0000 kfdhdb.grptyp: 1 ; 0x026: KFDGTP_EXTERNAL kfdhdb.hdrsts: 3 ; 0x027: KFDHDR_MEMBER kfdhdb.dskname: DG_SYS_0000 ; 0x028: length=11 kfdhdb.grpname: DG_SYS ; 0x048: length=6 kfdhdb.fgname: DG_SYS_0000 ; 0x068: length=11 kfdhdb.capname: ; 0x088: length=0 kfdhdb.crestmp.hi: 32990483 ; 0x0a8: HOUR=0x13 DAYS=0x8 MNTH=0x9 YEAR=0x7dd kfdhdb.crestmp.lo: 303455232 ; 0x0ac: USEC=0x0 MSEC=0x197 SECS=0x21 MINS=0x4 kfdhdb.mntstmp.hi: 32990485 ; 0x0b0: HOUR=0x15 DAYS=0x8 MNTH=0x9 YEAR=0x7dd kfdhdb.mntstmp.lo: 1776845824 ; 0x0b4: USEC=0x0 MSEC=0x221 SECS=0x1e MINS=0x1a kfdhdb.secsize: 512 ; 0x0b8: 0x0200 kfdhdb.blksize: 4096 ; 0x0ba: 0x1000 kfdhdb.ausize: 1048576 ; 0x0bc: 0x00100000 kfdhdb.mfact: 113792 ; 0x0c0: 0x0001bc80 kfdhdb.dsksize: 5451 ; 0x0c4: 0x0000154b kfdhdb.pmcnt: 3 ; 0x0c8: 0x00000003 kfdhdb.fstlocn: 1 ; 0x0cc: 0x00000001 kfdhdb.altlocn: 2 ; 0x0d0: 0x00000002 kfdhdb.f1b1locn: 10 ; 0x0d4: 0x0000000a kfdhdb.redomirrors[0]: 0 ; 0x0d8: 0x0000 kfdhdb.redomirrors[1]: 0 ; 0x0da: 0x0000 kfdhdb.redomirrors[2]: 0 ; 0x0dc: 0x0000 kfdhdb.redomirrors[3]: 0 ; 0x0de: 0x0000 kfdhdb.dbcompat: 168820736 ; 0x0e0: 0x0a100000 kfdhdb.grpstmp.hi: 32990483 ; 0x0e4: HOUR=0x13 DAYS=0x8 MNTH=0x9 YEAR=0x7dd kfdhdb.grpstmp.lo: 301063168 ; 0x0e8: USEC=0x0 MSEC=0x77 SECS=0x1f MINS=0x4 kfdhdb.vfstart: 224 ; 0x0ec: 0x000000e0 kfdhdb.vfend: 256 ; 0x0f0: 0x00000100 kfdhdb.spfile: 219 ; 0x0f4: 0x000000db ----asm spfile的起点 kfdhdb.spfflg: 1 ; 0x0f8: 0x00000001 kfdhdb.flags: 1 ; 0x0fc: 0x00000001
备份ocr
[root@xifenfei xff-cluster]# ocrconfig -manualbackup xifenfei 2013/09/08 23:48:57 /u01/app/12.1/grid/product/cdata/xff-cluster/backup_20130908_234857.ocr [root@xifenfei xff-cluster]# ocrconfig -showbackup xifenfei 2013/08/08 21:11:00 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/backup00.ocr xifenfei 2013/08/08 17:10:56 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/backup01.ocr xifenfei 2013/07/08 20:23:18 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/backup02.ocr xifenfei 2013/08/08 17:10:56 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/day.ocr xifenfei 2013/08/08 17:10:56 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/week.ocr xifenfei 2013/09/08 23:48:57 /u01/app/12.1/grid/product/cdata/xff-cluster/backup_20130908_234857.ocr xifenfei 2013/06/28 22:55:02 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/backup_20130628_225502.ocr
破坏asm disk
[grid@xifenfei ~]$ dd if=/dev/zero of=/dev/sdc2 bs=4096 count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 6.6061e-05 seconds, 62.0 MB/s
关闭crs
[root@xifenfei xff-cluster]# crsctl stop crs
启动crs
[root@xifenfei xff-cluster]# crsctl start crs CRS-4123: Oracle High Availability Services has been started. [grid@xifenfei admin]$ crsctl status res -t -init -------------------------------------------------------------------------------- Name Target State Server State details -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.asm 1 ONLINE OFFLINE Instance Shutdown,ST ABLE ora.cluster_interconnect.haip 1 ONLINE OFFLINE STABLE ora.crf 1 ONLINE OFFLINE STABLE ora.crsd 1 ONLINE OFFLINE STABLE ora.cssd 1 ONLINE OFFLINE xifenfei STARTING ora.cssdmonitor 1 ONLINE ONLINE xifenfei STABLE ora.ctssd 1 ONLINE OFFLINE STABLE ora.diskmon 1 OFFLINE OFFLINE STABLE ora.drivers.acfs 1 ONLINE ONLINE xifenfei STABLE ora.evmd 1 ONLINE INTERMEDIATE xifenfei STABLE ora.gipcd 1 ONLINE ONLINE xifenfei STABLE ora.gpnpd 1 ONLINE ONLINE xifenfei STABLE ora.mdnsd 1 ONLINE ONLINE xifenfei STABLE ora.storage 1 ONLINE OFFLINE STABLE --------------------------------------------------------------------------------
GI相关日志
--alert日志 2013-09-08 23:53:37.662: [gpnpd(1507)]CRS-2328:GPNPD started on node xifenfei. 2013-09-08 23:54:10.244: [cssd(1584)]CRS-1713:CSSD daemon is started in hub mode 2013-09-08 23:54:10.915: [cssd(1584)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /u01/app/12.1/grid/product/log/xifenfei/cssd/ocssd.log 2013-09-08 23:54:11.183: [ohasd(1367)]CRS-2767:Resource state recovery not attempted for 'ora.diskmon' as its target state is OFFLINE 2013-09-08 23:54:11.183: [ohasd(1367)]CRS-2769:Unable to failover resource 'ora.diskmon'. 2013-09-08 23:54:26.044: [cssd(1584)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /u01/app/12.1/grid/product/log/xifenfei/cssd/ocssd.log 2013-09-08 23:54:41.146: [cssd(1584)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /u01/app/12.1/grid/product/log/xifenfei/cssd/ocssd.log 2013-09-08 23:54:56.195: [cssd(1584)]CRS-1714:Unable to discover any voting files, retrying discovery in 15 seconds; Details at (:CSSNM00070:) in /u01/app/12.1/grid/product/log/xifenfei/cssd/ocssd.log --ocssd日志 2013-09-08 23:54:25.976: [ GPNP][1090226496]clsgpnp_profileCallUrlInt: [at clsgpnp.c:2360] Result: (0) CLSGPNP_OK. Successful get-profile CALL to remote "ipc://GPNPD_xifenfei" disco "" 2013-09-08 23:54:25.976: [ CSSD][1090226496]clssnmReadDiscoveryProfile: voting file discovery string(/dev/sd*) 2013-09-08 23:54:25.976: [ CSSD][1090226496]clssnmvDDiscThread: using discovery string /dev/sd* for initial discovery 2013-09-08 23:54:25.976: [ SKGFD][1090226496]Discovery with str:/dev/sd*: 2013-09-08 23:54:25.976: [ SKGFD][1090226496]UFS discovery with :/dev/sd*: 2013-09-08 23:54:26.032: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdc: 2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdc1: 2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdb: 2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdc2: 2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdd: 2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdd1: 2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sda: 2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sda1: 2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sda2: 2013-09-08 23:54:26.037: [ SKGFD][1090226496]OSS discovery with :/dev/sd*: 2013-09-08 23:54:26.042: [ SKGFD][1090226496]Handle 0x1d65c10 from lib :UFS:: for disk :/dev/sdb: 2013-09-08 23:54:26.043: [ SKGFD][1090226496]Handle 0x20c95a0 from lib :UFS:: for disk :/dev/sdc2: 2013-09-08 23:54:26.043: [ SKGFD][1090226496]Handle 0x20c9dd0 from lib :UFS:: for disk :/dev/sdd: 2013-09-08 23:54:26.044: [ SKGFD][1090226496]Lib :UFS:: closing handle 0x1d65c10 for disk :/dev/sdb: 2013-09-08 23:54:26.044: [ SKGFD][1090226496]Lib :UFS:: closing handle 0x20c95a0 for disk :/dev/sdc2: 2013-09-08 23:54:26.044: [ SKGFD][1090226496]Lib :UFS:: closing handle 0x20c9dd0 for disk :/dev/sdd: 2013-09-08 23:54:26.044: [ CSSD][1090226496]clssnmvDiskVerify: Successful discovery of 0 disks 2013-09-08 23:54:26.044: [ CSSD][1090226496]clssnmCompleteInitVFDiscovery: Completing initial voting file discovery 2013-09-08 23:54:26.044: [ CSSD][1090226496]clssnmvFindInitialConfigs: No voting files found 2013-09-08 23:54:26.044: [ CSSD][1090226496](:CSSNM00070:)clssnmCompleteInitVFDiscovery: Voting file not found. Retrying discovery in 15 seconds
在我们破坏了ocr所在的asm disk的磁盘后,启动crs明显提示无法找到votedisk信息
强制关闭crs
[root@xifenfei xff-cluster]# crsctl stop crs -f CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'xifenfei' CRS-2673: Attempting to stop 'ora.mdnsd' on 'xifenfei' CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'xifenfei' CRS-2677: Stop of 'ora.drivers.acfs' on 'xifenfei' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'xifenfei' succeeded CRS-2673: Attempting to stop 'ora.gpnpd' on 'xifenfei' CRS-2673: Attempting to stop 'ora.gipcd' on 'xifenfei' CRS-2673: Attempting to stop 'ora.evmd' on 'xifenfei' CRS-2677: Stop of 'ora.gpnpd' on 'xifenfei' succeeded CRS-2677: Stop of 'ora.gipcd' on 'xifenfei' succeeded CRS-2677: Stop of 'ora.evmd' on 'xifenfei' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'xifenfei' has completed CRS-4133: Oracle High Availability Services has been stopped.
exclusive模式启动crs
[root@xifenfei xff-cluster]# crsctl start crs -excl -nocrs CRS-4123: Oracle High Availability Services has been started. CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'xifenfei' CRS-2677: Stop of 'ora.drivers.acfs' on 'xifenfei' succeeded CRS-2672: Attempting to start 'ora.evmd' on 'xifenfei' CRS-2672: Attempting to start 'ora.mdnsd' on 'xifenfei' CRS-2676: Start of 'ora.evmd' on 'xifenfei' succeeded CRS-2676: Start of 'ora.mdnsd' on 'xifenfei' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'xifenfei' CRS-2676: Start of 'ora.gpnpd' on 'xifenfei' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'xifenfei' CRS-2672: Attempting to start 'ora.gipcd' on 'xifenfei' CRS-2676: Start of 'ora.cssdmonitor' on 'xifenfei' succeeded CRS-2676: Start of 'ora.gipcd' on 'xifenfei' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'xifenfei' CRS-2672: Attempting to start 'ora.diskmon' on 'xifenfei' CRS-2676: Start of 'ora.diskmon' on 'xifenfei' succeeded CRS-2676: Start of 'ora.cssd' on 'xifenfei' succeeded CRS-2672: Attempting to start 'ora.drivers.acfs' on 'xifenfei' CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'xifenfei' CRS-2672: Attempting to start 'ora.ctssd' on 'xifenfei' CRS-2676: Start of 'ora.ctssd' on 'xifenfei' succeeded CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'xifenfei' succeeded CRS-2676: Start of 'ora.drivers.acfs' on 'xifenfei' succeeded CRS-2672: Attempting to start 'ora.asm' on 'xifenfei' CRS-2676: Start of 'ora.asm' on 'xifenfei' succeeded [grid@xifenfei xifenfei]$ crsctl stat res -t -init -------------------------------------------------------------------------------- Name Target State Server State details -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.asm 1 ONLINE INTERMEDIATE xifenfei OCR not started,STAB LE ora.cluster_interconnect.haip 1 ONLINE ONLINE xifenfei STABLE ora.crf 1 OFFLINE OFFLINE STABLE ora.crsd 1 OFFLINE OFFLINE STABLE ora.cssd 1 ONLINE ONLINE xifenfei STABLE ora.cssdmonitor 1 ONLINE ONLINE xifenfei STABLE ora.ctssd 1 ONLINE ONLINE xifenfei ACTIVE:0,STABLE ora.diskmon 1 OFFLINE OFFLINE STABLE ora.drivers.acfs 1 ONLINE ONLINE xifenfei STABLE ora.evmd 1 ONLINE INTERMEDIATE xifenfei STABLE ora.gipcd 1 ONLINE ONLINE xifenfei STABLE ora.gpnpd 1 ONLINE ONLINE xifenfei STABLE ora.mdnsd 1 ONLINE ONLINE xifenfei STABLE ora.storage 1 OFFLINE OFFLINE STABLE
创建磁盘组
[grid@xifenfei xifenfei]$ sqlplus / as sysasm SQL*Plus: Release 12.1.0.1.0 Production on Mon Sep 9 00:23:40 2013 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected to: Oracle Database 12c Enterprise Edition Release 12.1.0.1.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options SQL> create diskgroup DG_OCR external redundancy disk '/dev/sdc2' attribute 'COMPATIBLE.ASM' = '12.1.0'; Diskgroup created. [root@xifenfei xff-cluster]# ls -l total 1472 -rw-r--r-- 1 root root 1503232 Sep 8 23:48 backup_20130908_234857.ocr [root@xifenfei xff-cluster]# ocrconfig -restore backup_20130908_234857.ocr PROT-35: The configured OCR locations are not accessible SQL> conn / as sysasm Connected. SQL> drop diskgroup DG_OCR force including contents; Diskgroup dropped. SQL> create diskgroup DG_SYS external redundancy disk '/dev/sdc2' attribute 'COMPATIBLE.ASM' = '12.1.0'; Diskgroup created.
为了操作方便,建议创建磁盘组和以前ocr所在异常的磁盘组一致
还原ocr
[root@xifenfei xff-cluster]# ocrconfig -restore backup_20130908_234857.ocr --ALERT 日志 2013-09-09 00:26:50.584: [client(3015)]CRS-1002:The OCR was restored from file backup_20130908_234857.ocr.
处理votedisk
[root@xifenfei xff-cluster]# crsctl replace votedisk +DG_SYS Successful addition of voting disk 60a037da30714f6bbfe5d90206ff27a7. Successfully replaced voting disk group with +DG_SYS. CRS-4266: Voting file(s) successfully replaced
创建asm spfile
[grid@xifenfei dbs]$ vi /tmp/asm.txt instance_type='asm' large_pool_size=12M remote_login_passwordfile= "EXCLUSIVE" asm_diskstring = "/dev/sd*" asm_power_limit = 1 [grid@xifenfei dbs]$ sqlplus '/ as sysasm' SQL*Plus: Release 12.1.0.1.0 Production on Mon Sep 9 00:34:18 2013 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected to: Oracle Database 12c Enterprise Edition Release 12.1.0.1.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options SQL> create spfile='+DG_SYS' FROM pfile='/tmp/asm.txt'; File created.
重启crs
[root@xifenfei xff-cluster]# crsctl stop crs -f [root@xifenfei xff-cluster]# crsctl start crs CRS-4123: Oracle High Availability Services has been started. [grid@xifenfei dbs]$ crsctl status res -t -------------------------------------------------------------------------------- Name Target State Server State details -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.ASMNET1LSNR_ASM.lsnr ONLINE ONLINE xifenfei STABLE ora.DATA.dg ONLINE ONLINE xifenfei STABLE ora.LISTENER.lsnr ONLINE ONLINE xifenfei STABLE ora.net1.network ONLINE ONLINE xifenfei STABLE ora.ons ONLINE ONLINE xifenfei STABLE ora.proxy_advm ONLINE OFFLINE xifenfei STABLE -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE xifenfei STABLE ora.MGMTLSNR 1 ONLINE ONLINE xifenfei 169.254.196.108 10.1 0.30.22,STABLE ora.asm 1 ONLINE ONLINE xifenfei Started,STABLE 2 OFFLINE OFFLINE STABLE 3 OFFLINE OFFLINE STABLE ora.cdb.db 1 ONLINE ONLINE xifenfei Open,STABLE ora.cvu 1 ONLINE ONLINE xifenfei STABLE ora.oc4j 1 ONLINE ONLINE xifenfei STABLE ora.scan1.vip 1 ONLINE ONLINE xifenfei STABLE ora.xifenfei.vip 1 ONLINE ONLINE xifenfei STABLE --------------------------------------------------------------------------------
这里crs已经恢复正常,进一步检查ocr,votedisk,asm spfile情况
[grid@xifenfei ~]$ ocrcheck Status of Oracle Cluster Registry is as follows : Version : 4 Total space (kbytes) : 409568 Used space (kbytes) : 1380 Available space (kbytes) : 408188 ID : 2132096904 Device/File Name : +DG_SYS Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check bypassed due to non-privileged user [grid@xifenfei ~]$ sqlplus / as sysasm SQL*Plus: Release 12.1.0.1.0 Production on Mon Sep 9 16:12:21 2013 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected to: Oracle Database 12c Enterprise Edition Release 12.1.0.1.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options SQL> show parameter spfile; NAME TYPE VALUE ------------------------------------ ----------- ------------------------------ spfile string +DG_SYS/xff-cluster/ASMPARAMET ERFILE/registry.253.825640465 SQL> exit Disconnected from Oracle Database 12c Enterprise Edition Release 12.1.0.1.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options [grid@xifenfei ~]$ crsctl query css votedisk ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 60a037da30714f6bbfe5d90206ff27a7 (/dev/sdc2) [DG_SYS] Located 1 voting disk(s).
至此在ocr 磁盘组异常,而有ocr备份的情况下故障恢复完毕,对于没有ocr备份的故障,只能通过重建ocr来完成,大概步骤为
--deconfigure(root) remote node # <$GRID_HOME>/crs/install/rootcrs.pl -deconfig -force -verbose lastnode # <$GRID_HOME>/crs/install/rootcrs.pl -deconfig -force -verbose -lastnode --配置信息重建ocr等(grid) # $GRID_HOME/crs/config/config.sh