标签云
asm恢复 bbed bootstrap$ dul In Memory kcbzib_kcrsds_1 kccpb_sanity_check_2 MySQL恢复 ORA-00312 ORA-00607 ORA-00704 ORA-00742 ORA-01110 ORA-01555 ORA-01578 ORA-08103 ORA-600 2131 ORA-600 2662 ORA-600 2663 ORA-600 3020 ORA-600 4000 ORA-600 4137 ORA-600 4193 ORA-600 4194 ORA-600 16703 ORA-600 kcbzib_kcrsds_1 ORA-600 KCLCHKBLK_4 ORA-15042 ORA-15196 ORACLE 12C oracle dul ORACLE PATCH Oracle Recovery Tools oracle加密恢复 oracle勒索 oracle勒索恢复 oracle异常恢复 Oracle 恢复 ORACLE恢复 ORACLE数据库恢复 oracle 比特币 OSD-04016 YOUR FILES ARE ENCRYPTED 勒索恢复 比特币加密文章分类
- Others (2)
- 中间件 (2)
- WebLogic (2)
- 操作系统 (103)
- 数据库 (1,716)
- DB2 (22)
- MySQL (74)
- Oracle (1,576)
- Data Guard (52)
- EXADATA (8)
- GoldenGate (24)
- ORA-xxxxx (160)
- ORACLE 12C (72)
- ORACLE 18C (6)
- ORACLE 19C (15)
- ORACLE 21C (3)
- Oracle 23ai (8)
- Oracle ASM (68)
- Oracle Bug (8)
- Oracle RAC (54)
- Oracle 安全 (6)
- Oracle 开发 (28)
- Oracle 监听 (28)
- Oracle备份恢复 (575)
- Oracle安装升级 (94)
- Oracle性能优化 (62)
- 专题索引 (5)
- 勒索恢复 (81)
- PostgreSQL (18)
- PostgreSQL恢复 (6)
- SQL Server (28)
- SQL Server恢复 (9)
- TimesTen (7)
- 达梦数据库 (2)
- 生活娱乐 (2)
- 至理名言 (11)
- 虚拟化 (2)
- VMware (2)
- 软件开发 (37)
- Asp.Net (9)
- JavaScript (12)
- PHP (2)
- 小工具 (20)
-
最近发表
- 不当使用_allow_resetlogs_corruption参数引起ORA-600 2662错误
- CSSD signal 11 in thread clssnmRcfgMgrThread故障处理
- 使用sid方式直接访问pdb(USE_SID_AS_SERVICE_LISTENER)
- ORA-00069: cannot acquire lock — table locks disabled for xxxx
- ORA-600 [4000] [a]相关bug
- sql server数据库“正在恢复”故障处理
- 如何判断数据文件是否处于begin backup状态
- CDM备份缺少归档打开数据库报ORA-600 kcbzib_kcrsds_1故障处理
- ORA-07445: exception encountered: core dump [expgod()+43] [IN_PAGE_ERROR]
- 2025年第一起ORA-600 16703故障恢复
- _gc_undo_affinity=FALSE触发ORA-01558
- public授权语句
- 中文环境显示AR8MSWIN1256(阿拉伯语字符集)
- 处理 Oracle 块损坏
- Oracle各种类型坏块说明和处理
- fio测试io,导致磁盘文件系统损坏故障恢复
- ORA-742 写丢失常见bug记录
- Oracle 19c 202501补丁(RUs+OJVM)-19.26
- 避免 19c 数据库性能问题需要考虑的事项 (Doc ID 3050476.1)
- Bug 21915719 Database hang or may fail to OPEN in 12c IBM AIX or HPUX Itanium – ORA-742, DEADLOCK or ORA-600 [kcrfrgv_nextlwn_scn] ORA-600 [krr_process_read_error_2]
标签归档:clssnmRcfgMgrThread
CSSD signal 11 in thread clssnmRcfgMgrThread故障处理
一个客户,集群无法启动,只能启动到如下状态
查看cssd日志有CSSD signal 11 in thread clssnmRcfgMgrThread报错
2025-02-21 18:21:25.500: [ CSSD][2788693760]clssnmDoSyncUpdate: node(2) is transitioning from joining state to active state 2025-02-21 18:21:25.500: [ CSSD][2788693760]clssnmDoSyncUpdate: Wait for 0 vote ack(s) 2025-02-21 18:21:25.500: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk 2025-02-21 18:21:25.700: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk 2025-02-21 18:21:25.901: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk 2025-02-21 18:21:25.995: [ CSSD][2801538816]clssnmvDiskPing: Writing with status 0x2, timestamp 1740133285/5870104 2025-02-21 18:21:25.997: [ CSSD][2799818496]clssnmvDiskKillCheck: not evicted, file /dev/dm-4 flags 0x00000000, kill block unique 0, my unique 1740133265 2025-02-21 18:21:26.000: [ CSSD][2793424640]clssgmWaitOnEventValue: after CmInfo State val 3, eval 2 waited 500 2025-02-21 18:21:26.101: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk 2025-02-21 18:21:26.302: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk 2025-02-21 18:21:26.497: [ CSSD][2801538816]clssnmvDiskPing: Writing with status 0x2, timestamp 1740133286/5870604 2025-02-21 18:21:26.502: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk 2025-02-21 18:21:26.702: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk 2025-02-21 18:21:26.902: [ CSSD][2788693760]clssnmDoSyncUpdate: waiting to update states on disk 2025-02-21 18:21:26.997: [ CSSD][2799818496]clssnmvDiskKillCheck: not evicted, file /dev/dm-4 flags 0x00000000, kill block unique 0, my unique 1740133265 2025-02-21 18:21:26.997: [ CSSD][2801538816]clssnmvDiskPing: Writing with status 0x2, timestamp 1740133286/5871114 2025-02-21 18:21:27.000: [ CSSD][2793424640]clssgmWaitOnEventValue: after CmInfo State val 3, eval 2 waited 0 2025-02-21 18:21:27.102: [ CSSD][2788693760]clssnmCheckDskInfo: Checking disk info... 2025-02-21 18:21:27.102: [ CSSD][2788693760]clssnmCheckDskInfo: diskTimeout set to (200000)ms 2025-02-21 18:21:27.103: [ CSSD][2788693760]################################### 2025-02-21 18:21:27.103: [ CSSD][2788693760]clssscExit: CSSD signal 11 in thread clssnmRcfgMgrThread 2025-02-21 18:21:27.103: [ CSSD][2788693760]################################### 2025-02-21 18:21:27.103: [ CSSD][2788693760](:CSSSC00012:)clssscExit: A fatal error occurred and the CSS daemon is terminating abnormally 2025-02-21 18:21:27.103: [ CSSD][2788693760] ----- Call Stack Trace ----- 2025-02-21 18:21:27.103: [ CSSD][2788693760]calling call entry argument values in hex 2025-02-21 18:21:27.103: [ CSSD][2788693760]location type point (? means dubious value) 2025-02-21 18:21:27.103: [ CSSD][2788693760]-------------------- -------- -------------------- ---------------------------- 2025-02-21 18:21:27.109: [ CSSD][2788693760]clssscExit()+745 call kgdsdst() 000000000 ? 000000000 ? 2025-02-21 18:21:27.109: [ CSSD][2788693760] 7F9EA637A650 ? 7F9EA637A728 ? 2025-02-21 18:21:27.109: [ CSSD][2788693760] 7F9EA637F1D0 ? 000000003 ? 2025-02-21 18:21:27.109: [ CSSD][2788693760]s0clsssc_sighandler call clssscExit() 001FB9FA0 ? 000000002 ? 2025-02-21 18:21:27.109: [ CSSD][2788693760]()+616 7F9EA637A650 ? 7F9EA637A728 ? 2025-02-21 18:21:27.109: [ CSSD][2788693760] 7F9EA637F1D0 ? 000000003 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760]__sighandler() call s0clsssc_sighandler 00000000B ? 000000002 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760] () 7F9EA637A650 ? 7F9EA637A728 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760] 7F9EA637F1D0 ? 000000003 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760]clssnmCheckSplit()+ signal __sighandler() 001BEE8A8 ? 000000000 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760]378 002039A80 ? 000000001 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760] 0004D2B40 ? 7F9EA63803C0 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760]clssnmCheckDskInfo( call clssnmCheckSplit() 001FB9FA0 ? 001DC83F0 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760])+387 000030D40 ? 000000001 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760] 0004D2B40 ? 7F9EA63803C0 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760]clssnmDoSyncUpdate( call clssnmCheckDskInfo( 001FB9FA0 ? 001DC83F0 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760])+4692 ) 000000001 ? 000000001 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760] 0004D2B40 ? 7F9EA63803C0 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760]clssnmLocalJoinEven call clssnmDoSyncUpdate( 001FB9FA0 ? 001DC83F0 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760]t()+3992 ) FFFFFFFFFFFFFFFF ? 2025-02-21 18:21:27.110: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760] 7F9EA63803C0 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760]clssnmRcfgMgrThread call clssnmLocalJoinEven 001FB9FA0 ? 001DC83F0 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760]()+2290 t() FFFFFFFFFFFFFFFF ? 2025-02-21 18:21:27.110: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760] 7F9EA63803C0 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760]clssscthrdmain()+25 call clssnmRcfgMgrThread 001FB9FA0 ? 001DC83F0 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760]3 () FFFFFFFFFFFFFFFF ? 2025-02-21 18:21:27.110: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ? 2025-02-21 18:21:27.110: [ CSSD][2788693760] 7F9EA63803C0 ? 2025-02-21 18:21:27.111: [ CSSD][2788693760]start_thread()+209 call clssscthrdmain() 001FB9FA0 ? 001DC83F0 ? 2025-02-21 18:21:27.111: [ CSSD][2788693760] FFFFFFFFFFFFFFFF ? 2025-02-21 18:21:27.111: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ? 2025-02-21 18:21:27.111: [ CSSD][2788693760] 7F9EA63803C0 ? 2025-02-21 18:21:27.111: [ CSSD][2788693760]clone()+109 call start_thread() 7F9EA6381700 ? 001DC83F0 ? 2025-02-21 18:21:27.111: [ CSSD][2788693760] FFFFFFFFFFFFFFFF ? 2025-02-21 18:21:27.111: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ? 2025-02-21 18:21:27.111: [ CSSD][2788693760] 7F9EA63803C0 ? 2025-02-21 18:21:27.111: [ CSSD][2788693760]0000000000000000 call clone() 7F9EA6381700 ? 001DC83F0 ? 2025-02-21 18:21:27.111: [ CSSD][2788693760] FFFFFFFFFFFFFFFF ? 2025-02-21 18:21:27.111: [ CSSD][2788693760] 000000001 ? 7F9EA6380D20 ? 2025-02-21 18:21:27.111: [ CSSD][2788693760] 7F9EA63803C0 ? 2025-02-21 18:21:27.111: [ CSSD][2788693760] 2025-02-21 18:21:27.111: [ CSSD][2788693760]--------------------- Binary Stack Dump ---------------------
这里提示表决盘超时,尝试启动nocrs貌似,在表决盘存在的情况下,启动依旧失败,通过处理让启动过程不读表决盘,启动nocrs模式成功,并mount其他业务磁盘组
确认其他磁盘没有问题,重建crs磁盘组
SQL> create diskgroup OCR external redundancy disk '/dev/dm-4' force attribute 'COMPATIBLE.ASM' = '11.2.0'; # ocrconfig -restore /u01/app/11.2.0.3/grid/cdata/scan/backup00.ocr # crsctl replace votedisk +OCR SQL> create spfile from pfile='/tmp/pfile.asm';
然后重启crs恢复正常