一个备库,检查发现日志不断出现以下告警:
-
errors in file /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_126106.trc:
-
ora-15025: could not open disk "/dev/asm-diskf"
-
ora-27041: unable to open file
-
linux-x86_64 error: 13: permission denied
-
additional information: 3
-
errors in file /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_126106.trc:
-
ora-15025: could not open disk "/dev/asm-diskf"
-
ora-27041: unable to open file
-
linux-x86_64 error: 13: permission denied
-
additional information: 3
-
warning: failed to read mirror side 1 of virtual extent 7 logical extent 0 of file 256 in group [1.1312465768] from disk data_0003 allocation unit 67556 reason error; if possible, will try another mirror side
-
fri jul 29 17:49:03 2022
-
errors in file /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_126495.trc:
-
ora-15025: could not open disk "/dev/asm-diskf"
-
ora-27041: unable to open file
-
linux-x86_64 error: 13: permission denied
-
additional information: 3
-
errors in file /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_126495.trc:
-
ora-15025: could not open disk "/dev/asm-diskf"
-
ora-27041: unable to open file
-
linux-x86_64 error: 13: permission denied
-
additional information: 3
-
warning: failed to read mirror side 1 of virtual extent 7 logical extent 0 of file 256 in group [1.1312465768] from disk data_0003 allocation unit 67556 reason error; if possible, will try another mirror side
每30秒就出现一次,而且每次都是diskf,简单看一眼 ls -l /dev/asm-diskf 权限正常,
-
[root@db01 ~]# ls -l /dev/|grep asm
-
lrwxrwxrwx 1 root root 3 jul 29 16:55 asm-diske -> sdf
-
lrwxrwxrwx 1 root root 3 jul 29 16:55 asm-diskf -> sdg
-
lrwxrwxrwx 1 root root 3 jul 29 16:55 asm-diskg -> sdh
-
lrwxrwxrwx 1 root root 3 jul 29 16:55 asm-diskh -> sdi
-
brw-rw---- 1 grid asmadmin 8, 80 jul 29 17:49 sdf
-
brw-rw---- 1 grid asmadmin 8, 96 jul 29 17:49 sdg
-
brw-rw---- 1 grid asmadmin 8, 112 jul 29 17:49 sdh
-
。。。
dg状态正常。
看看这个trc文件中有啥线索没
-
[root@db02 ~]# cat /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_108564.trc
-
trace file /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_108564.trc
-
oracle database 11g enterprise edition release 11.2.0.4.0 - 64bit production
-
with the partitioning, real application clusters, automatic storage management, olap,
-
data mining and real application testing options
-
oracle_home = /oracle/app/oracle/product/11.2.0/db_1
-
system name: linux
-
node name: db02
-
release: 2.6.32-696.el6.x86_64
-
version: #1 smp tue feb 21 00:53:17 est 2017
-
machine: x86_64
-
vm name: vmware version: 6
-
instance name: orcldg
-
redo thread mounted by this instance: 1
-
oracle process number: 56
-
unix process pid: 108564, image: oracle@db02 (tns v1-v3)
-
-
-
*** 2022-07-29 17:08:37.046
-
*** session id:(6.809) 2022-07-29 17:08:37.046
-
*** client id:() 2022-07-29 17:08:37.046
-
*** service name:(sys$users) 2022-07-29 17:08:37.046
-
*** module name:(sqlplus@db02 (tns v1-v3)) 2022-07-29 17:08:37.046
-
*** action name:() 2022-07-29 17:08:37.046
-
-
warning: failed to open a disk[/dev/asm-diskf]
-
ora-15025: could not open disk "/dev/asm-diskf"
-
ora-27041: unable to open file
-
linux-x86_64 error: 13: permission denied
-
additional information: 3
-
kfk_debug_get_user_groups: uid:10050, euid:502, gid:10050, egid:1001
-
warning: failed to open a disk[/dev/asm-diskf]
-
ora-15025: could not open disk "/dev/asm-diskf"
-
ora-27041: unable to open file
-
linux-x86_64 error: 13: permission denied
-
additional information: 3
-
kfk_debug_get_user_groups: uid:10050, euid:502, gid:10050, egid:1001
-
warning: disk locally closed resulting in i/o error
-
warning: read failed. group:1 disk:3 au:67556 offset:532480 size:8192
-
path:unknown disk
-
incarnation:0x57da53a8 synchronous result:'i/o error'
-
subsys:unknown library iop:0x7f3be4747000 bufp:0x2146f0000 osderr:0x0 osderr1:0x0
-
warning: failed to read mirror side 1 of virtual extent 7 logical extent 0 of file 256 in group [1.1312465768] from disk data_0003 allocation unit 67556 reason error; if possible, will try another mirror side
-
dde rules only execution for: ora 1110
-
----- start event driven actions dump ----
-
---- end event driven actions dump ----
-
----- start dde actions dump -----
-
executing sync actions
-
----- start dde action: 'db_structure_integrity_check' (async) -----
-
successfully dispatched
-
----- end dde action: 'db_structure_integrity_check' (success, 0 csec) -----
-
executing async actions
根据uid信息可以看出关联的用户grep 10050 /etc/passwd
是一个sdata用户,ps -ef|grep sdata 看到启动的zabbix相关进程(我就不点名批评奇点了)
此备库原先应该是一套rac,节点2估计是废弃了,只有节点1在运行,数据文件都在asm磁盘组上
检查文件权限
[oracle@db01 ~]$ ls -l $oracle_home/bin/oracle
-rwsr-s--x 1 oracle
oinstall 242786629 jul 3 2021 /oracle/app/oracle/product/11.2.0/db_1/bin/oracle
[oracle@db01 ~]$ chown
oracle:asmadmin $oracle_home/bin/oracle
烦人的permission denied消失,连 chmod 6751 $oracle_home/bin/oracle 都没用上。
阅读(930) | 评论(0) | 转发(0) |