dbWorker3
Folks,
IDS11.50FC8, RHEL6.
[informix@ncdopsdba101 tmp]$ onstat -g ath
IBM Informix Dynamic Server Version 11.50.FC8 -- On-Line -- Up 01:48:45
-- 13803348 Kbytes
Threads:tid tcb rstcb prty status
vp-class name
2 213effd70 0 1 IO Idle
14lio* lio vp 0
3 213f372a8 0 1 IO Idle
15pio* pio vp 0
4 213f572a8 0 1 IO Idle
16aio* aio vp 0
5 213f762a8 0 1 IO Idle
17msc* msc vp 0
6 213fa52a8 0 1 IO Idle
18fifo* fifo vp 0
7 213fc52a8 0 1 IO Idle
19aio* aio vp 1
8 213fe42a8 0 1 IO Idle
20aio* aio vp 2
9 2140032a8 0 1 IO Idle
21aio* aio vp 3
10 214022548 213394028 3 sleeping secs: 1
7cpu main_loop()
11 213f37c50 0 1 running
22soc* soctcppoll
12 213f577b8 0 1 running
23soc* soctcppoll
13 213f57d70 0 1 running
24soc* soctcppoll
14 213f76918 0 1 running
25soc* soctcppoll
15 213fa55c0 0 1 running
1cpu* sm_poll
16 213ee1890 0 2 sleeping forever
1cpu* soctcplst
17 2143202c8 0 2 sleeping forever
1cpu sm_listen
18 21440b9b8 0 1 sleeping secs: 1
8cpu sm_discon
19 214461c40 0 2 sleeping forever
7cpu* soctcplst
20 2144c6418 0 2 sleeping forever
8cpu* soctcplst
21 2144c6d90 213394880 1 sleeping secs: 1
9cpu flush_sub(0)
22 2144e90e0 2133950d8 1 sleeping secs: 1
9cpu flush_sub(1)
23 2144e93f8 213395930 1 sleeping secs: 1
9cpu flush_sub(2)
24 2144e9710 213396188 1 sleeping secs: 1
9cpu flush_sub(3)
25 2144e9a28 2133969e0 1 sleeping secs: 1
7cpu flush_sub(4)
26 2144e9d40 213397238 1 sleeping secs: 1
8cpu flush_sub(5)
27 2145760e0 213397a90 1 sleeping secs: 1
9cpu flush_sub(6)
28 2145763f8 2133982e8 1 sleeping secs: 1
7cpu flush_sub(7)
29 214576710 213398b40 1 sleeping secs: 1
8cpu flush_sub(8)
30 214576a28 213399398 1 sleeping secs: 1
9cpu flush_sub(9)
31 214576d40 213399bf0 1 sleeping secs: 1
9cpu flush_sub(10)
32 2146120e0 21339a448 1 sleeping secs: 1
7cpu flush_sub(11)
33 2146123f8 21339aca0 1 sleeping secs: 1
1cpu flush_sub(12)
34 214612710 21339b4f8 1 sleeping secs: 1
7cpu flush_sub(13)
35 214612a28 21339bd50 1 sleeping secs: 1
7cpu flush_sub(14)
36 214612d90 21339c5a8 1 sleeping secs: 1
9cpu flush_sub(15)
37 2146ae130 0 3 IO Idle
1cpu* kaio
38 21481b418 21339ce00 2 sleeping secs: 1
9cpu aslogflush
39 21493a220 21339d658 1 sleeping secs: 17
13cpu btscanner_0
41 2149983e8 0 3 IO Idle
7cpu* kaio
62 214bc3028 21339ef60 3 sleeping secs: 1
1cpu* onmode_mon
63 214bc3288 21339e708 3 sleeping secs: 1
9cpu periodic
70 214dce028 0 3 IO Idle
9cpu* kaio
71 214c4d278 0 3 IO Idle
8cpu* kaio
72 214c4d590 0 3 IO Idle
10cpu* kaio
74 214c4ead8 2133a0868 1 sleeping secs: 95
11cpu* dbScheduler
76 214a36ca0 2133a0010 1 sleeping forever
1cpu dbWorker1
77 214ad32c8 21339f7b8 1 sleeping forever
1cpu dbWorker2
78 214bbfab8 0 3 IO Idle
11cpu* kaio
79 214b1f310 2133a10c0 1 cond wait netnorm
7cpu sqlexec
80 215096418 0 3 IO Idle
12cpu* kaio
87 21512a1e8 0 3 IO Idle
13cpu* kaio
88 2151c8568 2133a1918 1 cond wait bp_cond
8cpu bf_priosweep()
Apparently, There is no dbWorker3 in the above list ( only dbWorker1 and
dbWorker2)
So, dbWorker3 just dump things(see below) and run ?
If possible, Please shed light on how to stop dbWorker3's dump.
Thanks,
Frank
[informix@ncdopsdba101 tmp]$ more af.4480f24
01:11:00 Context ptr = 0x000000000178a340
01:11:00 Siginfo ptr = 0x000000000178a470
01:11:00 Reg 0(R8) 0x0000000000000000 Reg 1(R9)
0x0000000000000000
01:11:00 Reg 2(R10) 0x0000000000000008 Reg 3(R11)
0x0000000000000246
01:11:00 Reg 4(R12) 0x00000000495d96b0 Reg 5(R13)
0x0000000215a646f0
01:11:00 Reg 6(R14) 0x0000000215a646e0 Reg 7(R15)
0x0000000215a64c00
01:11:00 Reg 8(RDI) 0x0000000215a646e0 Reg 9(RSI)
0x0000000214b68028
01:11:00 Reg 10(RBP) 0x0000000215a646e0 Reg 11(RBX)
0x0000000000000001
01:11:00 Reg 12(RDX) 0x0000000000000000 Reg 13(RAX)
0x0000000000000000
01:11:00 Reg 14(RCX) 0x0000003ba0c32be0 Reg 15(RSP)
0x0000000215a643e0
01:11:00 Reg 16(RIP) 0x000000000064bfe4 Reg 17(EFL)
0x0000000000010246
01:11:00 Reg 18(CSGSFS) 0x0000000000000033 Reg 19(ERR)
0x0000000000000004
01:11:00 Reg 20(TRAPNO) 0x000000000000000e Reg 21(OLDMASK)
0x0000000000000000
01:11:00 Reg 22(CR2) 0x0000000000000010
01:11:00
01:11:00 IBM Informix Dynamic Server Version 11.50.FC8 Software Serial
Number AAA#B000000
01:11:00 Assert Failed: Exception Caught. Type: MT_EX_OS, Context: mem
01:11:00 Who: Session(42, informix@, 0, 0x2133dccf8)
Thread(96, dbWorker3, 21339deb0, 8)
File: mtex.c Line: 417
01:11:00 Action: Please notify IBM Informix Technical Support.
01:11:00 Raw hex dump of stack located in /tmp/af.4480f24.rawstk
01:11:00 Stack for thread: 96 dbWorker3
base: 0x0000000215a46000
len: 135168
pc: 0x00000000010c91d7
tos: 0x0000000001789450
state: running
vp: 8
0x00000000010c91d7 (oninit) afstack
0x00000000010cb12c (oninit) afhandler
0x00000000010cb9e4 (oninit) affail_interface
0x00000000010cf7e9 (oninit) mt_ex_throw_sig
0x000000000108d895 (oninit) afsig_handler
0x0000003ba140f710 (Linux) <signal frame>
0x000000000064bfe4 (oninit) sqapi_error_desc_first
0x000000000064e5c8 (oninit) sqapi_callback_list_call
0x000000000064eab8 (oninit) sqapi_call_callbacks
0x000000000064ca4c (oninit) sqapi_error_dispatch
0x000000000064d0e3 (oninit) sqapi_online_error
0x0000000000549e19 (oninit) mi_exec
0x0000000000d59383 (oninit) aus_refresh
0x0000000000968514 (oninit) udrlm_clang_execute_internal
0x000000000096a319 (oninit) udrlm_clang_execute
0x0000000000907846 (oninit) udrlm_exec_routine
0x000000000063e641 (oninit) udr_execute
0x0000000000559aa5 (oninit) mi_routine_exec
0x0000000000d507d9 (oninit) ph_exec_func
0x0000000000d55511 (oninit) ph_execute
0x0000000000d55be8 (oninit) do_task
0x0000000000d568a8 (oninit) db_sch_worker
0x000000000096861e (oninit) udrlm_clang_execute_internal
0x000000000096a319 (oninit) udrlm_clang_execute
0x0000000000907846 (oninit) udrlm_exec_routine
0x000000000063e641 (oninit) udr_execute
0x0000000000d4dda5 (oninit) dbsched_start_udr
0x000000000109a9bb (oninit) startup
01:11:00 See Also: /tmp/af.4480f24, shmem.4480f24.0
---------------------------------
Begin System Alarm Program Output
---------------------------------
Assertion Failure Type: FAILURE
Host Name: ncdopsdba101
Database Server Name: ncdcops101_tcp
Time of failure: Sat Jan 25 01:11:00 UTC 2014
AF file: /tmp/af.4480f24
Shared memory file: None
System Blocking: OFF
===========------------- - - - - - -
tail -100 /dbbackup/online_log/online_ops.log:
00:13:33 Started 1 B-tree scanners.
00:13:33 B-tree scanner threshold set at 5000.
00:13:33 B-tree scanner range scan size set to -1.
00:13:33 B-tree scanner ALICE mode set to 6.
00:13:33 B-tree scanner index compression level set to med.
00:13:33 Physical Recovery Started at Page (2:808252).
00:13:33 Physical Recovery Complete: 0 Pages Examined, 0 Pages Restored.
00:13:33 Logical Recovery Started.
00:13:33 16 recovery worker threads will be started.
00:13:34 Logical Recovery has reached the transaction cleanup phase.@