repeated crash of informix

Our QA box is experiencing crash repeatedly. SunOS webqa 5.6 Generic_105181-33 sun4u sparc SUNW,Ultra-4. top component of af file: 12:13:01 Informix Dynamic Server 2000 Version 9.21.UC4 12:13:01 Assert Failed: Condition Failed (Bad block pointer 0xffffffe7 in pool 0x21002020), In (mt_shm_fr ee) 12:13:02 Who: Session(53, api@webqa, 6686, 554966472) Thread(85, sqlexec, 2111d558, 7) File: mtshpool.c Line: 3080 12:13:02 Action: Please notify Informix Technical Support. 12:13:02 Stack for thread: 85 sqlexec base: 0x21c07000 len: 36864 pc: 0x006d3bf8 tos: 0x21c0ef80 state: running vp: 7 0x006d2fbc (oninit)afhandler(0x43da11d, 0x1, 0x0, 0x21141dc8, 0x2, 0x2111d558) 0x006d2988 (oninit)affail_interface(0x21c0f6d8, 0x0, 0x2523bfc8, 0x1, 0x9d1350, 0xc08) 0x006c9a38 (oninit)mem_asfail(0x21c0f9b8, 0x9d0e04, 0xffffffe7, 0x21002020, 0x2100207c, 0x21c04594) 0x006c6f84 (oninit)mt_shm_free(0x21002020, 0xffffffff, 0x92441c, 0x2d7c, 0x1, 0x21b460c1) 0x00749fb0 (oninit)meFree (0x1, 0xffffffff, 0x0, 0xfffffff8, 0x0, 0x21b46d31) 0x006ef8b4 (oninit)frSqlEnv(0x1, 0x21c04510, 0x21c0fd6c, 0x21c002b8, 0x21c0fc4c, 0xef508c10) 0x00711d5c (oninit)cmDiscon(0x0, 0xa, 0x21c0fd6c, 0x21b46170, 0x21b460d8, 0x21c05078) 0x0070e824 (oninit)ascAbort(0x21b7fcfc, 0x21b460d8, 0x21c0fd68, 0x0, 0xef766b70, 0xef508c10) 0x006ebfe8 (oninit)asfExit (0xa, 0x21c0fd68, 0x21b46060, 0x21b46518, 0x21b460d8, 0x21b7fcfc) 0x006ebcf8 (oninit)ASF_Call(0x0, 0x21c0fd68, 0xffffffff, 0x21c05058, 0x39, 0x21c0fd71) 0x003e8f98 (oninit)sqscb_cleanup(0xa42fb0, 0x9a103c, 0x80000, 0x1000, 0x0, 0x21c0feb6) 0x006b78dc (oninit)destroy_session(0x21b15ad0, 0x2, 0x21c06018, 0x39, 0xef766b70, 0xef508c10) 0x003b8894 (oninit)sq_exit (0x38, 0x0, 0x134e, 0x0, 0x21c66460, 0x21b7f018) 0x003b3da8 (oninit)sqmain (0xa4e808, 0xa2f08c, 0xa42fb0, 0xc, 0xa, 0xef508c10) 0x006b3a08 (oninit)startup (0xa49000, 0xa39c00, 0x21008270, 0x0, 0x0, 0x21008270) 0x006aca10 (oninit)mt_poll_yield(0x0, 0x0, 0x0, 0x0, 0x0, 0x0) 0x00000000 (*nosymtab*)0x0 ============================= It has crashed 7 times since yesterday with the same af file and 6 times it was not vp: 1. so informix kept running. the session which was running last is: /opt/informix/bin/onstat -g sql 53: Informix Dynamic Server 2000 Version 9.21.UC4 -- On-Line -- Up 00:19:32 -- 504832 Kbytes Sess SQL Current Iso Lock SQL ISAM F.E. Id Stmt type Database Lvl Mode ERR ERR Vers 53 - - - Not Wait 0 0 9.03 Last parsed SQL statement : SELECT count(*) FROM request WHERE avail_done = 'N' AND index_oj <= 0 AND (((index BETWEEN 2000 AND 2999) AND dest_code IN( 2000 )) OR ((index >= 3200) AND request_mod( index ) BETWEEN 200 AND 299)) /opt/informix/bin/onstat -g ses 53: Informix Dynamic Server 2000 Version 9.21.UC4 -- On-Line -- Up 00:19:32 -- 504832 Kbytes session #RSAM total used id user tty pid hostname threads memory memory 53 api - 6686 webqa 1 159744 66328 tid name rstcb flags curstk status 85 sqlexec 2111d558 ---P--- 4136 2111d558 running Memory pools count 1 name class addr totalsize freesize #allocfrag #freefrag 53 V 21b7e020 159744 93416 173 58 name free used name free used overhead 0 1648 scb 0 96 opentable 0 22312 filetable 0 2624 log 0 2152 temprec 0 16200 keys 0 576 gentcb 0 1240 ostcb 0 2520 sort 0 56 sqscb 0 13112 sql 0 40 rdahead 0 256 hashfiletab 0 280 osenv 0 1464 sqtcb 0 1752 Sess SQL Current Iso Lock SQL ISAM F.E. Id Stmt type Database Lvl Mode ERR ERR Vers 53 - - - Not Wait 0 0 9.03 The program with that SQL code has not changed in months. from the af file does it mean that the crash is occuring after a seesion terminates. TIA.

This error is indicating problems with memory, are you getting any O/S messages in you error logs? It could be one of your memory chips is breaking down. Otherwise Call Tech Support. Keith -> -----Original Message----- -> From: rkusenet [mailto:rkusenet@sympatico.ca] -> Sent: Wednesday, February 05, 2003 9:52 PM -> To: ids@iiug.org -> Subject: repeated crash of informix [255] -> -> -> Our QA box is experiencing crash repeatedly. -> -> SunOS webqa 5.6 Generic_105181-33 sun4u sparc SUNW,Ultra-4. -> -> top component of af file: -> -> 12:13:01 Informix Dynamic Server 2000 Version 9.21.UC4 -> 12:13:01 Assert Failed: Condition Failed (Bad block pointer -> 0xffffffe7 in pool 0x21002020), In -> (mt_shm_fr -> ee) -> 12:13:02 Who: Session(53, api@webqa, 6686, 554966472) -> Thread(85, sqlexec, 2111d558, 7) -> File: mtshpool.c Line: 3080 -> 12:13:02 Action: Please notify Informix Technical Support. -> 12:13:02 Stack for thread: 85 sqlexec -> -> base: 0x21c07000 -> len: 36864 -> pc: 0x006d3bf8 -> tos: 0x21c0ef80 -> state: running -> vp: 7 -> -> 0x006d2fbc (oninit)afhandler(0x43da11d, 0x1, 0x0, -> 0x21141dc8, 0x2, 0x2111d558) -> 0x006d2988 (oninit)affail_interface(0x21c0f6d8, 0x0, -> 0x2523bfc8, 0x1, 0x9d1350, 0xc08) -> 0x006c9a38 (oninit)mem_asfail(0x21c0f9b8, 0x9d0e04, -> 0xffffffe7, 0x21002020, 0x2100207c, 0x21c04594) -> 0x006c6f84 (oninit)mt_shm_free(0x21002020, 0xffffffff, -> 0x92441c, 0x2d7c, 0x1, 0x21b460c1) -> 0x00749fb0 (oninit)meFree (0x1, 0xffffffff, 0x0, -> 0xfffffff8, 0x0, 0x21b46d31) -> 0x006ef8b4 (oninit)frSqlEnv(0x1, 0x21c04510, 0x21c0fd6c, -> 0x21c002b8, 0x21c0fc4c, 0xef508c10) -> 0x00711d5c (oninit)cmDiscon(0x0, 0xa, 0x21c0fd6c, -> 0x21b46170, 0x21b460d8, 0x21c05078) -> 0x0070e824 (oninit)ascAbort(0x21b7fcfc, 0x21b460d8, -> 0x21c0fd68, 0x0, 0xef766b70, 0xef508c10) -> 0x006ebfe8 (oninit)asfExit (0xa, 0x21c0fd68, 0x21b46060, -> 0x21b46518, 0x21b460d8, 0x21b7fcfc) -> 0x006ebcf8 (oninit)ASF_Call(0x0, 0x21c0fd68, 0xffffffff, -> 0x21c05058, 0x39, 0x21c0fd71) -> 0x003e8f98 (oninit)sqscb_cleanup(0xa42fb0, 0x9a103c, -> 0x80000, 0x1000, 0x0, 0x21c0feb6) -> 0x006b78dc (oninit)destroy_session(0x21b15ad0, 0x2, -> 0x21c06018, 0x39, 0xef766b70, 0xef508c10) -> 0x003b8894 (oninit)sq_exit (0x38, 0x0, 0x134e, 0x0, -> 0x21c66460, 0x21b7f018) -> 0x003b3da8 (oninit)sqmain (0xa4e808, 0xa2f08c, 0xa42fb0, -> 0xc, 0xa, 0xef508c10) -> 0x006b3a08 (oninit)startup (0xa49000, 0xa39c00, 0x21008270, -> 0x0, 0x0, 0x21008270) -> 0x006aca10 (oninit)mt_poll_yield(0x0, 0x0, 0x0, 0x0, 0x0, 0x0) -> 0x00000000 (*nosymtab*)0x0 -> ============================= -> -> It has crashed 7 times since yesterday with the same af file -> and 6 times it was not vp: 1. -> so informix kept running. -> -> the session which was running last is: -> -> /opt/informix/bin/onstat -g sql 53: -> -> Informix Dynamic Server 2000 Version 9.21.UC4 -- On-Line -> -- Up 00:19:32 -- 504832 Kbytes -> -> Sess SQL Current Iso Lock SQL ISAM F.E. -> Id Stmt type Database Lvl Mode ERR ERR Vers -> 53 - - - Not Wait 0 0 9.03 -> -> Last parsed SQL statement : -> SELECT count(*) FROM request WHERE avail_done = 'N' AND -> index_oj <= 0 AND -> (((index BETWEEN 2000 AND 2999) AND dest_code IN( 2000 -> )) OR ((index >= -> 3200) AND request_mod( index ) BETWEEN 200 AND 299)) -> -> /opt/informix/bin/onstat -g ses 53: -> -> Informix Dynamic Server 2000 Version 9.21.UC4 -- On-Line -> -- Up 00:19:32 -- 504832 Kbytes -> -> session #RSAM total used -> id user tty pid hostname threads memory -> memory -> 53 api - 6686 webqa 1 159744 -> 66328 -> -> tid name rstcb flags curstk status -> 85 sqlexec 2111d558 ---P--- 4136 2111d558 running -> -> Memory pools count 1 -> name class addr totalsize freesize #allocfrag #freefrag -> 53 V 21b7e020 159744 93416 173 58 -> -> name free used name free -> used -> overhead 0 1648 scb 0 96 -> opentable 0 22312 filetable 0 -> 2624 -> log 0 2152 temprec 0 -> 16200 -> keys 0 576 gentcb 0 -> 1240 -> ostcb 0 2520 sort 0 56 -> sqscb 0 13112 sql 0 40 -> rdahead 0 256 hashfiletab 0 -> 280 -> osenv 0 1464 sqtcb 0 -> 1752 -> -> Sess SQL Current Iso Lock SQL ISAM F.E. -> Id Stmt type Database Lvl Mode ERR ERR Vers -> 53 - - - Not Wait 0 0 9.03 -> -> -> -> The program with that SQL code has not changed in months. -> from the af file does it mean that the crash is occuring after -> a seesion terminates. -> -> TIA. -> -> ******************************************************************************** ** This message is sent in strict confidence for the addressee only. It may contain legally privileged information. The contents are not to be disclosed to anyone other than the addressee. Unauthorised recipients are requested to preserve this confidentiality and to advise the sender immediately of any error in transmission. This footnote also confirms that this email message has been swept for the presence of computer viruses, however we cannot guarantee that this message is free from such problems. ******************************************************************************** **