post_alarm_message 18-186758
User reported errors inserting into mon_page_usage table (errors -271 and -103 with illegal key descriptor), page bitmap corruption in tablespace 14, and dbWorker thread failures. Art Kagel suggested the sysadmin database schema may be corrupted from an upgrade and recommended dropping/recreating it. When user attempted to recreate sysadmin, they encountered further corruption errors in mon_compression_estimates and tablespace allocation.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
hi,
we get this message on informix log file:
08:17:36 SCHAPI: Re-starting 1 dbWorker threads.
08:17:36 SCHAPI: Started 1 dbWorker threads.
08:17:36 SCHAPI: [post_alarm_message 18-186758] Error -271 Could not insert
new row into the table.
08:17:36 SCHAPI: [post_alarm_message 18-186758] Error -103 ISAM error: illegal
key descriptor (too many parts or too long).
08:17:36 SCHAPI: thread dbWorker1 task post_alarm_message(18-186758) shutting
down
08:17:37 Logical Log 134405 - Backup Completed
08:17:37 SCHAPI: Re-starting 1 dbWorker threads.
08:17:37 SCHAPI: Started 1 dbWorker threads.
08:17:37 Logical Log 134406 - Backup Started
08:17:37 SCHAPI: [post_alarm_message 18-186759] Error -271 Could not insert
new row into the table.
08:17:37 SCHAPI: [post_alarm_message 18-186759] Error -103 ISAM error: illegal
key descriptor (too many parts or too long).
08:17:37 SCHAPI: thread dbWorker2 task post_alarm_message(18-186759) shutting
down
also this message at tmp directory, af file
16:22:22 IBM Informix Dynamic Server Version 11.70.FC1 Software Serial Numb
er AAA#B000000
16:22:22 Assert Failed: Page Check Error in mappage:bad bitmap page
16:22:22 Who: Session(40, informix@, 0, c0000000206fe610)
Thread(91, dbWorker1, c0000000206bc620, 4)
File: rsdebug.c Line: 1074
16:22:22 Results: Possible inconsistencies in 'TBLSpace 14'
16:22:22 Action: Run 'oncheck -cD 14'
16:22:22 Raw hex dump of stack located in /tmp/af.443cfbd.rawstk
16:22:22 Stack for thread: 91 dbWorker1
Current SQL statement :
INSERT INTO mon_page_usage select 4 , trunc(P.partnum / 1048577)
as dbsnum, CASE WHEN P.nkeys = 1 AND P.npused > 1 AND P.npdata = 0 AND
P.partnum <> P.lockid AND bitand(P.flags,4) = 0 THEN "I" ELSE "T" END as
type, P.partnum, P.lockid, P.nextns, P.nrows, P.nptotal, P.npused,
P.nptotal - ( BM.partly_used+BM.mostly_used+BM.very_full) AS free
,BM.partly_used ,BM.mostly_used , BM.very_full, CURRENT FROM
sysmaster:sysptnhdr P, outer (select b.pb_partnum as partnum,
(b.pb_partnum/1048577)::integer as dbsnum ,sum(decode(bitand(b.pb_bitmap,
12),4 ,1,0)) as partly_used ,sum(decode(bitand(b.pb_bitmap, 12),8 ,1,0))
as mostly_used ,sum(decode(bitand(b.pb_bitmap, 12),12,1,0)) as very_full
from sysmaster:sysptnbit b where b.pb_bitmap > 0 group by b.pb_partnum )
as BM WHERE P.partnum = BM.partnum and bitand(p.flags,"0xE0") = 0 and
sysmaster:partpagenum(P.partnum)>1;UPDATE STATISTICS HIGH FOR TABLE
mon_page_usage(ID,dbsnum,partnum,lockid)
i think this table on sysadmin, i already disable AUS mode.
we i check this table, no record:
sql>select * from mon_page_usage;
No rows found.
my question:
1. this is error or what? IF this error ,what we need to do to avoid this?
2. dbWorker threads uses for what?
3. bad bitmap page error? why and function table mon_page_usage?
Please advice..
thank you
Did you recently upgrade? Sometimes sysadmin doesn't drop during the
upgrade but some new functions are installed over the older schema. Look
for an article on dropping and recreating sysadmin which should fix this
one. Hmm, might fix the other deadlock problem as well, but I'm not sure.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Wed, May 8, 2013 at 8:12 PM, MOHD FADZIL JUSOH <fadzil@isianpadu.com>wrote:
> hi,
>
> we get this message on informix log file:
>
> 08:17:36 SCHAPI: Re-starting 1 dbWorker threads.
> 08:17:36 SCHAPI: Started 1 dbWorker threads.
> 08:17:36 SCHAPI: [post_alarm_message 18-186758] Error -271 Could not insert
> new row into the table.
>
> 08:17:36 SCHAPI: [post_alarm_message 18-186758] Error -103 ISAM error:
> illegal
> key descriptor (too many parts or too long).
>
> 08:17:36 SCHAPI: thread dbWorker1 task post_alarm_message(18-186758)
> shutting
> down
> 08:17:37 Logical Log 134405 - Backup Completed
> 08:17:37 SCHAPI: Re-starting 1 dbWorker threads.
> 08:17:37 SCHAPI: Started 1 dbWorker threads.
> 08:17:37 Logical Log 134406 - Backup Started
> 08:17:37 SCHAPI: [post_alarm_message 18-186759] Error -271 Could not insert
> new row into the table.
>
> 08:17:37 SCHAPI: [post_alarm_message 18-186759] Error -103 ISAM error:
> illegal
> key descriptor (too many parts or too long).
>
> 08:17:37 SCHAPI: thread dbWorker2 task post_alarm_message(18-186759)
> shutting
> down
>
> also this message at tmp directory, af file
>
> 16:22:22 IBM Informix Dynamic Server Version 11.70.FC1 Software Serial Numb
> er AAA#B000000
>
> 16:22:22 Assert Failed: Page Check Error in mappage:bad bitmap page
> 16:22:22 Who: Session(40, informix@, 0, c0000000206fe610)
>
> Thread(91, dbWorker1, c0000000206bc620, 4)
>
> File: rsdebug.c Line: 1074
> 16:22:22 Results: Possible inconsistencies in 'TBLSpace 14'
> 16:22:22 Action: Run 'oncheck -cD 14'
> 16:22:22 Raw hex dump of stack located in /tmp/af.443cfbd.rawstk
> 16:22:22 Stack for thread: 91 dbWorker1
>
> Current SQL statement :
> INSERT INTO mon_page_usage select 4 , trunc(P.partnum / 1048577)>
> as dbsnum, CASE WHEN P.nkeys = 1 AND P.npused > 1 AND P.npdata = 0 AND
>
> P.partnum <> P.lockid AND bitand(P.flags,4) = 0 THEN "I" ELSE "T" END as
>
> type, P.partnum, P.lockid, P.nextns, P.nrows, P.nptotal, P.npused,
>
> P.nptotal - ( BM.partly_used+BM.mostly_used+BM.very_full) AS free
>
> ,BM.partly_used ,BM.mostly_used , BM.very_full, CURRENT FROM
>
> sysmaster:sysptnhdr P, outer (select b.pb_partnum as partnum,
>
> (b.pb_partnum/1048577)::integer as dbsnum ,sum(decode(bitand(b.pb_bitmap,
>
> 12),4 ,1,0)) as partly_used ,sum(decode(bitand(b.pb_bitmap, 12),8 ,1,0))
>
> as mostly_used ,sum(decode(bitand(b.pb_bitmap, 12),12,1,0)) as very_full
>
> from sysmaster:sysptnbit b where b.pb_bitmap > 0 group by b.pb_partnum )
>
> as BM WHERE P.partnum = BM.partnum and bitand(p.flags,"0xE0") = 0 and
>
> sysmaster:partpagenum(P.partnum)>1;UPDATE STATISTICS HIGH FOR TABLE
>
> mon_page_usage(ID,dbsnum,partnum,lockid)
>
> i think this table on sysadmin, i already disable AUS mode.
>
> we i check this table, no record:
>
> sql>select * from mon_page_usage;>
> No rows found.
>
> my question:
>
> 1. this is error or what? IF this error ,what we need to do to avoid this?
> 2. dbWorker threads uses for what?
> 3. bad bitmap page error? why and function table mon_page_usage?
>
> Please advice..
>
> thank you
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--089e0158c7385d0b1e04dc3dffe5
hi,
what do your mean upgrade? new version?
right know we uses informix version at hp-ux
$ onstat -
IBM Informix Dynamic Server Version 11.70.FC1 -- On-Line -- Up 16:25:12 --655252 Kbytes
tq
If you are responding to my question, I asked if the server had been
upgraded from an earlier version?
BTW, 11.70.FC1 has several bugs and performance issues. Best to upgrade to
11.70.FC7 or later when you can. Just FWIW.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Wed, May 8, 2013 at 9:01 PM, MOHD FADZIL JUSOH <fadzil@isianpadu.com>wrote:
> hi,
>
> what do your mean upgrade? new version?
> right know we uses informix version at hp-ux
>
> $ onstat ->
> IBM Informix Dynamic Server Version 11.70.FC1 -- On-Line -- Up 16:25:12 --> 655252 Kbytes
>
> tq
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--001a11c3670227a3a504dc46351e
hi,
If you are responding to my question, I asked if the server had been
upgraded from an earlier version? NO
Thank for your advice.
we already try to recreate again sysadmin but have error like this:
$ dbaccess - db_uninstall.sql;
Database selected.
(expression) Successfully shutdown scheduler
1 row(s) retrieved.
Database closed.
Lockmode set.
215: Cannot open file for table (mon_compression_estimates).
135: ISAM error: TBLspace does not exist
Error in line 24Near character position 21
From log file
20:58:50 Assert Warning: pthdrpage:ptalloc:bad extent slot
20:58:50 IBM Informix Dynamic Server Version 11.70.FC1
20:58:50 Who: Session(103086, informix@faisone, 14391, c00000014dd6f838)
Thread(135858, sqlexec, c00000014e07c978, 3)
File: rspartn.c Line: 8334
20:58:50 Results: Cannot use TBLSpace page for TBLSpace 1048832
20:58:50 Action: Run 'oncheck -pt 1048832'
20:58:50 stack trace for pid 15379 written to /tmp/af.169a9d8a
20:58:50 See Also: /tmp/af.169a9d8a
20:58:50 pthdrpage:ptalloc:bad extent slot
20:58:52 Logical Log 134557 - Backup Started
20:58:52 Logical Log 134557 Complete, timestamp: 0xdf7da72.
20:58:52 Logical Log 134557 - Backup Completed
20:59:04 Logical Log 134558 Complete, timestamp: 0xdfada9d.
20:59:07 Logical Log 134558 - Backup Started
20:59:07 Logical Log 134558 - Backup Completed
$ oncheck -pt 1048832
TBLspace Report for Unknown:Unknown.100100
ISAM error: no record found.
What i need to do to solve this problem, i cannot drop table
mon_compression_estimates
Please advice us?
tq
Something is not right, that is what the oncheck is telling you. If it
were me, I would dbexport all my the user databases, init the server and
rebuild it from scratch (dbschema -c or -c -ns can help simplify that), and
reload all of the databases.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Thu, May 9, 2013 at 8:53 AM, MOHD FADZIL JUSOH <fadzil@isianpadu.com>wrote:
> hi,
>
> If you are responding to my question, I asked if the server had been
> upgraded from an earlier version? NO
>
> Thank for your advice.
>
> we already try to recreate again sysadmin but have error like this:
>
> $ dbaccess - db_uninstall.sql;>
> Database selected.
>
> (expression) Successfully shutdown scheduler
>
> 1 row(s) retrieved.
>
> Database closed.
>
> Lockmode set.
>
> 215: Cannot open file for table (mon_compression_estimates).>
> 135: ISAM error: TBLspace does not exist
> Error in line 24> Near character position 21
>
> >From log file
>
> 20:58:50 Assert Warning: pthdrpage:ptalloc:bad extent slot
> 20:58:50 IBM Informix Dynamic Server Version 11.70.FC1
> 20:58:50 Who: Session(103086, informix@faisone, 14391, c00000014dd6f838)
>
> Thread(135858, sqlexec, c00000014e07c978, 3)
>
> File: rspartn.c Line: 8334
> 20:58:50 Results: Cannot use TBLSpace page for TBLSpace 1048832
> 20:58:50 Action: Run 'oncheck -pt 1048832'
> 20:58:50 stack trace for pid 15379 written to /tmp/af.169a9d8a
> 20:58:50 See Also: /tmp/af.169a9d8a
> 20:58:50 pthdrpage:ptalloc:bad extent slot
> 20:58:52 Logical Log 134557 - Backup Started
> 20:58:52 Logical Log 134557 Complete, timestamp: 0xdf7da72.
> 20:58:52 Logical Log 134557 - Backup Completed
> 20:59:04 Logical Log 134558 Complete, timestamp: 0xdfada9d.
> 20:59:07 Logical Log 134558 - Backup Started
> 20:59:07 Logical Log 134558 - Backup Completed
>
> $ oncheck -pt 1048832>
> TBLspace Report for Unknown:Unknown.100100
>
> ISAM error: no record found.>
> What i need to do to solve this problem, i cannot drop table
> mon_compression_estimates
> Please advice us?
>
> tq
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--089e01228d68e1b5a904dc48a00e
Related threads
- RE: transfer via comp.databases.informix
- dbimport hangs
- Assert Failed errno 271 ISAM ERR -12803
- Syslocks table