Oninit cdi / Archive
Talk to an expert →

Assert Failed: Physical log recovery error

Posted in 2014

Summary

A 9.40 instance on HP-UX failed to start with "Assert Failed: Physical log recovery error" (rsrecvr.c line 804) and a "plog page disk read error" during physical recovery, with chunkio reporting errno 1. Suggestions were to retry the startup, check the OS error log for disk read errors, verify chunk/oninit permissions, and note that APAR IC96761 can report wrong errno values; IBM support read the AIOREQ dump as really being errno 5, i.e. a genuine I/O problem. The poster had EMC scan the disks and was rebooting; no final resolution is recorded.

Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.

Topics: Storage & Space Management, Stored Procedures & SPL, Error Codes & Troubleshooting, Server Administration, Logging & Checkpoints, Platform-Specific Issues

Knox, Ernest — — source: IIUG Forums & Mailing Lists

Need assistance on recovering physical log file: OS: HP Release B.11.11 / HP-UX IDS: 9.40.HC6X1 20:31:33 IBM Informix Dynamic Server Started. 20:31:33 Could not create single shared memory segment with resident and non-resident par titions. Proceeding to create 2 shared memory segments instead. 20:31:38 Segment locked: addr=0x82e61000, size=970039296 Tue Jul 15 20:31:40 2014 20:31:40 Event alarms enabled. ALARMPROG = '/informix/etc/log_full.sh' 20:31:40 Booting Language <c> from module <> 20:31:40 Loading Module <CNULL> 20:31:40 Booting Language <builtin> from module <> 20:31:40 Loading Module <BUILTINNULL> 20:31:40 Affinitied VP 1 to phys proc 1 20:31:41 Affinitied VP 5 to phys proc 2 20:31:41 Affinitied VP 6 to phys proc 3 20:31:41 Affinitied VP 7 to phys proc 4 20:31:41 Affinitied VP 8 to phys proc 5 20:31:41 Affinitied VP 9 to phys proc 6 20:31:46 Dynamically allocated new message shared memory segment (size 2192KB) 20:31:46 IBM Informix Dynamic Server Version 9.40.HC6X1 Software Serial Number AAA#B000000 20:31:50 IBM Informix Dynamic Server Initialized -- Shared Memory Initialized. 20:31:50 Started 2 btree scanners. 20:31:50 Low priority set for the btree scanners. 20:31:50 Btree scanner threshold set at 50000. 20:31:50 Btree scanner range scan size set at 256000. 20:31:50 Physical Recovery Started at Page (2:10642). 20:31:50 HPUX Version B.11.11 -> Using flag/select style KAIO 20:31:50 HP KAIO concurrent requests changed from 1000 to 2500 20:32:23 Assert Failed: Physical log recovery error 20:32:23 IBM Informix Dynamic Server Version 9.40.HC6X1 20:32:23 Who: Session(19, informix@gnbwms01, 0, c7849298) Thread(63, fast_rec, c7822e48, 7) File: rsrecvr.c Line: 804 20:32:23 Results: Physical Recovery Aborted. 20:32:23 Action: Retry and/or restore 20:32:23 stack trace for pid 5089 written to /opt/informix/informixdumps/af.427c816 20:32:23 See Also: /opt/informix/informixdumps/af.427c816, shmem.427c816.0 20:33:00 Invoking debugger on oninit pid 5089 20:33:00 Thread(63, fast_rec, 0x00000000, 7) 20:33:00 oninit pid 5089 waiting for debugger gnbwms01:KMart PRD:/ifxloglogs>head -50 /opt/informix/informixdumps/af.427c816 20:32:23 mt_aio_wait(c7cc5588) 20:32:23 chunkio(4, 0xc82ef400, 0x4df3, 0, 0x1f, -937239576, 524341) errno 1 AIOREQ *a c829c8ac: 00000000 00000000 00000001 00000000 ........ ........ c829c8bc: 00000000 00000000 00000000 00000000 ........ ........ c829c8cc: 00000000 c7cc5758 c7cc53b8 00000000 ......WX ..S..... c829c8dc: 00000000 0000133a 41494f72 65710000 .......: AIOreq.. c829c8ec: 00000000 07d10000 00000000 00000003 ........ ........ c829c8fc: 00000501 0000000b 00000002 00000001 ........ ........ c829c90c: 00000000 00000001 c7cc5610 00000000 ........ ..V..... c829c91c: 00000001 00000005 00000001 00000000 ........ ........ c829c92c: 00000000 00000000 ........ 20:32:23 physrecover: plog page disk read error 20:32:23 physrecover error: current phyoffset 19902, sh_stamp 0xeb1cc21e plog 82eee058: 00000000 00000000 00000001 00000000 ........ ........ 82eee068: 00000000 00000000 00000000 00000000 ........ ........ 82eee078: 00000000 82eee0a4 c8213770 00000000 ........ .!7p.... 82eee088: 00000000 000016e5 706c6f67 706c0000 ........ plogpl.. 82eee098: 00000000 07d10000 00000000 00000000 ........ ........ 82eee0a8: 00000000 00000000 00000001 00000000 ........ ........ 82eee0b8: 00000000 00000000 00000000 00000000 ........ ........ 82eee0c8: 82eee148 82eee058 00000000 00000000 ...H...X ........ 82eee0d8: 000016e6 706c6f67 63757200 00000000 ....plog cur..... 82eee0e8: 07d10000 00000000 00000001 00000000 ........ ........ 82eee0f8: 00000000 00000000 00000000 00000000 ........ ........ 82eee108: 00000000 82eee194 82eee36c 00000000 ........ ...l.... 82eee118: 00000000 00000215 706c6f67 706c0000 ........ plogpl.. 82eee128: 00000000 07d20000 00000000 00000000 ........ ........ 82eee138: 913d8000 00000000 00000000 00000000 .=...... ........ 82eee148: 00000000 00000000 00000001 00000000 ........ ........ 82eee158: 00000000 00000000 00000000 00000000 ........ ........ 82eee168: 00000000 82eedf44 82eee0a4 00000000 .......D ........ 82eee178: 00000000 000016e7 706c6f74 68720000 ........ plothr.. 82eee188: 00000000 07d10000 00000000 00000000 ........ ........ 82eee198: 00000000 00000000 00000001 00000000 ........ ........ 82eee1a8: 00000000 00000000 82eedf90 82eee0f0 ........ ........ 82eee1b8: 00000000 00000000 00000216 706c6f67 ........ ....plog 82eee1c8: 6f746872 00000000 07d20000 00000000 othr.... ........ 82eee1d8: 00000000 913e8800 00000000 00000000 .....>.. ........ 82eee1e8: 00000000 82eee0a4 82eee148 00200000 ........ ...H. .. 82eee1f8: 00000035 00000002 eb180276 000155cc ...5.... ...v..U. 82eee208: 0000295d 00000000 00000000 ..)].... .... current page c82fac00: 00061dc9 001352a7 00100090 03ce04a8 ......R. ........ c82fac10: 0000048b 0000048a 800060a0 000ff91d ........ ..`..... c82fac20: 00001089 0f018000 60a10004 1b140000 ........ `....... c82fac30: 06451200 00064513 0000066e 1500000d .E....E. ...n.... c82fac40: 820f0000 10061b00 0010661a 00001339 ........ ..f....9 c82fac50: 19000013 3a030000 14540d00 001a381c ....:... .T....8. Thanks, ******************************************************************************** ********** Ernie Knox Sr. Technologist, I&TG - Database Management Sears Holdings Management Corp 3333 Beverly Rd. Hoffman Estates, IL. 60179 Office: (847) 286-5735 Email: Ernest.Knox@searshc.com<mailto:Ernest.Knox@searshc.com> Blackberry: 2244650553@messaging.sprintpcs.com<mailto:2244650553@messaging.sprintpcs.com> Informix Email: ifmxdba@searshc.com<mailto:ifmxdba@searshc.com> and Team: InformixDBA@searshc.com<mailto:InformixDBA@searshc.com> Informix Primary: INFORMIXDBAPrimaryPager@searshc.com<mailto:INFORMIXDBAPrimaryPager@searshc.com> Informix Secondary: INFORMIXDBASecondaryPager@searshc.com<mailto:INFORMIXDBASecondaryPager@searshc.c om> MySQL Email: MYSQLDBAe@searshc.com<mailto:MYSQLDBAe@searshc.com> and Team: MySQLDBA2@searshc.com<mailto:MySQLDBA2@searshc.com> MySQL Primary: MYSQLDBAPrimaryPager@searshc.com<mailto:MYSQLDBAPrimaryPager@searshc.com> MySQL Secondary: MYSQLDBASecondaryPager@searshc.com<mailto:MYSQLDBASecondaryPager@searshc.com> For more information, view our DBA Wiki page link below: http://wiki.intra.sears.com/confluence/display/TechStrag/Database+Management#Dat abaseManagement<http://wiki.intra.sears.com/confluence/display/TechStrag/Databas e+Management> For creating SUCCEED and/or CCMDB request, use the link below: https://succeed.intra.searshc.com<https://succeed.intra.searshc.com/>; Have I provided a WOW member experience today? Send a Members' First Recognition to this Associate<http://searslabs.intra.searshc.com/irlabs/recognition/>; Nominate this Associate for a Technology Excellence Award<http://support.searshc.com/it/Home/TechExcellenceAwards/tabid/4271/Default .aspx> My Area: " Yes we can make a Change! " " IF you can think it, you can do it! " " IT'S always a great day to watch Sports: FOOTBALL " GSU MISSION: " The focus of my life begins at home with family, loved ones, and friends. I want to use my res

↪ replying to Knox, Ernest
Art Kagel — — source: IIUG Forums & Mailing Lists

Ernie: Have you tried to start it up again? Art On Jul 15, 2014 9:07 PM, "Knox, Ernest" <Ernest.Knox@searshc.com> wrote: > Need assistance on recovering physical log file: > > OS: HP Release B.11.11 / HP-UX > IDS: 9.40.HC6X1 > > 20:31:33 IBM Informix Dynamic Server Started. > 20:31:33 Could not create single shared memory segment with resident and > non-resident > par > titions. Proceeding to create 2 shared memory segments instead. > 20:31:38 Segment locked: addr=0x82e61000, size=970039296 > > Tue Jul 15 20:31:40 2014 > > 20:31:40 Event alarms enabled. ALARMPROG = '/informix/etc/log_full.sh' > 20:31:40 Booting Language <c> from module <> > 20:31:40 Loading Module <CNULL> > 20:31:40 Booting Language <builtin> from module <> > 20:31:40 Loading Module <BUILTINNULL> > 20:31:40 Affinitied VP 1 to phys proc 1 > 20:31:41 Affinitied VP 5 to phys proc 2 > 20:31:41 Affinitied VP 6 to phys proc 3 > 20:31:41 Affinitied VP 7 to phys proc 4 > 20:31:41 Affinitied VP 8 to phys proc 5 > 20:31:41 Affinitied VP 9 to phys proc 6 > 20:31:46 Dynamically allocated new message shared memory segment (size > 2192KB) > 20:31:46 IBM Informix Dynamic Server Version 9.40.HC6X1 Software Serial > Number > AAA#B000000 > 20:31:50 IBM Informix Dynamic Server Initialized -- Shared Memory > Initialized. > > 20:31:50 Started 2 btree scanners. > 20:31:50 Low priority set for the btree scanners. > 20:31:50 Btree scanner threshold set at 50000. > 20:31:50 Btree scanner range scan size set at 256000. > 20:31:50 Physical Recovery Started at Page (2:10642). > 20:31:50 HPUX Version B.11.11 -> Using flag/select style KAIO > 20:31:50 HP KAIO concurrent requests changed from 1000 to 2500 > 20:32:23 Assert Failed: Physical log recovery error > 20:32:23 IBM Informix Dynamic Server Version 9.40.HC6X1 > 20:32:23 Who: Session(19, informix@gnbwms01, 0, c7849298) > > Thread(63, fast_rec, c7822e48, 7) > > File: rsrecvr.c Line: 804 > 20:32:23 Results: Physical Recovery Aborted. > 20:32:23 Action: Retry and/or restore > 20:32:23 stack trace for pid 5089 written to > /opt/informix/informixdumps/af.427c816 > 20:32:23 See Also: /opt/informix/informixdumps/af.427c816, shmem.427c816.0 > 20:33:00 Invoking debugger on oninit pid 5089 > 20:33:00 > > Thread(63, fast_rec, 0x00000000, 7) > 20:33:00 oninit pid 5089 waiting for debugger > > gnbwms01:KMart PRD:/ifxloglogs>head -50 > /opt/informix/informixdumps/af.427c816 > 20:32:23 mt_aio_wait(c7cc5588) > 20:32:23 chunkio(4, 0xc82ef400, 0x4df3, 0, 0x1f, -937239576, 524341) errno > 1 > AIOREQ *a > c829c8ac: 00000000 00000000 00000001 00000000 ........ ........ > c829c8bc: 00000000 00000000 00000000 00000000 ........ ........ > c829c8cc: 00000000 c7cc5758 c7cc53b8 00000000 ......WX ..S..... > c829c8dc: 00000000 0000133a 41494f72 65710000 .......: AIOreq.. > c829c8ec: 00000000 07d10000 00000000 00000003 ........ ........ > c829c8fc: 00000501 0000000b 00000002 00000001 ........ ........ > c829c90c: 00000000 00000001 c7cc5610 00000000 ........ ..V..... > c829c91c: 00000001 00000005 00000001 00000000 ........ ........ > c829c92c: 00000000 00000000 ........ > 20:32:23 physrecover: plog page disk read error > 20:32:23 physrecover error: current phyoffset 19902, sh_stamp 0xeb1cc21e > plog > 82eee058: 00000000 00000000 00000001 00000000 ........ ........ > 82eee068: 00000000 00000000 00000000 00000000 ........ ........ > 82eee078: 00000000 82eee0a4 c8213770 00000000 ........ .!7p.... > 82eee088: 00000000 000016e5 706c6f67 706c0000 ........ plogpl.. > 82eee098: 00000000 07d10000 00000000 00000000 ........ ........ > 82eee0a8: 00000000 00000000 00000001 00000000 ........ ........ > 82eee0b8: 00000000 00000000 00000000 00000000 ........ ........ > 82eee0c8: 82eee148 82eee058 00000000 00000000 ...H...X ........ > 82eee0d8: 000016e6 706c6f67 63757200 00000000 ....plog cur..... > 82eee0e8: 07d10000 00000000 00000001 00000000 ........ ........ > 82eee0f8: 00000000 00000000 00000000 00000000 ........ ........ > 82eee108: 00000000 82eee194 82eee36c 00000000 ........ ...l.... > 82eee118: 00000000 00000215 706c6f67 706c0000 ........ plogpl.. > 82eee128: 00000000 07d20000 00000000 00000000 ........ ........ > 82eee138: 913d8000 00000000 00000000 00000000 .=...... ........ > 82eee148: 00000000 00000000 00000001 00000000 ........ ........ > 82eee158: 00000000 00000000 00000000 00000000 ........ ........ > 82eee168: 00000000 82eedf44 82eee0a4 00000000 .......D ........ > 82eee178: 00000000 000016e7 706c6f74 68720000 ........ plothr.. > 82eee188: 00000000 07d10000 00000000 00000000 ........ ........ > 82eee198: 00000000 00000000 00000001 00000000 ........ ........ > 82eee1a8: 00000000 00000000 82eedf90 82eee0f0 ........ ........ > 82eee1b8: 00000000 00000000 00000216 706c6f67 ........ ....plog > 82eee1c8: 6f746872 00000000 07d20000 00000000 othr.... ........ > 82eee1d8: 00000000 913e8800 00000000 00000000 .....>.. ........ > 82eee1e8: 00000000 82eee0a4 82eee148 00200000 ........ ...H. .. > 82eee1f8: 00000035 00000002 eb180276 000155cc ...5.... ...v..U. > 82eee208: 0000295d 00000000 00000000 ..)].... .... > current page > c82fac00: 00061dc9 001352a7 00100090 03ce04a8 ......R. ........ > c82fac10: 0000048b 0000048a 800060a0 000ff91d ........ ..`..... > c82fac20: 00001089 0f018000 60a10004 1b140000 ........ `....... > c82fac30: 06451200 00064513 0000066e 1500000d .E....E. ...n.... > c82fac40: 820f0000 10061b00 0010661a 00001339 ........ ..f....9 > c82fac50: 19000013 3a030000 14540d00 001a381c ....:... .T....8. > > Thanks, > > > ******************************************************************************** ********** > Ernie Knox > Sr. Technologist, I&TG - Database Management > Sears Holdings Management Corp > 3333 Beverly Rd. > Hoffman Estates, IL. 60179 > Office: (847) 286-5735 > Email: Ernest.Knox@searshc.com<mailto:Ernest.Knox@searshc.com> > Blackberry: > 2244650553@messaging.sprintpcs.com<mailto: > 2244650553@messaging.sprintpcs.com> > Informix Email: ifmxdba@searshc.com<mailto:ifmxdba@searshc.com> and Team: > InformixDBA@searshc.com<mailto:InformixDBA@searshc.com> > Informix Primary: > INFORMIXDBAPrimaryPager@searshc.com<mailto: > INFORMIXDBAPrimaryPager@searshc.com> > Informix Secondary: > INFORMIXDBASecondaryPager@searshc.com<mailto: > INFORMIXDBASecondaryPager@searshc.com> > MySQL Email: MYSQLDBAe@searshc.com<mailto:MYSQLDBAe@searshc.com> and Team: > MySQLDBA2@searshc.com<mailto:MySQLDBA2@searshc.com> > MySQL Primary: > MYSQLDBAPrimaryPager@searshc.com<mailto:MYSQLDBAPrimaryPager@searshc.com> > MySQL Secondary: > MYSQLDBASecondaryPager@searshc.com<mailto: > MYSQLDBASecondaryPager@searshc.com> > > For more information, view our DBA Wiki page link below: > > > http://wiki.intra.sears.com/confluence/display/TechStrag/Database+Management#Dat abaseManagement > < > http://wiki.intra.sears.com/confluence/display/TechStrag/Database+Management > > > > For creating SUCCEED and/or CCMDB request, use the link below: > https://succeed.intra.searshc.com<https://succeed.intra.searshc.com/>; > > Have I provided a WOW member experience today? > Send a Members' First Recognition to thi

↪ replying to Art Kagel
Knox, Ernest — — source: IIUG Forums & Mailing Lists

Yes. We had the EMC rep perform a full appliance scan of the disk and mirr= ors. We are rebooting now to see if it clears up. Thanks, ***************************************************************************= *************** Ernie Knox Sr. Technologist, I&TG - Database Management Sears Holdings Management Corp 3333 Beverly Rd. Hoffman Estates, IL. 60179 Office: (847) 286-5735 Email: Ernest.Knox@searshc.com Blackberry:=A02244650553@messaging.sprintpcs.com Informix Email: ifmxdba@searshc.com and Team: InformixDBA@searshc.com Informix Primary: INFORMIXDBAPrimaryPager@searshc.com Informix Secondary: INFORMIXDBASecondaryPager@searshc.com MySQL Email: MYSQLDBAe@searshc.com and Team: MySQLDBA2@searshc.com MySQL Primary: MYSQLDBAPrimaryPager@searshc.com MySQL Secondary: MYSQLDBASecondaryPager@searshc.com For more information, view our DBA Wiki page link below: http://wiki.intra.sears.com/confluence/display/TechStrag/Database+Managemen= t#DatabaseManagement For creating SUCCEED and/or CCMDB request, use the link below: https://succeed.intra.searshc.com Have I provided a WOW member experience today? Send a Members' First Recognition to this Associate Nominate this Associate for a Technology Excellence Award My Area: " Yes we can make a Change! " " IF you can think it, you can do it! " " IT'S always a great day to watch=A0Sports: FOOTBALL " GSU MISSION: " The focus of my life begins at home with family, loved ones, and friends.= =A0 I want to use my resources to create a secure environment that fosters love, learning, laughter, and mutual succes= s.=A0 I will protect and value integrity.=A0 I will admit and quickly correct my mistakes.=A0 I will be a self-starter.=A0= I will be a caring person.=A0 I will be a good listener with an open mind.=A0 I will continue to grow and learn.=A0 I will facilita= te and celebrate the success of others. " ***************************************************************************= *************** -----Original Message----- From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of Art K= agel Sent: Tuesday, July 15, 2014 10:23 PM To: ids@iiug.org Subject: Re: Assert Failed: Physical log recovery error [33398] Ernie:=20 Have you tried to start it up again?=20 Art On Jul 15, 2014 9:07 PM, "Knox, Ernest" <Ernest.Knox@searshc.com> wrote:=20 > Need assistance on recovering physical log file:=20 >=20 > OS: HP Release B.11.11 / HP-UX > IDS: 9.40.HC6X1 >=20 > 20:31:33 IBM Informix Dynamic Server Started.=20 > 20:31:33 Could not create single shared memory segment with resident=20 > and non-resident par titions. Proceeding to create 2 shared memory=20 > segments instead. > 20:31:38 Segment locked: addr=3D0x82e61000, size=3D970039296 >=20 > Tue Jul 15 20:31:40 2014 >=20 > 20:31:40 Event alarms enabled. ALARMPROG =3D '/informix/etc/log_full.sh'= =20 > 20:31:40 Booting Language <c> from module <> > 20:31:40 Loading Module <CNULL> > 20:31:40 Booting Language <builtin> from module <> > 20:31:40 Loading Module <BUILTINNULL> > 20:31:40 Affinitied VP 1 to phys proc 1 > 20:31:41 Affinitied VP 5 to phys proc 2 > 20:31:41 Affinitied VP 6 to phys proc 3 > 20:31:41 Affinitied VP 7 to phys proc 4 > 20:31:41 Affinitied VP 8 to phys proc 5 > 20:31:41 Affinitied VP 9 to phys proc 6 > 20:31:46 Dynamically allocated new message shared memory segment (size > 2192KB) > 20:31:46 IBM Informix Dynamic Server Version 9.40.HC6X1 Software=20 > Serial Number > AAA#B000000 > 20:31:50 IBM Informix Dynamic Server Initialized -- Shared Memory=20 > Initialized. >=20 > 20:31:50 Started 2 btree scanners.=20 > 20:31:50 Low priority set for the btree scanners.=20 > 20:31:50 Btree scanner threshold set at 50000.=20 > 20:31:50 Btree scanner range scan size set at 256000.=20 > 20:31:50 Physical Recovery Started at Page (2:10642).=20 > 20:31:50 HPUX Version B.11.11 -> Using flag/select style KAIO > 20:31:50 HP KAIO concurrent requests changed from 1000 to 2500 > 20:32:23 Assert Failed: Physical log recovery error > 20:32:23 IBM Informix Dynamic Server Version 9.40.HC6X1 > 20:32:23 Who: Session(19, informix@gnbwms01, 0, c7849298) >=20 > Thread(63, fast_rec, c7822e48, 7) >=20 > File: rsrecvr.c Line: 804 > 20:32:23 Results: Physical Recovery Aborted.=20 > 20:32:23 Action: Retry and/or restore > 20:32:23 stack trace for pid 5089 written to > /opt/informix/informixdumps/af.427c816 > 20:32:23 See Also: /opt/informix/informixdumps/af.427c816,=20 > shmem.427c816.0 > 20:33:00 Invoking debugger on oninit pid 5089 > 20:33:00 >=20 > Thread(63, fast_rec, 0x00000000, 7) > 20:33:00 oninit pid 5089 waiting for debugger >=20 > gnbwms01:KMart PRD:/ifxloglogs>head -50 > /opt/informix/informixdumps/af.427c816 > 20:32:23 mt_aio_wait(c7cc5588) > 20:32:23 chunkio(4, 0xc82ef400, 0x4df3, 0, 0x1f, -937239576, 524341)=20 > errno > 1 > AIOREQ *a > c829c8ac: 00000000 00000000 00000001 00000000 ........ ........=20 > c829c8bc: 00000000 00000000 00000000 00000000 ........ ........=20 > c829c8cc: 00000000 c7cc5758 c7cc53b8 00000000 ......WX ..S.....=20 > c829c8dc: 00000000 0000133a 41494f72 65710000 .......: AIOreq..=20 > c829c8ec: 00000000 07d10000 00000000 00000003 ........ ........=20 > c829c8fc: 00000501 0000000b 00000002 00000001 ........ ........=20 > c829c90c: 00000000 00000001 c7cc5610 00000000 ........ ..V.....=20 > c829c91c: 00000001 00000005 00000001 00000000 ........ ........=20 > c829c92c: 00000000 00000000 ........=20 > 20:32:23 physrecover: plog page disk read error > 20:32:23 physrecover error: current phyoffset 19902, sh_stamp=20 > 0xeb1cc21e plog > 82eee058: 00000000 00000000 00000001 00000000 ........ ........=20 > 82eee068: 00000000 00000000 00000000 00000000 ........ ........=20 > 82eee078: 00000000 82eee0a4 c8213770 00000000 ........ .!7p....=20 > 82eee088: 00000000 000016e5 706c6f67 706c0000 ........ plogpl..=20 > 82eee098: 00000000 07d10000 00000000 00000000 ........ ........=20 > 82eee0a8: 00000000 00000000 00000001 00000000 ........ ........=20 > 82eee0b8: 00000000 00000000 00000000 00000000 ........ ........=20 > 82eee0c8: 82eee148 82eee058 00000000 00000000 ...H...X ........=20 > 82eee0d8: 000016e6 706c6f67 63757200 00000000 ....plog cur.....=20 > 82eee0e8: 07d10000 00000000 00000001 00000000 ........ ........=20 > 82eee0f8: 00000000 00000000 00000000 00000000 ........ ........=20 > 82eee108: 00000000 82eee194 82eee36c 00000000 ........ ...l....=20 > 82eee118: 00000000 00000215 706c6f67 706c0000 ........ plogpl..=20 > 82eee128: 00000000 07d20000 00000000 00000000 ........ ........=20 > 82eee138: 913d8000 00000000 00000000 00000000 .=3D...... ........=20 > 82eee148: 00000000 00000000 00000001 00000000 ........ ........=20 > 82eee158: 00000000 00000000 00000000 00000000 ........ ........=20 > 82eee168: 00000000 82eedf44 82eee0a4 00000000 .......D ........=20 > 82eee178: 00000000 000016e7 706c6f74 68720000 ........ plothr..=20 > 82eee188: 00000000 07d10000 00000000 00000000 ........ ........=20 > 82eee198: 00000000 00000000 00000001 00000000 ........ ........=20 > 82eee1a8: 00000000 00000000 82eedf90 82eee0f0 .......

↪ replying to Knox, Ernest
david@smooth1.co.uk — — source: IIUG Forums & Mailing Lists

Also check the os errorlog for any disk read errors. David. > On 16 July 2014 at 03:26 "Knox, Ernest" <Ernest.Knox@searshc.com> wrote: > > > Yes. We had the EMC rep perform a full appliance scan of the disk and mirr= > ors. We are rebooting now to see if it clears up. > > Thanks, > ***************************************************************************= > *************** > Ernie Knox > Sr. Technologist, I&TG - Database Management > Sears Holdings Management Corp > 3333 Beverly Rd. > Hoffman Estates, IL. 60179 > Office: (847) 286-5735 > Email: Ernest.Knox@searshc.com > Blackberry:=A02244650553@messaging.sprintpcs.com > Informix Email: ifmxdba@searshc.com and Team: InformixDBA@searshc.com > Informix Primary: INFORMIXDBAPrimaryPager@searshc.com > Informix Secondary: INFORMIXDBASecondaryPager@searshc.com > MySQL Email: MYSQLDBAe@searshc.com and Team: MySQLDBA2@searshc.com > MySQL Primary: MYSQLDBAPrimaryPager@searshc.com > MySQL Secondary: MYSQLDBASecondaryPager@searshc.com > > For more information, view our DBA Wiki page link below: > http://wiki.intra.sears.com/confluence/display/TechStrag/Database+Managemen= > t#DatabaseManagement > > For creating SUCCEED and/or CCMDB request, use the link below: > https://succeed.intra.searshc.com > > Have I provided a WOW member experience today? > Send a Members' First Recognition to this Associate > Nominate this Associate for a Technology Excellence Award > > My Area: > " Yes we can make a Change! " > " IF you can think it, you can do it! " > " IT'S always a great day to watch=A0Sports: FOOTBALL " > GSU > MISSION: > " The focus of my life begins at home with family, loved ones, and friends.= > =A0 I want to use my resources to create a > secure environment that fosters love, learning, laughter, and mutual succes= > s.=A0 I will protect and value integrity.=A0 I > will admit and quickly correct my mistakes.=A0 I will be a self-starter.=A0= > I will be a caring person.=A0 I will be a good listener > with an open mind.=A0 I will continue to grow and learn.=A0 I will facilita= > te and celebrate the success of others. " > ***************************************************************************= > *************** > > -----Original Message----- > From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of Art K= > agel > Sent: Tuesday, July 15, 2014 10:23 PM > To: ids@iiug.org > Subject: Re: Assert Failed: Physical log recovery error [33398] > > Ernie:=20 > > Have you tried to start it up again?=20 > > Art > On Jul 15, 2014 9:07 PM, "Knox, Ernest" <Ernest.Knox@searshc.com> wrote:=20 > > > Need assistance on recovering physical log file:=20 > >=20 > > OS: HP Release B.11.11 / HP-UX > > IDS: 9.40.HC6X1 > >=20 > > 20:31:33 IBM Informix Dynamic Server Started.=20 > > 20:31:33 Could not create single shared memory segment with resident=20 > > and non-resident par titions. Proceeding to create 2 shared memory=20 > > segments instead. > > 20:31:38 Segment locked: addr=3D0x82e61000, size=3D970039296 > >=20 > > Tue Jul 15 20:31:40 2014 > >=20 > > 20:31:40 Event alarms enabled. ALARMPROG =3D '/informix/etc/log_full.sh'= > =20 > > 20:31:40 Booting Language <c> from module <> > > 20:31:40 Loading Module <CNULL> > > 20:31:40 Booting Language <builtin> from module <> > > 20:31:40 Loading Module <BUILTINNULL> > > 20:31:40 Affinitied VP 1 to phys proc 1 > > 20:31:41 Affinitied VP 5 to phys proc 2 > > 20:31:41 Affinitied VP 6 to phys proc 3 > > 20:31:41 Affinitied VP 7 to phys proc 4 > > 20:31:41 Affinitied VP 8 to phys proc 5 > > 20:31:41 Affinitied VP 9 to phys proc 6 > > 20:31:46 Dynamically allocated new message shared memory segment (size > > 2192KB) > > 20:31:46 IBM Informix Dynamic Server Version 9.40.HC6X1 Software=20 > > Serial Number > > AAA#B000000 > > 20:31:50 IBM Informix Dynamic Server Initialized -- Shared Memory=20 > > Initialized. > >=20 > > 20:31:50 Started 2 btree scanners.=20 > > 20:31:50 Low priority set for the btree scanners.=20 > > 20:31:50 Btree scanner threshold set at 50000.=20 > > 20:31:50 Btree scanner range scan size set at 256000.=20 > > 20:31:50 Physical Recovery Started at Page (2:10642).=20 > > 20:31:50 HPUX Version B.11.11 -> Using flag/select style KAIO > > 20:31:50 HP KAIO concurrent requests changed from 1000 to 2500 > > 20:32:23 Assert Failed: Physical log recovery error > > 20:32:23 IBM Informix Dynamic Server Version 9.40.HC6X1 > > 20:32:23 Who: Session(19, informix@gnbwms01, 0, c7849298) > >=20 > > Thread(63, fast_rec, c7822e48, 7) > >=20 > > File: rsrecvr.c Line: 804 > > 20:32:23 Results: Physical Recovery Aborted.=20 > > 20:32:23 Action: Retry and/or restore > > 20:32:23 stack trace for pid 5089 written to > > /opt/informix/informixdumps/af.427c816 > > 20:32:23 See Also: /opt/informix/informixdumps/af.427c816,=20 > > shmem.427c816.0 > > 20:33:00 Invoking debugger on oninit pid 5089 > > 20:33:00 > >=20 > > Thread(63, fast_rec, 0x00000000, 7) > > 20:33:00 oninit pid 5089 waiting for debugger > >=20 > > gnbwms01:KMart PRD:/ifxloglogs>head -50 > > /opt/informix/informixdumps/af.427c816 > > 20:32:23 mt_aio_wait(c7cc5588) > > 20:32:23 chunkio(4, 0xc82ef400, 0x4df3, 0, 0x1f, -937239576, 524341)=20 > > errno > > 1 > > AIOREQ *a > > c829c8ac: 00000000 00000000 00000001 00000000 ........ ........=20 > > c829c8bc: 00000000 00000000 00000000 00000000 ........ ........=20 > > c829c8cc: 00000000 c7cc5758 c7cc53b8 00000000 ......WX ..S.....=20 > > c829c8dc: 00000000 0000133a 41494f72 65710000 .......: AIOreq..=20 > > c829c8ec: 00000000 07d10000 00000000 00000003 ........ ........=20 > > c829c8fc: 00000501 0000000b 00000002 00000001 ........ ........=20 > > c829c90c: 00000000 00000001 c7cc5610 00000000 ........ ..V.....=20 > > c829c91c: 00000001 00000005 00000001 00000000 ........ ........=20 > > c829c92c: 00000000 00000000 ........=20 > > 20:32:23 physrecover: plog page disk read error > > 20:32:23 physrecover error: current phyoffset 19902, sh_stamp=20 > > 0xeb1cc21e plog > > 82eee058: 00000000 00000000 00000001 00000000 ........ ........=20 > > 82eee068: 00000000 00000000 00000000 00000000 ........ ........=20 > > 82eee078: 00000000 82eee0a4 c8213770 00000000 ........ .!7p....=20 > > 82eee088: 00000000 000016e5 706c6f67 706c0000 ........ plogpl..=20 > > 82eee098: 00000000 07d10000 00000000 00000000 ........ ........=20 > > 82eee0a8: 00000000 00000000 00000001 00000000 ........ ........=20 > > 82eee0b8: 00000000 00000000 00000000 00000000 ........ ........=20 > > 82eee0c8: 82eee148 82eee058 00000000 00000000 ...H...X ........=20 > > 82eee0d8: 000016e6 706c6f67 63757200 00000000 ....plog cur.....=20 > > 82eee0e8: 07d10000 00000000 00000001 00000000 ........ ........=20 > > 82eee0f8: 00000000 00000000 00000000 00000000 ........ ........=20 > > 82eee108: 00000000 82eee194 82eee36c 00000000 ........ ...l....=20 > > 82eee118: 00000000 00000215 706c6f67 706c0000 ........ plogpl..=20 > > 82eee128: 00000000 07d20000 00000000 00000000 ........ ........=20 > > 82eee138: 913d8000 00000000 00000000 00000000 .=3D...... ........=20 > > 82eee14

↪ replying to david@smooth1.co.uk
JON RITSON — — source: IIUG Forums & Mailing Lists

Hi, I would suggest checking permissions on chunk paths informix:informix and 660 and also on the oninit executable -rwsr-sr-- 1 root informix 24502491 Apr 14 15:05 oninit Just a bit weird to see errno 1 JJ

↪ replying to JON RITSON
JACQUES — — source: IIUG Forums & Mailing Lists

Original post: Hi, I would suggest checking permissions on chunk paths informix:informix and 660 and also on the oninit executable -rwsr-sr-- 1 root informix 24502491 Apr 14 15:05 oninit Just a bit weird to see errno 1 JJ Reply: Could be APAR IC96761 which can cause incorrect errno's to be reported. Jacques Renaut IBM Informix Advanced Support APD Team

↪ replying to JACQUES
JACQUES — — source: IIUG Forums & Mailing Lists

When I looked at the AIOREQ dumped in the 1st post, it would actually look like the errno that should have been reported is 5, which I believe would indicate an IO problem. Jacques Renaut IBM Informix Advanced Support APD Team

Glossary