Fast Recovery (CKPT REQ) state
Posted in 2013
A site running IDS 11.10.UC2 was stuck in Fast Recovery (CKPT REQ) with all 16 logical logs 100% full; the oldest log (317) appeared corrupt and couldn't be backed up, dropped or skipped, and no logs could be added. 'ontape -a' threw an assert warning (I/O read chunk 2, pagenum 25028, errno=2) and 'ontape -S' was rejected as an incompatible server state. Responders suggested IBM support (possibly truncating logs at the bad one), or restoring from the last archive and rolling forward saved logs, both with data loss, plus advice to back up logs continuously and size log space generously. Checks showed both chunk files intact and 'oncheck -ce' clean. No resolution is recorded in the thread.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Topics: Logging & Checkpoints, Versions, Editions & End-of-Life
Hi all,
Our database is in Fast Recovery mode, waiting for a checkpoint.
The Logical Logs got full, and apparently LL number 317, the next to be freed,
is corrupt. We are not able to back it up (with on "tape -a"), nor delete it
(in this state), nor skip it. We cannot add new logical logs either.
Also, to make matters worse, the engine was rebooted while in this state (when
we were trying to backup up logical logs or do something with that corrupt 317
LL), due to a power shortage.
The "onstat -l" output is the following:
IBM Informix Dynamic Server Version 11.10.UC2 -- Fast Recovery (CKPT REQ) --
Up 2 days 19:20:41 -- 28428 KbytesBlocked:CKPT
Physical Logging
Buffer bufused bufsize numpages numwrits pages/io
P-1 3 16 0 0 0.00
phybegin physize phypos phyused %used
1:263 1500 300 3 0.20
Logical Logging
Buffer bufused bufsize numrecs numpages numwrits recs/pages pages/io
L-1 1 16 0 0 0 0.0 0.0
Subsystem numrecs Log Space used
Buffer Waiting
Buffer ioproc flags
L-1 0 0x1 0
address number flags uniqid begin size used %used
44dbbcd0 1 U------ 321 1:1763 2500 2500 100.00
44dbbd18 2 U------ 322 1:4263 2500 2500 100.00
44dbbd60 3 U------ 323 1:6763 2500 2500 100.00
44dbbda8 4 U------ 324 1:9263 2500 2500 100.00
44dbbdf0 5 U------ 325 1:11763 2500 2500 100.00
44dbbe38 6 U------ 326 1:14263 2500 2500 100.00
44dbbe80 7 U------ 327 1:16763 2500 2500 100.00
44dbbec8 8 U------ 328 1:19263 2500 2500 100.00
44dbbf10 9 U------ 329 1:21763 2500 2500 100.00
44dbbf58 10 U------ 330 1:24263 2500 2500 100.00
44dbbfa0 11 U------ 331 2:53 5000 5000 100.00
44cf7b68 12 U---C-L 332 2:5053 5000 5000 100.00
44cf7bb0 13 U------ 317 2:10053 35000 35000 100.00
44cf7bf8 14 U------ 318 2:45053 35000 35000 100.00
44cf7c40 15 U------ 319 2:80053 50000 50000 100.00
44cf7c88 16 U------ 320 2:130053 50000 50000 100.00
16 active, 16 total
Thanks in advance,
Florencia
Hi,
I would say time to contact IBM support. Maybe they can get around the corrupt
logfile,
but if it is needed to do the recovery, chances are low.
Other way would be to restore the instance from scratch. But if you have
logfiles which you cannot
save, there will be data loss.
Maybe salvage Logs will work to get the latest state as files ?? ontape -S
Marcus Haarmann
----- Ursprüngliche Mail -----
Von: "FLORENCIA VITALE" <florencia_vitale@hotmail.com>
An: ids@iiug.org
Gesendet: Dienstag, 30. April 2013 15:49:05
Betreff: Fast Recovery (CKPT REQ) state [30157]
Hi all,
Our database is in Fast Recovery mode, waiting for a checkpoint.
The Logical Logs got full, and apparently LL number 317, the next to be freed,
is corrupt. We are not able to back it up (with on "tape -a"), nor delete it
(in this state), nor skip it. We cannot add new logical logs either.
Also, to make matters worse, the engine was rebooted while in this state (when
we were trying to backup up logical logs or do something with that corrupt 317
LL), due to a power shortage.
The "onstat -l" output is the following:
IBM Informix Dynamic Server Version 11.10.UC2 -- Fast Recovery (CKPT REQ) --
Up 2 days 19:20:41 -- 28428 KbytesBlocked:CKPT
Physical Logging
Buffer bufused bufsize numpages numwrits pages/io
P-1 3 16 0 0 0.00
phybegin physize phypos phyused %used
1:263 1500 300 3 0.20
Logical Logging
Buffer bufused bufsize numrecs numpages numwrits recs/pages pages/io
L-1 1 16 0 0 0 0.0 0.0
Subsystem numrecs Log Space used
Buffer Waiting
Buffer ioproc flags
L-1 0 0x1 0
address number flags uniqid begin size used %used
44dbbcd0 1 U------ 321 1:1763 2500 2500 100.00
44dbbd18 2 U------ 322 1:4263 2500 2500 100.00
44dbbd60 3 U------ 323 1:6763 2500 2500 100.00
44dbbda8 4 U------ 324 1:9263 2500 2500 100.00
44dbbdf0 5 U------ 325 1:11763 2500 2500 100.00
44dbbe38 6 U------ 326 1:14263 2500 2500 100.00
44dbbe80 7 U------ 327 1:16763 2500 2500 100.00
44dbbec8 8 U------ 328 1:19263 2500 2500 100.00
44dbbf10 9 U------ 329 1:21763 2500 2500 100.00
44dbbf58 10 U------ 330 1:24263 2500 2500 100.00
44dbbfa0 11 U------ 331 2:53 5000 5000 100.00
44cf7b68 12 U---C-L 332 2:5053 5000 5000 100.00
44cf7bb0 13 U------ 317 2:10053 35000 35000 100.00
44cf7bf8 14 U------ 318 2:45053 35000 35000 100.00
44cf7c40 15 U------ 319 2:80053 50000 50000 100.00
44cf7c88 16 U------ 320 2:130053 50000 50000 100.00
16 active, 16 total
Thanks in advance,
Florencia
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.
What message do you get when you try to back up the logs?
Hopefully you have extended support with IBM and can open a support case.
IBM may be able to fix the problem in log 317. Worst case they can go in
and truncate your logs at the corrupted one. You will loose all following
transactions.
The only alternative would be to restore the engine from the latest archive
and roll forward any logical logs saved between the archive and the last
good logical log backup. Again, you will lose all of the transactions in
the logs not backed up.
You should be backing up the logical logs immediately as they fill either
using ontape -c (continuous log backup) or ontape -a from the ALARMPROGRAM
when event #23 (logical log complete) fires it - or the equivalent onbar
operations. Also, you probably don't have nearly enough logical log space
configured. My rule of thumb is that you should have at least enough logs
that you can go for four days without backing them up if there is a failure
in your backup process somewhere (like if you are using onbar and your
storage management package goes down).
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Tue, Apr 30, 2013 at 9:49 AM, FLORENCIA VITALE <
florencia_vitale@hotmail.com> wrote:
> Hi all,
>
> Our database is in Fast Recovery mode, waiting for a checkpoint.
>
> The Logical Logs got full, and apparently LL number 317, the next to be
> freed,
> is corrupt. We are not able to back it up (with on "tape -a"), nor delete
> it
> (in this state), nor skip it. We cannot add new logical logs either.
>
> Also, to make matters worse, the engine was rebooted while in this state
> (when
> we were trying to backup up logical logs or do something with that corrupt
> 317
> LL), due to a power shortage.
>
> The "onstat -l" output is the following:
>
> IBM Informix Dynamic Server Version 11.10.UC2 -- Fast Recovery (CKPT REQ)
> --
> Up 2 days 19:20:41 -- 28428 Kbytes> Blocked:CKPT
>
> Physical Logging
> Buffer bufused bufsize numpages numwrits pages/io
> P-1 3 16 0 0 0.00
>
> phybegin physize phypos phyused %used
>
> 1:263 1500 300 3 0.20
>
> Logical Logging
> Buffer bufused bufsize numrecs numpages numwrits recs/pages pages/io
> L-1 1 16 0 0 0 0.0 0.0
>
> Subsystem numrecs Log Space used
>
> Buffer Waiting
> Buffer ioproc flags
> L-1 0 0x1 0
>
> address number flags uniqid begin size used %used
> 44dbbcd0 1 U------ 321 1:1763 2500 2500 100.00
> 44dbbd18 2 U------ 322 1:4263 2500 2500 100.00
> 44dbbd60 3 U------ 323 1:6763 2500 2500 100.00
> 44dbbda8 4 U------ 324 1:9263 2500 2500 100.00
> 44dbbdf0 5 U------ 325 1:11763 2500 2500 100.00
> 44dbbe38 6 U------ 326 1:14263 2500 2500 100.00
> 44dbbe80 7 U------ 327 1:16763 2500 2500 100.00
> 44dbbec8 8 U------ 328 1:19263 2500 2500 100.00
> 44dbbf10 9 U------ 329 1:21763 2500 2500 100.00
> 44dbbf58 10 U------ 330 1:24263 2500 2500 100.00
> 44dbbfa0 11 U------ 331 2:53 5000 5000 100.00
> 44cf7b68 12 U---C-L 332 2:5053 5000 5000 100.00
> 44cf7bb0 13 U------ 317 2:10053 35000 35000 100.00
> 44cf7bf8 14 U------ 318 2:45053 35000 35000 100.00
> 44cf7c40 15 U------ 319 2:80053 50000 50000 100.00
> 44cf7c88 16 U------ 320 2:130053 50000 50000 100.00
> 16 active, 16 total
>
> Thanks in advance,
> Florencia
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--001a11c3670208bbc204db94fbff
Hi Marcus,
Thanks for the prompt answer. Unfortunately, we are not able to do any kind of
backup in this state :
# ontape -SServer is in an incompatible state or user authentication failed.
Program over.
And it's not the authentication ;-(
I'll try to check the other options or restore from backup.
Thanks anyway,
Florencia
Hi Art,
Thanks for the detailed answer. As for the message when backing up the logs,
we are getting the message at the end of this post (I don't know if I can
attach a file here, I don't see an option).
So, I'll guess we'll have to go with the restore option, as we don't have
extended support.
Thanks again,
Florencia
09:35:40 mt_aio_wait(0x45225cd8)
09:35:40 chunkio(4, 0x0x45a95400, 0x61c4, 0, 0x0x10, 1155179056, 33) errno 1
AIOREQ *a
45b61bd0: 00000000 00000000 00000000 00000000 ........ ........
45b61be0 *
45b61bf0: 18602245 b85a2245 00000000 00000000 .`"E.Z"E ........
45b61c00: ee0f0000 41494f72 65710000 00000000 ....AIOr eq......
45b61c10: 00000000 00000000 d1070000 00000000 ........ ........
45b61c20: 04000000 01090000 01000000 02000000 ........ ........
45b61c30: 01000000 00000000 01000000 685d2245 ........ ....h]"E
45b61c40: 00000000 01000000 05000000 01000000 ........ ........
45b61c50: 00000000 00000000 00000000 00000000 ........ ........
09:35:40
09:35:40 IBM Informix Dynamic Server Version 11.10.UC2 Software Serial Number
AAA#B000000
09:35:40 Assert Warning: I/O read chunk 2, pagenum 25028, pagecnt 16 --> errno
= 2
09:35:40 Who: Session(18, root@soporte, 10426, 0x44dabec0)
Thread(43, logbackup, 44d7e874, 1)
File: rsbuff.c Line: 6156
09:35:40 Action: Please notify IBM Informix Technical Support.
09:35:40 Raw hex dump of stack located in /opt/informix/tmp/af.413906b.rawstk
09:35:40 Stack for thread: 43 logbackup
base: 0x45b59000
len: 36864
pc: 0x088c50b1
tos: 0x45b61420
state: running
vp: 1
0x088c50b1 (oninit)afstack (0x45abd150, 0x2621, 0x45b61930, 0x180c, 0x0, 0x0)
0x088c65ac (oninit)afhandler(0x1, 0x8dd8900, 0x0, 0x451e7f88, 0x401, 0x1)
0x088c697d (oninit)afwarn_interface(0x8dd8900, 0x0, 0x451e7f88, 0x8beed00,
0x180c, 0x10)
0x08655496 (oninit)physio (0x45225cd8, 0x45226018, 0x45a95400, 0x61c4, 0x2,
0x10)
0x087194cf (oninit)logbu_logfile(0x45b61fc4, 0x45b61fc8, 0x44cf7bb0, 0x0, 0x0,
0x0)
0x0871acff (oninit)dologbu (0x45a94a10, 0x0, 0x0, 0x0, 0x0, 0x0)
0x088a1a0f (oninit)startup (0xffffffff, 0x0, 0x0, 0x2000, 0x8b511f81, 0x0)
0x00000000 (*nosymtab*)0x(nil)
Hi Florence,
can you please post the last lines from the online.log?
Further we need to see "onstat -x".
What is the value of "DYNAMIC_LOGS" in ONCONFIG?
Kind Regards,
Marion Sussujew
Am 30.04.2013 15:49, schrieb FLORENCIA VITALE:
> Hi all,
>
> Our database is in Fast Recovery mode, waiting for a checkpoint.
>
> The Logical Logs got full, and apparently LL number 317, the next to be
freed,
> is corrupt. We are not able to back it up (with on "tape -a"), nor delete it
> (in this state), nor skip it. We cannot add new logical logs either.
>
> Also, to make matters worse, the engine was rebooted while in this state
(when
> we were trying to backup up logical logs or do something with that corrupt
317
> LL), due to a power shortage.
>
> The "onstat -l" output is the following:
>
> IBM Informix Dynamic Server Version 11.10.UC2 -- Fast Recovery (CKPT REQ) --
> Up 2 days 19:20:41 -- 28428 Kbytes> Blocked:CKPT
>
> Physical Logging
> Buffer bufused bufsize numpages numwrits pages/io
> P-1 3 16 0 0 0.00
>
> phybegin physize phypos phyused %used
>
> 1:263 1500 300 3 0.20
>
> Logical Logging
> Buffer bufused bufsize numrecs numpages numwrits recs/pages pages/io
> L-1 1 16 0 0 0 0.0 0.0
>
> Subsystem numrecs Log Space used
>
> Buffer Waiting
> Buffer ioproc flags
> L-1 0 0x1 0
>
> address number flags uniqid begin size used %used
> 44dbbcd0 1 U------ 321 1:1763 2500 2500 100.00
> 44dbbd18 2 U------ 322 1:4263 2500 2500 100.00
> 44dbbd60 3 U------ 323 1:6763 2500 2500 100.00
> 44dbbda8 4 U------ 324 1:9263 2500 2500 100.00
> 44dbbdf0 5 U------ 325 1:11763 2500 2500 100.00
> 44dbbe38 6 U------ 326 1:14263 2500 2500 100.00
> 44dbbe80 7 U------ 327 1:16763 2500 2500 100.00
> 44dbbec8 8 U------ 328 1:19263 2500 2500 100.00
> 44dbbf10 9 U------ 329 1:21763 2500 2500 100.00
> 44dbbf58 10 U------ 330 1:24263 2500 2500 100.00
> 44dbbfa0 11 U------ 331 2:53 5000 5000 100.00
> 44cf7b68 12 U---C-L 332 2:5053 5000 5000 100.00
> 44cf7bb0 13 U------ 317 2:10053 35000 35000 100.00
> 44cf7bf8 14 U------ 318 2:45053 35000 35000 100.00
> 44cf7c40 15 U------ 319 2:80053 50000 50000 100.00
> 44cf7c88 16 U------ 320 2:130053 50000 50000 100.00
> 16 active, 16 total
>
> Thanks in advance,
> Florencia
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
>
Did you try a simple "ontape -a"?
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Tue, Apr 30, 2013 at 11:07 AM, FLORENCIA VITALE <
florencia_vitale@hotmail.com> wrote:
> Hi Marcus,
>
> Thanks for the prompt answer. Unfortunately, we are not able to do any
> kind of
> backup in this state :
>
> # ontape -S> Server is in an incompatible state or user authentication failed.
> Program over.
>
> And it's not the authentication ;-(
>
> I'll try to check the other options or restore from backup.
>
> Thanks anyway,
> Florencia
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--047d7b342ba45c36da04db96da26
Errno 2 indicates that the chunk #2 holding your logical logs no longer
exists. If it was a RAW chunk perhaps someone deleted the device for it.
If it was a physical file in filesystem space, maybe someone deleted the
file!
At any rate, I would - without bringing the engine offline again, oncheck
the entire instance to see what else was trashed!
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Tue, Apr 30, 2013 at 11:27 AM, FLORENCIA VITALE <
florencia_vitale@hotmail.com> wrote:
> Hi Art,
>
> Thanks for the detailed answer. As for the message when backing up the
> logs,
> we are getting the message at the end of this post (I don't know if I can
> attach a file here, I don't see an option).
>
> So, I'll guess we'll have to go with the restore option, as we don't have
> extended support.
>
> Thanks again,
> Florencia
>
> 09:35:40 mt_aio_wait(0x45225cd8)
> 09:35:40 chunkio(4, 0x0x45a95400, 0x61c4, 0, 0x0x10, 1155179056, 33) errno
> 1
> AIOREQ *a
> 45b61bd0: 00000000 00000000 00000000 00000000 ........ ........
> 45b61be0 *
> 45b61bf0: 18602245 b85a2245 00000000 00000000 .`"E.Z"E ........
> 45b61c00: ee0f0000 41494f72 65710000 00000000 ....AIOr eq......
> 45b61c10: 00000000 00000000 d1070000 00000000 ........ ........
> 45b61c20: 04000000 01090000 01000000 02000000 ........ ........
> 45b61c30: 01000000 00000000 01000000 685d2245 ........ ....h]"E
> 45b61c40: 00000000 01000000 05000000 01000000 ........ ........
> 45b61c50: 00000000 00000000 00000000 00000000 ........ ........
> 09:35:40
> 09:35:40 IBM Informix Dynamic Server Version 11.10.UC2 Software Serial
> Number
> AAA#B000000
>
> 09:35:40 Assert Warning: I/O read chunk 2, pagenum 25028, pagecnt 16 -->
> errno
> = 2
> 09:35:40 Who: Session(18, root@soporte, 10426, 0x44dabec0)
>
> Thread(43, logbackup, 44d7e874, 1)
>
> File: rsbuff.c Line: 6156
> 09:35:40 Action: Please notify IBM Informix Technical Support.
> 09:35:40 Raw hex dump of stack located in
> /opt/informix/tmp/af.413906b.rawstk
> 09:35:40 Stack for thread: 43 logbackup
>
> base: 0x45b59000
> len: 36864
>
> pc: 0x088c50b1
> tos: 0x45b61420
> state: running
>
> vp: 1
>
> 0x088c50b1 (oninit)afstack (0x45abd150, 0x2621, 0x45b61930, 0x180c, 0x0,
> 0x0)
> 0x088c65ac (oninit)afhandler(0x1, 0x8dd8900, 0x0, 0x451e7f88, 0x401, 0x1)
> 0x088c697d (oninit)afwarn_interface(0x8dd8900, 0x0, 0x451e7f88, 0x8beed00,
> 0x180c, 0x10)
> 0x08655496 (oninit)physio (0x45225cd8, 0x45226018, 0x45a95400, 0x61c4, 0x2,
> 0x10)
> 0x087194cf (oninit)logbu_logfile(0x45b61fc4, 0x45b61fc8, 0x44cf7bb0, 0x0,
> 0x0,
> 0x0)
> 0x0871acff (oninit)dologbu (0x45a94a10, 0x0, 0x0, 0x0, 0x0, 0x0)
> 0x088a1a0f (oninit)startup (0xffffffff, 0x0, 0x0, 0x2000, 0x8b511f81, 0x0)
> 0x00000000 (*nosymtab*)0x(nil)
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--e89a8f3b9c29d4d1d104db96e37a
Hi Art,
Thanks again. And I'll answer both your questions here, to unify.
The error messages I've sent were the output of the "ontape -a".
And we only have 2 chunks and both are still online, see output of "onstat -d"
at the end of this post.
One question, the column "begin" in the the "onstat -l" has an initial "1" or
"2". Is that the chunk number ? If it is, I see other LL already backup up in
chunk number 2 (the same as LL 317).
Nevertheless good idea to do an oncheck. I'll try that now.
Thanks,
Florencia
Dbspaces
address number flags fchunk nchunks pgsize flags owner name
44cf77f0 1 0x40001 1 1 2048 N B informix rootdbs
44cf7d30 2 0x40001 2 1 2048 N B informix datosdbs
2 active, 2047 maximum
Chunks
address chunk/dbs offset size free bpages flags pathname
44cf7950 1 1 0 300000 226371 PO-B /opt/informix/espacios/rootdbs
44daa230 2 2 0 1000000 515172 PO-B /opt/informix/espacios/datosdbs
2 active, 32766 maximum
Hi Marion,
Thanks for the answer. Here is some of the info you asked for :
DYNAMIC_LOGS 2
LTXHWM 70
LTXEHWM 80
I'll get the "onstat -x" asap ... I'm remote to the server, and not connected
right now.
Best regards,
Florencia
Hi Art,
I am trying to install Informix 11.5FC9 on red hat Linux 6.4
I am getting the following error
*rpm -i --prefix=/opt/ifmx115fc9 iif-11.50.FC9-0.x86_64.rpm*
*Installation failed*
*exit status = 1*
*warning: %post(iif-11.50.FC9-0.x86_64) scriptlet failed, exit status 1*
Please can you share your thoughts
Regards
Nanarao
On Tue, Apr 30, 2013 at 9:57 AM, Art Kagel <art.kagel@gmail.com> wrote:
> Errno 2 indicates that the chunk #2 holding your logical logs no longer
> exists. If it was a RAW chunk perhaps someone deleted the device for it.
> If it was a physical file in filesystem space, maybe someone deleted the
> file!
>
> At any rate, I would - without bringing the engine offline again, oncheck
> the entire instance to see what else was trashed!
>
> Art
>
> Art S. Kagel
> Advanced DataTools (www.advancedatatools.com)
> Blog: http://informix-myview.blogspot.com/
>
> Disclaimer: Please keep in mind that my own opinions are my own opinions
> and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
> other organization with which I am associated either explicitly,
> implicitly, or by inference. Neither do those opinions reflect those of
> other individuals affiliated with any entity with which I am affiliated nor
> those of the entities themselves.
>
> On Tue, Apr 30, 2013 at 11:27 AM, FLORENCIA VITALE <
> florencia_vitale@hotmail.com> wrote:
>
> > Hi Art,
> >
> > Thanks for the detailed answer. As for the message when backing up the
> > logs,
> > we are getting the message at the end of this post (I don't know if I can
> > attach a file here, I don't see an option).
> >
> > So, I'll guess we'll have to go with the restore option, as we don't have
> > extended support.
> >
> > Thanks again,
> > Florencia
> >
> > 09:35:40 mt_aio_wait(0x45225cd8)
> > 09:35:40 chunkio(4, 0x0x45a95400, 0x61c4, 0, 0x0x10, 1155179056, 33)
> errno
> > 1
> > AIOREQ *a
> > 45b61bd0: 00000000 00000000 00000000 00000000 ........ ........
> > 45b61be0 *
> > 45b61bf0: 18602245 b85a2245 00000000 00000000 .`"E.Z"E ........
> > 45b61c00: ee0f0000 41494f72 65710000 00000000 ....AIOr eq......
> > 45b61c10: 00000000 00000000 d1070000 00000000 ........ ........
> > 45b61c20: 04000000 01090000 01000000 02000000 ........ ........
> > 45b61c30: 01000000 00000000 01000000 685d2245 ........ ....h]"E
> > 45b61c40: 00000000 01000000 05000000 01000000 ........ ........
> > 45b61c50: 00000000 00000000 00000000 00000000 ........ ........
> > 09:35:40
> > 09:35:40 IBM Informix Dynamic Server Version 11.10.UC2 Software Serial
> > Number
> > AAA#B000000
> >
> > 09:35:40 Assert Warning: I/O read chunk 2, pagenum 25028, pagecnt 16 -->
> > errno
> > = 2
> > 09:35:40 Who: Session(18, root@soporte, 10426, 0x44dabec0)
> >
> > Thread(43, logbackup, 44d7e874, 1)
> >
> > File: rsbuff.c Line: 6156
> > 09:35:40 Action: Please notify IBM Informix Technical Support.
> > 09:35:40 Raw hex dump of stack located in
> > /opt/informix/tmp/af.413906b.rawstk
> > 09:35:40 Stack for thread: 43 logbackup
> >
> > base: 0x45b59000
> > len: 36864
> >
> > pc: 0x088c50b1
> > tos: 0x45b61420
> > state: running
> >
> > vp: 1
> >
> > 0x088c50b1 (oninit)afstack (0x45abd150, 0x2621, 0x45b61930, 0x180c, 0x0,
> > 0x0)
> > 0x088c65ac (oninit)afhandler(0x1, 0x8dd8900, 0x0, 0x451e7f88, 0x401, 0x1)
> > 0x088c697d (oninit)afwarn_interface(0x8dd8900, 0x0, 0x451e7f88,
> 0x8beed00,
> > 0x180c, 0x10)
> > 0x08655496 (oninit)physio (0x45225cd8, 0x45226018, 0x45a95400, 0x61c4,
> 0x2,
> > 0x10)
> > 0x087194cf (oninit)logbu_logfile(0x45b61fc4, 0x45b61fc8, 0x44cf7bb0, 0x0,
> > 0x0,
> > 0x0)
> > 0x0871acff (oninit)dologbu (0x45a94a10, 0x0, 0x0, 0x0, 0x0, 0x0)
> > 0x088a1a0f (oninit)startup (0xffffffff, 0x0, 0x0, 0x2000, 0x8b511f81,
> 0x0)
> > 0x00000000 (*nosymtab*)0x(nil)
> >
> >
> >
> >
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --e89a8f3b9c29d4d1d104db96e37a
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--
Nanarao Ravipati
Database & System Admin.
--e89a8fb2032848e24804db979080
Florencia:
OK. Just curious, though, what happens if you do:
ls -l /opt/informix/espacios/*dbs
-and-
ls -l -L /opt/informix/espacios/*dbs
Are both chunks still there in the directory and still readable? If they
are links, does the second command show that the links are still valid?
The 'begin' column in the onstat -l report shows the chunk#/offset of the
start of the logical log in 11.xx. In earlier versions the chunk number
was encoded with the offset in a single number, so harder to track.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Tue, Apr 30, 2013 at 1:39 PM, FLORENCIA VITALE <
florencia_vitale@hotmail.com> wrote:
> Hi Art,
>
> Thanks again. And I'll answer both your questions here, to unify.
>
> The error messages I've sent were the output of the "ontape -a".
>
> And we only have 2 chunks and both are still online, see output of "onstat
> -d"
> at the end of this post.
>
> One question, the column "begin" in the the "onstat -l" has an initial "1"
> or
> "2". Is that the chunk number ? If it is, I see other LL already backup up
> in
> chunk number 2 (the same as LL 317).
>
> Nevertheless good idea to do an oncheck. I'll try that now.
>
> Thanks,
> Florencia
>
> Dbspaces
> address number flags fchunk nchunks pgsize flags owner name
> 44cf77f0 1 0x40001 1 1 2048 N B informix rootdbs
> 44cf7d30 2 0x40001 2 1 2048 N B informix datosdbs
> 2 active, 2047 maximum
>
> Chunks
> address chunk/dbs offset size free bpages flags pathname
> 44cf7950 1 1 0 300000 226371 PO-B /opt/informix/espacios/rootdbs
> 44daa230 2 2 0 1000000 515172 PO-B /opt/informix/espacios/datosdbs
> 2 active, 32766 maximum
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--e89a8f3b9c29c5fc4304db97be43
Nanarao:
I have no idea. I've never tried to use the rpm installer for Informix,
always just use the .tar installation which, when extracted, creates a
directory tree with an installserver script in the root and I run that. If
that gives me trouble I run "installserver --legacy" to extract the older
tarball installation and branding script.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Tue, Apr 30, 2013 at 1:45 PM, Nanarao Ravipati <nanarao@gmail.com> wrote:
> Hi Art,
>
> I am trying to install Informix 11.5FC9 on red hat Linux 6.4
> I am getting the following error
>
> *rpm -i --prefix=/opt/ifmx115fc9 iif-11.50.FC9-0.x86_64.rpm*
>
> *Installation failed*
>
> *exit status = 1*
>
> *warning: %post(iif-11.50.FC9-0.x86_64) scriptlet failed, exit status 1*
>
> Please can you share your thoughts
>
> Regards
>
> Nanarao
>
> On Tue, Apr 30, 2013 at 9:57 AM, Art Kagel <art.kagel@gmail.com> wrote:
>
> > Errno 2 indicates that the chunk #2 holding your logical logs no longer
> > exists. If it was a RAW chunk perhaps someone deleted the device for it.
> > If it was a physical file in filesystem space, maybe someone deleted the
> > file!
> >
> > At any rate, I would - without bringing the engine offline again, oncheck
> > the entire instance to see what else was trashed!
> >
> > Art
> >
> > Art S. Kagel
> > Advanced DataTools (www.advancedatatools.com)
> > Blog: http://informix-myview.blogspot.com/
> >
> > Disclaimer: Please keep in mind that my own opinions are my own opinions
> > and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
> > other organization with which I am associated either explicitly,
> > implicitly, or by inference. Neither do those opinions reflect those of
> > other individuals affiliated with any entity with which I am affiliated
> nor
> > those of the entities themselves.
> >
> > On Tue, Apr 30, 2013 at 11:27 AM, FLORENCIA VITALE <
> > florencia_vitale@hotmail.com> wrote:
> >
> > > Hi Art,
> > >
> > > Thanks for the detailed answer. As for the message when backing up the
> > > logs,
> > > we are getting the message at the end of this post (I don't know if I
> can
> > > attach a file here, I don't see an option).
> > >
> > > So, I'll guess we'll have to go with the restore option, as we don't
> have
> > > extended support.
> > >
> > > Thanks again,
> > > Florencia
> > >
> > > 09:35:40 mt_aio_wait(0x45225cd8)
> > > 09:35:40 chunkio(4, 0x0x45a95400, 0x61c4, 0, 0x0x10, 1155179056, 33)
> > errno
> > > 1
> > > AIOREQ *a
> > > 45b61bd0: 00000000 00000000 00000000 00000000 ........ ........
> > > 45b61be0 *
> > > 45b61bf0: 18602245 b85a2245 00000000 00000000 .`"E.Z"E ........
> > > 45b61c00: ee0f0000 41494f72 65710000 00000000 ....AIOr eq......
> > > 45b61c10: 00000000 00000000 d1070000 00000000 ........ ........
> > > 45b61c20: 04000000 01090000 01000000 02000000 ........ ........
> > > 45b61c30: 01000000 00000000 01000000 685d2245 ........ ....h]"E
> > > 45b61c40: 00000000 01000000 05000000 01000000 ........ ........
> > > 45b61c50: 00000000 00000000 00000000 00000000 ........ ........
> > > 09:35:40
> > > 09:35:40 IBM Informix Dynamic Server Version 11.10.UC2 Software Serial
> > > Number
> > > AAA#B000000
> > >
> > > 09:35:40 Assert Warning: I/O read chunk 2, pagenum 25028, pagecnt 16
> -->
> > > errno
> > > = 2
> > > 09:35:40 Who: Session(18, root@soporte, 10426, 0x44dabec0)
> > >
> > > Thread(43, logbackup, 44d7e874, 1)
> > >
> > > File: rsbuff.c Line: 6156
> > > 09:35:40 Action: Please notify IBM Informix Technical Support.
> > > 09:35:40 Raw hex dump of stack located in
> > > /opt/informix/tmp/af.413906b.rawstk
> > > 09:35:40 Stack for thread: 43 logbackup
> > >
> > > base: 0x45b59000
> > > len: 36864
> > >
> > > pc: 0x088c50b1
> > > tos: 0x45b61420
> > > state: running
> > >
> > > vp: 1
> > >
> > > 0x088c50b1 (oninit)afstack (0x45abd150, 0x2621, 0x45b61930, 0x180c,
> 0x0,
> > > 0x0)
> > > 0x088c65ac (oninit)afhandler(0x1, 0x8dd8900, 0x0, 0x451e7f88, 0x401,
> 0x1)
> > > 0x088c697d (oninit)afwarn_interface(0x8dd8900, 0x0, 0x451e7f88,
> > 0x8beed00,
> > > 0x180c, 0x10)
> > > 0x08655496 (oninit)physio (0x45225cd8, 0x45226018, 0x45a95400, 0x61c4,
> > 0x2,
> > > 0x10)
> > > 0x087194cf (oninit)logbu_logfile(0x45b61fc4, 0x45b61fc8, 0x44cf7bb0,
> 0x0,
> > > 0x0,
> > > 0x0)
> > > 0x0871acff (oninit)dologbu (0x45a94a10, 0x0, 0x0, 0x0, 0x0, 0x0)
> > > 0x088a1a0f (oninit)startup (0xffffffff, 0x0, 0x0, 0x2000, 0x8b511f81,
> > 0x0)
> > > 0x00000000 (*nosymtab*)0x(nil)
> > >
> > >
> > >
> > >
> >
> >
>
>
*******************************************************************************
> > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > >
> > >
> >
> > --e89a8f3b9c29d4d1d104db96e37a
> >
> >
> >
> >
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --
> Nanarao Ravipati
> Database & System Admin.
>
> --e89a8fb2032848e24804db979080
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--001a11c37a846a14bc04db97ca54
Hi Art,
Well, yes, both commands are ok. The files exist, both. And as said before,
there are other Logical Logs in chunk 2, and they are "ok":
# ls -l /opt/informix/espacios/*dbs
-rw-rw---- 1 informix informix 2048000000 abr 25 17:04
/opt/informix/espacios/datosdbs
-rw-rw---- 1 informix informix 614400000 abr 25 17:04
/opt/informix/espacios/rootdbs
# ls -l -L /opt/informix/espacios/*dbs
-rw-rw---- 1 informix informix 2048000000 abr 25 17:04
/opt/informix/espacios/datosdbs
-rw-rw---- 1 informix informix 614400000 abr 25 17:04
/opt/informix/espacios/rootdbs
I've also tried "oncheck -ce" and it gives no error. And "oncheck -cr" gives
an error that it cannot be executed in this state :
Validating IBM Informix Dynamic Server reserved pages
IBM Informix Dynamic Server must be OFFLINE or in QUIESCENT mode.
Should I take the engine to Quiescent ? Is it possible from Fast-Recovery ?
Or which oncheck options were you thinking of ?
Thanks,
Florencia
oncheck -cr should work with the engine online. Always does for me. Don'tknow what to suggest beyond call IBM in. Or unload whatever data you can
and trash and rebuild the engine from scratch.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Tue, Apr 30, 2013 at 5:05 PM, FLORENCIA VITALE <
florencia_vitale@hotmail.com> wrote:
> Hi Art,
>
> Well, yes, both commands are ok. The files exist, both. And as said before,
> there are other Logical Logs in chunk 2, and they are "ok":
>
> # ls -l /opt/informix/espacios/*dbs
> -rw-rw---- 1 informix informix 2048000000 abr 25 17:04
> /opt/informix/espacios/datosdbs
> -rw-rw---- 1 informix informix 614400000 abr 25 17:04
> /opt/informix/espacios/rootdbs>
> # ls -l -L /opt/informix/espacios/*dbs
> -rw-rw---- 1 informix informix 2048000000 abr 25 17:04
> /opt/informix/espacios/datosdbs
> -rw-rw---- 1 informix informix 614400000 abr 25 17:04
> /opt/informix/espacios/rootdbs>
> I've also tried "oncheck -ce" and it gives no error. And "oncheck -cr"
> gives
> an error that it cannot be executed in this state :
>
> Validating IBM Informix Dynamic Server reserved pages
> IBM Informix Dynamic Server must be OFFLINE or in QUIESCENT mode.
>
> Should I take the engine to Quiescent ? Is it possible from Fast-Recovery ?
>
> Or which oncheck options were you thinking of ?
>
> Thanks,
> Florencia
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--047d7b343360e64ad904db9c2d22
I downloaded the tar file and installed
Thanks
Nanarao
On Tue, Apr 30, 2013 at 11:01 AM, Art Kagel <art.kagel@gmail.com> wrote:
> Nanarao:
>
> I have no idea. I've never tried to use the rpm installer for Informix,
> always just use the .tar installation which, when extracted, creates a
> directory tree with an installserver script in the root and I run that. If
> that gives me trouble I run "installserver --legacy" to extract the older
> tarball installation and branding script.
>
> Art
>
> Art S. Kagel
> Advanced DataTools (www.advancedatatools.com)
> Blog: http://informix-myview.blogspot.com/
>
> Disclaimer: Please keep in mind that my own opinions are my own opinions
> and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
> other organization with which I am associated either explicitly,
> implicitly, or by inference. Neither do those opinions reflect those of
> other individuals affiliated with any entity with which I am affiliated nor
> those of the entities themselves.
>
> On Tue, Apr 30, 2013 at 1:45 PM, Nanarao Ravipati <nanarao@gmail.com>
> wrote:
>
> > Hi Art,
> >
> > I am trying to install Informix 11.5FC9 on red hat Linux 6.4
> > I am getting the following error
> >
> > *rpm -i --prefix=/opt/ifmx115fc9 iif-11.50.FC9-0.x86_64.rpm*
> >
> > *Installation failed*
> >
> > *exit status = 1*
> >
> > *warning: %post(iif-11.50.FC9-0.x86_64) scriptlet failed, exit status 1*
> >
> > Please can you share your thoughts
> >
> > Regards
> >
> > Nanarao
> >
> > On Tue, Apr 30, 2013 at 9:57 AM, Art Kagel <art.kagel@gmail.com> wrote:
> >
> > > Errno 2 indicates that the chunk #2 holding your logical logs no longer
> > > exists. If it was a RAW chunk perhaps someone deleted the device for
> it.
> > > If it was a physical file in filesystem space, maybe someone deleted
> the
> > > file!
> > >
> > > At any rate, I would - without bringing the engine offline again,
> oncheck> > > the entire instance to see what else was trashed!
> > >
> > > Art
> > >
> > > Art S. Kagel
> > > Advanced DataTools (www.advancedatatools.com)
> > > Blog: http://informix-myview.blogspot.com/
> > >
> > > Disclaimer: Please keep in mind that my own opinions are my own
> opinions
> > > and do not reflect on my employer, Advanced DataTools, the IIUG, nor
> any
> > > other organization with which I am associated either explicitly,
> > > implicitly, or by inference. Neither do those opinions reflect those of
> > > other individuals affiliated with any entity with which I am affiliated
> > nor
> > > those of the entities themselves.
> > >
> > > On Tue, Apr 30, 2013 at 11:27 AM, FLORENCIA VITALE <
> > > florencia_vitale@hotmail.com> wrote:
> > >
> > > > Hi Art,
> > > >
> > > > Thanks for the detailed answer. As for the message when backing up
> the
> > > > logs,
> > > > we are getting the message at the end of this post (I don't know if I
> > can
> > > > attach a file here, I don't see an option).
> > > >
> > > > So, I'll guess we'll have to go with the restore option, as we don't
> > have
> > > > extended support.
> > > >
> > > > Thanks again,
> > > > Florencia
> > > >
> > > > 09:35:40 mt_aio_wait(0x45225cd8)
> > > > 09:35:40 chunkio(4, 0x0x45a95400, 0x61c4, 0, 0x0x10, 1155179056, 33)
> > > errno
> > > > 1
> > > > AIOREQ *a
> > > > 45b61bd0: 00000000 00000000 00000000 00000000 ........ ........
> > > > 45b61be0 *
> > > > 45b61bf0: 18602245 b85a2245 00000000 00000000 .`"E.Z"E ........
> > > > 45b61c00: ee0f0000 41494f72 65710000 00000000 ....AIOr eq......
> > > > 45b61c10: 00000000 00000000 d1070000 00000000 ........ ........
> > > > 45b61c20: 04000000 01090000 01000000 02000000 ........ ........
> > > > 45b61c30: 01000000 00000000 01000000 685d2245 ........ ....h]"E
> > > > 45b61c40: 00000000 01000000 05000000 01000000 ........ ........
> > > > 45b61c50: 00000000 00000000 00000000 00000000 ........ ........
> > > > 09:35:40
> > > > 09:35:40 IBM Informix Dynamic Server Version 11.10.UC2 Software
> Serial
> > > > Number
> > > > AAA#B000000
> > > >
> > > > 09:35:40 Assert Warning: I/O read chunk 2, pagenum 25028, pagecnt 16
> > -->
> > > > errno
> > > > = 2
> > > > 09:35:40 Who: Session(18, root@soporte, 10426, 0x44dabec0)
> > > >
> > > > Thread(43, logbackup, 44d7e874, 1)
> > > >
> > > > File: rsbuff.c Line: 6156
> > > > 09:35:40 Action: Please notify IBM Informix Technical Support.
> > > > 09:35:40 Raw hex dump of stack located in
> > > > /opt/informix/tmp/af.413906b.rawstk
> > > > 09:35:40 Stack for thread: 43 logbackup
> > > >
> > > > base: 0x45b59000
> > > > len: 36864
> > > >
> > > > pc: 0x088c50b1
> > > > tos: 0x45b61420
> > > > state: running
> > > >
> > > > vp: 1
> > > >
> > > > 0x088c50b1 (oninit)afstack (0x45abd150, 0x2621, 0x45b61930, 0x180c,
> > 0x0,
> > > > 0x0)
> > > > 0x088c65ac (oninit)afhandler(0x1, 0x8dd8900, 0x0, 0x451e7f88, 0x401,
> > 0x1)
> > > > 0x088c697d (oninit)afwarn_interface(0x8dd8900, 0x0, 0x451e7f88,
> > > 0x8beed00,
> > > > 0x180c, 0x10)
> > > > 0x08655496 (oninit)physio (0x45225cd8, 0x45226018, 0x45a95400,
> 0x61c4,
> > > 0x2,
> > > > 0x10)
> > > > 0x087194cf (oninit)logbu_logfile(0x45b61fc4, 0x45b61fc8, 0x44cf7bb0,
> > 0x0,
> > > > 0x0,
> > > > 0x0)
> > > > 0x0871acff (oninit)dologbu (0x45a94a10, 0x0, 0x0, 0x0, 0x0, 0x0)
> > > > 0x088a1a0f (oninit)startup (0xffffffff, 0x0, 0x0, 0x2000, 0x8b511f81,
> > > 0x0)
> > > > 0x00000000 (*nosymtab*)0x(nil)
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
*******************************************************************************
> > > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > > >
> > > >
> > >
> > > --e89a8f3b9c29d4d1d104db96e37a
> > >
> > >
> > >
> > >
> >
> >
>
>
*******************************************************************************
> > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > >
> > >
> >
> > --
> > Nanarao Ravipati
> > Database & System Admin.
> >
> > --e89a8fb2032848e24804db979080
> >
> >
> >
> >
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --001a11c37a846a14bc04db97ca54
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--
Nanarao Ravipati
Database & System Admin.
--047d7b6dbc36e8892404dba06b1f
Hi Art, Well, it seems it's not working in this version, or maybe it's not supposed to work in Fast-Recovery mode, and the message is misleading (saying it should be in Quiescent or Off-line). Thanks for all your help. Best regards, Florencia