informix restore failed
Posted in 2015
Topics: High Availability & Replication, Backup & Restore, Storage & Space Management, Error Codes & Troubleshooting, Server Administration, Security, Permissions & Auditing, Logging & Checkpoints, Versions, Editions & End-of-Life
CentOS 6.4 32Bit+IDS 11.70
09:45:06 IBM Informix Dynamic Server Started.
09:45:06 Requested shared memory segment size rounded from 139076KB to 139264KB
09:45:06 Shared memory segment will use huge pages.
09:45:06 Segment locked: addr=0x44000000, size=142606336
09:45:06 Shared memory segment will use huge pages.
09:45:06 Segment locked: addr=0x4c800000, size=1048576000
Thu Feb 12 09:45:07 2015
09:45:07 Event alarms enabled. ALARMPROG = '/home/informix/etc/alarmprogram.sh'
09:45:07 Booting Language <c> from module <>
09:45:07 Loading Module <CNULL>
09:45:07 Booting Language <builtin> from module <>
09:45:07 Loading Module <BUILTINNULL>
09:45:13 Info: The trusted host file (/etc/hosts.equiv) does not exist.
09:45:13 Info: The trusted host file (/home/informix/etc/hosts.equiv) does not
exist.
09:45:13 DR: DRAUTO is 0 (Off)
09:45:13 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
09:45:13 Event notification facility epoll enabled.
09:45:13 IBM Informix Dynamic Server Version 11.70.UC7 Software Serial Number
AAA#B000000
09:45:14 IBM Informix Dynamic Server Initialized -- Shared Memory Initialized.
09:45:14 Started 1 B-tree scanners.
09:45:14 B-tree scanner threshold set at 5000.
09:45:14 B-tree scanner range scan size set to -1.
09:45:14 B-tree scanner ALICE mode set to 6.
09:45:14 B-tree scanner index compression level set to med.
09:45:14 Data replication type and state information reset. To start DR, use
the 'onmode -d' command and wait for the pair to be operational,
before shutting down the database server
09:45:14 Dataskip is now OFF for all dbspaces
09:45:14 Restartable Restore has been ENABLED
09:45:14 Recovery Mode
09:45:14 Physical Restore of rootdbs started.
09:45:20 Checkpoint Completed: duration was 0 seconds.
09:45:20 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4726ffe
Interval: 3356
09:45:20 Maximum server connections 0
09:45:20 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked 0,
Plog used 0, Llog used 0
09:45:23 Physical Restore of rootdbs Completed.
09:45:23 Checkpoint Completed: duration was 0 seconds.
09:45:23 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4727003
Interval: 3356
09:45:23 Maximum server connections 0
09:45:24 Physical Restore of phydbs started.
09:45:24 Physical Restore of idxdbs started.
09:45:24 Physical Restore of logdbs started.
09:45:24 Physical Restore of datadbs started.
11:26:57 Checkpoint Completed: duration was 0 seconds.
11:26:57 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf472700c
Interval: 3357
11:26:57 Maximum server connections 0
11:26:57 Checkpoint Statistics - Avg. Txn Block Time 0.001, # Txns blocked 0,
Plog used 0, Llog used 0
11:26:57 Physical Restore of datadbs Completed.
11:26:57 Checkpoint Completed: duration was 0 seconds.
11:26:57 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf47277f1
Interval: 3357
11:26:57 Maximum server connections 0
11:27:00 Checkpoint Completed: duration was 0 seconds.
11:27:00 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf47277fa
Interval: 3358
11:27:00 Maximum server connections 0
11:27:00 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked 0,
Plog used 0, Llog used 0
11:27:01 Checkpoint Completed: duration was 0 seconds.
11:27:01 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4727803
Interval: 3359
11:27:01 Maximum server connections 0
11:27:01 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked 0,
Plog used 0, Llog used 0
11:27:03 Physical Restore of logdbs Completed.
11:27:03 Checkpoint Completed: duration was 0 seconds.
11:27:03 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4727809
Interval: 3359
11:27:03 Maximum server connections 0
11:27:04 Physical Restore of phydbs Completed.
11:27:04 Checkpoint Completed: duration was 0 seconds.
11:27:04 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf472780f
Interval: 3359
11:27:04 Maximum server connections 0
11:41:32 Checkpoint Completed: duration was 1 seconds.
11:41:32 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4727818
Interval: 3360
11:41:32 Maximum server connections 0
11:41:32 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked 0,
Plog used 0, Llog used 0
11:41:34 Assert Failed: Page Check Error in rsclose_phr: bad chunk free list
page
11:41:34 IBM Informix Dynamic Server Version 11.70.UC7
11:41:34 Who: Session(10, informix@hostname, 2887, 0x4d018400)
Thread(35, ontape, 4cfed1b0, 10)
File: rsdebug.c Line: 1116
11:41:34 Results: Possible inconsistencies in a Chunk Freelist page
11:41:34 Action: Run 'oncheck -ce' and/or restore affected DBSpace
11:41:34 stack trace for pid 2879 written to /home/informix/tmp/af.40b20ee
11:41:34 See Also: /home/informix/tmp/af.40b20ee, shmem.40b20ee.0
11:41:43 Page Check Error in rsclose_phr: bad chunk free list page
11:41:43 Physical Restore of idxdbs Completed.
11:41:43 Checkpoint Completed: duration was 0 seconds.
11:41:43 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4727824
Interval: 3360
11:41:43 Maximum server connections 0
11:41:51 Logical Recovery Started.
11:41:51 10 recovery worker threads will be started.
11:41:51 Checkpoint Completed: duration was 0 seconds.
11:41:51 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf472782d
Interval: 3360
11:41:51 Maximum server connections 0
11:41:51 Start Logical Recovery - Start Log 12139, End Log ?
11:41:51 Starting Log Position - 12139 0x8ad3c4
11:41:51 Clearing the physical and logical logs has started
11:42:02 Cleared 1170 MB of the physical and logical logs in 11 seconds
11:42:02 Checkpoint Completed: duration was 0 seconds.
11:42:02 Thu Feb 12 - loguniq 12139, logpos 0x8b6214, timestamp: 0xf4727854
Interval: 3361
11:42:02 Maximum server connections 0
11:42:02 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked 0,
Plog used 13, Llog used 0
11:42:03 Logical Log 12139 Complete, timestamp: 0xf4727d05.
11:42:08 Checkpoint Completed: duration was 0 seconds.
11:42:08 Thu Feb 12 - loguniq 12140, logpos 0x377370, timestamp: 0xf4729bfc
Interval: 3362
11:42:08 Maximum server connections 0
11:42:08 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked 0,
Plog used 1517, Llog used 0
11:42:08 Assert Failed: Page Check Error in chfree:bad chunk free list page
11:42:08 IBM Informix Dynamic Server Version 11.70.UC7
11:42:08 Who: Session(19, informix@hostname, 0, 0x4d01865c)
Thread(65, xchg_2.0, 4cff1e44, 11)
File: rsdebug.c Line: 1116
11:42:08 Results: Possible inconsistencies in a Chunk Freelist page
11:42:08 Action: Run 'oncheck -ce' and/or restore affected DBSpace
11:42:08 stack trace for pid 2880 written to /home/informix/tmp/af.429210f
11:42:08 See Also: /home/informix/tmp/af.429210f, shmem.429210f.0
11:42:16 Page Check Error in chfree:bad chunk free list page
11:42:16 Assert Warning: Error trying to free extent. Chunk 6, Page offset
1437029, Number of pages 515
11:42:16 IBM Informix Dynamic Server Version 11.70.UC7
11:42:16 Who: Se
Is there a question here? The initial assert failure is this one:
11:41:34 Assert Failed: Page Check Error in rsclose_phr: bad chunk free list
page
That could be a hardware problem that prevented a page from being written
back to disk from the archive, it could be a bad page on the source server
that just restored as bad, it could be a corrupted archive. Call IBM
Support, tell them you need the down system support group, and open a case.
Art
Art S. Kagel, President and Principal Consultant
ASK Database Management
www.askdbmgt.com
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on the IIUG, nor any other organization with which I am
associated either explicitly, implicitly, or by inference. Neither do
those opinions reflect those of other individuals affiliated with any
entity with which I am affiliated nor those of the entities themselves.
On Thu, Feb 26, 2015 at 4:06 AM, WAN SHANE <wsy@114.com.cn> wrote:
> CentOS 6.4 32Bit+IDS 11.70
>
> 09:45:06 IBM Informix Dynamic Server Started.
> 09:45:06 Requested shared memory segment size rounded from 139076KB to
> 139264KB
> 09:45:06 Shared memory segment will use huge pages.
> 09:45:06 Segment locked: addr=0x44000000, size=142606336
> 09:45:06 Shared memory segment will use huge pages.
> 09:45:06 Segment locked: addr=0x4c800000, size=1048576000
>
> Thu Feb 12 09:45:07 2015
>
> 09:45:07 Event alarms enabled. ALARMPROG =
> '/home/informix/etc/alarmprogram.sh'
> 09:45:07 Booting Language <c> from module <>
> 09:45:07 Loading Module <CNULL>
> 09:45:07 Booting Language <builtin> from module <>
> 09:45:07 Loading Module <BUILTINNULL>
> 09:45:13 Info: The trusted host file (/etc/hosts.equiv) does not exist.
> 09:45:13 Info: The trusted host file (/home/informix/etc/hosts.equiv) does
> not
> exist.
> 09:45:13 DR: DRAUTO is 0 (Off)
> 09:45:13 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
> 09:45:13 Event notification facility epoll enabled.
> 09:45:13 IBM Informix Dynamic Server Version 11.70.UC7 Software Serial
> Number
> AAA#B000000
> 09:45:14 IBM Informix Dynamic Server Initialized -- Shared Memory
> Initialized.
>
> 09:45:14 Started 1 B-tree scanners.
> 09:45:14 B-tree scanner threshold set at 5000.
> 09:45:14 B-tree scanner range scan size set to -1.
> 09:45:14 B-tree scanner ALICE mode set to 6.
> 09:45:14 B-tree scanner index compression level set to med.
> 09:45:14 Data replication type and state information reset. To start DR,
> use
>
> the 'onmode -d' command and wait for the pair to be operational,
>
> before shutting down the database server
>
> 09:45:14 Dataskip is now OFF for all dbspaces
> 09:45:14 Restartable Restore has been ENABLED
> 09:45:14 Recovery Mode
> 09:45:14 Physical Restore of rootdbs started.
>
> 09:45:20 Checkpoint Completed: duration was 0 seconds.
> 09:45:20 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4726ffe
> Interval: 3356
>
> 09:45:20 Maximum server connections 0
> 09:45:20 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
> 0,
> Plog used 0, Llog used 0
>
> 09:45:23 Physical Restore of rootdbs Completed.
> 09:45:23 Checkpoint Completed: duration was 0 seconds.
> 09:45:23 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4727003
> Interval: 3356
>
> 09:45:23 Maximum server connections 0
> 09:45:24 Physical Restore of phydbs started.
>
> 09:45:24 Physical Restore of idxdbs started.
>
> 09:45:24 Physical Restore of logdbs started.
>
> 09:45:24 Physical Restore of datadbs started.
>
> 11:26:57 Checkpoint Completed: duration was 0 seconds.
> 11:26:57 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf472700c
> Interval: 3357
>
> 11:26:57 Maximum server connections 0
> 11:26:57 Checkpoint Statistics - Avg. Txn Block Time 0.001, # Txns blocked
> 0,
> Plog used 0, Llog used 0
>
> 11:26:57 Physical Restore of datadbs Completed.
> 11:26:57 Checkpoint Completed: duration was 0 seconds.
> 11:26:57 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf47277f1
> Interval: 3357
>
> 11:26:57 Maximum server connections 0
> 11:27:00 Checkpoint Completed: duration was 0 seconds.
> 11:27:00 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf47277fa
> Interval: 3358
>
> 11:27:00 Maximum server connections 0
> 11:27:00 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
> 0,
> Plog used 0, Llog used 0
>
> 11:27:01 Checkpoint Completed: duration was 0 seconds.
> 11:27:01 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4727803
> Interval: 3359
>
> 11:27:01 Maximum server connections 0
> 11:27:01 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
> 0,
> Plog used 0, Llog used 0
>
> 11:27:03 Physical Restore of logdbs Completed.
> 11:27:03 Checkpoint Completed: duration was 0 seconds.
> 11:27:03 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4727809
> Interval: 3359
>
> 11:27:03 Maximum server connections 0
> 11:27:04 Physical Restore of phydbs Completed.
> 11:27:04 Checkpoint Completed: duration was 0 seconds.
> 11:27:04 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf472780f
> Interval: 3359
>
> 11:27:04 Maximum server connections 0
> 11:41:32 Checkpoint Completed: duration was 1 seconds.
> 11:41:32 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4727818
> Interval: 3360
>
> 11:41:32 Maximum server connections 0
> 11:41:32 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
> 0,
> Plog used 0, Llog used 0
>
> 11:41:34 Assert Failed: Page Check Error in rsclose_phr: bad chunk free
> list
> page
> 11:41:34 IBM Informix Dynamic Server Version 11.70.UC7
> 11:41:34 Who: Session(10, informix@hostname, 2887, 0x4d018400)
>
> Thread(35, ontape, 4cfed1b0, 10)
>
> File: rsdebug.c Line: 1116
> 11:41:34 Results: Possible inconsistencies in a Chunk Freelist page
> 11:41:34 Action: Run 'oncheck -ce' and/or restore affected DBSpace
> 11:41:34 stack trace for pid 2879 written to /home/informix/tmp/af.40b20ee
> 11:41:34 See Also: /home/informix/tmp/af.40b20ee, shmem.40b20ee.0
> 11:41:43 Page Check Error in rsclose_phr: bad chunk free list page
> 11:41:43 Physical Restore of idxdbs Completed.
> 11:41:43 Checkpoint Completed: duration was 0 seconds.
> 11:41:43 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf4727824
> Interval: 3360
>
> 11:41:43 Maximum server connections 0
> 11:41:51 Logical Recovery Started.
> 11:41:51 10 recovery worker threads will be started.
> 11:41:51 Checkpoint Completed: duration was 0 seconds.
> 11:41:51 Thu Feb 12 - loguniq 12139, logpos 0x8ad3c4, timestamp: 0xf472782d
> Interval: 3360
>
> 11:41:51 Maximum server connections 0
> 11:41:51 Start Logical Recovery - Start Log 12139, End Log ?
> 11:41:51 Starting Log Position - 12139 0x8ad3c4
> 11:41:51 Clearing the physical and logical logs has started
> 11:42:02 Cleared 1170 MB of the physical and logical logs in 11 seconds
> 11:42:02 Checkpoint Completed: duration was 0 seconds.
> 11:42:02 Thu Feb 12