Cannot open chunk ''
Posted in 2010
Topics: Storage & Space Management, Stored Procedures & SPL, Server Administration, Security, Permissions & Auditing, Logging & Checkpoints, Platform-Specific Issues, Versions, Editions & End-of-Life
Hello World,
I am having problems to start a IDS 9.40.FC7 (in a Solaris zone, Release 5.10)
on a 'forgotten' zone.
Please have a look and share with me your opinions.
Regards,
Emanuel
bash-3.00$ oninit -vvvChecking group membership to determine server run modesucceeded
Reading configuration file
'/export/home/informix/IDS1/etc/onconfig1.tsi119'...succeeded
Creating /INFORMIXTMP/.infxdirs ... succeeded
Creating infos file "/export/home/informix/IDS1/etc/.infos.tsi1191_shm" ...
"/export/home/informix/IDS1/etc/.conf.tsi1191_shm" ... succeeded
Writing to infos file ... succeeded
Checking config parameters...succeeded
Allocating and attaching to shared memory...succeeded
Creating resident pool 80268 kbytes...succeeded
Creating buffer pool 335998 kbytes...succeeded
Creating buffer pool 6 kbytes...succeeded
Initializing rhead structure...succeeded
Initializing ASF ...succeeded
Initializing Dictionary Cache and SPL Routine Cache...succeeded
Bringing up ADM VP...succeeded
Creating VP classes...succeeded
Onlining 2 additional cpu vps...succeeded
Onlining 3 IO vps...succeeded
Initialization of Encryption...succeeded
Forking main_loop thread...succeeded
Initializing DR structures...succeeded
Forking 3 'ipcshm' listener threads...succeeded
Forking 1 'tlitcp' listener threads...succeeded
Forking 1 'ipcstr' listener threads...succeeded
Starting tracing...succeeded
Initializing 31 flushers...succeeded
Initializing log/checkpoint information...succeeded
Opening primary chunks...oninit: Cannot open chunk ''. errno = 2
Chunk already exists.
Primary reserved page is corrupt.
FAILED
oninit: Fatal error in shared memory initialization
<onconfig1>
ROOTPATH /export/home/informix/IDS1/chunks/dev_chkmaster1
ROOTOFFSET 2
ROOTSIZE 100000
</onconfig1>
bash-3.00$ oncheck -pr|grep FlagsI/O bad request chunk 1, pagenum 14121, pagecnt 65539
bash-3.00$ ls -lL /export/home/informix/IDS1/chunks/dev_chkmaster1
crw-rw---- 1 informix informix 298, 4 Oct 5 11:47
/export/home/informix/IDS1/chunks/dev_chkmaster1
bash-3.00$ ls -l /export/home/informix/IDS1/chunks/dev_chkmaster1lrwxrwxrwx 1 root root 25 Feb 27 2010
/export/home/informix/IDS1/chunks/dev_chkmaster1 -> /dev/zvol/rdsk/p1/zraw119
bash-3.00$ ls -l /dev/zvol/rdsk/p1/zraw119
crw-rw---- 1 informix informix 298, 4 Oct 5 11:47 /dev/zvol/rdsk/p1/zraw119
bash-3.00$ df -hFilesystem size used avail capacity Mounted on
/ 9.0G 3.1G 5.9G 35% /
/dev 9.0G 3.1G 5.9G 35% /dev
/lib 9.9G 7.0G 2.8G 72% /lib
/platform 9.9G 7.0G 2.8G 72% /platform
/sbin 9.9G 7.0G 2.8G 72% /sbin
/usr 9.9G 7.0G 2.8G 72% /usr
proc 0K 0K 0K 0% /proc
ctfs 0K 0K 0K 0% /system/contract
mnttab 0K 0K 0K 0% /etc/mnttab
objfs 0K 0K 0K 0% /system/object
swap 3.8G 312K 3.8G 1% /etc/svc/volatile
/platform/sun4u-us3/lib/libc_psr/libc_psr_hwcap1.so.1
9.9G 7.0G 2.8G 72% /platform/sun4u-us3/lib/libc_psr.so.1
/platform/sun4u-us3/lib/sparcv9/libc_psr/libc_psr_hwcap1.so.1
9.9G 7.0G 2.8G 72% /platform/sun4u-us3/lib/sparcv9/libc_psr.so.1
fd 0K 0K 0K 0% /dev/fd
swap 3.8G 16K 3.8G 1% /tmp
swap 3.8G 32K 3.8G 1% /var/run
I need to see the ouput of 'zpool list' and 'zpool status -x'=20
Regards=20
Francisco Gaspar L=C3=B3pez=20
Director de Tecnolog=C3=ADa=20
SISTEL=20
Servicios Inform=C3=A1ticos de Software y Telecomunicaciones=20
Avd. Los Jarales, 4 (03010) ALICANTE=20
Tlf. 965930080 - Fax. 901021558=20
http://www.sistel.es/=20
----- Mensaje original -----=20
De: "EMANUEL IONESCU" <elionescu@yahoo.com>=20
Para: ids@iiug.org=20
Enviados: Martes, 5 de Octubre 2010 13:19:47 GMT +01:00 Amsterdam / Berl=C3=
=ADn / Berna / Roma / Estocolmo / Viena=20
Asunto: Cannot open chunk '' [21544]=20
Hello World,=20
I am having problems to start a IDS 9.40.FC7 (in a Solaris zone, Release 5.=
10)=20
on a 'forgotten' zone.=20
Please have a look and share with me your opinions.=20
Regards,=20
Emanuel=20
bash-3.00$ oninit -vvv=20Checking group membership to determine server run modesucceeded=20
Reading configuration file=20
'/export/home/informix/IDS1/etc/onconfig1.tsi119'...succeeded=20
Creating /INFORMIXTMP/.infxdirs ... succeeded=20
Creating infos file "/export/home/informix/IDS1/etc/.infos.tsi1191_shm" ...=
=20
"/export/home/informix/IDS1/etc/.conf.tsi1191_shm" ... succeeded=20
Writing to infos file ... succeeded=20
Checking config parameters...succeeded=20
Allocating and attaching to shared memory...succeeded=20
Creating resident pool 80268 kbytes...succeeded=20
Creating buffer pool 335998 kbytes...succeeded=20
Creating buffer pool 6 kbytes...succeeded=20
Initializing rhead structure...succeeded=20
Initializing ASF ...succeeded=20
Initializing Dictionary Cache and SPL Routine Cache...succeeded=20
Bringing up ADM VP...succeeded=20
Creating VP classes...succeeded=20
Onlining 2 additional cpu vps...succeeded=20
Onlining 3 IO vps...succeeded=20
Initialization of Encryption...succeeded=20
Forking main_loop thread...succeeded=20
Initializing DR structures...succeeded=20
Forking 3 'ipcshm' listener threads...succeeded=20
Forking 1 'tlitcp' listener threads...succeeded=20
Forking 1 'ipcstr' listener threads...succeeded=20
Starting tracing...succeeded=20
Initializing 31 flushers...succeeded=20
Initializing log/checkpoint information...succeeded=20
Opening primary chunks...oninit: Cannot open chunk ''. errno =3D 2=20
Chunk already exists.=20
Primary reserved page is corrupt.=20
FAILED=20
oninit: Fatal error in shared memory initialization=20
<onconfig1>=20
ROOTPATH /export/home/informix/IDS1/chunks/dev_chkmaster1=20
ROOTOFFSET 2=20
ROOTSIZE 100000=20
</onconfig1>=20
bash-3.00$ oncheck -pr|grep Flags=20I/O bad request chunk 1, pagenum 14121, pagecnt 65539=20
bash-3.00$ ls -lL /export/home/informix/IDS1/chunks/dev_chkmaster1=20
crw-rw---- 1 informix informix 298, 4 Oct 5 11:47=20
/export/home/informix/IDS1/chunks/dev_chkmaster1=20
bash-3.00$ ls -l /export/home/informix/IDS1/chunks/dev_chkmaster1=20lrwxrwxrwx 1 root root 25 Feb 27 2010=20
/export/home/informix/IDS1/chunks/dev_chkmaster1 -> /dev/zvol/rdsk/p1/zraw1=
19=20
bash-3.00$ ls -l /dev/zvol/rdsk/p1/zraw119=20
crw-rw---- 1 informix informix 298, 4 Oct 5 11:47 /dev/zvol/rdsk/p1/zraw119=
=20
bash-3.00$ df -h=20Filesystem size used avail capacity Mounted on=20
/ 9.0G 3.1G 5.9G 35% /=20
/dev 9.0G 3.1G 5.9G 35% /dev=20
/lib 9.9G 7.0G 2.8G 72% /lib=20
/platform 9.9G 7.0G 2.8G 72% /platform=20
/sbin 9.9G 7.0G 2.8G 72% /sbin=20
/usr 9.9G 7.0G 2.8G 72% /usr=20
proc 0K 0K 0K 0% /proc=20
ctfs 0K 0K 0K 0% /system/contract=20
mnttab 0K 0K 0K 0% /etc/mnttab=20
objfs 0K 0K 0K 0% /system/object=20
swap 3.8G 312K 3.8G 1% /etc/svc/volatile=20
/platform/sun4u-us3/lib/libc_psr/libc_psr_hwcap1.so.1=20
9.9G 7.0G 2.8G 72% /platform/sun4u-us3/lib/libc_psr.so.1=20
/platform/sun4u-us3/lib/sparcv9/libc_psr/libc_psr_hwcap1.so.1=20
9.9G 7.0G 2.8G 72% /platform/sun4u-us3/lib/sparcv9/libc_psr.so.1=20
fd 0K 0K 0K 0% /dev/fd=20
swap 3.8G 16K 3.8G 1% /tmp=20
swap 3.8G 32K 3.8G 1% /var/run=20
***************************************************************************=
****=20
Forum Note: Use "Reply" to post a response in the discussion forum.=20
--Boundary_(ID_c33r1enO3SjlodlsADMdlg)
The errno - 2 says there is a chunk that does not exist. Try oncheck -pr. It
will either point you to which onw it is or fail if it is the 1st chunk.
Thank you all for being involved!
Your suggestion open a new path to investigate, so here is what I have found:
- tsi119, the 'culprit' is a zone
- on the same host there is another zone called tsi113
- long time ago, tsi113 crashed due to a power outage
Now, running oncheck -pr / -cR' on tsi119, I've got a lot of error due to
differences between 'Value in config file' and 'Value in reserved page'. The
most intriguing is the 'DBSERVERNAME':
Value in reserved page: tsi1131_shm
Value in config file: tsi1191_shm
Trying to understand how we end up with this differences, I am thinking that
maybe:
- zone 'tsi113' was cloned as 'tsi119', while informix @ tsi113 was already
f..up'
- [or] on tsi119 a restore was attempted, using a 'bad' backup from tsi113
- [or] the raw device currently used by tsi119 was used before by tsi113 (?).
Although tsi113 is up & running (including a fresh installed IDS), the
'zonecfg -z zone113 info' run on 'globalzone' shows:
..
device
match: /dev/zvol/rdsk/p1/zraw113
..
But this '/dev/zvol/rdsk/p1/zraw113' doesn't exist.
The 'match: /dev/zvol/rdsk/p1/zraw119', tsi119' analog exist on the host:
'zraw119 -> ../../../../devices/pseudo/zfs@0:4c,raw'
I will look further for this 'zone' issues.
Regards,
Emanuel
PS Funny output for 'oncheck -cR' [especially the 'Segmentation Fault (core
dumped)' part]:
shared memory not initialized for INFORMIXSERVER 'tsi1191_str'
Validating IBM Informix Dynamic Server reserved pages
Validating PAGE_PZERO...
Validating PAGE_CONFIG...
ONCONFIG config file error on element ROOTPATH.
Value in reserved page: /opt/INFORMIX/IDS1/chunks/dev_chkmaster1
Value in config file: /export/home/informix/IDS1/chunks/dev_chkmaster1
ONCONFIG config file error on element ROOTSIZE.
Value in reserved page: 100000
Value in config file: 700000
ONCONFIG config file error on element DB_LIBRARY_PATH.
Value in reserved page: $INFORMIXDIR/extend
Value in config file:
ONCONFIG config file error on element JVPHOME.
Value in reserved page: /opt/INFORMIX/IDS1/extend/krakatoa
Value in config file: /export/home/informix/IDS1/extend/krakatoa
ONCONFIG config file error on element JVPJAVAHOME.
Value in reserved page: /opt/INFORMIX/IDS1/extend/krakatoa/jre/
Value in config file: /export/home/informix/IDS1/extend/krakatoa/jre/
ONCONFIG config file error on element JVPLOGFILE.
Value in reserved page: /ldata/opt/INFORMIX/IDS1/log/jvp.log
Value in config file: /ldata/export/home/informix/IDS1/log/jvp.log
ONCONFIG config file error on element JVPPROPFILE.
Value in reserved page: /opt/INFORMIX/IDS1/extend/krakatoa/.jvpprops
Value in config file: /export/home/informix/IDS1/extend/krakatoa/.jvpprops
ONCONFIG config file error on element JVPCLASSPATH.
Value in reserved page:
/opt/INFORMIX/IDS1/extend/krakatoa/krakatoa.jar:/opt/INFORMIX/IDS1/extend/krakat
oa/jdbc.jar
Value in config file:
/export/home/informix/IDS1/extend/krakatoa/krakatoa.jar:/export/home/informix/ID
S1/extend/krakatoa/jdbc.jar
Warning : The config parameter LOGFILES value has been modified
since the server was brought online last time.
Value in reserved page: 21
Value in config file : 10
The server might have updated the value in the config file.
However, the negative values could be a potential error.
ONCONFIG config file error on element LOGSIZE.
Value in reserved page: 40000
Value in config file: 10000
ONCONFIG config file error on element MSGPATH.
Value in reserved page: /ldata/opt/INFORMIX/IDS1/log/online1.log
Value in config file: /ldata/export/home/informix/IDS1/log/online1.log
ONCONFIG config file error on element CONSOLE.
Value in reserved page: /ldata/opt/INFORMIX/IDS1/log/console1.log
Value in config file: /ldata/export/home/informix/IDS1/log/console1.log
ONCONFIG config file error on element TAPEDEV.
Value in reserved page: /backup2/instance1/tape/tape
Value in config file: /backup1/instance1/tape/tape
ONCONFIG config file error on element TAPESIZE.
Value in reserved page: 72000000
Value in config file: 24000000
ONCONFIG config file error on element LTAPEDEV.
Value in reserved page: /dev/null
Value in config file: /backup1/instance1/tape/ltape
ONCONFIG config file error on element LTAPESIZE.
Value in reserved page: 72000000
Value in config file: 24000000
ONCONFIG config file error on element DBSERVERNAME.
Value in reserved page: tsi1131_shm
Value in config file: tsi1191_shm
ONCONFIG config file error on element PHYSBUFF.
Value in reserved page: 256
Value in config file: 128
ONCONFIG config file error on element LOGBUFF.
Value in reserved page: 256
Value in config file: 64
ONCONFIG config file error on element DRLOSTFOUND.
Value in reserved page: /opt/INFORMIX/IDS1/etc/dr.lostfound
Value in config file: /export/home/informix/IDS1/etc/dr.lostfound
ONCONFIG config file error on element DUMPDIR.
Value in reserved page: /backup2/instance1/crash
Value in config file: /backup1/instance1/crash
ONCONFIG config file error on element SHMVIRTSIZE.
Value in reserved page: 109226
Value in config file: 50000
Validating PAGE_1CKPT & PAGE_2CKPT...
Using check point page PAGE_1CKPT.
Segmentation Fault (core dumped)