IDS 11.7 - cannot create instance
On Solaris 10 with IDS 11.70.FC3, Sally could not bring up a second instance: oninit -v failed at "Initializing Dictionary Cache and SPL Routine Cache" with "Cannot find message file. Check INFORMIXDIR and DBLANG". She had installed 11.7 over an existing 11.5 INFORMIXDIR; building a clean INFORMIXDIR (CSDK/SQL then IDS) fixed the message-file error. Startup then failed with "chunk failed sanity check" on the root chunk. Art Kagel noted chunk permissions should be 660 and asked whether the new instance had been initialized with oninit -i; that was the problem - she had run oninit -v instead of oninit -vi. Resolved.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Originally I installed 11.5, and had no problem creating an instance and
loading the test database which has been working fine. I think I original
installed SQL first, but had to install an upgrade at a later date.
Then the word was to use 11.7, so I took the instance off-line, installed 11.7
on top of the existing INFORMIXDIR, and produced an amended ONCONFIG by
amending a copy of the standard one as necessary for our particular situation.
The instance came up, the database works.
Then I wanted to create a second instance, for a copy of the live database.
Had to fix a couple of minor problems - a unique SERVERNUM, an entry in
sqlhosts - and now I have hit a brick wall:
This is the screen output:
v6live > oninit -v
Reading configuration file
'/housing/informix/ids11_7/etc/onconfig.v6live'...succeeded
Creating /INFORMIXTMP/.infxdirs...succeeded
Checking config parameters...succeeded
Allocating and attaching to shared memory...succeeded
Creating resident pool 270360 kbytes...succeeded
Allocating 100016 kbytes for buffer pool of 2K page size...succeeded
Creating infos file "/housing/informix/ids11_7/etc/.infos.v6live"...succeeded
Linking conf file "/housing/informix/ids11_7/etc/.conf.v6live"...succeeded
Initializing rhead structure...succeeded
Writing to infos file...succeeded
Initialization of Encryption...succeeded
Initializing ASF...succeeded
Cannot find message file. Check INFORMIXDIR and DBLANG.Initializing
Dictionary
Cache and SPL Routine Cache...FAILED
The logfile:
17:09:01 IBM Informix Dynamic Server Started.
17:09:01 Requested shared memory segment size rounded from 375808KB
to 393216KB
17:09:01 Shared memory segment will use large pages with intimate shared
memory (ISM) if available
17:09:01 Segment locked: addr=10a000000, size=402653184
17:09:01 Requested shared memory segment size rounded from 32656KB to
32768KB
Mon Oct 31 17:09:02 2011
17:09:02 Event alarms enabled. ALARMPROG =
'/housing/informix/ids11_7/etc/alarmprogram.sh'
The differences in the ONCONFIG between the one I can't create and the one
that is working:
ROOTPATH /dev/online/live/root_dbs | ROOTPATH /dev/online/dev/root_dbs
MSGPATH $INFORMIXDIR/v6live. | MSGPATH $INFORMIXDIR/v6te
CONSOLE $INFORMIXDIR/v6live. | CONSOLE $INFORMIXDIR/v6te
SERVERNUM 1 | SERVERNUM 0DBSERVERNAME v6live | DBSERVERNAME v6test
#DBSERVERALIASES v6livetcp | #DBSERVERALIASES v6testtcp
I have checked the slices are informix, informix all the way down - they
weren't but it didn't make any difference. I have used truss (only the -o
flag) on the oninit command and checked all the .iem files it is trying to
open exist - they do. I have checked LD_LIBRARY_PATH, it is the same as for
the instance that is running.
I am stumped and (of course) this is pressing...
Forgot to mention - the exact version is 11.70.FC3, and the OS is Solaris 10 which was installed in April so it up-to-date at least until then.
PPS: INFORMIXDIR = /housing/informix/ids11_7 INFORMIXSERVER = v6live ONCONFIG = onconfig.v6live
Don't remember, did you contact IBM Tech Support? Art Art S. Kagel Advanced DataTools (www.advancedatatools.com) Blog: http://informix-myview.blogspot.com/ Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on my employer, Advanced DataTools, the IIUG, nor any other organization with which I am associated either explicitly, implicitly, or by inference. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves. On Tue, Nov 1, 2011 at 9:32 AM, SALLY WOOLRICH <sally.woolrich@civica.co.uk>wrote: > PPS: > > INFORMIXDIR = /housing/informix/ids11_7 > INFORMIXSERVER = v6live > ONCONFIG = onconfig.v6live > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --e89a8f3ba85dc2c13604b0ac8dee
Cannot get support at present because of the complicated situation with the
customer. However a couple of people kindly emailed me and suggested what I
was thinking of doing anyway - building a new INFORMIXDIR. I did that and
things got better, but I still couldn't create the second instance:
I made a new INFORMIXDIR, installed SQL then IDS into it, brought the old
instance off-line, swapped directories (so INFORMIXDIR is still the same name)
and it has moved things forward. I am not sure why as whilst originally I
installed IDS then SQL, I then installed IDS 11.7 on top... Never mind.
Copied the onconfig and sqlhosts files in, and thankfully the existing
instance was happy to start up and I can access the database.
Attempting to initialize the new instance got a lot further:
...
Initializing Dictionary Cache and SPL Routine Cache...succeeded
Bringing up ADM VP...succeeded
Creating VP classes...succeeded
Onlining 0 additional cpu vps...succeeded
Onlining 2 IO vps...succeeded
Forking main_loop thread...succeeded
Initializing DR structures...succeeded
Forking 1 'tlitcp' listener threads...succeeded
Starting tracing...succeeded
Initializing 8 flushers...succeeded
oninit: Fatal error in shared memory initialization
WARNING: server initialization failed, or possibly timed out (if -w
was used).
Check the message log, online.log, for errors.
And from the log file:
15:41:13 IBM Informix Dynamic Server Version 11.70.FC3 Software
Serial Number AAA#B000000)
15:41:13 Memory sizes:resident:393216 KB, virtual:160768 KB, no
SHMTOTAL limit15:41:17 Assert Warning: chunk failed sanity check
15:41:17 IBM Informix Dynamic Server Version 11.70.FC3
15:41:17 Who: Thread(8, main_loop(), 12237c028, 1)3bf028)
File: rspartn.c Line: 10573
15:41:17 Results: Chunk 1 is being taken OFFLINE.
15:41:17 Action: For all spaces other than temporary dbspaces,
restore the space
temporary dbspace and if it is not the only chunk in that
dbspace,
then drop and re-create the chunk. Otherwise drop and re-
create
the temporary dbspace.
15:41:17 stack trace for pid 4038 written to /housing/informix/
ids11_7/tmp/af.3f0131d
15:41:17 See Also: /housing/informix/ids11_7/tmp/af.3f0131d
15:41:17 chunk failed sanity check
15:41:18 I/O error, Primary Chunk '/dev/online/live/root_dbs' --
Offline (sanity)
15:41:18 oninit: Fatal error in shared memory initialization
15:41:18 IBM Informix Dynamic Server Stopped.
15:41:18 mt_shm_remove: WARNING: may not have removed all/correct
segments
I have done the chown -R and chrgrp -R on the directory holding the
symbolic links to the actual disk, plus chmod -R 664.
The concept of restoring a space before one has managed to initialize
the instance is amusing!
Unfortunately I know nothing about Solstice Volum Manager, might my
feeling that might be where the problem now lies correct?
Permissions on the chunk files should be 660 not 664. Is this a brand new
instance? If so did you start the initial oninit with the -i option to
initialize the root chunk's reserved pages? It looks like the engine did
not find any reserved pages when it started up.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Tue, Nov 1, 2011 at 11:54 AM, SALLY WOOLRICH <sally.woolrich@civica.co.uk
> wrote:
> Cannot get support at present because of the complicated situation with the
> customer. However a couple of people kindly emailed me and suggested what I
> was thinking of doing anyway - building a new INFORMIXDIR. I did that and
> things got better, but I still couldn't create the second instance:
>
> I made a new INFORMIXDIR, installed SQL then IDS into it, brought the old
> instance off-line, swapped directories (so INFORMIXDIR is still the same
> name)
> and it has moved things forward. I am not sure why as whilst originally I
> installed IDS then SQL, I then installed IDS 11.7 on top... Never mind.
>
> Copied the onconfig and sqlhosts files in, and thankfully the existing
> instance was happy to start up and I can access the database.
>
> Attempting to initialize the new instance got a lot further:
>
> ....
> Initializing Dictionary Cache and SPL Routine Cache...succeeded
> Bringing up ADM VP...succeeded
> Creating VP classes...succeeded
> Onlining 0 additional cpu vps...succeeded
> Onlining 2 IO vps...succeeded
> Forking main_loop thread...succeeded
> Initializing DR structures...succeeded
> Forking 1 'tlitcp' listener threads...succeeded
> Starting tracing...succeeded
> Initializing 8 flushers...succeeded
> oninit: Fatal error in shared memory initialization
>
> WARNING: server initialization failed, or possibly timed out (if -w
> was used).
> Check the message log, online.log, for errors.
>
> And from the log file:
> 15:41:13 IBM Informix Dynamic Server Version 11.70.FC3 Software
> Serial Number AAA#B000000)
> 15:41:13 Memory sizes:resident:393216 KB, virtual:160768 KB, no
> SHMTOTAL limit> 15:41:17 Assert Warning: chunk failed sanity check
>
> 15:41:17 IBM Informix Dynamic Server Version 11.70.FC3
> 15:41:17 Who: Thread(8, main_loop(), 12237c028, 1)3bf028)
>
> File: rspartn.c Line: 10573
> 15:41:17 Results: Chunk 1 is being taken OFFLINE.
> 15:41:17 Action: For all spaces other than temporary dbspaces,
> restore the space
>
> temporary dbspace and if it is not the only chunk in that
> dbspace,
>
> then drop and re-create the chunk. Otherwise drop and re-
> create
>
> the temporary dbspace.
> 15:41:17 stack trace for pid 4038 written to /housing/informix/
> ids11_7/tmp/af.3f0131d
> 15:41:17 See Also: /housing/informix/ids11_7/tmp/af.3f0131d
> 15:41:17 chunk failed sanity check
>
> 15:41:18 I/O error, Primary Chunk '/dev/online/live/root_dbs' --
> Offline (sanity)
> 15:41:18 oninit: Fatal error in shared memory initialization
>
> 15:41:18 IBM Informix Dynamic Server Stopped.
>
> 15:41:18 mt_shm_remove: WARNING: may not have removed all/correct
> segments
>
> I have done the chown -R and chrgrp -R on the directory holding the
> symbolic links to the actual disk, plus chmod -R 664.
>
> The concept of restoring a space before one has managed to initialize
> the instance is amusing!
>
> Unfortunately I know nothing about Solstice Volum Manager, might my
> feeling that might be where the problem now lies correct?
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--14dae934105371126604b0af3a8c
OK. 664 was a typo - so was using oninit -v rather than oninit -vi...
Doh!
Many thanks to all who helped, it is much appreciated.