AW: Error while starting IDS

Hi, Here are the lines from online.log where the chunk data859 was added to physdbs 12:32:11 Maximum server connections 40 12:32:11 Chunk '/informix/T40/sapdata/physdev2/data859' added to space'physdbs '. 12:43:28 Checkpoint Completed: duration was 7 seconds. 12:43:28 Checkpoint loguniq 2655, logpos 0x12a0018, timestamp: 0x159a94e1 12:43:28 Maximum server connections 40 12:43:29 IBM Informix Dynamic Server Stopped. 12:44:40 IBM Informix Dynamic Server Started. 12:44:42 Requested shared memory segment size rounded from 200000KB to200704KB Fri Jan 12 12:44:43 2007 12:44:43 Buffer manager: env variable NOFUZZYCKPT is defined. All checkpoints will be hard checkpoints. 12:44:43 Event alarms enabled. ALARMPROG = '/informix/T40/etc/no_log.sh' 12:44:43 Booting Language <c> from module <> 12:44:43 Loading Module <CNULL> 12:44:43 Booting Language <builtin> from module <> 12:44:43 Loading Module <BUILTINNULL> 12:44:48 Requested shared memory segment size rounded from 6464KB to 7168KB 12:44:48 IBM Informix Dynamic Server Version 9.40.FC5 Software SerialNumbe r AAA#B000000 12:44:50 IBM Informix Dynamic Server Initialized -- Shared MemoryInitialized. 12:44:50 Physical Recovery Started at Page (43:20729). 12:44:51 Physical Recovery Complete: 0 Pages Examined, 0 Pages Restored. 12:44:51 Logical Recovery Started. 12:44:51 10 recovery worker threads will be started. 12:44:53 Logical Recovery has reached the transaction cleanup phase. 12:44:54 Logical Recovery Complete. 0 Committed, 1 Rolled Back, 0 Open, 0 Bad Locks 12:44:54 Dataskip is now OFF for all dbspaces 12:44:54 Checkpoint Completed: duration was 0 seconds. 12:44:54 Checkpoint loguniq 2655, logpos 0x12a17e8, timestamp: 0x159a9569 12:44:54 Maximum server connections 0 12:44:55 On-Line Mode As you see the server started successfully. And here are the relevant lines when server doesn't start: 08:41:55 IBM Informix Dynamic Server Started. 08:41:58 Requested shared memory segment size rounded from 200000KB to200704KB Fri Jan 19 08:41:58 2007 08:41:58 Buffer manager: env variable NOFUZZYCKPT is defined. All checkpoints will be hard checkpoints. 08:41:58 Event alarms enabled. ALARMPROG = '/informix/T40/etc/no_log.sh' 08:41:58 Booting Language <c> from module <> 08:41:58 Loading Module <CNULL> 08:41:58 Booting Language <builtin> from module <> 08:41:58 Loading Module <BUILTINNULL> 08:42:03 Requested shared memory segment size rounded from 6464KB to 7168KB 08:42:04 IBM Informix Dynamic Server Version 9.40.FC5 Software SerialNumbe r AAA#B000000 #### The following to lines I found only once though we tried to start the server several times! 08:42:05 Cannot Open Primary Chunk '/informix/T40/sapdata/physdev2/data859', er rno = 2 08:42:05 Cannot Open Primary Chunk '/informix/T40/sapdata/physdev2/data859', er rno = 2 08:42:05 IBM Informix Dynamic Server Stopped. 08:42:05 mt_shm_remove: WARNING: may not have removed all/correct segments 12:32:06 IBM Informix Dynamic Server Started. 12:32:09 Requested shared memory segment size rounded from 200000KB to200704KB Fri Jan 19 12:32:09 2007 12:32:09 Buffer manager: env variable NOFUZZYCKPT is defined. All checkpoints will be hard checkpoints. 12:32:09 Event alarms enabled. ALARMPROG = '/informix/T40/etc/no_log.sh' 12:32:09 Booting Language <c> from module <> 12:32:09 Loading Module <CNULL> 12:32:09 Booting Language <builtin> from module <> 12:32:09 Loading Module <BUILTINNULL> 12:32:14 Requested shared memory segment size rounded from 6464KB to 7168KB 12:32:15 IBM Informix Dynamic Server Version 9.40.FC5 Software SerialNumbe r AAA#B000000 12:32:19 IBM Informix Dynamic Server Stopped. I can't see anything what gives me a clue. The following is the output from oninit -v: Checking group membership to determine server run modesucceeded Reading configuration file '/informix/T40/etc/onconfig.A13SAZ0S.t40'...succeeded Creating /INFORMIXTMP/.infxdirs ... succeeded Creating infos file "/informix/T40/etc/.infos.a13saz0st40tcp" ... "/informix/T40 /etc/.conf.a13saz0st40tcp" ... succeeded Writing to infos file ... succeeded Checking config parameters...succeeded Allocating and attaching to shared memory...succeeded Creating resident pool 261628 kbytes...succeeded Creating buffer pool 199998 kbytes...succeeded Creating buffer pool 6 kbytes...succeeded Initializing rhead structure...succeeded Initializing ASF ...succeeded Initializing Dictionary Cache and SPL Routine Cache...succeeded Bringing up ADM VP...succeeded Creating VP classes...succeeded Onlining 0 additional cpu vps...succeeded Onlining 2 IO vps...succeeded Initialization of Encryption...succeeded Forking main_loop thread...succeeded Initializing DR structures...succeeded Forking 1 'ipcshm' listener threads...succeeded Forking 1 'tlitcp' listener threads...succeeded Starting tracing...succeeded Initializing 2 flushers...succeeded Initializing log/checkpoint information...succeeded Opening primary chunks...Chunk /informix/T40/sapdata/physdev2/data859 already ex ists. Primary reserved page is corrupt. FAILED oninit: Fatal error in shared memory initialization Regards, Reinhard. > -----Urspr'ngliche Nachricht----- > Von: informix-list-bounces@iiug.org > [mailto:informix-list-bounces@iiug.org]Im Auftrag von RoB > Gesendet am: Freitag, 19. Januar 2007 16:00 > An: informix-list@iiug.org > Betreff: Re: Error while starting IDS > > > Could your "dd" command have truncated the content of the device > /informix/T40/sapdata/physdev2/data859? > I've heard that can happen on certain OSs and some version of dd. > > Is there no entry in the online.log with further information? > > The last chunk you added (Chunk number 82) is located on the affected > device and it belongs to the physdbs where the physical log is located > so it's definately a critical chunk. When was the chunk added? Did you > change anything in the onconfig file regarding the physical log > (PHYSDBS, PHYSFILE)? > > I'd recommend you log a call with tech support about this. > > The relevant parts of oncheck -pr: > > ... > PHYSDBS physdbs > PHYSFILE 200000 (k) > ...> > DBspace number 8 > DBspace name psapbtab > Flags 0x20001 No mirror chunks > Number of chunks 4 > First chunk 35 > Date/Time created 12/29/2006 09:29:32 > Partition table page number 4 > Logical Log Unique Id 0 > Logical Log Position 0x0 > Oldest Logical Log Unique Id 2913 > Last Logical Log Unique Id 0 > DBspace archive status No archives have occurred. > ... > DBspace number 16 > DBspace name physdbs > Flags 0x2000

> 08:42:05 Cannot Open Primary Chunk '/informix/T40/sapdata/physdev2/data859', errno = 2 finderr 2: "-2 No such file or directory. An operating-system error code with the meaning shown was unexpectedly returned to the database server. Look for other operating-system error messages that might give more information." Make sure the device actually exists (ls -l /informix/T40/sapdata/physdev2/data859). Although I suspect that isn't the cause of this. There are a few newer interim versions availble for after 9.40.UC5 so it might also have been caused by a bug. Contact support to find out. Do you have a valid backup available? Habichtsberg, Reinhard wrote: > Hi, > > Here are the lines from online.log where the chunk data859 was added to > physdbs > > 12:32:11 Maximum server connections 40 > 12:32:11 Chunk '/informix/T40/sapdata/physdev2/data859' added to space> 'physdbs > '. > 12:43:28 Checkpoint Completed: duration was 7 seconds. > 12:43:28 Checkpoint loguniq 2655, logpos 0x12a0018, timestamp: 0x159a94e1 > > 12:43:28 Maximum server connections 40 > 12:43:29 IBM Informix Dynamic Server Stopped. > > 12:44:40 IBM Informix Dynamic Server Started. > 12:44:42 Requested shared memory segment size rounded from 200000KB to> 200704KB > > Fri Jan 12 12:44:43 2007 > > 12:44:43 Buffer manager: env variable NOFUZZYCKPT is> defined. All checkpoints will be hard checkpoints. > 12:44:43 Event alarms enabled. ALARMPROG = '/informix/T40/etc/no_log.sh' > 12:44:43 Booting Language <c> from module <> > 12:44:43 Loading Module <CNULL> > 12:44:43 Booting Language <builtin> from module <> > 12:44:43 Loading Module <BUILTINNULL> > 12:44:48 Requested shared memory segment size rounded from 6464KB to 7168KB > 12:44:48 IBM Informix Dynamic Server Version 9.40.FC5 Software Serial> Numbe > r AAA#B000000 > 12:44:50 IBM Informix Dynamic Server Initialized -- Shared Memory> Initialized. > > 12:44:50 Physical Recovery Started at Page (43:20729). > 12:44:51 Physical Recovery Complete: 0 Pages Examined, 0 Pages Restored. > 12:44:51 Logical Recovery Started. > 12:44:51 10 recovery worker threads will be started. > 12:44:53 Logical Recovery has reached the transaction cleanup phase. > 12:44:54 Logical Recovery Complete.> 0 Committed, 1 Rolled Back, 0 Open, 0 Bad Locks > > 12:44:54 Dataskip is now OFF for all dbspaces > 12:44:54 Checkpoint Completed: duration was 0 seconds. > 12:44:54 Checkpoint loguniq 2655, logpos 0x12a17e8, timestamp: 0x159a9569 > > 12:44:54 Maximum server connections 0 > 12:44:55 On-Line Mode> > As you see the server started successfully. > > And here are the relevant lines when server doesn't start: > > 08:41:55 IBM Informix Dynamic Server Started. > 08:41:58 Requested shared memory segment size rounded from 200000KB to> 200704KB > > Fri Jan 19 08:41:58 2007 > > 08:41:58 Buffer manager: env variable NOFUZZYCKPT is> defined. All checkpoints will be hard checkpoints. > 08:41:58 Event alarms enabled. ALARMPROG = '/informix/T40/etc/no_log.sh' > 08:41:58 Booting Language <c> from module <> > 08:41:58 Loading Module <CNULL> > 08:41:58 Booting Language <builtin> from module <> > 08:41:58 Loading Module <BUILTINNULL> > 08:42:03 Requested shared memory segment size rounded from 6464KB to 7168KB > 08:42:04 IBM Informix Dynamic Server Version 9.40.FC5 Software Serial> Numbe > r AAA#B000000 > #### The following to lines I found only once though we tried to > start the server several times! > 08:42:05 Cannot Open Primary Chunk > '/informix/T40/sapdata/physdev2/data859', er > rno = 2 > 08:42:05 Cannot Open Primary Chunk > '/informix/T40/sapdata/physdev2/data859', er > rno = 2 > 08:42:05 IBM Informix Dynamic Server Stopped. > > 08:42:05 mt_shm_remove: WARNING: may not have removed all/correct segments > > 12:32:06 IBM Informix Dynamic Server Started. > 12:32:09 Requested shared memory segment size rounded from 200000KB to> 200704KB > > Fri Jan 19 12:32:09 2007 > > 12:32:09 Buffer manager: env variable NOFUZZYCKPT is> defined. All checkpoints will be hard checkpoints. > 12:32:09 Event alarms enabled. ALARMPROG = '/informix/T40/etc/no_log.sh' > 12:32:09 Booting Language <c> from module <> > 12:32:09 Loading Module <CNULL> > 12:32:09 Booting Language <builtin> from module <> > 12:32:09 Loading Module <BUILTINNULL> > 12:32:14 Requested shared memory segment size rounded from 6464KB to 7168KB > 12:32:15 IBM Informix Dynamic Server Version 9.40.FC5 Software Serial> Numbe > r AAA#B000000 > 12:32:19 IBM Informix Dynamic Server Stopped.> > I can't see anything what gives me a clue. > > The following is the output from oninit -v: > > Checking group membership to determine server run modesucceeded > Reading configuration file > '/informix/T40/etc/onconfig.A13SAZ0S.t40'...succeeded > Creating /INFORMIXTMP/.infxdirs ... succeeded > Creating infos file "/informix/T40/etc/.infos.a13saz0st40tcp" ... > "/informix/T40 > /etc/.conf.a13saz0st40tcp" ... succeeded > Writing to infos file ... succeeded > Checking config parameters...succeeded > Allocating and attaching to shared memory...succeeded > Creating resident pool 261628 kbytes...succeeded > Creating buffer pool 199998 kbytes...succeeded > Creating buffer pool 6 kbytes...succeeded > Initializing rhead structure...succeeded > Initializing ASF ...succeeded > Initializing Dictionary Cache and SPL Routine Cache...succeeded > Bringing up ADM VP...succeeded > Creating VP classes...succeeded > Onlining 0 additional cpu vps...succeeded > Onlining 2 IO vps...succeeded > Initialization of Encryption...succeeded > Forking main_loop thread...succeeded > Initializing DR structures...succeeded > Forking 1 'ipcshm' listener threads...succeeded > Forking 1 'tlitcp' listener threads...succeeded > Starting tracing...succeeded > Initializing 2 flushers...succeeded > Initializing log/checkpoint information...succeeded > Opening primary chunks...Chunk /informix/T40/sapdata/physdev2/data859 > already ex > ists. > Primary reserved page is corrupt. > FAILED > oninit: Fatal error in shared memory initialization > > Regards, > Reinhard. > > > > -----Ursprüngliche Nachricht----- > > Von: informix-list-bounces@iiug.org > > [mailto:informix-list-bounces@iiug.org]Im Auftrag von RoB > > Gesendet am: Freitag, 19. Januar 2007 16:00 > > An: informix-list@iiug.org > > Betreff: Re: Error while starting IDS > > > > > > Could your "dd" command have truncated the content of the device > > /informix/T40/sapdata/physdev2/data859? > > I've heard that can happen on certain OSs and some version of dd. > > > > Is there no entry in the online.log with further information? > > > > The last chunk you added (Chunk number 82) is located on the affected > > device and it belongs to the physdbs where the physical log is located > > so it's definately a critical chunk. When was the chunk added? Did you > > change anything in the onconf