Re: Regarding database hanging problem - Please Help
Posted in 2008
On Sep 5, 10:22 pm, "da...@smooth1.co.uk" <da...@smooth1.co.uk> wrote:
> On 4 Sep, 19:41, raja <dextersu...@gmail.com> wrote:
>
>
>
>
>
> > Hi,
>
> > I am facing a database hanging problem. The details are as follows :
>
> > Database Version : IBM Informix Dynamic Server Version 10.00
> > OS : HP-UX
>
> > There are 2 db servers, one for test environment and one for
> > development environment.
> > The problem is with the development environment and not the test
> > environment.
>
> > Problem is :
> > Frequent Database Server down that has been going on in the
> > development instance.
>
> > My Observations :
> > From the log, found that whenever the database is running out of
> > tempDB space it issues warnings. After couple of warnings and it
> > reaches the 1 GB limit, it stops giving any new connections. During
> > this period if any new connection request is received, the database
> > rejects the request but increases the Max Connection count. Once the
> > Max connection count reaches the 1024, the Database server goes into
> > panic mode thinking it is under attack.
>
> > Quick Fix:
> > Increasing the TempDB space.
> > ( since we are running a number of reports, batches etc… we may be
> > genuinely running into memory issues.)
>
> > Kindly check the attached onconfig files of :
> > 1. dsinfglsop_prob_development_env.txt – development environment
> > – problem exists here ( hanging )
> > 2. dsinfglsqa_good_test_env.txt – test environment – no problem,
> > good environment.
> > Some of the difference that I have found in the test environment
> > ( good condition ) and development environment (bad condition – where
> > problem is there ) are as follows :
>
> > --------------------------------
> > -----------------------------------------------------------------------
> > parameters good - test env bad -
> > development env
> > --------------------------------
> > -----------------------------------------------------------------------
> > servernum 2
> > 1
> > shmvirtsize 512000
> > 256000
> > shmtotal 153600
> > 1024000
> > listen-timeout 10
> > 20
> > max incomplete connections 1024 2048
> > --------------------------------
> > -----------------------------------------------------------------------
>
> > My Final Observations :
> > Connection refuse does not looks like due to tempdb full issue. This
> > is primarily due to memory utilization against allocated memory.
> > The memory being used by Informix exceeds the allocated shared memory
> > of 1GB (size of resident - above 700MB & virtual segments – above
> > 350MB).
> > The difference between test environment and development environment
> > could be either due to number of users or the configured values.
> > Please note the following attachments with informix_details1.zip
> > file :
>
> > 1. dsinfglsop_prob_development_env.txt
> > 2. dsinfglsqa_good_test_env.txt
> > 3. log_file.txt
>
> > Please explain me your observations and your suggestions in detail.
> > Please guide me to solve this problem.
>
> > Please Note : Sorry, Not able to attach the details here ( i cant find
> > any provision to attach the files here ). for attachements, kindly
> > mail me personally, i will send you the attachments/details.
>
> > With Regards,
> > Raja.
>
> What messages are in the online.log when this happens?- Hide quoted text -
>
> - Show quoted text -
Hi,
Thanks David, for your immediate response.
I sent all the details regarding this problem to you
( david....@smooth1.co.uk ), but the mail didnt reach you ( i got mail
delivery failure ).
I have both the onconfig files ( of test and development environment )
and the message log
Kindly mail to dextersunil@gmail.com, to get the complete details.
The message log output is as follows :
----------------------------------------------------------------------------------------------------
00:37:37 Size of resident + virtual segments 725088KB + 359472KB >1024000KB
00:37:37 total allowed by configuration parameter SHMTOTAL
00:39:49 Size of resident + virtual segments 725088KB + 359472KB >1024000KB
00:39:49 total allowed by configuration parameter SHMTOTAL
00:39:49 create_tcb: cannot allocate memory
00:39:49 (10167) connection rejected - too many users, or invaliduser name
00:39:49 listener-thread: err = -25571: oserr = 0: errstr = : Cannotcreate a user thread.
00:39:53 Size of resident + virtual segments 725088KB + 359472KB >1024000KB
00:39:53 total allowed by configuration parameter SHMTOTAL
00:39:53 create_tcb: cannot allocate memory
00:39:53 (10168) connection rejected - too many users, or invaliduser name
00:39:53 listener-thread: err = -25571: oserr = 0: errstr = : Cannotcreate a user thread.
00:39:55 Size of resident + virtual segments 725088KB + 359472KB >1024000KB
00:39:55 total allowed by configuration parameter SHMTOTAL
----------------------------------------------------------------------------------------------------
00:52:24 Checkpoint Completed: duration was 0 seconds.
00:52:24 Checkpoint loguniq 285306, logpos 0x13fc018, timestamp:0x691e6ba3
00:52:24 Maximum server connections 57
00:54:46 WARNING: temporary space tempdbs2 is full
00:55:42 WARNING: temporary space tempdbs1 is full
01:22:43 Checkpoint Completed: duration was 0 seconds.
01:22:43 Checkpoint loguniq 285306, logpos 0x1412018, timestamp:0x691fc560
01:22:43 Maximum server connections 57
01:39:25 WARNING: temporary space tempdbs1 is full
01:40:09 Size of resident + virtual segments 725088KB + 359472KB >1024000KB
01:40:09 total allowed by configuration parameter SHMTOTAL
01:49:26 Size of resident + virtual segments 725088KB + 359472KB >1024000KB
01:49:26 total allowed by configuration parameter SHMTOTAL
01:53:01 Checkpoint Completed: duration was 0 seconds.
01:53:01 Checkpoint loguniq 285306, logpos 0x14312a4, timestamp:0x6920c92b
01:53:01 Maximum server connections 57
----------------------------------------------------------------------------------------------------
Waiting for your replies.
Thanks in Advance.
With Regards,
Raja.