thread memory allocation
Posted in 2001
Topics: Connectivity: ODBC / JDBC / .NET, Platform-Specific Issues
Hi all,
I have a weird memory usage issue.
Here is the problem:
on IDS 2000 running on Sun Solaris 8 we have a number of application servers
connecting to the informix instance called 'contentdb1'.
Most of the threads are JDBC.
Somehow one of the application boxes ( app02) requires much more memory per
thread then the other boxes.
Due to that the dynamic server keeps allocating shared memory segments - and
is running slow.
I wonder if someone dealt with this before.
Below are the outputs of onstat -g seg, ipcs, onstat -g ses ( with sessions
from app02, and the other box app01).
Appreciate all efforts to help,
Sincerely,
Elena.
*********
informix@contentdb1:/db/informix921[52]$onstat -g seg
Informix Dynamic Server 2000 Version 9.21.UC1 -- On-Line -- Up 1 days
13:13:23 -- 2041856 Kbytes
Segment Summary:
id key addr size ovhd class blkused blkfree
700 1381976065 a000000 805306368 26968 R* 193954 2654
703 1381976068 3a000000 614465536 19352 V 123382 26634
206 1381976071 5ea00000 1048576 632 M 69 187
307 1381976072 5eb00000 33554432 1624 V 5769 2423
208 1381976073 60b00000 33554432 1624 V 5198 2994
209 1381976074 62b00000 33554432 1624 V 5359 2833
210 1381976075 64b00000 33554432 1624 V 5511 2681
211 1381976076 66b00000 33554432 1624 V 4725 3467
212 1381976077 68b00000 33554432 1624 V 5142 3050
213 1381976078 6ab00000 33554432 1624 V 5154 3038
114 1381976079 6cb00000 33554432 1624 V 3533 4659
115 1381976080 6eb00000 33554432 1624 V 2727 5465
116 1381976081 70b00000 33554432 1624 V 2826 5366
117 1381976082 72b00000 33554432 1624 V 3092 5100
118 1381976083 74b00000 33554432 1624 V 1981 6211
119 1381976084 76b00000 33554432 1624 V 3101 5091
120 1381976085 78b00000 33554432 1624 V 3133 5059
121 1381976086 7ab00000 33554432 1624 V 3031 5161
122 1381976087 7cb00000 33554432 1624 V 3116 5076
123 1381976088 7eb00000 33554432 1624 V 2344 5848
124 1381976089 80b00000 33554432 1624 V 3173 5019
125 1381976090 82b00000 33554432 1624 V 6869 1323
126 1381976091 84b00000 33554432 1624 V 6154 2038
Total: - - 2091909120 - - 399343 111377
************
informix@contentdb1:/db/informix921[53]$ipcs
IPC status from <running system> as of Mon Feb 12 13:08:21 PST 2001
Message Queue facility inactive.
T ID KEY MODE OWNER GROUP
Shared Memory:
m 700 0x525f4801 --rw-rw---- root informix
m 701 0x525f4802 --rw-rw---- root informix
m 702 0x525f4803 --rw-rw---- root informix
m 703 0x525f4804 --rw-rw---- root informix
m 2204 0x525f4805 --rw-rw---- root informix
m 2205 0x525f4806 --rw-rw---- root informix
m 206 0x525f4807 --rw-rw-rw- root informix
m 307 0x525f4808 --rw-rw---- root informix
m 208 0x525f4809 --rw-rw---- root informix
m 209 0x525f480a --rw-rw---- root informix
m 210 0x525f480b --rw-rw---- root informix
m 211 0x525f480c --rw-rw---- root informix
m 212 0x525f480d --rw-rw---- root informix
m 213 0x525f480e --rw-rw---- root informix
m 114 0x525f480f --rw-rw---- root informix
m 115 0x525f4810 --rw-rw---- root informix
m 116 0x525f4811 --rw-rw---- root informix
m 117 0x525f4812 --rw-rw---- root informix
m 118 0x525f4813 --rw-rw---- root informix
m 119 0x525f4814 --rw-rw---- root informix
m 120 0x525f4815 --rw-rw---- root informix
m 121 0x525f4816 --rw-rw---- root informix
m 122 0x525f4817 --rw-rw---- root informix
m 123 0x525f4818 --rw-rw---- root informix
m 124 0x525f4819 --rw-rw---- root informix
m 125 0x525f481a --rw-rw---- root informix
m 126 0x525f481b --rw-rw---- root informix
Semaphores:
s 458752 0 --ra-ra---- root informix
s 458753 0 --ra-ra-ra- root informix
*******************
session #RSAM total used
id user tty pid hostname threads memory memory
...
6525 ejb - -1 app02.st 1 3534848 3452720
6523 ejb - -1 app02.st 1 3534848 3440896
6522 ejb - -1 app02.st 1 3543040 3444712
6520 ejb - -1 app02.st 1 3534848 3451256
6517 ejb - -1 app02.st 1 3526656 3452336
6514 ejb - -1 app02.st 1 3530752 3440024
6511 ejb - -1 app02.st 1 3526656 3451704
6509 ejb - -1 app02.st 1 3543040 3442640
6508 ejb - -1 app02.st 1 3538944 3448392
6506 ejb - -1 app02.st 1 3543040 3442616
6504 ejb - -1 app02.st 1 3543040 3443984
6502 ejb - -1 app02.st 1 3534848 3443184
...
10492 ejb - -1 app01.st 1 110592 71536
10491 ejb - -1 app01.st 1 94208 57640
10490 ejb - -1 app01.st 1 110592 71776
10489 ejb - -1 app01.st 1 106496 70200
10487 ejb - -1 app01.st 1 114688 71720
10486 ejb - -1 app01.st 1 118784 71872
10485 ejb - -1 app01.st 1 110592 71760
10484 ejb - -1 app01.st 1 114688 71448
10483 ejb - -1 app01.st 1 110592 73016
...
10332 ejb - -1 ecomm02. 1 425984 395224
10331 ejb - -1 ecomm02. 1 421888 393248
10330 ejb - -1 ecomm02. 1 438272 396056
10329 ejb - -1 ecomm02. 1 430080 395120
10328 ejb - -1 ecomm02. 1 421888 395560
10327 ejb - -1 ecomm02. 1 421888 394720
10326 ejb - -1 ecomm02. 1 430080 395848
10325 ejb - -1 ecomm02. 1 430080 395688
10324 ejb - -1 ecomm02. 1 425984 395160
10323 ejb - -1 ecomm02. 1 430080 397376
10322 ejb - -1 ecomm02. 1 434176 394456
10321 ejb - -1 ecomm02. 1 434176 394112
10320 ejb - -1 ecomm02. 1 425984 394120
e-mail: ekorol@styleclick.com
Tel: 310-751-2164 Fax: 310-751-2124
In the year of Our Lord Mon, 12 Feb 2001 13:13:42 -0800, Elena Korol <ekorol@styleclick.com> spake, saying: >I have a weird memory usage issue. >Here is the problem: >on IDS 2000 running on Sun Solaris 8 we have a number of application servers >connecting to the informix instance called 'contentdb1'. > >Most of the threads are JDBC. >Somehow one of the application boxes ( app02) requires much more memory per >thread then the other boxes. >Due to that the dynamic server keeps allocating shared memory segments - and >is running slow. Are the exact same processes running on both boxes? Backups on one but not the other? Reports? DBA stuff?
Hi
There are two issues here
1> your application does need so much mem, can you change this?
2> Even so much mem needed, you still can avoid system adding too many
segments causing server busy by changing:
'shmadd' much bigger: from 33554432 Bytes to like 700000 Kb
This will create one big addtional segment.
Creating additional segment takes a lot of system resource.
Regards
"Elena Korol" <ekorol@styleclick.com> wrote in message
news:969lgv$bqf$1@news.xmission.com...
>
> Hi all,
>
> I have a weird memory usage issue.
> Here is the problem:
> on IDS 2000 running on Sun Solaris 8 we have a number of application
servers
> connecting to the informix instance called 'contentdb1'.
>
> Most of the threads are JDBC.
> Somehow one of the application boxes ( app02) requires much more memory
per
> thread then the other boxes.
> Due to that the dynamic server keeps allocating shared memory segments -
and
> is running slow.
>
> I wonder if someone dealt with this before.
> Below are the outputs of onstat -g seg, ipcs, onstat -g ses ( with
sessions
> from app02, and the other box app01).
> Appreciate all efforts to help,
> Sincerely,
> Elena.
>
> *********
> informix@contentdb1:/db/informix921[52]$onstat -g seg
>
> Informix Dynamic Server 2000 Version 9.21.UC1 -- On-Line -- Up 1 days
> 13:13:23 -- 2041856 Kbytes
>
> Segment Summary:
> id key addr size ovhd class blkused blkfree
> 700 1381976065 a000000 805306368 26968 R* 193954 2654
> 703 1381976068 3a000000 614465536 19352 V 123382 26634
> 206 1381976071 5ea00000 1048576 632 M 69 187
> 307 1381976072 5eb00000 33554432 1624 V 5769 2423
> 208 1381976073 60b00000 33554432 1624 V 5198 2994
> 209 1381976074 62b00000 33554432 1624 V 5359 2833
> 210 1381976075 64b00000 33554432 1624 V 5511 2681
> 211 1381976076 66b00000 33554432 1624 V 4725 3467
> 212 1381976077 68b00000 33554432 1624 V 5142 3050
> 213 1381976078 6ab00000 33554432 1624 V 5154 3038
> 114 1381976079 6cb00000 33554432 1624 V 3533 4659
> 115 1381976080 6eb00000 33554432 1624 V 2727 5465
> 116 1381976081 70b00000 33554432 1624 V 2826 5366
> 117 1381976082 72b00000 33554432 1624 V 3092 5100
> 118 1381976083 74b00000 33554432 1624 V 1981 6211
> 119 1381976084 76b00000 33554432 1624 V 3101 5091
> 120 1381976085 78b00000 33554432 1624 V 3133 5059
> 121 1381976086 7ab00000 33554432 1624 V 3031 5161
> 122 1381976087 7cb00000 33554432 1624 V 3116 5076
> 123 1381976088 7eb00000 33554432 1624 V 2344 5848
> 124 1381976089 80b00000 33554432 1624 V 3173 5019
> 125 1381976090 82b00000 33554432 1624 V 6869 1323
> 126 1381976091 84b00000 33554432 1624 V 6154 2038
> Total: - - 2091909120 - - 399343 111377
> ************
> informix@contentdb1:/db/informix921[53]$ipcs
> IPC status from <running system> as of Mon Feb 12 13:08:21 PST 2001
> Message Queue facility inactive.
> T ID KEY MODE OWNER GROUP
> Shared Memory:
> m 700 0x525f4801 --rw-rw---- root informix
> m 701 0x525f4802 --rw-rw---- root informix
> m 702 0x525f4803 --rw-rw---- root informix
> m 703 0x525f4804 --rw-rw---- root informix
> m 2204 0x525f4805 --rw-rw---- root informix
> m 2205 0x525f4806 --rw-rw---- root informix
> m 206 0x525f4807 --rw-rw-rw- root informix
> m 307 0x525f4808 --rw-rw---- root informix
> m 208 0x525f4809 --rw-rw---- root informix
> m 209 0x525f480a --rw-rw---- root informix
> m 210 0x525f480b --rw-rw---- root informix
> m 211 0x525f480c --rw-rw---- root informix
> m 212 0x525f480d --rw-rw---- root informix
> m 213 0x525f480e --rw-rw---- root informix
> m 114 0x525f480f --rw-rw---- root informix
> m 115 0x525f4810 --rw-rw---- root informix
> m 116 0x525f4811 --rw-rw---- root informix
> m 117 0x525f4812 --rw-rw---- root informix
> m 118 0x525f4813 --rw-rw---- root informix
> m 119 0x525f4814 --rw-rw---- root informix
> m 120 0x525f4815 --rw-rw---- root informix
> m 121 0x525f4816 --rw-rw---- root informix
> m 122 0x525f4817 --rw-rw---- root informix
> m 123 0x525f4818 --rw-rw---- root informix
> m 124 0x525f4819 --rw-rw---- root informix
> m 125 0x525f481a --rw-rw---- root informix
> m 126 0x525f481b --rw-rw---- root informix
> Semaphores:
> s 458752 0 --ra-ra---- root informix
> s 458753 0 --ra-ra-ra- root informix
> *******************
> session #RSAM total used
> id user tty pid hostname threads memory memory
> ...
>
> 6525 ejb - -1 app02.st 1 3534848 3452720
> 6523 ejb - -1 app02.st 1 3534848 3440896
> 6522 ejb - -1 app02.st 1 3543040 3444712
> 6520 ejb - -1 app02.st 1 3534848 3451256
> 6517 ejb - -1 app02.st 1 3526656 3452336
> 6514 ejb - -1 app02.st 1 3530752 3440024
> 6511 ejb - -1 app02.st 1 3526656 3451704
> 6509 ejb - -1 app02.st 1 3543040 3442640
> 6508 ejb - -1 app02.st 1 3538944 3448392
> 6506 ejb - -1 app02.st 1 3543040 3442616
> 6504 ejb - -1 app02.st 1 3543040 3443984
> 6502 ejb - -1 app02.st 1 3534848 3443184
> ...
> 10492 ejb - -1 app01.st 1 110592 71536
> 10491 ejb - -1 app01.st 1 94208 57640
> 10490 ejb - -1 app01.st 1 110592 71776
> 10489 ejb - -1 app01.st 1 106496 70200
> 10487 ejb - -1 app01.st 1 114688 71720
> 10486 ejb - -1 app01.st 1 118784 71872
> 10485 ejb - -1 app01.st 1 110592 71760
> 10484 ejb - -1 app01.st 1 114688 71448
> 10483 ejb - -1 app01.st 1 110592 73016
> ...
> 10332 ejb - -1 ecomm02. 1 425984 395224
> 10331 ejb - -1 ecomm02. 1 421888 393248
> 10330 ejb - -1 ecomm02. 1 438272 396056
> 10329 ejb - -1 ecomm02. 1 430080 395120
> 10328 ejb - -1 ecomm02. 1 421888 395560@@NL@
I have had this problem as well. But on solaris 7 with ids2000. We located
the problem to the java code using the jdbc driver.
If transactions are not explicitly commited, the memory just keeps getting
chewed up and do not use the autocommit routine in java.sql.
But it alse depends upon the app as well. If you are using connection
pools, make sure that the sessions to the database server are closed once
thaey have completed their work.
Cheers
Hans
Elena Korol wrote in message <969lgv$bqf$1@news.xmission.com>...
>
>Hi all,
>
>I have a weird memory usage issue.
>Here is the problem:
>on IDS 2000 running on Sun Solaris 8 we have a number of application
servers
>connecting to the informix instance called 'contentdb1'.
>
>Most of the threads are JDBC.
>Somehow one of the application boxes ( app02) requires much more memory per
>thread then the other boxes.
>Due to that the dynamic server keeps allocating shared memory segments -
and
>is running slow.
>
>I wonder if someone dealt with this before.
>Below are the outputs of onstat -g seg, ipcs, onstat -g ses ( with sessions
>from app02, and the other box app01).
>Appreciate all efforts to help,
>Sincerely,
>Elena.
>
>*********
>informix@contentdb1:/db/informix921[52]$onstat -g seg
>
>Informix Dynamic Server 2000 Version 9.21.UC1 -- On-Line -- Up 1 days
>13:13:23 -- 2041856 Kbytes
>
>Segment Summary:
>id key addr size ovhd class blkused blkfree
>700 1381976065 a000000 805306368 26968 R* 193954 2654
>703 1381976068 3a000000 614465536 19352 V 123382 26634
>206 1381976071 5ea00000 1048576 632 M 69 187
>307 1381976072 5eb00000 33554432 1624 V 5769 2423
>208 1381976073 60b00000 33554432 1624 V 5198 2994
>209 1381976074 62b00000 33554432 1624 V 5359 2833
>210 1381976075 64b00000 33554432 1624 V 5511 2681
>211 1381976076 66b00000 33554432 1624 V 4725 3467
>212 1381976077 68b00000 33554432 1624 V 5142 3050
>213 1381976078 6ab00000 33554432 1624 V 5154 3038
>114 1381976079 6cb00000 33554432 1624 V 3533 4659
>115 1381976080 6eb00000 33554432 1624 V 2727 5465
>116 1381976081 70b00000 33554432 1624 V 2826 5366
>117 1381976082 72b00000 33554432 1624 V 3092 5100
>118 1381976083 74b00000 33554432 1624 V 1981 6211
>119 1381976084 76b00000 33554432 1624 V 3101 5091
>120 1381976085 78b00000 33554432 1624 V 3133 5059
>121 1381976086 7ab00000 33554432 1624 V 3031 5161
>122 1381976087 7cb00000 33554432 1624 V 3116 5076
>123 1381976088 7eb00000 33554432 1624 V 2344 5848
>124 1381976089 80b00000 33554432 1624 V 3173 5019
>125 1381976090 82b00000 33554432 1624 V 6869 1323
>126 1381976091 84b00000 33554432 1624 V 6154 2038
>Total: - - 2091909120 - - 399343 111377
>************
>informix@contentdb1:/db/informix921[53]$ipcs
>IPC status from <running system> as of Mon Feb 12 13:08:21 PST 2001
>Message Queue facility inactive.
>T ID KEY MODE OWNER GROUP
>Shared Memory:
>m 700 0x525f4801 --rw-rw---- root informix
>m 701 0x525f4802 --rw-rw---- root informix
>m 702 0x525f4803 --rw-rw---- root informix
>m 703 0x525f4804 --rw-rw---- root informix
>m 2204 0x525f4805 --rw-rw---- root informix
>m 2205 0x525f4806 --rw-rw---- root informix
>m 206 0x525f4807 --rw-rw-rw- root informix
>m 307 0x525f4808 --rw-rw---- root informix
>m 208 0x525f4809 --rw-rw---- root informix
>m 209 0x525f480a --rw-rw---- root informix
>m 210 0x525f480b --rw-rw---- root informix
>m 211 0x525f480c --rw-rw---- root informix
>m 212 0x525f480d --rw-rw---- root informix
>m 213 0x525f480e --rw-rw---- root informix
>m 114 0x525f480f --rw-rw---- root informix
>m 115 0x525f4810 --rw-rw---- root informix
>m 116 0x525f4811 --rw-rw---- root informix
>m 117 0x525f4812 --rw-rw---- root informix
>m 118 0x525f4813 --rw-rw---- root informix
>m 119 0x525f4814 --rw-rw---- root informix
>m 120 0x525f4815 --rw-rw---- root informix
>m 121 0x525f4816 --rw-rw---- root informix
>m 122 0x525f4817 --rw-rw---- root informix
>m 123 0x525f4818 --rw-rw---- root informix
>m 124 0x525f4819 --rw-rw---- root informix
>m 125 0x525f481a --rw-rw---- root informix
>m 126 0x525f481b --rw-rw---- root informix
>Semaphores:
>s 458752 0 --ra-ra---- root informix
>s 458753 0 --ra-ra-ra- root informix
>*******************
>session #RSAM total used
>id user tty pid hostname threads memory memory
>...
>
>6525 ejb - -1 app02.st 1 3534848 3452720
>6523 ejb - -1 app02.st 1 3534848 3440896
>6522 ejb - -1 app02.st 1 3543040 3444712
>6520 ejb - -1 app02.st 1 3534848 3451256
>6517 ejb - -1 app02.st 1 3526656 3452336
>6514 ejb - -1 app02.st 1 3530752 3440024
>6511 ejb - -1 app02.st 1 3526656 3451704
>6509 ejb - -1 app02.st 1 3543040 3442640
>6508 ejb - -1 app02.st 1 3538944 3448392
>6506 ejb - -1 app02.st 1 3543040 3442616
>6504 ejb - -1 app02.st 1 3543040 3443984
>6502 ejb - -1 app02.st 1 3534848 3443184
>...
>10492 ejb - -1 app01.st 1 110592 71536
>10491 ejb - -1 app01.st 1 94208 57640
>10490 ejb - -1 app01.st 1 110592 71776
>10489 ejb - -1 app01.st 1 106496 70200
>10487 ejb - -1 app01.st 1 114688 71720
>10486 ejb - -1 app01.st 1 118784 71872
>10485 ejb - -1 app01.st 1 110592 71760
>10484 ejb - -1 app01.st 1 114688 71448
>10483 ejb - -1 app01.st 1 110592 73016
>...
>10332 ejb - -1 ecomm02. 1 425984 395224
>10331 ejb - -1 ecomm02. 1 421888 393248
>10330 ejb - -1 ecomm02. 1 438272 396056
>10329 ejb - -1 ecomm02. 1 430080 395120
>10328 ejb - -1 ecomm02. 1 421888 395560
>10327 ejb - -1 ecomm02. 1 421888 394720
>10326 ejb
Related threads
- Posting from the Informix-list
- Migrating from IDS 9.40.UC6 to 11.50.UC3
- Ip for a network session
- questions onstat -g