Memory leak on AIX 5.3
Posted in 2007
After moving from AIX 5.2 to AIX 5.3, the poster saw per-session memory in 'onstat -g ses' grow steadily (with IDS 9.40.UC7, and also when rebuilt under IDS 10) until the box crashed; the same app was fine on AIX 5.2. Suggestions included upgrading the AIX technology level (the poster was on 5300-02, while TL5 reportedly ran fine), an AIX-side fix obtained via IBM support (PMR 12140,999,866) and APAR IY91677 — though one respondent felt that APAR covered a different, msc-VP/authorization issue and urged opening a PMR plus checking 'onstat -g ses/mem/afr/stm' to identify the growing pool. No confirmed resolution is recorded in the thread.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Topics: Migration, Import/Export & Data Conversion, Platform-Specific Issues, Versions, Editions & End-of-Life
Our clients recently has migrated their system to AIX 5.3. Since the
migration they are having problem with our application. It is a
memory leak reported by Informix command 'onstst -g ses'. The memory
allocated to our processes grows until it crashes the system. This is
an example of onstat right after system startup:
IBM Informix Dynamic Server Version 9.40.UC7 -- On-Line -- Up
00:14:25 -- 38144 Kbytes
session #RSAM total
used dyna
mic
id user tty pid hostname threads memory
memory expl
ain
24 informix - 0 - 0 12288
7992 off
23 istadm 1 28638 H50 1 282624
267712 off
22 istadm 1 27608 H50 1 102400
96400 off
21 istadm 1 27866 H50 1 135168
125672 off
20 istadm 1 26838 H50 1 299008
283960 off
19 istadm 1 26322 H50 1 57344
50880 off
17 istadm 1 29670 H50 1 57344
53352 off
9 istadm 1 22962 H50 1 36864
32088 off
3 informix - 0 - 0 12288
9200 off
2 informix - 0 - 0 12288
7992 off
Our main process' PID is 26838. This is the output from onstat just a
few minutes leter:
IBM Informix Dynamic Server Version 9.40.UC7 -- On-Line -- Up
00:32:42 -- 38144 Kbytes
session #RSAM total
used dyna
mic
id user tty pid hostname threads memory
memory expl
ain
24 informix - 0 - 0 12288
7992 off
23 istadm 1 28638 H50 1 405504
389504 off
22 istadm 1 27608 H50 1 102400
96400 off
21 istadm 1 27866 H50 1 163840
150184 off
20 istadm 1 26838 H50 1 659456
641336 off
19 istadm 1 26322 H50 1 57344
50880 off
17 istadm 1 29670 H50 1 57344
53352 off
9 istadm 1 22962 H50 1 36864
32088 off
3 informix - 0 - 0 12288
9200 off
2 informix - 0 - 0 12288
7992 off
We were able to recreate this on our dev box. We are running AIX 5.3
with latest Service Pack from IBM and Informix IDS 9.40.UC7. We can
run identical application on AIX 5.2 with IDS 9.4 or IDS 9.2 without
any problems. It is only on AIX 5.3. We re-compiled the system with
IDS 10 on AIX 5.3 and we got the memory leak problem.
Does anybody has any suggestions?
Thank you.
Please post the output from the following AIX command:
oslevel -r
Mike
> -----Original Message-----
> From: informix-list-bounces@iiug.org
> [mailto:informix-list-bounces@iiug.org] On Behalf Of mirekb
> Sent: Friday, March 30, 2007 12:59 PM
> To: informix-list@iiug.org
> Subject: Memory leak on AIX 5.3
>
> Our clients recently has migrated their system to AIX 5.3.
> Since the migration they are having problem with our
> application. It is a memory leak reported by Informix
> command 'onstst -g ses'. The memory allocated to our
> processes grows until it crashes the system. This is an
> example of onstat right after system startup:
>
> IBM Informix Dynamic Server Version 9.40.UC7 -- On-Line -- Up
> 00:14:25 -- 38> 144 Kbytes
>
> session #RSAM total
> used dyna
> mic
> id user tty pid hostname threads memory
> memory expl
> ain
> 24 informix - 0 - 0 12288
> 7992 off
> 23 istadm 1 28638 H50 1 282624
> 267712 off
> 22 istadm 1 27608 H50 1 102400
> 96400 off
> 21 istadm 1 27866 H50 1 135168
> 125672 off
> 20 istadm 1 26838 H50 1 299008
> 283960 off
> 19 istadm 1 26322 H50 1 57344
> 50880 off
> 17 istadm 1 29670 H50 1 57344
> 53352 off
> 9 istadm 1 22962 H50 1 36864
> 32088 off
> 3 informix - 0 - 0 12288
> 9200 off
> 2 informix - 0 - 0 12288
> 7992 off
>
> Our main process' PID is 26838. This is the output from
> onstat just a few minutes leter:
>
> IBM Informix Dynamic Server Version 9.40.UC7 -- On-Line -- Up
> 00:32:42 -- 38> 144 Kbytes
>
> session #RSAM total
> used dyna
> mic
> id user tty pid hostname threads memory
> memory expl
> ain
> 24 informix - 0 - 0 12288
> 7992 off
> 23 istadm 1 28638 H50 1 405504
> 389504 off
> 22 istadm 1 27608 H50 1 102400
> 96400 off
> 21 istadm 1 27866 H50 1 163840
> 150184 off
> 20 istadm 1 26838 H50 1 659456
> 641336 off
> 19 istadm 1 26322 H50 1 57344
> 50880 off
> 17 istadm 1 29670 H50 1 57344
> 53352 off
> 9 istadm 1 22962 H50 1 36864
> 32088 off
> 3 informix - 0 - 0 12288
> 9200 off
> 2 informix - 0 - 0 12288
> 7992 off
>
> We were able to recreate this on our dev box. We are running
> AIX 5.3 with latest Service Pack from IBM and Informix IDS
> 9.40.UC7. We can run identical application on AIX 5.2 with
> IDS 9.4 or IDS 9.2 without any problems. It is only on AIX
> 5.3. We re-compiled the system with IDS 10 on AIX 5.3 and we
> got the memory leak problem.
> Does anybody has any suggestions?
>
> Thank you.
>
> _______________________________________________
> Informix-list mailing list
> Informix-list@iiug.org
> http://www.iiug.org/mailman/listinfo/informix-list
>
>
On Mar 30, 3:12 pm, "Mike Badar" <mba...@esri.com> wrote:
> Please post the output from the following AIX command:
>
> oslevel -r
>
> Mike
>
>
>
> > -----Original Message-----
> > From: informix-list-boun...@iiug.org
> > [mailto:informix-list-boun...@iiug.org] On Behalf Of mirekb
> > Sent: Friday, March 30, 2007 12:59 PM
> > To: informix-l...@iiug.org
> > Subject: Memory leak on AIX 5.3
>
> > Our clients recently has migrated their system to AIX 5.3.
> > Since the migration they are having problem with our
> > application. It is a memory leak reported by Informix
> > command 'onstst -g ses'. The memory allocated to our
> > processes grows until it crashes the system. This is an
> > example of onstat right after system startup:
>
> > IBM Informix Dynamic Server Version 9.40.UC7 -- On-Line -- Up
> > 00:14:25 -- 38> > 144 Kbytes
>
> > session #RSAM total
> > used dyna
> > mic
> > id user tty pid hostname threads memory
> > memory expl
> > ain
> > 24 informix - 0 - 0 12288
> > 7992 off
> > 23 istadm 1 28638 H50 1 282624
> > 267712 off
> > 22 istadm 1 27608 H50 1 102400
> > 96400 off
> > 21 istadm 1 27866 H50 1 135168
> > 125672 off
> > 20 istadm 1 26838 H50 1 299008
> > 283960 off
> > 19 istadm 1 26322 H50 1 57344
> > 50880 off
> > 17 istadm 1 29670 H50 1 57344
> > 53352 off
> > 9 istadm 1 22962 H50 1 36864
> > 32088 off
> > 3 informix - 0 - 0 12288
> > 9200 off
> > 2 informix - 0 - 0 12288
> > 7992 off
>
> > Our main process' PID is 26838. This is the output from
> > onstat just a few minutes leter:
>
> > IBM Informix Dynamic Server Version 9.40.UC7 -- On-Line -- Up
> > 00:32:42 -- 38> > 144 Kbytes
>
> > session #RSAM total
> > used dyna
> > mic
> > id user tty pid hostname threads memory
> > memory expl
> > ain
> > 24 informix - 0 - 0 12288
> > 7992 off
> > 23 istadm 1 28638 H50 1 405504
> > 389504 off
> > 22 istadm 1 27608 H50 1 102400
> > 96400 off
> > 21 istadm 1 27866 H50 1 163840
> > 150184 off
> > 20 istadm 1 26838 H50 1 659456
> > 641336 off
> > 19 istadm 1 26322 H50 1 57344
> > 50880 off
> > 17 istadm 1 29670 H50 1 57344
> > 53352 off
> > 9 istadm 1 22962 H50 1 36864
> > 32088 off
> > 3 informix - 0 - 0 12288
> > 9200 off
> > 2 informix - 0 - 0 12288
> > 7992 off
>
> > We were able to recreate this on our dev box. We are running
> > AIX 5.3 with latest Service Pack from IBM and Informix IDS
> > 9.40.UC7. We can run identical application on AIX 5.2 with
> > IDS 9.4 or IDS 9.2 without any problems. It is only on AIX
> > 5.3. We re-compiled the system with IDS 10 on AIX 5.3 and we
> > got the memory leak problem.
> > Does anybody has any suggestions?
>
> > Thank you.
>
> > _______________________________________________
> > Informix-list mailing list
> > Informix-l...@iiug.org
> >http://www.iiug.org/mailman/listinfo/informix-list- Hide quoted text -
>
> - Show quoted text -
5300-02
> -----Original Message-----
> From: informix-list-bounces@iiug.org
> [mailto:informix-list-bounces@iiug.org] On Behalf Of mirekb
> Sent: Friday, March 30, 2007 1:33 PM
> To: informix-list@iiug.org
> Subject: Re: Memory leak on AIX 5.3
>
> On Mar 30, 3:12 pm, "Mike Badar" <mba...@esri.com> wrote:
> > Please post the output from the following AIX command:
> >
> > oslevel -r
> >
> > Mike
> >
> >
> >
> > > -----Original Message-----
> > > From: informix-list-boun...@iiug.org
> > > [mailto:informix-list-boun...@iiug.org] On Behalf Of mirekb
> > > Sent: Friday, March 30, 2007 12:59 PM
> > > To: informix-l...@iiug.org
> > > Subject: Memory leak on AIX 5.3
> >
> > > Our clients recently has migrated their system to AIX 5.3.
> > > Since the migration they are having problem with our
> application.
> > > It is a memory leak reported by Informix command 'onstst
> -g ses'.
> > > The memory allocated to our processes grows until it crashes the
> > > system. This is an example of onstat right after system startup:
> >
> > > IBM Informix Dynamic Server Version 9.40.UC7 -- On-Line -- Up
> > > 00:14:25 -- 38> > > 144 Kbytes
> >
> > > session #RSAM total
> > > used dyna
> > > mic
> > > id user tty pid hostname threads memory
> > > memory expl
> > > ain
> > > 24 informix - 0 - 0 12288
> > > 7992 off
> > > 23 istadm 1 28638 H50 1 282624
> > > 267712 off
> > > 22 istadm 1 27608 H50 1 102400
> > > 96400 off
> > > 21 istadm 1 27866 H50 1 135168
> > > 125672 off
> > > 20 istadm 1 26838 H50 1 299008
> > > 283960 off
> > > 19 istadm 1 26322 H50 1 57344
> > > 50880 off
> > > 17 istadm 1 29670 H50 1 57344
> > > 53352 off
> > > 9 istadm 1 22962 H50 1 36864
> > > 32088 off
> > > 3 informix - 0 - 0 12288
> > > 9200 off
> > > 2 informix - 0 - 0 12288
> > > 7992 off
> >
> > > Our main process' PID is 26838. This is the output from
> onstat just
> > > a few minutes leter:
> >
> > > IBM Informix Dynamic Server Version 9.40.UC7 -- On-Line -- Up
> > > 00:32:42 -- 38> > > 144 Kbytes
> >
> > > session #RSAM total
> > > used dyna
> > > mic
> > > id user tty pid hostname threads memory
> > > memory expl
> > > ain
> > > 24 informix - 0 - 0 12288
> > > 7992 off
> > > 23 istadm 1 28638 H50 1 405504
> > > 389504 off
> > > 22 istadm 1 27608 H50 1 102400
> > > 96400 off
> > > 21 istadm 1 27866 H50 1 163840
> > > 150184 off
> > > 20 istadm 1 26838 H50 1 659456
> > > 641336 off
> > > 19 istadm 1 26322 H50 1 57344
> > > 50880 off
> > > 17 istadm 1 29670 H50 1 57344
> > > 53352 off
> > > 9 istadm 1 22962 H50 1 36864
> > > 32088 off
> > > 3 informix - 0 - 0 12288
> > > 9200 off
> > > 2 informix - 0 - 0 12288
> > > 7992 off
> >
> > > We were able to recreate this on our dev box. We are running AIX
> > > 5.3 with latest Service Pack from IBM and Informix IDS
> 9.40.UC7. We
> > > can run identical application on AIX 5.2 with IDS 9.4 or IDS 9.2
> > > without any problems. It is only on AIX 5.3. We re-compiled the
> > > system with IDS 10 on AIX 5.3 and we got the memory leak problem.
> > > Does anybody has any suggestions?
> >
> > > Thank you.
> >
> > > _______________________________________________
> > > Informix-list mailing list
> > > Informix-l...@iiug.org
> > >http://www.iiug.org/mailman/listinfo/informix-list- Hide
> quoted text
> > >-
> >
> > - Show quoted text -
>
> 5300-02
You are running Technology Level - TL - 2. I'm running TL 5 with IDS
9.4, 10.00.UC5, and Cheetah; no problems. You may want to consider
installing TL 5.
Mike
We had a memory leak on AIX 5.3 earlier this year at one of our customer
sites. We were given an AIX patch to fix it. I can't find the bug
description, but the IBM PMR number was 12140,999,866. I guess IBM Informix
Tech Support could get the details for you, but although we originally
raised a call with Informix support it was ultimately fixed by AIX support.
--
Neil Truby t:01932 724027
Director m:07798 811708
Ardenta Limited e:neil.truby@ardenta.com
"mirekb" <mirekb50@gmail.com> wrote in message
news:1175281145.130768.243690@n76g2000hsh.googlegroups.com...
> Our clients recently has migrated their system to AIX 5.3. Since the
> migration they are having problem with our application. It is a
> memory leak reported by Informix command 'onstst -g ses'. The memory
> allocated to our processes grows until it crashes the system. This is
> an example of onstat right after system startup:
>
> IBM Informix Dynamic Server Version 9.40.UC7 -- On-Line -- Up
> 00:14:25 -- 38> 144 Kbytes
>
> session #RSAM total
> used dyna
> mic
> id user tty pid hostname threads memory
> memory expl
> ain
> 24 informix - 0 - 0 12288
> 7992 off
> 23 istadm 1 28638 H50 1 282624
> 267712 off
> 22 istadm 1 27608 H50 1 102400
> 96400 off
> 21 istadm 1 27866 H50 1 135168
> 125672 off
> 20 istadm 1 26838 H50 1 299008
> 283960 off
> 19 istadm 1 26322 H50 1 57344
> 50880 off
> 17 istadm 1 29670 H50 1 57344
> 53352 off
> 9 istadm 1 22962 H50 1 36864
> 32088 off
> 3 informix - 0 - 0 12288
> 9200 off
> 2 informix - 0 - 0 12288
> 7992 off
>
> Our main process' PID is 26838. This is the output from onstat just a
> few minutes leter:
>
> IBM Informix Dynamic Server Version 9.40.UC7 -- On-Line -- Up
> 00:32:42 -- 38> 144 Kbytes
>
> session #RSAM total
> used dyna
> mic
> id user tty pid hostname threads memory
> memory expl
> ain
> 24 informix - 0 - 0 12288
> 7992 off
> 23 istadm 1 28638 H50 1 405504
> 389504 off
> 22 istadm 1 27608 H50 1 102400
> 96400 off
> 21 istadm 1 27866 H50 1 163840
> 150184 off
> 20 istadm 1 26838 H50 1 659456
> 641336 off
> 19 istadm 1 26322 H50 1 57344
> 50880 off
> 17 istadm 1 29670 H50 1 57344
> 53352 off
> 9 istadm 1 22962 H50 1 36864
> 32088 off
> 3 informix - 0 - 0 12288
> 9200 off
> 2 informix - 0 - 0 12288
> 7992 off
>
> We were able to recreate this on our dev box. We are running AIX 5.3
> with latest Service Pack from IBM and Informix IDS 9.40.UC7. We can
> run identical application on AIX 5.2 with IDS 9.4 or IDS 9.2 without
> any problems. It is only on AIX 5.3. We re-compiled the system with
> IDS 10 on AIX 5.3 and we got the memory leak problem.
> Does anybody has any suggestions?
>
> Thank you.
>
Google for IY91677 HTH, Andreas
Reading through this my impression is that this APAR talks about authorization functionality and the msc VP growing in size. What Mirek described looks like Informix session memory is growing rapidly within IDS shared memory - if I don't misinterpret what he's saying about the 'memory allocated to our processes'. This probably is something different... I'd say this qualifies for an interesting tech support case, someone had to look at the memory pools in detail and at the corresponding application logic. Wonder what OS dependency will really turn out here. Mirek, are you in a position to open a PMR on monday? Regards, Andreas
On 30 Mar, 19:59, "mirekb" <mirek...@gmail.com> wrote:
> Our clients recently has migrated their system to AIX 5.3. Since the
> migration they are having problem with our application. It is a
> memory leak reported by Informix command 'onstst -g ses'. The memory
> allocated to our processes grows until it crashes the system. This is
> an example of onstat right after system startup:
>
>
> We were able to recreate this on our dev box. We are running AIX 5.3
> with latest Service Pack from IBM and Informix IDS 9.40.UC7. We can
> run identical application on AIX 5.2 with IDS 9.4 or IDS 9.2 without
> any problems. It is only on AIX 5.3. We re-compiled the system with
> IDS 10 on AIX 5.3 and we got the memory leak problem.
> Does anybody has any suggestions?
>
> Thank you.
What does
onstat -g ses <sessionsid>
onstat -g mem
onstat -g afr
onstat -g stm
give?
Which pool is the memory going to?
David.
Related threads
- Posting from the Informix-list
- Migrating from IDS 9.40.UC6 to 11.50.UC3
- Ip for a network session
- questions onstat -g