new bufferpool
Posted in 2014
Topics: Performance & Tuning, Server Administration
This concerns ids12.10TC3IE .
These are the old lines in my onconfig...
#BUFFERPOOL
default,buffers=10000,lrus=8,lru_min_dirty=50.00,lru_max_dirty=60.50
#BUFFERPOOL
size=4K,buffers=100000,lrus=8,lru_min_dirty=20.00,lru_max_dirty=30.00
#BUFFERPOOL
size=16K,buffers=20000,lrus=8,lru_min_dirty=20.00,lru_max_dirty=30.00
These are the new lines ( I tried to approximate the same number of buffers)
...
BUFFERPOOL default,memory=auto
BUFFERPOOL size=4K,memory=400mb
BUFFERPOOL size=16K,memory=320mb
onstat âb says this:
Buffer pool page size: 4096
842 modified, 14878 total, 131072 hash buckets, 4096 buffer size
Buffer pool page size: 16384
26 modified, 1996 total, 16384 hash buckets, 16384 buffer size
and no matter how much memory I say to use the number of buffers stay the same.
I suppose the âmemory=autoâ causes this, but how does it know to start at
14878 buffers?
onstat âg seg says this:
Segment Summary:
id key addr size ovhd class blkused blkfree
1381386241 52564801 c000000 4980736 255904 R* 1214 2
1381386242 52564802 c4c0000 819200000 4801216 V 35999 164001
1381386243 52564803 3d200000 67108864 1 B* 16384 0
1381386244 52564804 41200000 33554432 1 B* 8192 0
Total: - - 924844032 - - 61789 164003
How does the 400mb of 4k buffers get to be 8192 blocks allocated?
Help me understand please.
Also window task manager shows oninit has working set memory of 265mb instead
of 2gb previously. Where did the ram go? one of the svchost.exe that is
running?
Should this improve or hurt performance?
original post
This concerns ids12.10TC3IE .
These are the old lines in my onconfig...
#BUFFERPOOL
default,buffers=10000,lrus=8,lru_min_dirty=50.00,lru_max_dirty=60.50
#BUFFERPOOL
size=4K,buffers=100000,lrus=8,lru_min_dirty=20.00,lru_max_dirty=30.00
#BUFFERPOOL
size=16K,buffers=20000,lrus=8,lru_min_dirty=20.00,lru_max_dirty=30.00
These are the new lines ( I tried to approximate the same number of buffers)
...
BUFFERPOOL default,memory=auto
BUFFERPOOL size=4K,memory=400mb
BUFFERPOOL size=16K,memory=320mb
onstat âb says this:
Buffer pool page size: 4096
842 modified, 14878 total, 131072 hash buckets, 4096 buffer size
Buffer pool page size: 16384
26 modified, 1996 total, 16384 hash buckets, 16384 buffer size
and no matter how much memory I say to use the number of buffers stay the same.
I suppose the âmemory=autoâ causes this, but how does it know to start at
14878 buffers?
onstat âg seg says this:
Segment Summary:
id key addr size ovhd class blkused blkfree
1381386241 52564801 c000000 4980736 255904 R* 1214 2
1381386242 52564802 c4c0000 819200000 4801216 V 35999 164001
1381386243 52564803 3d200000 67108864 1 B* 16384 0
1381386244 52564804 41200000 33554432 1 B* 8192 0
Total: - - 924844032 - - 61789 164003
How does the 400mb of 4k buffers get to be 8192 blocks allocated?
Help me understand please.
Also window task manager shows oninit has working set memory of 265mb instead
of 2gb previously. Where did the ram go? one of the svchost.exe that is
running?
Should this improve or hurt performance?
Response:
Well, if I'm reading the doc correctly, it looks like if you use the new
memory syntax for the BUFFERPOOL config paramter when you specify
memory=<blah>, that's the max size. It also means that your buffer pool is
defaulting to expandable, and the initial size of the pool is 32Mb. If you
want to configure the starting size you need to use syntax something like this
I believe:
BUFFERPOOL size=4K,start_memory=<whatever>,memory=400mb
BUFFERPOOL size=16K,start_memory=<whatever>,memory=320mb
So that should clear up your "no matter how much memory I say to use the
number of buffers stay the same" issue.
Obviously your 4k buffer pool is not 400mb if the onstat -g seg is showing
only 8192 blocks (since that would be 8192 * 4k which looks like 32 Mb which
would be the default starting size for a buffer pool before it expands).
As for why task manager is reporting a difference in working set memory, I
have no idea...I don't do a lot of windows.
Jacques Renaut
IBM Informix Advanced Support
APD Team
Thanks.
That was very helpful.
-----Original Message-----
From: JACQUES RENAUT
Sent: Wednesday, May 21, 2014 9:29 PM
To: ids@iiug.org
Subject: Re: new bufferpool [33079]
original post
This concerns ids12.10TC3IE .
These are the old lines in my onconfig...
#BUFFERPOOL
default,buffers=10000,lrus=8,lru_min_dirty=50.00,lru_max_dirty=60.50
#BUFFERPOOL
size=4K,buffers=100000,lrus=8,lru_min_dirty=20.00,lru_max_dirty=30.00
#BUFFERPOOL
size=16K,buffers=20000,lrus=8,lru_min_dirty=20.00,lru_max_dirty=30.00
These are the new lines ( I tried to approximate the same number of buffers)
....
BUFFERPOOL default,memory=auto
BUFFERPOOL size=4K,memory=400mb
BUFFERPOOL size=16K,memory=320mb
onstat âb says this:
Buffer pool page size: 4096
842 modified, 14878 total, 131072 hash buckets, 4096 buffer size
Buffer pool page size: 16384
26 modified, 1996 total, 16384 hash buckets, 16384 buffer size
and no matter how much memory I say to use the number of buffers stay the
same.
I suppose the âmemory=autoâ causes this, but how does it know to start
at
14878 buffers?
onstat âg seg says this:
Segment Summary:
id key addr size ovhd class blkused blkfree
1381386241 52564801 c000000 4980736 255904 R* 1214 2
1381386242 52564802 c4c0000 819200000 4801216 V 35999 164001
1381386243 52564803 3d200000 67108864 1 B* 16384 0
1381386244 52564804 41200000 33554432 1 B* 8192 0
Total: - - 924844032 - - 61789 164003
How does the 400mb of 4k buffers get to be 8192 blocks allocated?
Help me understand please.
Also window task manager shows oninit has working set memory of 265mb
instead
of 2gb previously. Where did the ram go? one of the svchost.exe that is
running?
Should this improve or hurt performance?
Response:
Well, if I'm reading the doc correctly, it looks like if you use the new
memory syntax for the BUFFERPOOL config paramter when you specify
memory=<blah>, that's the max size. It also means that your buffer pool is
defaulting to expandable, and the initial size of the pool is 32Mb. If you
want to configure the starting size you need to use syntax something like
this
I believe:
BUFFERPOOL size=4K,start_memory=<whatever>,memory=400mb
BUFFERPOOL size=16K,start_memory=<whatever>,memory=320mb
So that should clear up your "no matter how much memory I say to use the
number of buffers stay the same" issue.
Obviously your 4k buffer pool is not 400mb if the onstat -g seg is showing
only 8192 blocks (since that would be 8192 * 4k which looks like 32 Mb which
would be the default starting size for a buffer pool before it expands).
As for why task manager is reporting a difference in working set memory, I
have no idea...I don't do a lot of windows.
Jacques Renaut
IBM Informix Advanced Support
APD Team
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.
I would suggest using "onstat -g buf" to view the information.
John F. Miller III
STSM, Lead Architect
ids-bounces@iiug.org wrote on 05/22/2014 12:33:46 PM:
> From: "BillHatVerizon" <garage_dba@verizon.net>
> To: ids@iiug.org,
> Date: 05/22/2014 12:34 PM
> Subject: Re: new bufferpool [33083]
> Sent by: ids-bounces@iiug.org
>
> Thanks.
> That was very helpful.
>
> -----Original Message-----
> From: JACQUES RENAUT
> Sent: Wednesday, May 21, 2014 9:29 PM
> To: ids@iiug.org
> Subject: Re: new bufferpool [33079]
>
> original post
>
> This concerns ids12.10TC3IE .
>
> These are the old lines in my onconfig...
> #BUFFERPOOL
> default,buffers=3D10000,lrus=3D8,lru_min_dirty=3D50.00,lru_max_dirty=3D=
60.50
> #BUFFERPOOL
> size=3D4K,buffers=3D100000,lrus=3D8,lru_min_dirty=3D20.00,lru_max_dir=
ty=3D30.00
> #BUFFERPOOL
> size=3D16K,buffers=3D20000,lrus=3D8,lru_min_dirty=3D20.00,lru_max_dir=
ty=3D30.00
>
> These are the new lines ( I tried to approximate the same number of
buffers)
> .....
> BUFFERPOOL default,memory=3Dauto
> BUFFERPOOL size=3D4K,memory=3D400mb
> BUFFERPOOL size=3D16K,memory=3D320mb>
> onstat =E2b says this:
> Buffer pool page size: 4096
> 842 modified, 14878 total, 131072 hash buckets, 4096 buffer size
>
> Buffer pool page size: 16384
> 26 modified, 1996 total, 16384 hash buckets, 16384 buffer size
>
> and no matter how much memory I say to use the number of buffers stay=
the
> same.
> I suppose the =E2memory=3Dauto=E2=9D causes this, but how does it kno=
w to start
> at
> 14878 buffers?
>
> onstat =E2g seg says this:
>
> Segment Summary:
> id key addr size ovhd class blkused blkfree
> 1381386241 52564801 c000000 4980736 255904 R* 1214 2
> 1381386242 52564802 c4c0000 819200000 4801216 V 35999 164001
> 1381386243 52564803 3d200000 67108864 1 B* 16384 0
> 1381386244 52564804 41200000 33554432 1 B* 8192 0
> Total: - - 924844032 - - 61789 164003
>
> How does the 400mb of 4k buffers get to be 8192 blocks allocated?
> Help me understand please.
>
> Also window task manager shows oninit has working set memory of 265mb=
> instead
> of 2gb previously. Where did the ram go? one of the svchost.exe that =
is
> running?
> Should this improve or hurt performance?
>
> Response:
>
> Well, if I'm reading the doc correctly, it looks like if you use the =
new
> memory syntax for the BUFFERPOOL config paramter when you specify
> memory=3D<blah>, that's the max size. It also means that your buffer =
pool
is
> defaulting to expandable, and the initial size of the pool is 32Mb. I=
f
you
> want to configure the starting size you need to use syntax something =
like
> this
> I believe:
>
> BUFFERPOOL size=3D4K,start_memory=3D<whatever>,memory=3D400mb
> BUFFERPOOL size=3D16K,start_memory=3D<whatever>,memory=3D320mb
>
> So that should clear up your "no matter how much memory I say to use =
the
> number of buffers stay the same" issue.
>
> Obviously your 4k buffer pool is not 400mb if the onstat -g seg is
showing
> only 8192 blocks (since that would be 8192 * 4k which looks like 32 M=
b
which
> would be the default starting size for a buffer pool before it expand=
s).
>
> As for why task manager is reporting a difference in working set memo=
ry,
I
> have no idea...I don't do a lot of windows.
>
> Jacques Renaut
> IBM Informix Advanced Support
> APD Team
>
>
>
***********************************************************************=
********
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
>
***********************************************************************=
********
> Forum Note: Use "Reply" to post a response in the discussion forum.=
>=
Related threads
- Posting from the Informix-list
- Migrating from IDS 9.40.UC6 to 11.50.UC3
- Ip for a network session
- questions onstat -g