shared memory questions
Posted in 2012
On IDS 11.70.TC3IE (Innovator-C) on Windows 2008, every startup logged a message about the total shared memory size being set to 2097152 KB, and the poster wanted to know whether he could still add buffers (onstat -g seg showed only ~1.2 GB in use). An IBM support engineer explained the message is just the server resetting SHMTOTAL because the onconfig had SHMTOTAL=0 (or >2 GB); setting SHMTOTAL to 2 GB stopped the message, which it did. Buffers could be increased as long as total shared memory stayed under 2 GB. Art Kagel noted buffers live in the resident segment, so an oversized SHMVIRTSIZE eats into the 2 GB available for them.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Topics: Platform-Specific Issues
This concerns IDS 11.70.TC3IE on Windows server 2008.
Each time the instance is started it reports that
"the total shared memory size for this server to 2097152 KB"
regardless of how many buffers, locks, etc are allocated.
So, I conclude that the message is hard-coded to write to the log always.
This is the output of onstat -g seg:
Segment Summary:
id key addr size ovhd class blkused blkfree
1382434817 52664801 c000000 708575232 4378720 R* 172986 6
1382434818 52664802 363c0000 512032768 3001384 V 22014 102994
Total: - - 1220608000 - - 195000 103000
1. Does this mean I can add buffers to use the rest of the 876544 KB allowed?
2. Should I reduce SHMVIRTSIZE to allow me to get more buffers?
(Currently the virtual segment is 82% free.)
Hello.
In your version 11.70.TC3IE, IE stands for Innovator-C Edition.
You are reaching one of its limits.
Check it out for a full description of all your limitations on the free
edition:
http://www.ibm.com/developerworks/data/library/techarticle/dm-0801doe/
Regards.
Alexandre Marini
IBM Informix Certified Professional v10 / v11.50 / v11.70
IBM Information Management Informix Technical Professional
IBM Infosphere DataStage Technical Professional
Database Administrator - Cleartech Ltda
BRIUG website administrator
Informix independent consultant
> To: ids@iiug.org
> From: garage_dba@verizon.net
> Subject: shared memory questions [28454]
> Date: Tue, 9 Oct 2012 00:15:34 -0400
>
> This concerns IDS 11.70.TC3IE on Windows server 2008.
> Each time the instance is started it reports that
> "the total shared memory size for this server to 2097152 KB"
> regardless of how many buffers, locks, etc are allocated.
> So, I conclude that the message is hard-coded to write to the log always.
> This is the output of onstat -g seg:
> Segment Summary:
> id key addr size ovhd class blkused blkfree
> 1382434817 52664801 c000000 708575232 4378720 R* 172986 6
> 1382434818 52664802 363c0000 512032768 3001384 V 22014 102994
> Total: - - 1220608000 - - 195000 103000
> 1. Does this mean I can add buffers to use the rest of the 876544 KB allowed?
> 2. Should I reduce SHMVIRTSIZE to allow me to get more buffers?
> (Currently the virtual segment is 82% free.)
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
Thanks, but I don't know which limitation it is complaining about. It
appears to say memory but that does not seem possible, so I must disregard
the message as being hardcoded.
The question was ... If onstat -g seg shows a total of 1220608000 then is
that enough info to conclude that a bunch of buffers could be added or is
there something I am missing?
Follow-up question: if you push it too far, what does the engine change to
bring the memory within limits? buffers? locks? random decision?
-----Original Message-----
From: Alexandre Marini
Sent: Tuesday, October 09, 2012 8:59 AM
To: ids@iiug.org
Subject: RE: shared memory questions [28456]
Hello.
In your version 11.70.TC3IE, IE stands for Innovator-C Edition.
You are reaching one of its limits.
Check it out for a full description of all your limitations on the free
edition:
http://www.ibm.com/developerworks/data/library/techarticle/dm-0801doe/
Regards.
Alexandre Marini
IBM Informix Certified Professional v10 / v11.50 / v11.70
IBM Information Management Informix Technical Professional
IBM Infosphere DataStage Technical Professional
Database Administrator - Cleartech Ltda
BRIUG website administrator
Informix independent consultant
> To: ids@iiug.org
> From: garage_dba@verizon.net
> Subject: shared memory questions [28454]
> Date: Tue, 9 Oct 2012 00:15:34 -0400
>
> This concerns IDS 11.70.TC3IE on Windows server 2008.
> Each time the instance is started it reports that
> "the total shared memory size for this server to 2097152 KB"
> regardless of how many buffers, locks, etc are allocated.
> So, I conclude that the message is hard-coded to write to the log always.
> This is the output of onstat -g seg:
> Segment Summary:
> id key addr size ovhd class blkused blkfree
> 1382434817 52664801 c000000 708575232 4378720 R* 172986 6
> 1382434818 52664802 363c0000 512032768 3001384 V 22014 102994
> Total: - - 1220608000 - - 195000 103000
> 1. Does this mean I can add buffers to use the rest of the 876544 KB
allowed?
> 2. Should I reduce SHMVIRTSIZE to allow me to get more buffers?
> (Currently the virtual segment is 82% free.)
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.
Ok, I´ve even saw that kind of message when SHMTOTAL was exceeding the version
limit.
Maybe some of our IBMer friends would help you, and explain further????
Regards.
Alexandre Marini
IBM Informix Certified Professional v10 / v11.50 / v11.70
IBM Information Management Informix Technical Professional
IBM Infosphere DataStage Technical Professional
Database Administrator - Cleartech Ltda
BRIUG website administrator
Informix independent consultant
> To: ids@iiug.org
> From: garage_dba@verizon.net
> Subject: Re: shared memory questions [28458]
> Date: Tue, 9 Oct 2012 13:40:57 -0400
>
> Thanks, but I don't know which limitation it is complaining about. It
> appears to say memory but that does not seem possible, so I must disregard
> the message as being hardcoded.
>
> The question was ... If onstat -g seg shows a total of 1220608000 then is
> that enough info to conclude that a bunch of buffers could be added or is
> there something I am missing?
>
> Follow-up question: if you push it too far, what does the engine change to
> bring the memory within limits? buffers? locks? random decision?
>
> -----Original Message-----
> From: Alexandre Marini
> Sent: Tuesday, October 09, 2012 8:59 AM
> To: ids@iiug.org
> Subject: RE: shared memory questions [28456]
>
> Hello.
> In your version 11.70.TC3IE, IE stands for Innovator-C Edition.
> You are reaching one of its limits.
> Check it out for a full description of all your limitations on the free
> edition:
>
> http://www.ibm.com/developerworks/data/library/techarticle/dm-0801doe/
>
> Regards.
>
> Alexandre Marini
> IBM Informix Certified Professional v10 / v11.50 / v11.70
>
> IBM Information Management Informix Technical Professional
>
> IBM Infosphere DataStage Technical Professional
> Database Administrator - Cleartech Ltda
> BRIUG website administrator
> Informix independent consultant
>
> > To: ids@iiug.org
> > From: garage_dba@verizon.net
> > Subject: shared memory questions [28454]
> > Date: Tue, 9 Oct 2012 00:15:34 -0400
> >
> > This concerns IDS 11.70.TC3IE on Windows server 2008.
> > Each time the instance is started it reports that
> > "the total shared memory size for this server to 2097152 KB"
> > regardless of how many buffers, locks, etc are allocated.
> > So, I conclude that the message is hard-coded to write to the log always.
> > This is the output of onstat -g seg:
> > Segment Summary:
> > id key addr size ovhd class blkused blkfree
> > 1382434817 52664801 c000000 708575232 4378720 R* 172986 6
> > 1382434818 52664802 363c0000 512032768 3001384 V 22014 102994
> > Total: - - 1220608000 - - 195000 103000
> > 1. Does this mean I can add buffers to use the rest of the 876544 KB
> allowed?
> > 2. Should I reduce SHMVIRTSIZE to allow me to get more buffers?
> > (Currently the virtual segment is 82% free.)
> >
> >
> >
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
Original Post:
This concerns IDS 11.70.TC3IE on Windows server 2008.
Each time the instance is started it reports that
"the total shared memory size for this server to 2097152 KB"
regardless of how many buffers, locks, etc are allocated.
So, I conclude that the message is hard-coded to write to the log always.
This is the output of onstat -g seg:
Segment Summary:
id key addr size ovhd class blkused blkfree
1382434817 52664801 c000000 708575232 4378720 R* 172986 6
1382434818 52664802 363c0000 512032768 3001384 V 22014 102994
Total: - - 1220608000 - - 195000 103000
1. Does this mean I can add buffers to use the rest of the 876544 KB allowed?
2. Should I reduce SHMVIRTSIZE to allow me to get more buffers?
(Currently the virtual segment is 82% free.)
Response:
Well, first looking for that message when where it's generated in source code
looks like it can come from a couple different spots...so if you could post
more of the MSGPATH file (several lines before and after that line) I could
pinpoint it further. But from some quick code inspection, it looks like since
you appear to actually be below the value it says is the limit, it could just
be reporting that message because you have SHMTOTAL set to 0 in your $ONCONFIG
file (well set to 0 or > 2Gb). So it might just be printing that message
because of what that parameter is set to and all it's doing after printing
that message out is resting SHMTOTQAL in the shared memory. So if that's it,
try setting SHMTOTAL to 2Gb to get rid of it, and regardless of doing that
since you aren't exceeding 2Gb's you should be able to increase your buffers
as long as you keep total shared memory to 2Gb or less. If that's not the
case, then you are possibly getting the error from sompplace else and if you
post the MSGPATH output I could possibly figure out what else it might mean.
Jacques Renaut
IBM Informix Advanced Support
APD Team
I changed shmtotal as you suggested.
16:34:06 Onconfig parameter SHMTOTAL modified from 0 to 2097152.
The license message went away the next time I started the IDS.
Thanks, Jacques.
-----Original Message-----
From: JACQUES RENAUT
Sent: Tuesday, October 09, 2012 3:58 PM
To: ids@iiug.org
Subject: Re: shared memory questions [28460]
Original Post:
This concerns IDS 11.70.TC3IE on Windows server 2008.
Each time the instance is started it reports that
"the total shared memory size for this server to 2097152 KB"
regardless of how many buffers, locks, etc are allocated.
So, I conclude that the message is hard-coded to write to the log always.
This is the output of onstat -g seg:
Segment Summary:
id key addr size ovhd class blkused blkfree
1382434817 52664801 c000000 708575232 4378720 R* 172986 6
1382434818 52664802 363c0000 512032768 3001384 V 22014 102994
Total: - - 1220608000 - - 195000 103000
1. Does this mean I can add buffers to use the rest of the 876544 KB
allowed?
2. Should I reduce SHMVIRTSIZE to allow me to get more buffers?
(Currently the virtual segment is 82% free.)
Response:
Well, first looking for that message when where it's generated in source
code
looks like it can come from a couple different spots...so if you could post
more of the MSGPATH file (several lines before and after that line) I could
pinpoint it further. But from some quick code inspection, it looks like
since
you appear to actually be below the value it says is the limit, it could
just
be reporting that message because you have SHMTOTAL set to 0 in your
$ONCONFIG
file (well set to 0 or > 2Gb). So it might just be printing that message
because of what that parameter is set to and all it's doing after printing
that message out is resting SHMTOTQAL in the shared memory. So if that's it,
try setting SHMTOTAL to 2Gb to get rid of it, and regardless of doing that
since you aren't exceeding 2Gb's you should be able to increase your buffers
as long as you keep total shared memory to 2Gb or less. If that's not the
case, then you are possibly getting the error from sompplace else and if you
post the MSGPATH output I could possibly figure out what else it might mean.
Jacques Renaut
IBM Informix Advanced Support
APD Team
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.
Buffers do not live in the virtual segments but in the resident segment
(the only exception is if you add a dbspace with a pagesize that does not
already have a buffer cache while the instance is online.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Tue, Oct 9, 2012 at 12:15 AM, Bill Hamilton <garage_dba@verizon.net>wrote:
> This concerns IDS 11.70.TC3IE on Windows server 2008.
> Each time the instance is started it reports that
> "the total shared memory size for this server to 2097152 KB"
> regardless of how many buffers, locks, etc are allocated.
> So, I conclude that the message is hard-coded to write to the log always.
> This is the output of onstat -g seg:
> Segment Summary:
> id key addr size ovhd class blkused blkfree
> 1382434817 52664801 c000000 708575232 4378720 R* 172986 6
> 1382434818 52664802 363c0000 512032768 3001384 V 22014 102994
> Total: - - 1220608000 - - 195000 103000
> 1. Does this mean I can add buffers to use the rest of the 876544 KB
> allowed?
> 2. Should I reduce SHMVIRTSIZE to allow me to get more buffers?
> (Currently the virtual segment is 82% free.)
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--e89a8f647ac90b1ab304cba93ac4
I understand that, Art, but if I am running a version of IDS with a 2gb
limit and I make the shmvirtsize too large, then I think I reduce the memory
left for the resident part(buffers,etc).
Is that right?
-----Original Message-----
From: Art Kagel
Sent: Tuesday, October 09, 2012 7:06 PM
To: ids@iiug.org
Subject: Re: shared memory questions [28463]
Buffers do not live in the virtual segments but in the resident segment
(the only exception is if you add a dbspace with a pagesize that does not
already have a buffer cache while the instance is online.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Tue, Oct 9, 2012 at 12:15 AM, Bill Hamilton
<garage_dba@verizon.net>wrote:
> This concerns IDS 11.70.TC3IE on Windows server 2008.
> Each time the instance is started it reports that
> "the total shared memory size for this server to 2097152 KB"
> regardless of how many buffers, locks, etc are allocated.
> So, I conclude that the message is hard-coded to write to the log always.
> This is the output of onstat -g seg:
> Segment Summary:
> id key addr size ovhd class blkused blkfree
> 1382434817 52664801 c000000 708575232 4378720 R* 172986 6
> 1382434818 52664802 363c0000 512032768 3001384 V 22014 102994
> Total: - - 1220608000 - - 195000 103000
> 1. Does this mean I can add buffers to use the rest of the 876544 KB
> allowed?
> 2. Should I reduce SHMVIRTSIZE to allow me to get more buffers?
> (Currently the virtual segment is 82% free.)
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--e89a8f647ac90b1ab304cba93ac4
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.
Ahh, indeed yes.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Tue, Oct 9, 2012 at 8:28 PM, Bill Hamilton <garage_dba@verizon.net>wrote:
> I understand that, Art, but if I am running a version of IDS with a 2gb
> limit and I make the shmvirtsize too large, then I think I reduce the
> memory
> left for the resident part(buffers,etc).
> Is that right?
>
> -----Original Message-----
> From: Art Kagel
> Sent: Tuesday, October 09, 2012 7:06 PM
> To: ids@iiug.org
> Subject: Re: shared memory questions [28463]
>
> Buffers do not live in the virtual segments but in the resident segment
> (the only exception is if you add a dbspace with a pagesize that does not
> already have a buffer cache while the instance is online.
>
> Art
>
> Art S. Kagel
> Advanced DataTools (www.advancedatatools.com)
> Blog: http://informix-myview.blogspot.com/
>
> Disclaimer: Please keep in mind that my own opinions are my own opinions
> and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
> other organization with which I am associated either explicitly,
> implicitly, or by inference. Neither do those opinions reflect those of
> other individuals affiliated with any entity with which I am affiliated nor
> those of the entities themselves.
>
> On Tue, Oct 9, 2012 at 12:15 AM, Bill Hamilton
> <garage_dba@verizon.net>wrote:
>
> > This concerns IDS 11.70.TC3IE on Windows server 2008.
> > Each time the instance is started it reports that
> > "the total shared memory size for this server to 2097152 KB"
> > regardless of how many buffers, locks, etc are allocated.
> > So, I conclude that the message is hard-coded to write to the log always.
> > This is the output of onstat -g seg:
> > Segment Summary:
> > id key addr size ovhd class blkused blkfree
> > 1382434817 52664801 c000000 708575232 4378720 R* 172986 6
> > 1382434818 52664802 363c0000 512032768 3001384 V 22014 102994
> > Total: - - 1220608000 - - 195000 103000
> > 1. Does this mean I can add buffers to use the rest of the 876544 KB
> > allowed?
> > 2. Should I reduce SHMVIRTSIZE to allow me to get more buffers?
> > (Currently the virtual segment is 82% free.)
> >
> >
> >
> >
>
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --e89a8f647ac90b1ab304cba93ac4
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--14dae9341165cb4af704cba996cc
Related threads
- Posting from the Informix-list
- Migrating from IDS 9.40.UC6 to 11.50.UC3
- Ip for a network session
- questions onstat -g