IDS 12.10 on HP-UX- DS Total Memory
On startup of IDS 12.10 (HP-UX Itanium, in an HP Integrity VM) the user saw "Warning: Parameter's user-configured value was adjusted (DS_TOTAL_MEMORY)" and asked how to tune memory. Replies explained DS_TOTAL_MEMORY must not exceed SHMVIRTSIZE minus 10 MB (check actual value with onstat -g mgm) and that the engine may round it; no universal "best practice" settings exist since tuning depends on workload. Art Kagel also flagged SHMBASE, pointed to the machine notes ($INFORMIXDIR/release), where 0x0L is correct for HP-UX/Itanium. Martin Fuerderer added that no special ONCONFIG settings are needed for VMs, but avoid processor affinity and over-committed memory. No explicit confirmation that the warning was cleared.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Hi,
When we start Informix, we get this message,
$oninit
Warning: Parameter's user-configured value was adjusted. (DS_TOTAL_MEMORY)
Need your opinion/advice for this, We need to adjust our memory parameter?
Any explanation about this? Any document we can refer for this as reference to
us to get better performance?
Thank You
You are probably setting this value too high in the ONCONFIG. Do you have
it set within 10 MB of SHMVIRTSIZE?
From the manual: Set the DS_TOTAL_MEMORY configuration parameter to any
value not greater than the quantity (SHMVIRTSIZE - 10 megabytes).
...or perhaps the engine is changing it dynamically to align with the
default page size.
Are there any other messages in the log, indicating what it was changed to,
or why it was changed?
You can check the current value with onstat -g mgm. How does
DS_TOTAL_MEMORY shown there compare to the value in your onconfig?
Mike
-----Original Message-----
From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of MOHD
FADZIL JUSOH
Sent: Thursday, July 21, 2016 9:02 AM
To: ids@iiug.org
Subject: IDS 12.10 on HP-UX- DS Total Memory [37463]
Hi,
When we start Informix, we get this message,
$oninit
Warning: Parameter's user-configured value was adjusted. (DS_TOTAL_MEMORY)
Need your opinion/advice for this, We need to adjust our memory parameter?
Any explanation about this? Any document we can refer for this as reference
to us to get better performance?
Thank You
****************************************************************************
***
Forum Note: Use "Reply" to post a response in the discussion forum.
What was the adjustment?
Art
Art S. Kagel, President and Principal Consultant
ASK Database Management
www.askdbmgt.com
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on the IIUG, nor any other organization with which I am
associated either explicitly, implicitly, or by inference. Neither do
those opinions reflect those of other individuals affiliated with any
entity with which I am affiliated nor those of the entities themselves.
On Thu, Jul 21, 2016 at 11:01 AM, MOHD FADZIL JUSOH <fadzil@isianpadu.com>
wrote:
> Hi,
>
> When we start Informix, we get this message,
>
> $oninit
> Warning: Parameter's user-configured value was adjusted. (DS_TOTAL_MEMORY)
>
> Need your opinion/advice for this, We need to adjust our memory parameter?
> Any explanation about this? Any document we can refer for this as
> reference to
> us to get better performance?
>
> Thank You
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--001a1135b1941fe67905382961bd
Hi,
Here our current memory configuration config for IDS 11.10
SHMVIRTSIZE 3000000 # initial virtual shared memory segment size
SHMADD 1800000 # Size of new shared memory segments (Kbytes)
EXTSHMADD 8192 # Size of new extension shared memory segments (Kbytes)
SHMTOTAL 0 # Total shared memory (Kbytes). 0=>unlimited
When we migration into IDS 12.10, I increase this parameter as below:
RESIDENT 2
SHMBASE 0
SHMVIRTSIZE 12000000 #32656
SHMADD 1800000 # 8192
EXTSHMADD 1000000 #8192
SHMTOTAL 0
SHMVIRT_ALLOCSEG 0,3
SHMNOACCESS
We still do some application testing right now, What Best for i need to set,
follow best practices from IBM to get best performance for our Database?
Our server information as below:
# machinfo
CPU info:
Intel(R) Itanium(R) Processor 9560 (2.53 GHz, 32 MB)
1 core, 1 logical processor per socket
6.38 GT/s QPI, CPU version D0
Active processor count:
8 sockets
8 cores
Memory: 45050 MB (43.99 GB)
Firmware info:
Firmware revision: 06.30.05.00
FP SWA driver revision: 1.18
IPMI is supported on this system.
BMC firmware revision: 6.1e
Platform info:
Model: "ia64 hp server Integrity Virtual Machine"
Machine ID number: a0c44804-b363-11e5-bd0a-d0bf9c400100
Machine serial number: VM01601001
Thank You
Unfortunately there are not best practices for tuning an Informix instance
since all workloads are different. Tuning can only be done after observing
actual production workloads. There are ways you can capture your production
workloads on the older system and test them on the new platform before
moving it into production and tune the engine that way.
That said, I see one of the settings you display that appears wrong to me.
I know of no platform that has a recommended setting for SHMBASE set to
zero. Look at the release notes on your machine for the recommended setting
for your platform. These files are under $INFORMIXDIR/release.
Art
Art S. Kagel, President and Principal Consultant
ASK Database Management
www.askdbmgt.com
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on the IIUG, nor any other organization with which I am
associated either explicitly, implicitly, or by inference. Neither do
those opinions reflect those of other individuals affiliated with any
entity with which I am affiliated nor those of the entities themselves.
On Thu, Jul 21, 2016 at 10:01 PM, MOHD FADZIL JUSOH <fadzil@isianpadu.com>
wrote:
> Hi,
>
> Here our current memory configuration config for IDS 11.10
>
> SHMVIRTSIZE 3000000 # initial virtual shared memory segment size
> SHMADD 1800000 # Size of new shared memory segments (Kbytes)
> EXTSHMADD 8192 # Size of new extension shared memory segments (Kbytes)
> SHMTOTAL 0 # Total shared memory (Kbytes). 0=>unlimited>
> When we migration into IDS 12.10, I increase this parameter as below:
>
> RESIDENT 2
> SHMBASE 0
> SHMVIRTSIZE 12000000 #32656
> SHMADD 1800000 # 8192
> EXTSHMADD 1000000 #8192
> SHMTOTAL 0
> SHMVIRT_ALLOCSEG 0,3
> SHMNOACCESS>
> We still do some application testing right now, What Best for i need to
> set,
> follow best practices from IBM to get best performance for our Database?
>
> Our server information as below:
>
> # machinfo
> CPU info:
>
> Intel(R) Itanium(R) Processor 9560 (2.53 GHz, 32 MB)
>
> 1 core, 1 logical processor per socket
>
> 6.38 GT/s QPI, CPU version D0
>
> Active processor count:
>
> 8 sockets
>
> 8 cores
>
> Memory: 45050 MB (43.99 GB)
>
> Firmware info:
>
> Firmware revision: 06.30.05.00
>
> FP SWA driver revision: 1.18
>
> IPMI is supported on this system.
>
> BMC firmware revision: 6.1e
>
> Platform info:
>
> Model: "ia64 hp server Integrity Virtual Machine"
>
> Machine ID number: a0c44804-b363-11e5-bd0a-d0bf9c400100
>
> Machine serial number: VM01601001
>
> Thank You
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--001a11443c58009c1705382ff222
Hi, Value for SHMBASE based on machine noted, I just need follow this value right? #SHMBASE 0x0L Our new enviroment IDS 12.10 will run on Virtual Machine. Any different configration we need to tune on onconfig parameter for virtual machine? Thank You
There are no special server configurations needed for virtual environment. Configuration of the VM environment itself is, however, important for performance. Sadly, I'm not an expert in HP's VM environment configuration. So can't help more. Art Art S. Kagel, President and Principal Consultant ASK Database Management www.askdbmgt.com Blog: http://informix-myview.blogspot.com/ Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on the IIUG, nor any other organization with which I am associated either explicitly, implicitly, or by inference. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves. On Thu, Jul 21, 2016 at 10:20 PM, MOHD FADZIL JUSOH <fadzil@isianpadu.com> wrote: > Hi, > > Value for SHMBASE based on machine noted, I just need follow this value > right? > > #SHMBASE 0x0L > > Our new enviroment IDS 12.10 will run on Virtual Machine. Any different > configration we need to tune on onconfig parameter for virtual machine? > > Thank You > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --001a1135b1943abefd053831ab77
Hi,
right, for HP-UX on Itanium the "Machine Specific Notes" (aka "Machine=20
Notes")
tell that the Informix configuration parameter SHMBASE should be set to=20
0x0L .
Whether the Informix server is running in a virtual machine or on 'bare=20
metal' does
not matter - the setting of SHMBASE depends on the operating system that=20
is used.
[ What it specifies is the location where the shared memory that=20
Informix allocates
gets mapped to within the memory address space of the "oninit"=20
processes.
Occupants of this address space are the text and data segments=20
(basically where
the binary code of the executable gets loaded), the stack, the heap,=20
shared libraries,
etc. ... and shared memory segments. Where these things are located=20
(i.e. mapped
to) and in which direction they can grow when needed, depends on the=20
operating
system.
For the shared memory segments of the Informix server, the aim is to=20
have them as
contiguous as possible. I.e. even when several segments get allocated=20
over time, their
use can be more efficient when they are adjacent in the memory space=20
rather then
dispersed (which results in more fragmentation of the memory space).
With a value of 0x0L on HP-UX, I think the OS is intelligent enough to =
figure out the best
place by itself. (I'm quite sure that SHM segments of Informix do not=20
really start at address
0x0 ... one could check by looking at something equivalent to=20
/proc/<pid>/maps .) ]
For the Informix server there are no specific parameters for running in a=20
virtual machine
environment - as already mentioned by Art Kagel, et al. After all, this=20
would be against
the basic idea of a virtual machine, which is that an application like=20
Informix does not need
to know about the fact that it is running in a virtual machine.
However ... there are some things to know:
- a virtual machine may pretend that there is more memory than physically=20
exists. The
virtual machine manager most probably will use a technique like=20
swapping, paging, etc.
to cover any bottlenecks. If this happens, it will most probably be=20
noticed as a (grave)
peformance problem for the Informix server.
- a virtual machine manager may distribute the existing CPU resources=20
among several virtual
machines ... on a time slice basis or similar. In such a case, it=20
probably does not make much
sense to configure the Informix server with processor affinity ... as=20
the virtual machine
manager may switch the CPUs given to the virtual machine - without even=20
letting the OS in the
virtual machine know about this.
The best case for Informix server in a virtual machine is when hardware=20
rescources, especially
CPUs and memory, are directly and exclusively dedicated to the virtual=20
machine. This is the only
way to get somewhat predictable performance results in a virtual machine=20
environment.
Everything else leaves you always with a big "it depends" ... no matter=20
what the people in
charge of the virtual machine manager might tell you. :-)
Regards, Martin
--
Martin Fuerderer
IBM Informix Development Munich, Germany
Information Management
Read about the Informix Warehouse Accelerator:
http://tinyurl.com/the-iwa-blog
IBM Deutschland Research & Development GmbH
Chairman of the Supervisory Board: Martina Koederitz
Board of Management: Dirk Wittkopp
Corporate Seat: Boeblingen, Germany
Reg.-Gericht: Amtsgericht Stuttgart, HRB 243294
From: "MOHD FADZIL JUSOH" <fadzil@isianpadu.com>
To: ids@iiug.org
Date: 07/22/2016 04:21
Subject: Re: IDS 12.10 on HP-UX- DS Total Memory [37470]
Sent by: ids-bounces@iiug.org
Hi,=20
Value for SHMBASE based on machine noted, I just need follow this value=20
right?=20
#SHMBASE 0x0L=20
Our new enviroment IDS 12.10 will run on Virtual Machine. Any different=20
configration we need to tune on onconfig parameter for virtual machine?=20
Thank You=20
***************************************************************************=
****=20
Forum Note: Use "Reply" to post a response in the discussion forum.=20