IDS Memory leak with tcp connections under high lo
Posted in 2007
Hello,
does anybody know about a memory leak in the shared memory of IDS10
(FC6, FC7) on HPUX 11.31
whith many network connections (and high load)?
We have a SAP system with IDS10FC7 with about 1400 concurrent sessions
running on HP Superdome HPUX 11.31.
Since the switch to the new Superdome with HPUX 11.31 (faster OS network
stack!? faster hardware) we see an
steady increase (up to a few GB per hour) of global shared memory pool
onstat -g mem|grep global
And
onstat -g afr global shows more and more entries with 'net' (afew hundreds more every second).
onstat -g ntu shows a similar increase in the alloc/maxcounters in the header/summary line.
Anyone seen something like this?
It seems as if the problem is reproducable with simple queries against a
sysmaster tables an a small server - although
in this case the increase of the counters or shared memory is minimal
and would not look very suspectible.
Should the net configuration (NETVPs etc.) be changed?
onconfig follows - yes, it's a really big machine:
ROOTNAME rootdbs # Root dbspace name
ROOTPATH /informix/P91/sapdata/physdev1/data1
# Path for device containing root
dbspace
ROOTOFFSET 16 # Offset of root dbspace into device
(Kbytes)
ROOTSIZE 170000 # Size of root dbspace (Kbytes)
MIRROR 1 # Mirroring flag (Yes = 1, No = 0)
MIRRORPATH /informix/P91/sapdata/physdev2/data3
# Path for device containing mirrored
root
MIRROROFFSET 16 # Offset into mirrored device (Kbytes)
PHYSDBS physdbs # Location (dbspace) of physical log
PHYSFILE 2000000 # Physical log file size (Kbytes)
LOGFILES 2125 # Number of logical log files
LOGSIZE 5000 # initial (!) Logical log size (Kbytes)
MSGPATH /informix/P91/online.x9168.p91.log
# System message log file path
CONSOLE /informix/P91/console.x9168.p91.log
# System console message path
ALARMPROGRAM /home/informix/bin/alarm_event.p91 # Alarm program path
TAPEDEV /dev/null # Tape device path
TAPEBLK 256 # Tape block size (Kbytes)
TAPESIZE 19500000 # Maximum amount of data to put on tape
(Kbytes)
LTAPEDEV /archiv/p91logs/llogs.p91 # Log tape device path
LTAPEBLK 256 # Log tape block size (Kbytes)
LTAPESIZE 19500000 # Max amount of data to put on log tape
(Kbytes)
STAGEBLOB # INFORMIX-OnLine/Optical staging area
SERVERNUM 0 # Unique id corresponding to a OnLineinstance
DBSERVERNAME asapp91p91shm # default database server
DBSERVERALIASES asapp91p91tcp,x9168p91tc1,x9168p91tc2 #
NETTYPE ipcshm,1,60,
NETTYPE soctcp,15,120,NET
DEADLOCK_TIMEOUT 60 # Max time to wait of lock indistributed env.
RESIDENT -1 # Forced residency flag (Yes = 1, No =
0)
MULTIPROCESSOR 1 # 0 for single-processor, 1 formulti-processor
NUMCPUVPS 62 # Number of user (cpu) vps
SINGLE_CPU_VP 0 # If non-zero, limit number of cpu vpsto one
MUTEX_WAIT_LISTS 0 # If non-zero, force use of mutex wait
lists
NOAGE 1 # Process aging
AFF_SPROC 0 # Affinity start processor
AFF_NPROCS 0 # Affinity number of processors
BUFFERPOOL
default,buffers=1000000,lrus=32,lru_min_dirty=1.000000,lru_max_dirty=2.000000
BUFFERPOOL
size=2K,buffers=50000000,lrus=60,lru_min_dirty=0.020000,lru_max_dirty=0.040000
BUFFERPOOL
size=8K,buffers=24000000,lrus=60,lru_min_dirty=0.030000,lru_max_dirty=0.070000
NUMAIOVPS 2 # Number of IO vps
PHYSBUFF 1024 # Physical log buffer size (Kbytes)
LOGBUFF 64 # Logical log buffer size (Kbytes)
CLEANERS 128 # Number of buffer cleaner processes
SHMBASE 0x0 # Shared memory base address
SHMVIRTSIZE 32000000 # initial virtual shared mem segmentsize
SHMADD 4000000 # Size of new shared memory segments
(Kbytes)
SHMTOTAL 0 # Total shared memory (Kbytes).
0=>unlimited
CKPTINTVL 3600 # Check point interval (in sec) <<<EURO
LTXHWM 18 # Long transaction high water markpercentage
LTXEHWM 85 # Long transaction high water mark
(exclusive)
TXTIMEOUT 0x12c # Transaction timeout (in sec)
STACKSIZE 256 # Stack size (Kbytes)
OFF_RECVRY_THREADS 30 # Default number of offline workerthreads
ON_RECVRY_THREADS 4 # Default number of online workerthreads
DRINTERVAL 30 # DR max time between DR buffer flushes
(in sec)
DRTIMEOUT 30 # DR network timeout (in sec)
DRLOSTFOUND /informix/P91/etc/dr.lostfound # DR lost+found file path
BAR_ACT_LOG /home/informix/logs/bar_act.log
BAR_DEBUG_LOG /home/informix/tmp/bar_dbug.log
BAR_MAX_BACKUP 2
BAR_RETRY 1
BAR_DEBUG 0
BAR_PROGRESS_FREQ 0
BAR_NB_XPORT_COUNT 10
BAR_XFER_BUF_SIZE 31
BAR_BSALIB_PATH /informix/P91/lib/libbsa.so
RA_PAGES 32 # Number of pages to attempt to readahead
RA_THRESHOLD 24 # Number of pages left before next group
DBSPACETEMP tmpdbs1,tmpdbs2,tmpdbs3,tmpdbs4,tmpdbs5,tmpdbs6
# Default temp dbspaces
DUMPDIR /home/informix/dumps # Preserve diagnostics in this
directory
DUMPSHMEM 0 # Dump a copy of shared memory
DUMPGCORE 0 # Dump a core image using 'gcore'
DUMPCORE 0 # Dump a core image (Warning:this aborts
OnLine)
DUMPCNT 1 # Number of shared memory or gcore dumpsfor
# a single user's session
FILLFACTOR 90 # Fill factor for building indexes
USEOSTIME 0 # 0: use internal time(fast), 1: get
time from OS(slow)
MAX_PDQPRIORITY 10 # Maximum allowed pdqpriority
DS_MAX_QUERIES 20 # Maximum number of decision supportqueries
DS_TOTAL_MEMORY 24000000 # Decision support memory (Kbytes)after crash
DS_MAX_SCANS 1024 # Maximum number of decision supportscans
DATASKIP off
ONDBSPACEDOWN 1 # Dbspace down option: 0 = CONTINUE, 1 =
ABORT, 2 = WAIT
OPCACHEMAX 128 # Maximum optical cache size (Kbytes)
HETERO_COMMIT 0
DD_HASHSIZE 613 # Length of DD Hash; 03-Nov-94
DD_HASHMAX 30 # Width of DD Hash; 03-Nov-94
LOCKS 8000000 # Maximum number of lock
WSTATS 1
TBLSPACE_STATS 1
CDR_EVALTHREADS 1,1 # evaluator threads
(per-cpu-vp,additional)
CDR_DSLOCKWAIT 5 # DS lockwait timeout (seconds)
CDR_QUEUEMEM 4096 # Maximum amount of memory for any CDR
queue (Kbytes)
OPTCOMPIND 0
SYSALARMPROGRAM /informix/P91/etc/evidence.sh # System Alarm program
path
ISM_DATA_POOL ISMDiskData # If the data pool name is changed, be
sure to
ISM_LOG_POOL ISMDiskLogs
OPT_GOAL -1
DIRECTIVES 1
RESTARTABLE_RESTORE off
CDR_NIFCOMPRESS 0 # Link level compression (-1 never, 0
none, 9 max)
NOFUZZYCKPT 1
DYNAMIC_LOGS 2
CDR_SERIAL 0,0 # Serial Column Sequence
CDR_DBSPACE # dbspace for syscdr database
CDR_QHDR_DBSPACE # CDR queue dbspace (default same as
catalog)
CDR_QDATA_SBSPACE # List of CDR queue smart blob spaces
CDR_MAX_DYNAMIC_LOGS 0 # Dynamic l