CPU workload

Hi, I have two instances of Informix 9.4FC9 running on Solaris 5.4 with 16 cpu and 40 GB of memory, the databases are big they share a SAN with 5 terabytes. I have a lot of cpu usage sometimes 90% could somebody give me some tips to improve cpu usage? Thanks.

Post your ONCONFIG files, and the following onstat output from both servers (suitably isolated to avoid confusion) and someone may spot something: onstat -p onstat -g glo onstat -g iov onstat -d onstat -D onstat -g iof onstat -u onstat -g ses onstat -g rea onstat -g wai You are aware that your Solaris version is very old and that your IDS release is now out of support? Art S. Kagel Oninit (www.oninit.com) IIUG Board of Directors (art@iiug.org) Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on my employer, Oninit, the IIUG, nor any other organization with which I am associated either explicitly or implicitly. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves. On Tue, Jun 23, 2009 at 8:20 PM, PEDRO PEREZ <pedro2263@gmail.com> wrote: > Hi, > > I have two instances of Informix 9.4FC9 running on Solaris 5.4 with 16 cpu > and > 40 GB of memory, the databases are big they share a SAN with 5 terabytes. > > I have a lot of cpu usage sometimes 90% could somebody give me some tips to > improve cpu usage? > > Thanks. > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --001636c594e5db1265046d0d5a76

I will have to write many messages for the number of lines allowed. First Instance onconfig file: IBM Informix Dynamic Server Version 9.40.FC9 -- On-Line -- Up 13:55:14 --11752448 Kbytes # Root Dbspace Configuration ROOTNAME rootdbs # Root dbspace nameROOTPATH /dev/vx/rdsk/dbdg/raw512m_02 # Path for device containing root dbspace ROOTOFFSET 0 # Offset of root dbspace into device (Kbytes) ROOTSIZE 524000 # Size of root dbspace (Kbytes)# Disk Mirroring Configuration Parameters MIRROR 0 # Mirroring flag (Yes = 1, No = 0) MIRRORPATH # Path for device containing mirrored root MIRROROFFSET 0 # Offset into mirrored device (Kbytes)# Physical Log Configuration PHYSDBS physdbs # Location (dbspace) of physical log PHYSFILE 99000 # Physical log file size (Kbytes)# Logical Log Configuration LOGFILES 12 # Number of logical log files LOGSIZE 50000 # Logical log size (Kbytes)# Diagnostics MSGPATH /dump_ifx/online.spsm.log # System message log file path CONSOLE /dev/null # System console message path# To automatically backup logical logs, edit alarmprogram.sh and set # BACKUPLOGS=Y ALARMPROGRAM /informix/etc/alarmprogram.sh # Alarm program path TBLSPACE_STATS 1 # Maintain tblspace statistics# System Archive Tape Device TAPEDEV /dev/null # Tape device path TAPEBLK 16 # Tape block size (Kbytes) TAPESIZE 10240 # Maximum amount of data to put on tape (Kbytes)# Log Archive Tape Device LTAPEDEV /dev/null # Log tape device path LTAPEBLK 32 # Log tape block size (Kbytes) LTAPESIZE 10240 # Max amount of data to put on log tape (Kbytes) # OpticalSTAGEBLOB # Informix Dynamic Server staging area # System Configuration SERVERNUM 10 # Unique id corresponding to a OnLine instance DBSERVERNAME online_spsm # Name of default database server DBSERVERALIASES ontcp_spsm,ontcp_spsm1,ontcp_spsm11,ontcp_spsm3,ontcp_spsm4,ontcp_spsm5,ontcp_sp sm6,ontcp_spsm7,ontcp_spsm8,ontcp_spsm9,ontcp_spsm10 NETTYPE ipcshm,5,100,CPU NETTYPE tlitcp,5,100,NET DEADLOCK_TIMEOUT 60 # Max time to wait of lock in distributed env. RESIDENT 0 # Forced residency flag (Yes = 1, No = 0) MULTIPROCESSOR 1 # 0 for single-processor, 1 for multi-processor NUMCPUVPS 9 # Number of user (cpu) vps JMH 13-Jul-05 SINGLE_CPU_VP 0 # If non-zero, limit number of cpu vps to one NOAGE 1 # Process aging Marzo 12, 2004 HPCG# Shared Memory Parameters LOCKS 50000 # Maximum number of locks BUFFERS 5040000 # Maximum number of shared buffers#BUFFERS 1180000 # Maximum number of shared buffers NUMAIOVPS 8 # Number of IO vps #####HPCG Marzo 8, 2004 PHYSBUFF 32 # Physical log buffer size (Kbytes) LOGBUFF 32 # Logical log buffer size (Kbytes) CLEANERS 32 # Number of buffer cleaner processes SHMBASE 0x10a000000 # Shared memory base address SHMVIRTSIZE 720000 # initial virtual shared memory segment size SHMADD 280000 # Size of new shared memory segments (Kbytes) AAJ 774 SHMTOTAL 0 # Total shared memory (Kbytes). 0=>unlimited CKPTINTVL 300 # Check point interval (in sec) LRUS 32 # Number of LRU queues LRU_MAX_DIRTY 3 # LRU percent dirty begin cleaning limit LRU_MIN_DIRTY 2 # LRU percent dirty end cleaning limit TXTIMEOUT 0x12c # Transaction timeout (in sec) STACKSIZE 128 # Stack size (Kbytes) DYNAMIC_LOGS 2 LTXHWM 70 LTXEHWM 80 OFF_RECVRY_THREADS 10 # Default number of offline worker threads ON_RECVRY_THREADS 1 # Default number of online worker threads# Data Replication Variables DRINTERVAL 30 # DR max time between DR buffer flushes (in sec) DRTIMEOUT 30 # DR network timeout (in sec)DRLOSTFOUND /informix/etc/dr.lostfound # DR lost+found file path # CDR Variables CDR_EVALTHREADS 1,2 # evaluator threads (per-cpu-vp,additional) CDR_DSLOCKWAIT 5 # DS lockwait timeout (seconds) CDR_QUEUEMEM 4096 # Maximum amount of memory for any CDR queue (Kbytes) CDR_NIFCOMPRESS 0 # Link level compression (-1 never, 0 none, 9 max) CDR_SERIAL 0,0 # Serial Column Sequence CDR_DBSPACE # dbspace for syscdr database CDR_QHDR_DBSPACE # CDR queue dbspace (default same as catalog) CDR_QDATA_SBSPACE # List of CDR queue smart blob spaces CDR_MAX_DYNAMIC_LOGS 0 # Dynamic log addition disabled by default# Backup/Restore variables BAR_ACT_LOG /informix/bar_act.log # ON-Bar Log file - not in /tmp please BAR_DEBUG_LOG /informix/bar_dbug.log # ON-Bar Debug Log - not in /tmp please BAR_MAX_BACKUP 0 BAR_RETRY 1 BAR_NB_XPORT_COUNT 10 BAR_XFER_BUF_SIZE 31 RESTARTABLE_RESTORE on BAR_PROGRESS_FREQ 0# Informix Storage Manager variables ISM_DATA_POOL ISMData ISM_LOG_POOL ISMLogs # Read Ahead Variables RA_PAGES # Number of pages to attempt to read ahead RA_THRESHOLD # Number of pages left before next groupDBSPACETEMP temporary1,temporary2,temporary3 # Default temp dbspaces HPCG 24-Mar-2004 DUMPDIR /dump_ifx/AF # Preserve diagnostics in this directory DUMPSHMEM 1 # Dump a copy of shared memory DUMPGCORE 0 # Dump a core image using 'gcore' DUMPCORE 0 # Dump a core image (Warning:this aborts OnLine) DUMPCNT 1 # Number of shared memory or gcore dumps for FILLFACTOR 90 # Fill factor for building indexes# method for OnLine to use when determining current time USEOSTIME 0 # 0: use internal time(fast), 1: get time from OS(slow)# Parallel Database Queries (pdq) MAX_PDQPRIORITY 0 # Maximum allowed pdqpriority HPCG 5-MAR-04 DS_TOTAL_MEMORY 800000 # Decision support memory (Kbytes) DS_MAX_SCANS 1048576 # Maximum number of decision support scans DATASKIP off OPTCOMPIND 2 # To hint the optimizer DIRECTIVES 1 # Optimizer DIRECTIVES ON (1/Default) or OFF (0) ONDBSPACEDOWN 2 # Dbspace down option: 0 = CONTINUE, 1 = ABORT, 2 = WAITOPCACHEMAX 0 # Maximum optical cache size (Kbytes) HETERO_COMMIT 0 SBSPACENAME # Default smartblob space name - this is where blobs # go if no sbspace is specified when the smartblob is # created. It is also used by some datablades as # the location to put their smartblobs. SYSSBSPACENAME # Default smartblob space for use by the Informix # Server. This is used primarily for Informix Server # system statistics collection. BLOCKTIMEOUT 3600 # Default timeout for system blockSYSALARMPROGRAM /informix/etc/evidence.sh # System Alarm program path # Optimization goal: -1 = ALL_ROWS(Default), 0 = FIRST_ROWS OPT_GOAL -1 ALLOW_NEWLINE 0 # embedded newlines(Yes = 1, No = 0 or anything but 1) DS_MAX_QUERIES # Maximum number of decision support queriesDBCREATE_PERMISSION informix ******************************************************************************** ************************************** onstat -p IBM Informix Dynamic Server Version 9.40.FC9 -- On-Line -- Up 13:32:37 --11752448 Kbytes Profile dskreads pagreads bufreads %cached dskwrits pagwrits bufwrits %cached 74848521 79307924 14996133175 99.50 13926109 20756246 347897260 96.01 isamtot open start read write rewrite delete commit rollbk 12758109443 50854647 537289675 10094962453 149170614 16953333 19504296 7219 0 gp_read gp_write gp_rewrt gp_del gp_alloc gp_free gp_curs 0 0 0 0 0 0 0 ovlock ovuserthread ovbuff usercpu syscpu numckpts flushes 0 0 0 188803.42 11293.89 221 442 bufwaits lokwaits lockreqs deadlks dltouts ckpwaits compress seqscans 15792899 2 499577286 0 0 2293 3765555 103

Continue informaton of the first instance: ******************************************************************************** ************************************* onstat -D IBM Informix Dynamic Server Version 9.40.FC9 -- On-Line -- Up 13:35:58 --11752448 Kbytes Dbspaces address number flags fchunk nchunks flags owner name 3aab46490 1 0x20001 1 1 N informix rootdbs 3acf02358 2 0x60001 2 4 N B informix nokiadbs 3acf027c0 3 0x60001 55 1 N B informix simacdbs8 3acf05028 4 0x60001 98 1 N B informix simacdbs9 3acf05490 5 0x60001 5 2 N B informix grupomed1 3acf058f8 6 0x60001 6 2 N B informix grupomed2 3acf0a028 7 0x60001 7 5 N B informix sicri_ncel 3acf0a490 8 0x2001 11 4 N T informix temporary 3acf0a8f8 9 0x42001 15 4 N TB informix temporary1 3acf0f028 10 0x60001 19 7 N B informix ndato_dia 3acf0f490 11 0x60001 25 3 N B informix ngrupomed1 3acf0f8f8 12 0x60001 28 3 N B informix ngrupomed2 3acf13028 13 0x60001 31 10 N B informix dbsindex 3acf13490 14 0x60001 41 7 N B informix dbsindex2 3acf138f8 15 0x60001 46 4 N B informix otrsdbs1 3acf18028 16 0x60001 49 4 N B informix otrsdbs2 3acf18490 17 0x60001 93 2 N B informix logsdbs 3acf188f8 18 0x60001 120 1 N B informix simacdbs10 3acf1c028 19 0x60001 56 7 N B informix simacdbs1 3acf1c490 20 0x60001 62 12 N B informix simacdbs2 3acf1c8f8 21 0x60001 68 7 N B informix simacdbs3 3acf21028 22 0x60001 74 7 N B informix simacdbs4 3acf21490 23 0x42001 80 2 N TB informix ntemporary 3acf218f8 24 0x42001 82 2 N TB informix ntemporary1 3acf25028 25 0x60001 84 1 N B informix nsimacdbs 3acf25490 26 0x60001 85 3 N B informix nsicri_ncel 3acf258f8 27 0x60001 88 4 N B informix simacdbs5 3acf2a028 28 0x60001 89 3 N B informix simacdbs6 3acf2a490 29 0x20001 94 1 N informix physdbs 3acf2a8f8 30 0x42001 95 1 N TB informix temporary2 3acf2e028 31 0x42001 96 1 N TB informix temporary3 3acf2e490 32 0x60001 114 3 N B informix nokiadbs2 3acf2e8f8 33 0x60001 121 1 N B informix nokiadbs3 3acf33028 34 0x60001 116 1 N B informix wcellsdbs 3acf33490 35 0x60001 117 1 N B informix simacdbs7 3acf338f8 36 0x60001 122 1 N B informix simacdbs11 3acf37028 37 0x60001 123 1 N B informix simacdbs12 3acf37490 38 0x60001 124 1 N B informix wcellsdbs3 3acf378f8 39 0x60001 125 1 N B informix simacdbs13 3acf3c028 40 0x60001 126 1 N B informix simacdbs14 3acf3c490 41 0x60001 127 1 N B informix simacdbs15 41 active, 2047 maximum Chunks address chunk/dbs offset page Rd page Wr pathname 3aab468f8 1 1 0 2676 5129 /dev/vx/rdsk/dbdg/raw512m_02 3acdb3778 2 2 0 5016332 59542 /dev/vx/rdsk/dbdg/raw10g_02 3acdb3910 3 27 0 55873 0 /dev/vx/rdsk/dbdg/raw4g_65 3acdb3aa8 4 10 0 510 0 /dev/vx/rdsk/dbdg/raw4g_66 3acdb3c40 5 5 0 64183 62278 /dev/vx/rdsk/dbdg/raw6g_01 3acdb3dd8 6 6 0 463989 751345 /dev/vx/rdsk/dbdg/raw10g_01 3ac8b4028 7 7 0 4431 2686 /dev/vx/rdsk/dbdg/raw512m_03 3ac8b41c0 8 7 0 3919 1009 /dev/vx/rdsk/dbdg/raw512m_04 3ac8b4358 9 7 0 84013 55 /dev/vx/rdsk/dbdg/raw512m_05 3ac8b44f0 10 7 0 176764 583 /dev/vx/rdsk/dbdg/raw512m_11 3ac8b4688 11 8 8 75 28018 /dev/vx/rdsk/dbdg/raw2g_01 3ac8b4820 12 8 8 1 2 /dev/vx/rdsk/dbdg/raw2g_02 3ac8b49b8 13 8 8 1 2 /dev/vx/rdsk/dbdg/raw2g_03 3ac8b4b50 14 8 8 1 2 /dev/vx/rdsk/dbdg/raw512m_12 3ac8b4ce8 15 9 8 943002 667195 /dev/vx/rdsk/dbdg/raw2g_04 3ac8b4e80 16 9 8 1 2 /dev/vx/rdsk/dbdg/raw2g_05 3ac995028 17 9 8 1 2 /dev/vx/rdsk/dbdg/raw2g_06 3ac9951c0 18 2 0 858674 0 /dev/vx/rdsk/dbdg/raw2g_19 3ac995358 19 10 0 213576 4261 /dev/vx/rdsk/dbdg/Ndato_dia_01 3ac9954f0 20 10 0 198421 65685 /dev/vx/rdsk/dbdg/Ndato_dia_02 3ac995688 21 10 0 92547 63709 /dev/vx/rdsk/dbdg/Ndato_dia_03 3ac995820 22 10 0 15178 7303 /dev/vx/rdsk/dbdg/Ndato_dia_04 3ac9959b8 23 10 0 642 0 /dev/vx/rdsk/dbdg/Ndato_dia_05 3ac995b50 24 10 0 16373 9842 /dev/vx/rdsk/dbdg/Ndato_dia_06 3ac995ce8 25 11 0 32084 33406 /dev/vx/rdsk/dbdg/Ngrupomed1_01 3ac995e80 26 11 0 10868 854 /dev/vx/rdsk/dbdg/Ngrupomed1_02 3acebd028 27 11 0 1209 0 /dev/vx/rdsk/dbdg/Ngrupomed1_03 3acebd1c0 28 12 0 623664 856353 /dev/vx/rdsk/dbdg/Ngrupomed2_01 3acebd358 29 12 0 2934 10 /dev/vx/rdsk/dbdg/Ngrupomed2_02 3acebd4f0 30 12 0 1 0 /dev/vx/rdsk/dbdg/Ngrupomed2_03 3acebd688 31 13 0 289871 29987 /dev/vx/rdsk/dbdg/dbsindex_01 3acebd820 32 13 0 450828 2089 /dev/vx/rdsk/dbdg/dbsindex_02 3acebd9b8 33 13 0 667600 8695 /dev/vx/rdsk/dbdg/dbsindex_03 3acebdb50 34 13 0 1338208 18871 /dev/vx/rdsk/dbdg/dbsindex_04 3acebdce8 35 13 0 1792759 11999 /dev/vx/rdsk/dbdg/dbsindex_05 3acebde80 36 13 0 1631603 18993 /dev/vx/rdsk/dbdg/dbsindex_06 3acebe028 37 13 0 1350638 3650 /dev/vx/rdsk/dbdg/dbsindex_07 3acebe1c0 38 13 0 1941239 12275 /dev/vx/rdsk/dbdg/dbsindex_08 3acebe358 39 13 0 1149676 7714 /dev/vx/rdsk/dbdg/dbsindex_09 3acebe4f0 40 13 0 855619 41819 /dev/vx/rdsk/dbdg/dbsindex_10 3acebe688 41 14 0 228654 260190 /dev/vx/rdsk/dbdg/dbsindex2_01 3acebe820 42 14 0 300042 144972 /dev/vx/rdsk/dbdg/dbsindex2_02 3acebe9b8 43 14 0 215471 8302 /dev/vx/rdsk/dbdg/dbsindex2_03 3acebeb50 44 14 0 383277 23169 /dev/vx/rdsk/dbdg/dbsindex2_04 3acebece8 45 14 0 381857 15733 /dev/vx/rdsk/dbdg/dbsindex2_05 3acebee80 46 15 0 1341346 1673126 /dev/vx/rdsk/dbdg/otrsdbs1_01 3acebf028 47 15 0 483808 94872 /dev/vx/rdsk/dbdg/otrsdbs1_02 3acebf1c0 48 15 0 2775868 895 /dev/vx/rdsk/dbdg/otrsdbs1_03 3acebf358 49 16 0 335387 171931 /dev/vx/rdsk/dbdg/otrsdbs2_01 3acebf4f0 50 16 0 186968 203020 /dev/vx/rdsk/dbdg/otrsdbs2_02 3acebf688 51 16 0 85063 106157 /dev/vx/rdsk/dbdg/otrsdbs2_03 3acebf820 52 20 0 283 102 /dev/vx/rdsk/dbdg/raw2g_20 3acebf9b8 53 28 0 67955 49643 /dev/vx/rdsk/dbdg/raw4g_51 3acebfb50 54 20 0 11611 2566 /dev/vx/rdsk/dbdg/raw2g_86 3acebfce8 55 3 0 31230 17410 /dev/vx/rdsk/dbdg/raw20g_07 3acebfe80 56 19 0 473733 88041 /dev/vx/rdsk/dbdg/simacdbs1_01 3acec4028 57 19 0 636373 2148 /dev/vx/rdsk/dbdg/simacdbs1_02 3acec41c0 58 19 0 303629 1092 /dev/vx/rdsk/dbdg/simacdbs1_03 3acec4358 59 19 0 674447 4710 /dev/vx/rdsk/dbdg/simacdbs1_04 3acec44f0 60 19 0 809402 5163 /dev/vx/rdsk/dbdg/simacdbs1_05 3acec4688 61 19 0 112947 6194 /dev/vx/rdsk/dbdg/simacdbs1_06 3acec4820 62 20 0 722362 4842 /dev/vx/rdsk/dbdg/simacdbs2_01 3acec49b8 63 20 0 1069015 1121 /dev/vx/rdsk/dbdg/simacdbs2_02 3acec4b50 64 20 0 1318918 1385 /dev/vx/rdsk/dbdg/simacdbs2_03 3acec4ce8 65 20 0 954103 3712 /dev/vx/rdsk/dbdg/simacdbs2_04 3acec4e80 66 20 0 1151304 9803 /dev/vx/rdsk/dbdg/simacdbs2_05 3acecb028 67 20 0 920211 10272 /dev/vx/rdsk/dbdg/simacdbs2_06 3acecb1c0 68 21 0 829545 4059 /dev/vx/rdsk/dbdg/simacdbs3_01 3acecb358 69 21 0 457470 3437 /dev/vx/rdsk/dbdg/simacdbs3_02 3acecb4f0 70 21 0 1635381 4814 /dev/vx/rdsk/dbdg/simacdbs3_03 3acecb688 71 21 0 832520 8027 /dev/vx/rdsk/dbdg/simacdbs3_04 3acecb820 72 21 0 307447 3419 /dev/vx/rdsk/dbdg/simacdbs3_05 3acecb9b8 73 21 0 99754 7482 /dev/vx/rdsk/dbdg/simacdbs3_06 3acecbb50 74 22 0 1237836 2806 /dev/vx/rdsk/dbdg/simacdbs4_01 3acecbce8 75 22 0 323930 3850 /dev/vx/rdsk/dbdg/simacdbs4_02 3acecbe80 76 22 0 116463 7249 /dev/vx/rdsk/dbdg/simacdbs4_03 3acecc028 77 22 0 89882 4728 /dev/vx/rdsk/dbdg/simacdbs4_04 3acecc1c0 78 22 0 69442 5540 /dev/vx/rdsk/dbdg/simacdbs4_05 3acecc358 79 22 0 8706 3950 /dev/vx/rdsk/dbdg/simacdbs4_06 3acecc4f0 80 23 0 4 4 /dev/vx/rdsk/dbdg/temporary_01 3acecc688 81 23 0 1 2 /dev/vx/rdsk/dbdg/temporary_02 3acecc820 82 24 0 4 4 /dev/vx/rdsk/dbdg

Second instance: Second instance: IBM Informix Dynamic Server Version 9.40.FC9 -- On-Line -- Up 13:56:23 --3214336 Kbytes Configuration File: /informix/etc/onconfig.gsm # Root Dbspace Configuration ROOTNAME rootdbs # Root dbspace nameROOTPATH /dev/vx/rdsk/hdsdbdg/raw200m_24 # Path for device containing root dbspace ROOTOFFSET 0 # Offset of root dbspace into device (Kbytes) ROOTSIZE 200000 # Size of root dbspace (Kbytes)# Disk Mirroring Configuration Parameters MIRROR 0 # Mirroring flag (Yes = 1, No = 0) MIRRORPATH # Path for device containing mirrored root MIRROROFFSET 0 # Offset into mirrored device (Kbytes)# Physical Log Configuration PHYSDBS physdbs # Location (dbspace) of physical log PHYSFILE 999990 # Physical log file size (Kbytes)# Logical Log Configuration LOGFILES 11 # Number of logical log files LOGSIZE 45000 # Logical log size (Kbytes)# Diagnostics MSGPATH /dump_ifx/online.gsm.log # System message log file path CONSOLE /dev/null # System console message path ALARMPROGRAM /informix/etc/log_full.sh # Alarm program path TBLSPACE_STATS 1 # Maintain tblspace statistics# System Archive Tape Device TAPEDEV /dev/null # Tape device path TAPEBLK 16 # Tape block size (Kbytes) TAPESIZE 10240 # Maximum amount of data to put on tape (Kbytes)# Log Archive Tape Device LTAPEDEV /dev/null # Log tape device path LTAPEBLK 16 # Log tape block size (Kbytes) LTAPESIZE 10240 # Max amount of data to put on log tape (Kbytes) # OpticalSTAGEBLOB # Informix Dynamic Server staging area # System Configuration SERVERNUM 29 # Unique id corresponding to a OnLine instance DBSERVERNAME online_gsm # Name of default database serverDBSERVERALIASES ontcp_gsm,ontcp_gsmb # List of alternate dbservernames NETTYPE ipcshm,3,100,CPU NETTYPE tlitcp,3,100,NET DEADLOCK_TIMEOUT 60 # Max time to wait of lock in distributed env. RESIDENT 0 # Forced residency flag (Yes = 1, No = 0) MULTIPROCESSOR 1 # 0 for single-processor, 1 for multi-processor NUMCPUVPS 6 # Number of user (cpu) vps JMH 13-Jul-05 SINGLE_CPU_VP 0 # If non-zero, limit number of cpu vps to one NOAGE 1 # Process aging# Shared Memory Parameters LOCKS 70000 # Maximum number of locks BUFFERS 1368000 # Maximum number of shared buffers HPCG 11-Mar-2004 NUMAIOVPS 8 # Number of IO vps # HPCG Marzo 8, 2004 PHYSBUFF 32 # Physical log buffer size (Kbytes) LOGBUFF 32 # Logical log buffer size (Kbytes) CLEANERS 13 # Number of buffer cleaner processes, HPCG Abril 13 SHMBASE 0xa000000 # Shared memory base address SHMVIRTSIZE 213120 # Incrementado por generacion de 4 segmentos mas Abril 82005 SHMADD 63936 # Size of new shared memory segments (Kbytes) SHMTOTAL 0 # Total shared memory (Kbytes). 0=>unlimited CKPTINTVL 3000 # Check point interval (in sec) LRUS 13 # Number of LRU queues LRU_MAX_DIRTY 5 # LRU percent dirty begin cleaning limit LRU_MIN_DIRTY 2 # LRU percent dirty end cleaning limit TXTIMEOUT 0x12c # Transaction timeout (in sec) STACKSIZE 128 # Stack size (Kbytes) DYNAMIC_LOGS 2 LTXHWM 70 LTXEHWM 80 OFF_RECVRY_THREADS 10 # Default number of offline worker threads ON_RECVRY_THREADS 1 # Default number of online worker threads# Data Replication Variables DRINTERVAL 30 # DR max time between DR buffer flushes (in sec) DRTIMEOUT 30 # DR network timeout (in sec)DRLOSTFOUND /informix/etc/dr.lostfound # DR lost+found file path # CDR Variables CDR_EVALTHREADS 1,2 # evaluator threads (per-cpu-vp,additional) CDR_DSLOCKWAIT 5 # DS lockwait timeout (seconds) CDR_QUEUEMEM 4096 # Maximum amount of memory for any CDR queue (Kbytes) CDR_NIFCOMPRESS 0 # Link level compression (-1 never, 0 none, 9 max) CDR_SERIAL 0,0 # Serial Column Sequence CDR_DBSPACE # dbspace for syscdr database CDR_QHDR_DBSPACE # CDR queue dbspace (default same as catalog) CDR_QDATA_SBSPACE # CDR queue smart blob space# Backup/Restore variables BAR_ACT_LOG /informix/bar_act.log # ON-Bar Log file - not in /tmp please BAR_DEBUG_LOG /informix/bar_dbug.log # ON-Bar Debug Log - not in /tmp please BAR_MAX_BACKUP 0 BAR_RETRY 1 BAR_NB_XPORT_COUNT 10 BAR_XFER_BUF_SIZE 31 RESTARTABLE_RESTORE on BAR_PROGRESS_FREQ 0# Informix Storage Manager variables ISM_DATA_POOL ISMData ISM_LOG_POOL ISMLogs # Read Ahead Variables RA_PAGES # Number of pages to attempt to read ahead RA_THRESHOLD # Number of pages left before next group DBSPACETEMP temporary # Default temp dbspaces DUMPDIR /dump_ifx/AF # Preserve diagnostics in this directory DUMPSHMEM 1 # Dump a copy of shared memory DUMPGCORE 0 # Dump a core image using 'gcore' DUMPCORE 0 # Dump a core image (Warning:this aborts OnLine) DUMPCNT 1 # Number of shared memory or gcore dumps for FILLFACTOR 90 # Fill factor for building indexes# method for OnLine to use when determining current time USEOSTIME 0 # 0: use internal time(fast), 1: get time from OS(slow)# Parallel Database Queries (pdq) MAX_PDQPRIORITY 100 # Maximum allowed pdqpriority DS_MAX_QUERIES # Maximum number of decision support queries DS_TOTAL_MEMORY # Decision support memory (Kbytes) DS_MAX_SCANS 1048576 # Maximum number of decision support scans DATASKIP off OPTCOMPIND 2 # To hint the optimizer DIRECTIVES 1 # Optimizer DIRECTIVES ON (1/Default) or OFF (0) ONDBSPACEDOWN 2 # Dbspace down option: 0 = CONTINUE, 1 = ABORT, 2 = WAITOPCACHEMAX 0 # Maximum optical cache size (Kbytes) HETERO_COMMIT 0 SBSPACENAME # Default smartblob space name - this is where blobs # go if no sbspace is specified when the smartblob is # created. It is also used by some datablades as # the location to put their smartblobs. SYSSBSPACENAME # Default smartblob space for use by the Informix # Server. This is used primarily for Informix Server # system statistics collection. BLOCKTIMEOUT 3600 # Default timeout for system blockSYSALARMPROGRAM /informix/etc/evidence.sh # System Alarm program path # Optimization goal: -1 = ALL_ROWS(Default), 0 = FIRST_ROWS OPT_GOAL -1 ALLOW_NEWLINE 0 # embedded newlines(Yes = 1, No = 0 or anything but 1)JVPJAVAHOME /informix/extend/krakatoa/jre/ # JRE installation root directory JVPHOME /informix/extend/krakatoa # Krakatoa installation directory JVPPROPFILE /informix/extend/krakatoa/.jvpprops # JVP property file JVPLOGFILE /informix/jvp.log # JVP log file. JDKVERSION 1.3 # JDK version supported by this server # The path to the JRE libraries relative to JVPJAVAHOME JVPJAVALIB /lib/sparc/# The JRE libraries to use for the Java VM JVPJAVAVM hpi:server:verify:java:net:zip:jpeg # use JVPARGS to change Java VM configuration #To display jni call #JVPARGS -verbose:jni # Classpath to use upon Java VM start-up (use _g version for debugging) JVPCLASSPATH /informix/extend/krakatoa/krakatoa.jar:/informix/extend/krakatoa/jdbc.jar CDR_MAX_DYNAMIC_LOGS 0 # Dynamic log addition disabled by defaultDBCREATE_PERMISSION informix ******************************************************************************** ************************************ onstat -p IBM Informix Dynamic Server Version 9.40.FC9 -- On-Line -- Up 13:42:46 --3214336 Kbytes Profile dskreads pagreads bufreads %cached dskwrits pagwrits bufwrits %cached 66689482 90774642 7115125237 99.07 18961044 25973210 5

Finally the last part. ******************************************************************************** *********************************** onstat -D IBM Informix Dynamic Server Version 9.40.FC9 -- On-Line -- Up 13:48:53 --3214336 Kbytes Dbspaces address number flags fchunk nchunks flags owner name c0d8b490 1 0x20001 1 1 N informix rootdbs c224f9b8 2 0x60001 2 3 N B informix celdbs c2254028 3 0x60001 3 2 N B informix rbsdbs c2254490 4 0x60001 4 4 N B informix halfdbs c22548f8 5 0x60001 5 1 N B informix celmdbs c2259028 6 0x60001 6 2 N B informix rbsmdbs c2259490 7 0x60001 7 2 N B informix halfmdbs c22598f8 8 0x20001 8 1 N informix catdbs c225d028 9 0x60001 9 1 N B informix mensdbs c225d490 10 0x60001 10 1 N B informix semdbs c225d8f8 11 0x60001 11 3 N B informix tempdbs c2262028 12 0x60001 12 14 N B informix tempdbs2 c2262490 13 0x60001 13 11 N B informix tempdbs1 c22628f8 14 0x60001 14 1 N B informix stshlrdbs c2267028 15 0x60001 15 6 N B informix stsbscdbs c2267490 16 0x60001 16 9 N B informix bsc1sts1dbs c22678f8 17 0x60001 17 3 N B informix hlr1sts3dbs c226b028 18 0x60001 18 2 N B informix hlr1sts2dbs c226b490 19 0x60001 19 5 N B informix hlr1sts4dbs c226b8f8 20 0x60001 20 2 N B informix msc1sts1dbs c2270028 21 0x60001 83 1 N B informix tempdbs4 c2270490 22 0x60001 22 1 N B informix msc1sts3dbs c22708f8 23 0x60001 23 2 N B informix msc1sts4dbs c2274028 24 0x60001 86 7 N B informix idxtchdbs c2274490 26 0x60001 26 1 N B informix scp1stsdbs c22748f8 27 0x60001 27 3 N B informix scp2stsdbs c2279028 28 0x60001 28 1 N B informix stsscpdbs c2279490 29 0x60001 29 2 N B informix stsmscdbs c22798f8 30 0x60001 30 1 N B informix barfildbs c227d028 31 0x60001 31 1 N B informix rirfildbs c227d490 32 0x60001 32 1 N B informix mtrfildbs c227d8f8 33 0x60001 33 1 N B informix mrrdbs c2282028 34 0x60001 64 2 N B informix halfdbs_hora c2282490 35 0x60001 35 1 N B informix tradodbs c22828f8 36 0x60001 36 3 N B informix cmddbs c2286028 37 0x60001 37 2 N B informix variosdbs c2286490 38 0x60001 38 2 N B informix varmacdbs c22868f8 39 0x20001 39 1 N informix logsdbs c228b028 40 0x20001 40 1 N informix physdbs c228b490 41 0x42001 41 3 N TB informix temporary c228b8f8 42 0x20001 42 1 N informix basedbs c228f028 43 0x20011 43 1 N B informix blobsp1 c228f490 44 0x60001 65 4 N B informix celdbs_hora c228f8f8 45 0x60001 66 4 N B informix rbsdbs_hora c2294028 46 0x20001 88 17 N informix trafdbs12 c2294490 47 0x20001 89 6 N informix idxceldbs c22948f8 49 0x20001 136 8 N informix nuevo1 c2298028 50 0x20001 92 1 N informix ststchdbs2 c2298490 51 0x20001 93 2 N informix ststchdbs3 c22988f8 52 0x20001 94 3 N informix ststchdbs4 c229d028 53 0x20001 95 3 N informix ststchdbs5 c229d490 54 0x20001 96 3 N informix ststchdbs6 c229d8f8 55 0x20001 97 2 N informix ststchdbs7 c22a2028 56 0x20001 98 2 N informix ststchdbs8 c22a2490 57 0x60001 99 3 N B informix ststchdbs9 c22a28f8 58 0x60001 100 2 N B informix ststchdbs10 c22a6028 59 0x60001 101 2 N B informix ststchdbs11 c22a6490 60 0x60001 170 1 N B informix paso1gsm c22a68f8 61 0x60001 171 1 N B informix paso2gsm c22ab028 62 0x60001 172 2 N B informix paso3gsm c22ab490 63 0x60001 173 1 N B informix paso4gsm c22ab8f8 64 0x60001 174 2 N B informix paso5gsm c22af028 65 0x20001 107 4 N informix datgen1 c22af490 66 0x20001 108 5 N informix datgen2 c22af8f8 67 0x20001 109 7 N informix datgen3 c22b4028 69 0x60001 215 1 N B informix gsmdbs1 c22b4490 70 0x60001 221 1 N B informix gsmdbs2 c22b48f8 71 0x60001 248 1 N B informix idxgsmdbs1 c22b8028 72 0x60001 251 1 N B informix comandos_dbs c22b8490 75 0x60011 254 1 N BB informix blobsp2 c22b88f8 76 0x60001 257 1 N B informix sts_amr c22bd028 77 0x60001 266 1 N B informix sts_celevent c22bd490 78 0x60001 278 1 N B informix sts_data c22bd8f8 79 0x60001 279 1 N B informix sts_tch c22c1028 87 0x60001 129 1 N B informix datgen8 c22c1490 148 0x60001 196 1 N B informix dceldbs c22c18f8 149 0x60001 197 1 N B informix ddatadbs c22c6028 150 0x60001 198 1 N B informix dhoragsm1 c22c6490 151 0x60001 199 1 N B informix dhoragsm2 c22c68f8 152 0x60001 200 3 N B informix idxcmd1dbs c22ca028 153 0x60001 205 2 N B informix idxcmd2dbs c22ca490 154 0x60001 224 1 N B informix dtchmdbs c22ca8f8 155 0x60001 225 2 N B informix ddatamdbs c22cf028 156 0x60001 226 1 N B informix dcchmdbs c22cf490 157 0x60001 227 1 N B informix dcelmdbs c22cf8f8 158 0x60001 259 4 N B informix motsdbs c22d3028 159 0x60001 261 1 N B informix pasodbs c22d3490 160 0x60001 262 3 N B informix msc1sts2dbs c22d38f8 161 0x60001 267 1 N B informix sts4dbs1 c22d8028 162 0x60001 268 3 N B informix sts4dbs2 c22d8490 163 0x60001 269 1 N B informix sts4dbs3 c22d88f8 166 0x20001 281 3 N informix motsdbs11 c22dc028 175 0x20001 290 7 N informix motsdbs9 c22dc490 176 0x20001 291 3 N informix motsdbs10 c22dc8f8 177 0x60001 292 1 N B informix idxsts10_dbs c22e1028 178 0x60001 293 3 N B informix sts10_dbs c22e1490 183 0x20001 299 2 N informix trafdbs7 c22e18f8 185 0x20001 301 2 N informix idxtrafdbs1 c22e6028 186 0x60001 302 1 N B informix trafdbs4 c22e6490 187 0x60001 303 1 N B informix trafdbs5 c22e68f8 188 0x60001 304 1 N B informix trafdbs9 c22ea028 189 0x60001 305 1 N B informix trafdbs10 c22ea490 190 0x60001 306 1 N B informix trafdbs11 c22ea8f8 192 0x60001 308 1 N B informix trafmdbs 104 active, 2047 maximum Chunks address chunk/dbs offset page Rd page Wr pathname c0d8b8f8 1 1 0 4953 1071 /dev/vx/rdsk/hdsdbdg/raw200m_24 c1347790 2 2 0 111171 15277 /dev/vx/rdsk/hdsdbdg1/raw10g_11 c1347928 3 3 0 605390 113551 /dev/vx/rdsk/hdsdbdg1/raw10g_12 c1347ac0 4 4 0 969926 110626 /dev/vx/rdsk/hdsdbdg1/raw10g_13 c1347c58 5 5 0 1801949 28317 /dev/vx/rdsk/hdsdbdg1/raw10g_14 c1347df0 6 6 0 690840 53444 /dev/vx/rdsk/hdsdbdg1/raw10g_15 c1fb3028 7 7 0 44725 75227 /dev/vx/rdsk/hdsdbdg1/raw10g_16 c1fb31c0 8 8 0 20461 26 /dev/vx/rdsk/hdsdbdg1/raw2g_56 c1fb3358 9 9 0 34940 24364 /dev/vx/rdsk/hdsdbdg1/raw6g_21 c1fb34f0 10 10 0 34559 13252 /dev/vx/rdsk/hdsdbdg1/raw10g_17 c1fb3688 11 11 0 147014 13830 /dev/vx/rdsk/hdsdbdg/raw4g_36 c1fb3820 12 12 0 83532 19131 /dev/vx/rdsk/hdsdbdg/raw4g_37 c1fb39b8 13 13 0 600887 692506 /dev/vx/rdsk/hdsdbdg/raw4g_38 c1fb3b50 14 14 0 196754 37602 /dev/vx/rdsk/hdsdbdg1/raw10g_18 c1fb3ce8 15 15 0 383769 46774 /dev/vx/rdsk/hdsdbdg1/raw10g_19 c1fb3e80 16 16 0 1079864 492452 /dev/vx/rdsk/hdsdbdg1/raw10g_20 c1f7a028 17 17 0 508127 148041 /dev/vx/rdsk/hdsdbdg1/raw10g_21 c1f7a1c0 18 18 0 252477 29116 /dev/vx/rdsk/hdsdbdg1/raw10g_22 c1f7a358 19 19 0 3415 1614 /dev/vx/rdsk/hdsdbdg1/raw10g_23 c1f7a4f0 20 20 0 83408 24558 /dev/vx/rdsk/hdsdbdg1/raw10g_24 c1f7a688 21 16 0 285128 38134 /dev/vx/rdsk/hdsdbdg1/raw10g_28 c1f7a820 22 22 0 145942 40526 /dev/vx/rdsk/hdsdbdg1/raw10g_26 c1f7a9b8 23 23 0 1126836 569448 /dev/vx/rdsk/hdsdbdg1/raw10g_27 c1f7ab50 24 19 0 182155 5440 /dev/vx/rdsk/hdsdbdg1/raw10g_25 c1f7ace8 25 13 0 56329 9654 /dev/vx/rdsk/hdsdbdg1/raw5g_24 c1f7ae80 26 26 0 191609 28596 /dev/vx/rdsk/hdsdbdg1/raw10g_30 c1f42028 27 27 0 145 2772 /dev/vx/rdsk/hdsdbdg1/raw10g_31 c1f421c0 28 28 0 7750 4372 /dev/vx/rdsk/hdsdbdg1/raw10g_32 c1f42358 29 29 0 56403 33842 /dev/vx/rdsk/hdsdbdg1/raw10g_33 c1f424f0 30 30 0 70961 6735 /dev/vx/rdsk/hdsdbdg1/r

Server 1: Reduce AIO VPs down to 4, half are unused and one more is under used. I see lots of write activity to a dbspace the appears to have indexes. It may be that your BTREE scanner threads are running almost constantly to keep up with cleaning your indexes. Unfortunately you cannot tune the BTREE scanners in 9.40 - yet another reason to upgrade. The scanners in 11.50 not only can be tuned, but include two advanced scanning algorithms that you can configure that are FAR lower in overhead. About 20% of your queries include a sequential scan. You should look at the table profiles to determine if any larger tables are being scanned that way and track down the queries that are doing this. Either adjust the queries or add missing indexes. I don't understand why you have configured 10 TCP server aliases. Polling all of these connections ports may be part of the problem. Beyond that I don't see anything obvious. Maybe someone else will. Art S. Kagel Oninit (www.oninit.com) IIUG Board of Directors (art@iiug.org) Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on my employer, Oninit, the IIUG, nor any other organization with which I am associated either explicitly or implicitly. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves. On Tue, Jun 23, 2009 at 10:29 PM, PEDRO PEREZ <pedro2263@gmail.com> wrote: > Continue informaton of the first instance: > > > ******************************************************************************** ************************************* > onstat -D> > IBM Informix Dynamic Server Version 9.40.FC9 -- On-Line -- Up 13:35:58 --> 11752448 Kbytes > > Dbspaces > address number flags fchunk nchunks flags owner name > 3aab46490 1 0x20001 1 1 N informix rootdbs > 3acf02358 2 0x60001 2 4 N B informix nokiadbs > 3acf027c0 3 0x60001 55 1 N B informix simacdbs8 > 3acf05028 4 0x60001 98 1 N B informix simacdbs9 > 3acf05490 5 0x60001 5 2 N B informix grupomed1 > 3acf058f8 6 0x60001 6 2 N B informix grupomed2 > 3acf0a028 7 0x60001 7 5 N B informix sicri_ncel > 3acf0a490 8 0x2001 11 4 N T informix temporary > 3acf0a8f8 9 0x42001 15 4 N TB informix temporary1 > 3acf0f028 10 0x60001 19 7 N B informix ndato_dia > 3acf0f490 11 0x60001 25 3 N B informix ngrupomed1 > 3acf0f8f8 12 0x60001 28 3 N B informix ngrupomed2 > 3acf13028 13 0x60001 31 10 N B informix dbsindex > 3acf13490 14 0x60001 41 7 N B informix dbsindex2 > 3acf138f8 15 0x60001 46 4 N B informix otrsdbs1 > 3acf18028 16 0x60001 49 4 N B informix otrsdbs2 > 3acf18490 17 0x60001 93 2 N B informix logsdbs > 3acf188f8 18 0x60001 120 1 N B informix simacdbs10 > 3acf1c028 19 0x60001 56 7 N B informix simacdbs1 > 3acf1c490 20 0x60001 62 12 N B informix simacdbs2 > 3acf1c8f8 21 0x60001 68 7 N B informix simacdbs3 > 3acf21028 22 0x60001 74 7 N B informix simacdbs4 > 3acf21490 23 0x42001 80 2 N TB informix ntemporary > 3acf218f8 24 0x42001 82 2 N TB informix ntemporary1 > 3acf25028 25 0x60001 84 1 N B informix nsimacdbs > 3acf25490 26 0x60001 85 3 N B informix nsicri_ncel > 3acf258f8 27 0x60001 88 4 N B informix simacdbs5 > 3acf2a028 28 0x60001 89 3 N B informix simacdbs6 > 3acf2a490 29 0x20001 94 1 N informix physdbs > 3acf2a8f8 30 0x42001 95 1 N TB informix temporary2 > 3acf2e028 31 0x42001 96 1 N TB informix temporary3 > 3acf2e490 32 0x60001 114 3 N B informix nokiadbs2 > 3acf2e8f8 33 0x60001 121 1 N B informix nokiadbs3 > 3acf33028 34 0x60001 116 1 N B informix wcellsdbs > 3acf33490 35 0x60001 117 1 N B informix simacdbs7 > 3acf338f8 36 0x60001 122 1 N B informix simacdbs11 > 3acf37028 37 0x60001 123 1 N B informix simacdbs12 > 3acf37490 38 0x60001 124 1 N B informix wcellsdbs3 > 3acf378f8 39 0x60001 125 1 N B informix simacdbs13 > 3acf3c028 40 0x60001 126 1 N B informix simacdbs14 > 3acf3c490 41 0x60001 127 1 N B informix simacdbs15 > 41 active, 2047 maximum > > Chunks > address chunk/dbs offset page Rd page Wr pathname > 3aab468f8 1 1 0 2676 5129 /dev/vx/rdsk/dbdg/raw512m_02 > 3acdb3778 2 2 0 5016332 59542 /dev/vx/rdsk/dbdg/raw10g_02 > 3acdb3910 3 27 0 55873 0 /dev/vx/rdsk/dbdg/raw4g_65 > 3acdb3aa8 4 10 0 510 0 /dev/vx/rdsk/dbdg/raw4g_66 > 3acdb3c40 5 5 0 64183 62278 /dev/vx/rdsk/dbdg/raw6g_01 > 3acdb3dd8 6 6 0 463989 751345 /dev/vx/rdsk/dbdg/raw10g_01 > 3ac8b4028 7 7 0 4431 2686 /dev/vx/rdsk/dbdg/raw512m_03 > 3ac8b41c0 8 7 0 3919 1009 /dev/vx/rdsk/dbdg/raw512m_04 > 3ac8b4358 9 7 0 84013 55 /dev/vx/rdsk/dbdg/raw512m_05 > 3ac8b44f0 10 7 0 176764 583 /dev/vx/rdsk/dbdg/raw512m_11 > 3ac8b4688 11 8 8 75 28018 /dev/vx/rdsk/dbdg/raw2g_01 > 3ac8b4820 12 8 8 1 2 /dev/vx/rdsk/dbdg/raw2g_02 > 3ac8b49b8 13 8 8 1 2 /dev/vx/rdsk/dbdg/raw2g_03 > 3ac8b4b50 14 8 8 1 2 /dev/vx/rdsk/dbdg/raw512m_12 > 3ac8b4ce8 15 9 8 943002 667195 /dev/vx/rdsk/dbdg/raw2g_04 > 3ac8b4e80 16 9 8 1 2 /dev/vx/rdsk/dbdg/raw2g_05 > 3ac995028 17 9 8 1 2 /dev/vx/rdsk/dbdg/raw2g_06 > 3ac9951c0 18 2 0 858674 0 /dev/vx/rdsk/dbdg/raw2g_19 > 3ac995358 19 10 0 213576 4261 /dev/vx/rdsk/dbdg/Ndato_dia_01 > 3ac9954f0 20 10 0 198421 65685 /dev/vx/rdsk/dbdg/Ndato_dia_02 > 3ac995688 21 10 0 92547 63709 /dev/vx/rdsk/dbdg/Ndato_dia_03 > 3ac995820 22 10 0 15178 7303 /dev/vx/rdsk/dbdg/Ndato_dia_04 > 3ac9959b8 23 10 0 642 0 /dev/vx/rdsk/dbdg/Ndato_dia_05 > 3ac995b50 24 10 0 16373 9842 /dev/vx/rdsk/dbdg/Ndato_dia_06 > 3ac995ce8 25 11 0 32084 33406 /dev/vx/rdsk/dbdg/Ngrupomed1_01 > 3ac995e80 26 11 0 10868 854 /dev/vx/rdsk/dbdg/Ngrupomed1_02 > 3acebd028 27 11 0 1209 0 /dev/vx/rdsk/dbdg/Ngrupomed1_03 > 3acebd1c0 28 12 0 623664 856353 /dev/vx/rdsk/dbdg/Ngrupomed2_01 > 3acebd358 29 12 0 2934 10 /dev/vx/rdsk/dbdg/Ngrupomed2_02 > 3acebd4f0 30 12 0 1 0 /dev/vx/rdsk/dbdg/Ngrupomed2_03 > 3acebd688 31 13 0 289871 29987 /dev/vx/rdsk/dbdg/dbsindex_01 > 3acebd820 32 13 0 450828 2089 /dev/vx/rdsk/dbdg/dbsindex_02 > 3acebd9b8 33 13 0 667600 8695 /dev/vx/rdsk/dbdg/dbsindex_03 > 3acebdb50 34 13 0 1338208 18871 /dev/vx/rdsk/dbdg/dbsindex_04 > 3acebdce8 35 13 0 1792759 11999 /dev/vx/rdsk/dbdg/dbsindex_05 > 3acebde80 36 13 0 1631603 18993 /dev/vx/rdsk/dbdg/dbsindex_06 > 3acebe028 37 13 0 1350638 3650 /dev/vx/rdsk/dbdg/dbsindex_07 > 3acebe1c0 38 13 0 1941239 12275 /dev/vx/rdsk/dbdg/dbsindex_08 > 3acebe358 39 13 0 1149676 7714 /dev/vx/rdsk/dbdg/dbsindex_09 > 3acebe4f0 40 13 0 855619 41819 /dev/vx/rdsk/dbdg/dbsindex_10 > 3acebe688 41 14 0 228654 260190 /dev/vx/rdsk/dbdg/dbsindex2_01 > 3acebe820 42 14 0 300042 144972 /dev/vx/rdsk/dbdg/dbsindex2_02 > 3acebe9b8 43 14 0 215471 8302 /dev/vx/rdsk/dbdg/dbsindex2_03 > 3acebeb50 44 14 0 383277 23169 /dev/vx/rdsk/dbdg/dbsindex2_04 > 3acebece8 45 14 0 381857 15733 /dev/vx/rdsk/dbdg/dbsindex2_05 > 3acebee80 46 15 0 1341346 1673126 /dev/vx/rdsk/dbdg/otrsdbs1_01 > 3acebf028 47 15 0 483808 94872 /dev/vx/rdsk/dbdg/otrsdbs1_02 > 3acebf1c0 48 15 0 2775868 895 /dev/vx/rdsk/dbdg/otrsdbs1_03 > 3acebf358 49 16 0 335387 171931 /dev/vx/rdsk/dbdg/otrsdbs2_01 > 3acebf4f0 50 16 0 186968 203020 /dev/vx/rdsk/dbdg/otrsdbs2_02 > 3acebf688 51 16 0 85063 106157 /dev/vx/rdsk/dbdg/otrsdbs2_03 > 3acebf820 52 20 0 283 102 /dev/vx/rdsk/dbdg/raw2g_20 > 3acebf9b8 53 28 0 67955 49643 /dev/vx/rdsk/dbdg/raw4g_51 >