Re: PDQ with lots of threads waiting poor peformance vs RAID5

Jay, How many rows does your statement put into temp table tmp_e06? What I suspect is that you produce lots of rows which are all sent to the sqlexec thread. It then has to put them all into the temp table. If that's so, your problem is that the temp table is not fragmented and the insert is none in the sqlexec thread which cannot cope. Michael Jay wrote: > Hi, > > I'm running 7.24, 4-way f50 with 1gig memory on AIX 4.3.3 with PDQ = 100, > tables are fragmented by round robin on three disks. I'm finding very > little performance improvements compared to our production enviroment on > RAID5 with no fragmentation nor PDQ. One thing I find very odd, is the > number of scan and group threads that are just waiting. Can someone please > help me understand and correct the problem. > > Thanks > > J. > > ROOTNAME rootdbs # Root dbspace name> ROOTPATH /dev/prod2_rootdbs # Path for device containing root dbspace > ROOTOFFSET 0 # Offset of root dbspace into device > (Kbytes)> #ROOTSIZE 1048576 # Size of root dbspace (Kbytes) > ROOTSIZE 884000> > # Disk Mirroring Configuration Parameters > > MIRROR 0 # Mirroring flag (Yes = 1, No = 0) > MIRRORPATH # Path for device containing mirrored root > MIRROROFFSET 0 # Offset into mirrored device (Kbytes)> > # Physical Log Configuration > > PHYSDBS rootdbs # Location (dbspace) of physical log > PHYSFILE 80000 # Physical log file size (Kbytes)> > # Logical Log Configuration > > LOGFILES 6 # Number of logical log files > LOGSIZE 45000 # Logical log size (Kbytes)> > # Diagnostics > > MSGPATH /isgprod2/inf7dev/online.log # System message log file path > CONSOLE /isgprod2/inf7dev/console.log # System console message path > ALARMPROGRAM /isgprod2/inf7dev/etc/no_log.sh # Alarm program path > > # System Archive Tape Device > > #TAPEDEV /dev/rmt1 # Tape device path > TAPEDEV /dev/mybackup_rmt1 > TAPEBLK 512 # Tape block size (Kbytes) > TAPESIZE 12582412 # Maximum amount of data to put on tape > (Kbytes)> > # Log Archive Tape Device > > #LTAPEDEV /isgprod2/inf7dev/LLogs/llog.log # Log tape device > path > LTAPEDEV /dev/null > LTAPEBLK 512 # Log tape block size (Kbytes) > LTAPESIZE 2097152 # Max amount of data to put on log tape > (Kbytes)> > # Optical > > STAGEBLOB # INFORMIX-OnLine/Optical staging area > > # System Configuration > > SERVERNUM 0 # Unique id corresponding to a OnLine> instance > DBSERVERNAME aixprod2_on # Name of default database server > DBSERVERALIASES rt_aixprod2_on # List of alternate dbservernames > DEADLOCK_TIMEOUT 60 # Max time to wait of lock in distributed > env. > RESIDENT 0 # Forced residency flag (Yes = 1, No = 0) > > MULTIPROCESSOR 1 # 0 for single-processor, 1 for> multi-processor > NUMCPUVPS 4 # Number of user (cpu) vps > SINGLE_CPU_VP 0 # If non-zero, limit number of cpu vps to> one > > NOAGE 0 # Process aging > AFF_SPROC 0 # Affinity start processor > AFF_NPROCS 0 # Affinity number of processors> > # Shared Memory Parameters > > LOCKS 4000 # Maximum number of locks > BUFFERS 150000 # Maximum number of shared buffers > NUMAIOVPS 6 # Number of IO vps > PHYSBUFF 64 # Physical log buffer size (Kbytes) > LOGBUFF 64 # Logical log buffer size (Kbytes)> LOGSMAX 6 # Maximum number of logical log files > CLEANERS 8 # Number of buffer cleaner processes > SHMBASE 0x30000000 # Shared memory base address > SHMVIRTSIZE 65536 # initial virtual shared memory segment size > SHMADD 16384 # Size of new shared memory segments > (Kbytes) > SHMTOTAL 0 # Total shared memory (Kbytes). 0=>unlimited > CKPTINTVL 300 # Check point interval (in sec) > LRUS 32 # Number of LRU queues > LRU_MAX_DIRTY 60 # LRU percent dirty begin cleaning limit > LRU_MIN_DIRTY 50 # LRU percent dirty end cleaning limit > LTXHWM 50 # Long transaction high water mark> percentage > LTXEHWM 60 # Long transaction high water mark > (exclusive) > TXTIMEOUT 0x12c # Transaction timeout (in sec) > STACKSIZE 64 # Stack size (Kbytes)> > # System Page Size > # BUFFSIZE - OnLine no longer supports this configuration parameter. > # To determine the page size used by OnLine on your platform > # see the last line of output from the command, 'onstat -b'. > > > # Recovery Variables > # OFF_RECVRY_THREADS: > # Number of parallel worker threads during fast recovery or an offline > restore. > # ON_RECVRY_THREADS: > # Number of parallel worker threads during an online restore. > > OFF_RECVRY_THREADS 10 # Default number of offline worker> threads > ON_RECVRY_THREADS 5 # Default number of online worker threads> > # Data Replication Variables > # DRAUTO: 0 manual, 1 retain type, 2 reverse type > DRAUTO 0 # DR automatic switchover > DRINTERVAL 30 # DR max time between DR buffer flushes (in > sec) > DRTIMEOUT 30 # DR network timeout (in sec)> DRLOSTFOUND /isgprod2/inf7dev/etc/dr.lostfound # DR lost+found file path > > # CDR Variables > CDR_LOGBUFFERS 2048 # size of log reading buffer pool (Kbytes) > CDR_EVALTHREADS 1,2 # evaluator threads (per-cpu-vp,additional) > CDR_DSLOCKWAIT 5 # DS lockwait timeout (seconds) > CDR_QUEUEMEM 4096 # Maximum amount of memory for any CDR queue > (Kbytes)> > # Backup/Restore variables > BAR_ACT_LOG /tmp/bar_act.log > BAR_MAX_BACKUP 0 > BAR_RETRY 1 > BAR_NB_XPORT_COUNT 10 > BAR_XFER_BUF_SIZE 31> > # Read Ahead Variables > RA_PAGES 32 # Number of pages to attempt to read ahead > RA_THRESHOLD 30 # Number of pages left before next group> > # DBSPACETEMP: > # OnLine equivalent of DBTEMP for SE. This is the list of dbspaces > # that the OnLine SQL Engine will use to create temp tables etc. > # If specified it must be a colon separated list of dbspaces that exist > # when the OnLine system is brought online. If not specified, or if > # all dbspaces specified are invalid, various ad hoc queries will create > # temporary files in /tmp instead. > > DBSPACETEMP tempdbs1:tempdbs2:tempdbs3 # Default temp dbspaces > > # DUMP*: > # The following parameters control the type of diagnostics inf