Re: Slow database creation and loading

On Jun 22, 10:26 am, johneevo <johne...@gmail.com> wrote: > On Jun 22, 3:06 am, Superboer <superbo...@t-online.de> wrote: > Hi Superboer, Hurray, I was able to shave about 1:40 off of the import time by spliting the table and index creation into seperate sql files. Then after creating the tables running HPL, then setting PDQ and then creating the indexes. So now it will run in 8 hours and 40 minutes instead of 10 hours and 24 minutes. I would still like to get this faster. > > on aix afaicr there is a utitlity called topas which also displays > > iostats.... > > aix should also have sar and if i am not mistaken iostat??? > > > how long the checkpoints are taking. > > > how long checkpoints are taking, have a look in your log file (onstat - > > m) > > Sorry I should have mentioned that we are running aix on an RS-6000. > I will run sar > during the next import on Saturday night. I'll check the checkpoints > then also. Below is the output from "sar", "iostat" and "onstat -m" all taken while the import was running. 05:00:01 %usr %sys %wio %idle 06:00:01 21 1 0 78 07:00:00 4 0 0 96 08:00:01 0 0 0 100 08:20:01 1 0 0 99 08:40:01 0 0 0 99 09:00:00 0 0 0 99 09:20:00 0 0 1 99 09:40:00 0 0 0 99 10:00:01 1 0 0 99 10:20:01 2 1 0 97 10:40:01 0 0 0 99 11:00:00 1 0 0 99 11:20:00 2 1 1 96 11:40:00 3 1 0 96 12:00:01 5 1 1 94 12:20:01 1 0 1 98 12:40:01 8 0 0 92 13:00:01 3 1 1 95 13:20:01 1 0 0 99 13:40:01 18 4 7 71 14:00:00 2 1 1 96 14:20:00 6 1 1 93 14:40:00 5 1 1 94 15:00:00 17 1 2 80 15:20:00 25 0 0 74 15:40:00 34 3 6 57 16:00:00 24 1 3 72 16:20:00 0 0 0 99 16:40:00 0 0 0 100 17:00:00 1 0 0 99 17:20:00 0 0 0 100 17:40:00 0 0 0 100 18:00:01 0 0 0 100 19:00:00 0 0 0 100 20:00:01 0 0 0 99 21:00:02 9 9 2 79 22:00:02 18 3 1 78 Average 6 1 1 92 tty: tin tout avg-cpu: % user % sys % idle % iowait 2.0 76.0 9.0 2.1 88.0 0.9 Disks: % tm_act Kbps tps Kb_read Kb_wrtn hdisk0 2.9 65.1 3.8 142438018 458150353 hdisk1 2.1 59.1 2.9 86629487 458128613 hdisk5 7.2 288.9 16.0 749891204 1913831081 hdisk6 1.9 65.5 4.5 283490318 319931240 hdisk8 5.2 237.9 12.4 1642809150 550714601 hdisk3 5.0 227.0 10.7 1558397822 533924883 hdisk4 1.8 68.8 4.8 301438330 332516919 hdisk7 4.7 213.5 10.1 1461735242 506336724 hdisk9 4.1 147.2 16.4 782876350 574582217 hdisk10 6.3 244.0 12.1 346583380 1903228001 hdisk11 3.6 340.4 11.6 1673723910 1464929775 hdisk12 7.2 113.4 19.5 513698446 531469423 hdisk13 7.0 108.4 19.1 492614050 506336724 hdisk14 5.1 170.9 17.6 999561254 575746368 hdisk15 3.6 131.6 14.1 894433394 319094627 hdisk16 7.2 115.8 19.6 516760878 550714601 hdisk17 3.4 136.2 14.7 921304710 334455264 hdisk2 2.6 277.7 9.0 1095040122 1464929775 cd0 0.0 0.0 0.0 0 0 Informix Dynamic Server Version 7.31.UD7 -- On-Line -- Up 01:36:41 -- 221180 8 Kbytes Message Log File: /usr/informix/online.insurance 21:55:25 Checkpoint loguniq 9895, logpos 0x925098 21:55:56 Checkpoint Completed: duration was 5 seconds. 21:55:56 Checkpoint loguniq 9895, logpos 0x94a018 21:56:00 Checkpoint Completed: duration was 0 seconds. 21:56:00 Checkpoint loguniq 9895, logpos 0x94b018 21:56:15 Checkpoint Completed: duration was 2 seconds. 21:56:15 Checkpoint loguniq 9895, logpos 0x975018 21:57:59 Checkpoint Completed: duration was 0 seconds. 21:57:59 Checkpoint loguniq 9895, logpos 0x977018 22:00:08 Checkpoint Completed: duration was 32 seconds. 22:00:08 Checkpoint loguniq 9895, logpos 0x97b17c 22:00:32 Checkpoint Completed: duration was 7 seconds. 22:00:32 Checkpoint loguniq 9895, logpos 0x97c138