Re: Slow database creation and loading
Posted in 2007
On Jun 21, 9:35 am, "Art S. Kagel" <art.ka...@gmail.com> wrote:
Hi Art,
In case you didn't see my reply to Superboer I was able to speed up
the import
by only creating the tables, running HPL then setting PDQ and then
creating the
indexes. THis cut the time from 10:25 to 8:40. I would like to see
about getting
this even faster.
Below are the stats that you requested. They were all taken one after
another in the
order posted while the import was running.
Thanks again for your help with this.
> Once you get that all worked out, post the following if it's still not
> good:
>
> onstat -p (including the time since stats were zero'd).I'm not sure if I included the time since stats wer zero'd (I ran
onstat -p). I'm not really surewhat you meant or were looking for with that statement.
Informix Dynamic Server Version 7.31.UD7 -- On-Line -- Up 01:47:33
-- 221180
8 Kbytes
Profile
dskreads pagreads bufreads %cached dskwrits pagwrits bufwrits %cached
1570999 8775316 28181244 94.43 1135204 2834114 3322217 65.83
isamtot open start read write rewrite delete
commit rollbk
53795341 130822 148858 12409836 35421742 3680 13513
5476 139
gp_read gp_write gp_rewrt gp_del gp_alloc gp_free gp_curs
0 0 0 0 0 0 0
ovlock ovuserthread ovbuff usercpu syscpu numckpts flushes
0 0 0 4259.90 417.96 372 762
bufwaits lokwaits lockreqs deadlks dltouts ckpwaits compress
seqscans
848420 0 15624669 0 0 640 1869 11852
ixda-RA idx-RA da-RA RA-pgsused lchwaits
42 1 253189 253220 42055
> onstat -D
Informix Dynamic Server Version 7.31.UD7 -- On-Line (CKPT REQ) --
Up 01:52:3
8 -- 2211808 KbytesBlocked:CKPT
Dbspaces
address number flags fchunk nchunks flags owner name
a0058150 1 1 1 1 N informix rootdbs
a008ff30 2 1 2 1 N informix histdbs
a0f96018 3 1001 3 1 N informix
fragdbs1
a0f960d8 4 1001 4 1 N informix
fragdbs3
a0f96198 5 1001 5 1 N informix
fragdbs5
a0f96258 6 1001 6 1 N informix
fragdbs2
a0f96318 7 1001 7 1 N informix
fragdbs4
a0f963d8 8 1001 8 1 N informix
fragdbs6
a0f96498 9 1 9 1 N informix histidx
a0f96558 10 1 10 1 N informix
fragidx1
a0f96618 11 1 11 1 N informix
fragidx2
a0f966d8 12 1 12 1 N informix
fragidx3
a0f96798 13 1 13 1 N informix
fragidx4
a0f96858 14 1 14 1 N informix
fragidx5
a0f96918 15 1 15 1 N informix
fragidx6
a0f969d8 16 2001 16 1 N T informix
temp_space1
a0f96a98 17 2001 17 1 N T informix
temp_space2
a0f96b58 18 1001 18 5 N informix
indexdbs
a0f96c18 19 1 21 1 N informix datadbs
19 active, 2047 maximum
Chunks
address chk/dbs offset page Rd page Wr pathname
a0058210 1 1 1 90491 997000 /usr/informix/dblinks/
infrootlv1
a00832f0 2 2 1 1177229 111776 /usr/informix/dblinks/
infhistlv1
a00833f0 3 3 1 1199160 147996 /usr/informix/dblinks/
infbdatalv1
a00834f0 4 4 1 1199219 147981 /usr/informix/dblinks/
infbdatalv3
a00835f0 5 5 1 1199237 147995 /usr/informix/dblinks/
infbdatalv5
a00836f0 6 6 1 1199235 147996 /usr/informix/dblinks/
infbdatalv2
a00837f0 7 7 1 1199236 147994 /usr/informix/dblinks/
infbdatalv4
a00838f0 8 8 1 1199174 147992 /usr/informix/dblinks/
infbdatalv6
a00839f0 9 9 1 62455 72056 /usr/informix/dblinks/
infhidxlv1
a0083af0 10 10 1 17057 17098 /usr/informix/dblinks/
inffidxlv1
a0083bf0 11 11 1 16365 16405 /usr/informix/dblinks/
inffidxlv2
a0083cf0 12 12 1 1576 1577 /usr/informix/dblinks/
inffidxlv3
a0083df0 13 13 1 1445 1459 /usr/informix/dblinks/
inffidxlv4
a0083ef0 14 14 1 25 23 /usr/informix/dblinks/
inffidxlv5
a008f630 15 15 1 19 17 /usr/informix/dblinks/
inffidxlv6
a008f730 16 16 1 5 878 /usr/informix/dblinks/
inftemplv1
a008f830 17 17 1 6 886 /usr/informix/dblinks/
inftemplv2
a008f930 18 18 1 274158 351676 /usr/informix/dblinks/
infidxlv1
a008fa30 19 18 1 152513 186007 /usr/informix/dblinks/
infidxlv2
a008fb30 20 18 1 305521 313197 /usr/informix/dblinks/
infidxlv3
a008fc30 21 19 1 3 0 /usr/informix/dblinks/
infdatalv1
a008fd30 22 18 1 2 1 /usr/informix/dblinks/
infidxlv4
a008fe30 23 18 1 2 1 /usr/informix/dblinks/
infidxlv5
23 active, 2047 maximum
> onstat -P
Informix Dynamic Server Version 7.31.UD7 -- On-Line -- Up 01:53:04
-- 221180
8 Kbytes
partnum total btree data other resident dirty
0 199025 198583 6 436 0 985
1048578 2 1 1 0 0 0
1048579 8 4 4 0 0 0
1048580 1 1 0 0 0 0
1048582 1 1 0 0 0 0
1048584 4 2 2 0 0 0
1048595 1 1 0 0 0 0
1048606 1 1 0 0 0 0
1048627 30 12 17 1 0 0
1048628 11 6 4 1 0 0
1048629 37 14 23 0 0 0
1048630 2 1 1 0 0 0
1048631 2 1 1 0 0 0
1048633 2 1 1 0 0 0
1048634 1 1 0 0 0 0
1048636 1 1 0 0 0 0
1048637 32 7 24 1 0 0
1048638 1 1 0 0 0 0
1048640 2 1 1 0 0 0
1048641 9 6 2 1 0 0
1048646 1 1 0 0 0 0
1048647 1 1 0 0 0 0
1048648 1 1 0 0 0 0
1048650 1 1 0 0 0 0
1048651 98 20 77 1 0 0
1048652 2 2 0 0 0 0
1048654 44 18 25 1 0 0
1048655 5 3 1 1 0 0
1048672 4 2 2 0 0 0
1048838 5 0 5 0 0