Re: LOADING DATA INTO WAREHOUSING
Posted in 1998
Beatrice
I was looking at HPL to replace a purge/archive process we run here,
and while I haven't implemented the replacement (mainly because the
processing done by purge/archive is more complex than can be handled
in HPL, IMO), I have gone through the docs.
To run HPL, you would need to populate an onpload database. This is
done automatically when you start ipload (the X windows front end).
The ipload tool allow you to specify parameters for loading the
onpload database. If you go through the docs, you will find what
tables in the onpload database need to be populated for each load. The
load process can be run from the command line using the onpload
command.
HPL allows you to load parallelly from multiple sources for a table,
so I think you would get better performance by splitting your 4GB
ASCII file into seperate files and fragmenting the table to be loaded
into seperate dbspaces.
I have never used dbload but it looks to me like a tool which gives
the user more control, much like Oracle's SQL*Loader. I dont know if
it is faster than load.
HTH
Sujit
______________________________ Reply Separator _________________________________
Subject: LOADING DATA INTO WAREHOUSING
Author: "BEATRIZ ROCHA" <BEATRICE.ROCHA@worldnet.att.net> at internet
Date: 9/3/98 12:22 AM
We have an ASCII file that is currently 4GB that has to be loaded into an
Informix table. The load command
takes about 8 hours. I have added a few things to speed up the load such
as locking the table.
Is dbload faster than load?
Has any one use the High Performance Loader. We do not have X windows, so
I have not been able to test the High Performance
Loader. If any one has used it, do you have some suggestions on how to
run-it through the command line. Is the HPL really
efficient.
We will be moving to a bigger HP box with 1GB of memory and a good number
of processors, but for know I have to do something
with the current machine
Any help will be greatly appreciated.
Thanks
beatrice.rocha@worldnet.att.net