Re: LOADING DATA INTO WAREHOUSING
Posted in 1998
BEATRIZ ROCHA wrote:
>
> We have an ASCII file that is currently 4GB that has to be loaded into an
> Informix table. The load command
> takes about 8 hours. I have added a few things to speed up the load such
> as locking the table.
>
> Is dbload faster than load?
>
No freakin' way!
*-)
Read the manuals! You should definitely not be loading a 4 GB file with
the standard loading programs such as dbload, or load. Use the HP loader,
and save yourself some time. Depending on your system of course, the
load shouldn't be taking 8 hours.
> Has any one use the High Performance Loader. We do not have X windows, so
> I have not been able to test the High Performance
> Loader. If any one has used it, do you have some suggestions on how to
> run-it through the command line. Is the HPL really
> efficient.
>
Using the GUI interface should not be required.
Yes, the HP loader is extremely efficient, thus the name.
In 8.x you would most likely write a script for the loader, it's
probably the same for 7.x, but I haven't used the 7.x loader in
a while.
> We will be moving to a bigger HP box with 1GB of memory and a good number
> of processors, but for know I have to do something
> with the current machine
>
> Any help will be greatly appreciated.
>
> Thanks
> beatrice.rocha@worldnet.att.net
Read the documentation that came with your software. The high-performance
loader is specifically designed for large loads. I know the HP loader for
7.x is slightly different from the 8.x HP loader. To the best of my
knowledge on 7.x I believe the "express" mode is the same as the 8.x RAW
mode, which is bypassing the buffer cache, and thus no logging. There are
restrictions on using this, please read your docs. On our particular XPS
system a 4 GB file would load in under an hour, probably less than 10
minutes, but that's because of the parallelism of a four-node system.
Thanks,
Tim
--
Tim Schaefer
tschaefe@mindspring.com
http://www.inxutil.com
Informix on Linux?
Dude... No Way!
This Changes Everything