Re: INSERT performance problems
Posted in 1999
> Also, it doesn't really look like HPL is a viable option, because most of
> the INSERTs are done via INSERT INTO... SELECT FROM... statements; we'd
> have to externalize to use HPL. I've already run some tests, and using
> HPL in deluxe mode is still slower (surprisingly enough) than doing INSERT
> INTO SELECT FROM with constraints enabled.
I would expect that not much time was spent tuning HPL,
then...even in deluxe mode, you should be able to load a few gig an
hour. That's obviously subject to a lot of conditions, but I'm
surprised to hear that HPL would take several hours for just 500K
rows for a relatively small table. Then again, I don't know the
implications of having 17 foreign keys...
> Using HPL in express mode
> isn't an option, because then you need to take a Level-0 archive after
> loading before the table can be used, and on our system that takes a few
> hours to do.
What about faking a Level 0 backup? Either an ontape to /dev/null
or "onbar -B -f" (maybe it's "onbar -b -F"). The Level 0 is only
necessary if you're going to modify the table, I believe...if you're
just going to read from it, I don't think it's necessary.