Re: Slow data load
Posted in 1998
Alastair Bell <113322.3375@CompuServe.COM> wrote in message <#WidZl4G#GA.186@nih2naab.prod2.compuserve.com>... >I am trying to load a large table into On - Line v 7.20 (running >on HPUX 10.10). The table has 3million rows with a row size of >700. Initially it runs quickly (20,000 rows /min) but after >loading 2million rows the performance falls away quickly until at >the 2.5 million mark it is only loading 800 rows/ min. >The load routine is a 4gl with a cursor, but even when I try >using a load statement from an ascii file a get the same problem. >Note there are no indexes on the table whilst the data is being >loaded. Does anyone have any suggestions how to speed the data >load up. Also note that I am building a test database so nothing >else has access to it. > >-- >Alastair Bell Try all the usual methods...like extent size, non logging database etc.etc. I was wondering if you can split the data files into several small files run several instances of your program. Individual program throughput will be lower but the combined throughput will be much higher. You will start to have a diminishing return after certain number of processes which is your optimal point. I am assuming that you have a multi-CPU machine and will be able to spread the individual files accross different I/O channels. Hope this helps..... Idiot