Re: For The Gurus: On-The-Fly aggregation vs. end-of-day aggregation
Posted in 1998
>First off, let me say that each DB does things slightly differently >but you should not use locks to load data warehouse data on any of >them. Red Brick has a direct loader (rb_tmu) as does Oracle (sqlldr >direct=y) and most of the others. Use this feature it's important >to avoid locks and redo logs. Does this allow summary records to be updated during the bulk load? I though that was what the original question was about. Informix's High Performance Loader will allow this type of bulk loading as well. It can be used in both "log bypass mode" or "logged mode". > >As far as aggregation goes the choice will probably depend on what >you are doing and when. If you load during prime query time then >you will need more resources then if you load and aggregate during >off hours. If you do not have this option partition the DB so >that there will not be contention between the loads and querries. > >Also if you are using UN*X then you can avoid using lots of disk >space by spliting the file and using named pipes. Do a man (UN*X on >line manual) on 'tee' and 'mkfifo' > >Hope this helps Madison Pruet