Re: How to HPL to pipe to HPL?
Posted in 1999
---- you wrote: > Hi, > > We need to copy/move 24 million x 200 byte row sized tables around on a > regular basis. The two main options we use right now are: > > 1) the blunt INSERT INTO table_copy SELECT required_columns FROM > original_table WHERE certain_filters, > 2) the almost just as blunt, HPL unload of the SELECT and and HPL load into > the copy_table. > > The 2nd option usually turns out to be the quicker. We would like to figure > out how we can have the HPL unload feed the HPL load directly through a pipe > of sorts so we do not have to wait upon completion of the unload before > starting the load. > > Has anybody got an idea how to best do this, or if this is at all possible? Sure it's possible dude. Just create a named pipe with mknod or something and use that as your device name for the load and unload jobs. Just remember though that you will need mega amounts of shared memory. > This could really make a killer data movement solution for our situation.... It sure could. Just be careful how you sync the unload woth the load or you might hit a timeout on the pipe. AB ---------------------------------------------------------------- Get your free email from AltaVista at http://altavista.iname.com