Re: HPLoader Configuration
I'm curious, can you simply use the pipe as a FILE in the device array and
bypass the "cat - > /tmp/myfifo" and "cat /tmp/myfifo" PIPECOMMANDs?
Will the unload job open the pipe for writing and block until the load job
opens the pipe for reading or is the "cat" necessary?
We've done something similar here for unloads/loads to different engines
using HPL with named pipes and ssh to transfer the data over a network and
skip the disk.
1. create a named pipe on the target server, /tmp/hpl1.p (or multiple pipes
for parallelism)
2. create a device for the unload on the source server with a PIPECOMMAND
of "ssh informix@target ""cat - > /tmp/hpl1.p"" (informix from the source
must be trusted on the target)
3. create a device for the load on the target server with a PIPECOMMAND of
"cat /tmp/hpl1.p"
4. start the unload job on the source
5. start the load job on the target
Just wondering if we can change the target's device to have a FILE of
"/tmp/hpl1.p" and skip the small overhead of sending the data thru cat.
Andrew
----- Original Message -----
From: "Superboer" <superboer7@planet.nl>
To: <informix-list@iiug.org>
Sent: Wednesday, June 08, 2005 3:54 AM
Subject: Re: HPLoader Configuration
>
> 2 ways onploadadm (check manual) and ipload (check manual)
>
> easiest way is ipload. set your display correctly and start it.(ipload)
>
> then choose default project and choose Components from the menu.
> in there choose first the devices.
> --> create one it should be straight forward
> --> then choose generate job where you choose the above created
> dev array and tables etc.
>
> to avoid 2 GB limit use fifo's (array type pipe) you have to create
> 2 dev arrays one for load one for unload. eq:
>
> mkfifo /tmp/myfifo
>
> unload dev:
>
> cat - > /tmp/myfifo (pipe command)
>
> load dev
>
> cat /tmp/myfifo (pipe command)
>
> Warning the os can muck up here so check your data and results
>
> Superboer.
>
>
>
>
> Cesar Cruz schreef:
> > That's the problem
> >
> > I don't know how to do it.
> >
> > Have you an example or something that can help me?
> >
> > Regards,
> >
> >
> > --- Martin_Fischer@agsea.com escribi=F3:
> >
> > > Or one could create HPL load jobs that copy from table to table
bypassi=
> ng
> > > the need to unload to files altogether. There was not alot of
informat=
> ion
> > > in the initial post to determine a proper solution.
> > >
> > > Martin Fischer
> > > Database Administrator
> > > Associated Grocers, Inc.
> > >
> > >
> > > NOTICE: This email message is for the sole use of the intended
> > > recipient(s) and may contain confidential and privileged information.
=
> Any
> > > unauthorized review, use, disclosure or distribution is prohibited.
If=
> you
> > > are not the intended recipient, please contact the sender by reply
email
> > > and destroy all copies of the original message. Thank you.
> > >
> > >
> > >
> > >
> > > "Savio Pinto
> > > \\(s\\)"
> > > <spinto@cap.org>
=
> To
> > > Sent by: "Cesae Cruz"
> > > owner-informix-li <markaragnos17@yahoo.com.mx>,
> > > st@iiug.org <informix-list@iiug.org>
> > >
=
> cc
> > >
> > > 06/07/2005 01:09
Subj=
> ect
> > > PM RE: HPLoader Configuration
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > you can create a Load jobs in HPL to do this, you can create a HPL
jobs=
> to
> > > unload the table into multiple files, and then create a single job to
l=
> oad
> > > the multiple files to the table. you may do this from the gui (ipload)
=
> or
> > > using onpladm.
> > >
> > > -----Original Message-----
> > > From: owner-informix-list@iiug.org
> > > [mailto:owner-informix-list@iiug.org]On Behalf Of Cesae Cruz
> > > Sent: Monday, June 06, 2005 4:24 PM
> > > To: informix-list@iiug.org
> > > Subject: HPLoader Configuration
> > >
> > >
> > >
> > > Hi,
> > >
> > >
> > > I need know how i can configurate/setting the HPloader for
dowlo=
> and
> > > from dbspace1 and upload the same Table on dbspace8 (
39,000,000
> > > Records )
> > >
> > >
> > > I tryed with onunload but at 25,000,000 Records it Fails.
> > >
> > >
> > > Regards,
> > >
> > >
> > > Do You Yahoo!? La mejor conexi=F3n a Internet y 2GB extra a tu
co=
> rreo
> > > por $100 al mes. http://net.yahoo.com.mx
> > >
> > >
> > >
> > >
> >
> >
> >
> >
> >
> >
> > ___________________________________________________________
> > Do You Yahoo!?
> > La mejor conexi=F3n a Internet y <b >2GB</b> extra a tu correo por $100
a=
> l mes. http://net.yahoo.com.mx
> >=20
> > sending to informix-list
>
>
sending to informix-list