dbcopy over secure/encrypted line
A user wanted to run Art Kagel's "dbcopy" over an encrypted link (migrating HP IDS 9.40 to Linux IDS 10.00) and couldn't get ssh port forwarding to work; ontape wasn't viable across platforms/versions, and he wanted to avoid intermediate flat files. Respondents recommended the High Performance Loader with named pipes over ssh instead: mkfifo a pipe on the target, define a PIPE device array on the source running `ssh informix@target "cat - > /pipe"` and one on the target running `cat /pipe`, then run unload and load jobs concurrently (via onpladm/onpload), with passwordless ssh trust. A blog link was given, and the poster said he'd try it; no confirmation of the outcome is recorded.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Anyone have an ideas on how to use Art K.'s "dbcopy" utility over a secure/encrypted line? I tried to set up port forwarding under ssh, but am not having any luck. Anyone made this to work? TIA, Paul M.
On Sep 17, 5:50 pm, <moss...@wellsfargo.com> wrote:
> Anyone have an ideas on how to use Art K.'s "dbcopy" utility over a
> secure/encrypted line? I tried to set up port forwarding under ssh, but
> am not having any luck. Anyone made this to work?
>
> TIA,
> Paul M.
Are you using a later version of informix because HPL is now much
nicer. The onpladm command works great. This may take the place of
using dbcopy. Can you just use HPL to unload the data and then sftp to
the other box? Also in 10 you can redirect ontape through the ssh I
have an example of doing this that might work for you.
just type onpladm for help
onpladm
usage : onpladm <command>
create job <jobname> {options}
create map <mapname> {options}
create project <projectname> {options}
create object {options}
delete job <jobname> {options}
delete map <mapname> {options}
delete format <formatname> {options}
delete query <queryname> {options}
delete filter <filtername> {options}
delete device <devicename> {options}
delete machine <machinename> {options}
delete project <projectname> {options}
modify object {options}
describe job <jobname> {options}
describe map <mapname> {options}
describe format <formatname> {options}
describe query <queryname> {options}
describe filter <filtername> {options}
describe device <devicename> {options}
describe machine <machinename> {options}
describe project <projectname> {options}
list job {options}
list map {options}
list format {options}
list query {options}
list filter {options}
list device {options}
list machine {options}
list project {options}
list defaults {options}
run job {options}
run project {options}
configure defaults {options}
> -----Original Message-----
> From: informix-list-bounces@iiug.org [mailto:informix-list-
> bounces@iiug.org] On Behalf Of bozon
> Sent: Thursday, September 18, 2008 8:44 AM
> To: informix-list@iiug.org
> Subject: Re: dbcopy over secure/encrypted line
>
> On Sep 17, 5:50 pm, <moss...@wellsfargo.com> wrote:
> > Anyone have an ideas on how to use Art K.'s "dbcopy" utility over a
> > secure/encrypted line? I tried to set up port forwarding under ssh,
> but
> > am not having any luck. Anyone made this to work?
> >
> > TIA,
> > Paul M.
>
> Are you using a later version of informix because HPL is now much
> nicer. The onpladm command works great. This may take the place of
> using dbcopy. Can you just use HPL to unload the data and then sftp to
> the other box? Also in 10 you can redirect ontape through the ssh I
> have an example of doing this that might work for you.
>
> just type onpladm for help
>
> onpladm
> usage : onpladm <command>
> create job <jobname> {options}
<< clipped >>
Thanks for the suggestion. HPL might be an option, but we were hoping
to bypass having to put the data to flat files at all, thus the desire
to use dbcopy. And ontape is not an option for us, as we are migrating
to different boxes (HP => Linux), and different IDS versions (9.40 =>
10.00).
A co-worker (former Informix employee) and I were experimenting, and
there might be a way to use named pipes, ssh, and unload / load, to get
the data across and loaded. Anyone already done something like that??
TIA (again),
Paul M.
mosserp@wellsfargo.com wrote:
>> -----Original Message-----
>> From: informix-list-bounces@iiug.org [mailto:informix-list-
>> bounces@iiug.org] On Behalf Of bozon
>> Sent: Thursday, September 18, 2008 8:44 AM
>> To: informix-list@iiug.org
>> Subject: Re: dbcopy over secure/encrypted line
>>
>> On Sep 17, 5:50 pm, <moss...@wellsfargo.com> wrote:
>>> Anyone have an ideas on how to use Art K.'s "dbcopy" utility over a
>>> secure/encrypted line? I tried to set up port forwarding under ssh,
>> but
>>> am not having any luck. Anyone made this to work?
>>>
>>> TIA,
>>> Paul M.
>> Are you using a later version of informix because HPL is now much
>> nicer. The onpladm command works great. This may take the place of
>> using dbcopy. Can you just use HPL to unload the data and then sftp to
>> the other box? Also in 10 you can redirect ontape through the ssh I
>> have an example of doing this that might work for you.
>>
>> just type onpladm for help
>>
>> onpladm
>> usage : onpladm <command>
>> create job <jobname> {options}>
> << clipped >>
>
> Thanks for the suggestion. HPL might be an option, but we were hoping
> to bypass having to put the data to flat files at all, thus the desire
> to use dbcopy. And ontape is not an option for us, as we are migrating
> to different boxes (HP => Linux), and different IDS versions (9.40 =>
> 10.00).
>
> A co-worker (former Informix employee) and I were experimenting, and
> there might be a way to use named pipes, ssh, and unload / load, to get
> the data across and loaded. Anyone already done something like that??
>
> TIA (again),
> Paul M.
>
Not sure who to attribute this to ("Andrew" is all I have, so ... see him for any issues :O )
HPL with named pipes is the one of the coolest things ever and if you have a
later version you can use the onpladm command line tool and bypass the GUI.
With a little work you can perform an unload of the source table, ship the
data over a network (i.e. skip the unload to temporary flat file bottleneck)
and concurrently load the data into your target table.
1. Create some named pipes on the target server with the mkfifo command:
mkfifo /home/informix/pipe.0
2. Create a device array in HPL on the source server consisting of PIPE
devices with a command that looks like:
ssh informix@target_server "cat - > /home/informix/pipe.0"
3. Create a device array in HPL on the target server consisting of PIPE
devices with a command that looks like:
cat /home/informix/pipe.0
4. Create an unload job on the source server and start it with onpload
5. Create a load job on the target server and start it with onpload
There you go, you're simultaneously unloading from the source and loading
into the target and eliminating those pesky temporary unload files.
informix on the source server must be trusted on the target server for the
ssh (or remsh or rsh) to work without requesting a password.
> -----Original Message-----
> From: informix-list-bounces@iiug.org [mailto:informix-list-
> bounces@iiug.org] On Behalf Of TBP
> Sent: Thursday, September 18, 2008 10:03 AM
> To: informix-list@iiug.org
> Subject: Re: dbcopy over secure/encrypted line
>
> mosserp@wellsfargo.com wrote:
> >> -----Original Message-----
> >> From: informix-list-bounces@iiug.org [mailto:informix-list-
> >> bounces@iiug.org] On Behalf Of bozon
> >> Sent: Thursday, September 18, 2008 8:44 AM
> >> To: informix-list@iiug.org
> >> Subject: Re: dbcopy over secure/encrypted line
> >>
> >> On Sep 17, 5:50 pm, <moss...@wellsfargo.com> wrote:
> >>> Anyone have an ideas on how to use Art K.'s "dbcopy" utility over
a
> >>> secure/encrypted line? I tried to set up port forwarding under
> ssh,
> >> but
> >>> am not having any luck. Anyone made this to work?
> >>>
> >>> TIA,
> >>> Paul M.
> >> Are you using a later version of informix because HPL is now much
> >> nicer. The onpladm command works great. This may take the place of
> >> using dbcopy. Can you just use HPL to unload the data and then sftp
> to
> >> the other box? Also in 10 you can redirect ontape through the ssh I
> >> have an example of doing this that might work for you.
> >>
> >> just type onpladm for help
> >>
> >> onpladm
> >> usage : onpladm <command>
> >> create job <jobname> {options}> >
> > << clipped >>
> >
> > Thanks for the suggestion. HPL might be an option, but we were
> hoping
> > to bypass having to put the data to flat files at all, thus the
> desire
> > to use dbcopy. And ontape is not an option for us, as we are
> migrating
> > to different boxes (HP => Linux), and different IDS versions (9.40
=>
> > 10.00).
> >
> > A co-worker (former Informix employee) and I were experimenting, and
> > there might be a way to use named pipes, ssh, and unload / load, to
> get
> > the data across and loaded. Anyone already done something like
> that??
> >
> > TIA (again),
> > Paul M.
> >
>
> Not sure who to attribute this to ("Andrew" is all I have, so ... see
> him for any issues :O )
>
> HPL with named pipes is the one of the coolest things ever and if you
> have a
> later version you can use the onpladm command line tool and bypass the
> GUI.
>
> With a little work you can perform an unload of the source table, ship
> the
> data over a network (i.e. skip the unload to temporary flat file
> bottleneck)
> and concurrently load the data into your target table.
>
> 1. Create some named pipes on the target server with the mkfifo
> command:
> mkfifo /home/informix/pipe.0
> 2. Create a device array in HPL on the source server consisting of
> PIPE
> devices with a command that looks like:
>
> ssh informix@target_server "cat - > /home/informix/pipe.0"
>
> 3. Create a device array in HPL on the target server consisting of
> PIPE
> devices with a command that looks like:
>
> cat /home/informix/pipe.0
>
> 4. Create an unload job on the source server and start it with
onpload> 5. Create a load job on the target server and start it with onpload
>
> There you go, you're simultaneously unloading from the source and
> loading
> into the target and eliminating those pesky temporary unload files.
>
> informix on the source server must be trusted on the target server for
> the
> ssh (or remsh or rsh) to work without requesting a password.
Cool!! We'll give it a try -- Thanks!!
Paul M.
----- Original Message -----
From: "TBP" <theBP@Usenet-News.Net>
Newsgroups: comp.databases.informix
To: <informix-list@iiug.org>
Sent: Thursday, September 18, 2008 12:02 PM
Subject: Re: dbcopy over secure/encrypted line
> mosserp@wellsfargo.com wrote:
>>> -----Original Message-----
>>> From: informix-list-bounces@iiug.org [mailto:informix-list-
>>> bounces@iiug.org] On Behalf Of bozon
>>> Sent: Thursday, September 18, 2008 8:44 AM
>>> To: informix-list@iiug.org
>>> Subject: Re: dbcopy over secure/encrypted line
>>>
>>> On Sep 17, 5:50 pm, <moss...@wellsfargo.com> wrote:
>>>> Anyone have an ideas on how to use Art K.'s "dbcopy" utility over a
>>>> secure/encrypted line? I tried to set up port forwarding under ssh,
>>> but
>>>> am not having any luck. Anyone made this to work?
>>>>
>>>> TIA,
>>>> Paul M.
>>> Are you using a later version of informix because HPL is now much
>>> nicer. The onpladm command works great. This may take the place of
>>> using dbcopy. Can you just use HPL to unload the data and then sftp to
>>> the other box? Also in 10 you can redirect ontape through the ssh I
>>> have an example of doing this that might work for you.
>>>
>>> just type onpladm for help
>>>
>>> onpladm
>>> usage : onpladm <command>
>>> create job <jobname> {options}>>
>> << clipped >>
>>
>> Thanks for the suggestion. HPL might be an option, but we were hoping
>> to bypass having to put the data to flat files at all, thus the desire
>> to use dbcopy. And ontape is not an option for us, as we are migrating
>> to different boxes (HP => Linux), and different IDS versions (9.40 =>
>> 10.00).
>>
>> A co-worker (former Informix employee) and I were experimenting, and
>> there might be a way to use named pipes, ssh, and unload / load, to get
>> the data across and loaded. Anyone already done something like that??
>>
>> TIA (again),
>> Paul M.
>>
>
> Not sure who to attribute this to ("Andrew" is all I have, so ... see him for any issues :O )
>
> HPL with named pipes is the one of the coolest things ever and if you have a
> later version you can use the onpladm command line tool and bypass the GUI.
>
> With a little work you can perform an unload of the source table, ship the
> data over a network (i.e. skip the unload to temporary flat file bottleneck)
> and concurrently load the data into your target table.
>
> 1. Create some named pipes on the target server with the mkfifo command:
> mkfifo /home/informix/pipe.0
> 2. Create a device array in HPL on the source server consisting of PIPE
> devices with a command that looks like:
>
> ssh informix@target_server "cat - > /home/informix/pipe.0"
>
> 3. Create a device array in HPL on the target server consisting of PIPE
> devices with a command that looks like:
>
> cat /home/informix/pipe.0
>
> 4. Create an unload job on the source server and start it with onpload
> 5. Create a load job on the target server and start it with onpload
>
> There you go, you're simultaneously unloading from the source and loading
> into the target and eliminating those pesky temporary unload files.
>
> informix on the source server must be trusted on the target server for the
> ssh (or remsh or rsh) to work without requesting a password.
> _______________________________________________
> Informix-list mailing list
> Informix-list@iiug.org
> http://www.iiug.org/mailman/listinfo/informix-list
> Not sure who to attribute this to ("Andrew" is all I have, so ... see him for any issues :O )
Don't trust that Andrew guy, he is full of it. :)
Check out this blog entry for a run down of HPL with named pipes over ssh and onpladm.
http://www.ibmdatabasemag.com/blog/main/archives/2008/06/the_informix_hi_1.html
"Andrew"
mosserp@wellsfargo.com wrote:
>> -----Original Message-----
>> From: informix-list-bounces@iiug.org [mailto:informix-list-
>> bounces@iiug.org] On Behalf Of bozon
>> Sent: Thursday, September 18, 2008 8:44 AM
>> To: informix-list@iiug.org
>> Subject: Re: dbcopy over secure/encrypted line
>>
>> On Sep 17, 5:50 pm, <moss...@wellsfargo.com> wrote:
>>> Anyone have an ideas on how to use Art K.'s "dbcopy" utility over a
>>> secure/encrypted line? I tried to set up port forwarding under ssh,
>> but
>>> am not having any luck. Anyone made this to work?
>>>
>>> TIA,
>>> Paul M.
>> Are you using a later version of informix because HPL is now much
>> nicer. The onpladm command works great. This may take the place of
>> using dbcopy. Can you just use HPL to unload the data and then sftp to
>> the other box? Also in 10 you can redirect ontape through the ssh I
>> have an example of doing this that might work for you.
>>
>> just type onpladm for help
>>
>> onpladm
>> usage : onpladm <command>
>> create job <jobname> {options}>
> << clipped >>
>
> Thanks for the suggestion. HPL might be an option, but we were hoping
> to bypass having to put the data to flat files at all, thus the desire
> to use dbcopy. And ontape is not an option for us, as we are migrating
> to different boxes (HP => Linux), and different IDS versions (9.40 =>
> 10.00).
>
> A co-worker (former Informix employee) and I were experimenting, and
> there might be a way to use named pipes, ssh, and unload / load, to get
> the data across and loaded. Anyone already done something like that??
>
> TIA (again),
> Paul M.
>
Just use HPL and named pipes - works well
Cheers
Paul
mosserp@wellsfargo.com wrote:
>> -----Original Message-----
>> From: informix-list-bounces@iiug.org [mailto:informix-list-
>> bounces@iiug.org] On Behalf Of bozon
>> Sent: Thursday, September 18, 2008 8:44 AM
>> To: informix-list@iiug.org
>> Subject: Re: dbcopy over secure/encrypted line
>>
>> On Sep 17, 5:50 pm, <moss...@wellsfargo.com> wrote:
>>> Anyone have an ideas on how to use Art K.'s "dbcopy" utility over a
>>> secure/encrypted line? I tried to set up port forwarding under ssh,
>> but
>>> am not having any luck. Anyone made this to work?
>>>
>>> TIA,
>>> Paul M.
>> Are you using a later version of informix because HPL is now much
>> nicer. The onpladm command works great. This may take the place of
>> using dbcopy. Can you just use HPL to unload the data and then sftp to
>> the other box? Also in 10 you can redirect ontape through the ssh I
>> have an example of doing this that might work for you.
>>
>> just type onpladm for help
>>
>> onpladm
>> usage : onpladm <command>
>> create job <jobname> {options}>
> << clipped >>
>
> Thanks for the suggestion. HPL might be an option, but we were hoping
> to bypass having to put the data to flat files at all, thus the desire
> to use dbcopy. And ontape is not an option for us, as we are migrating
> to different boxes (HP => Linux), and different IDS versions (9.40 =>
> 10.00).
>
> A co-worker (former Informix employee) and I were experimenting, and
> there might be a way to use named pipes, ssh, and unload / load, to get
> the data across and loaded. Anyone already done something like that??
>
> TIA (again),
> Paul M.
>
Just use HPL and named pipes - works well
Cheers
Paul