HPL fast loads and unloads
Posted in 2008
Topics: Migration, Import/Export & Data Conversion
All, When using fast load and unload jobs with HPL, i.e. no conversion jobs, what are the limitations as far as taking an unload from one table and loading it into another table? I want to be able to unload a table from INFORMIXSERVER X at HOST A and load the data into a table with identical schema on INFORMIXSERVER Y at HOST B. Both hosts are running the same version of the OS and are the exact same versions of Informix. I will be able to test this once HOST B is available, but it is like down and stuff. Anyone off the top of their heads know if I can swing this? Hurl the manual at me if you can find the answer there. I could not. MM
PLEASE POST VERSION AND PLATFORM INFORMATION!
Sorry to shout but I must have posted that 'suggestion' 6 times this week
alone - and I'm getting frustrated! Mike, you know better.
Direct answer, if you are using versions prior to the expanded file support
in 9.40 you have the 2GB filesize limitation to deal with, that's it.
If you want an easy way to do this for an entire database, and
dbexport/dbimport is too slow, get my replacement utility, myexport/myimport
in the package myexport on the IIUG Software Repository. You will also need
myschema from my utils2_ak package, Jonathan Leffler's sqlcmd package, and
Ravi Krishna's myonpload package. If you are on AIX or older versions of
HPUX you will need my portable ar utility, ar2 in the package of the same
name unless you have GNU ar installed already in order to unpack the archive
containing the myschema source. If you do not have GNU make you'll have to
edit the makefiles in utils2 (and may have to make some changes even so
depending on your platform).
Myexport/myimport has extended options to use the HPLoader through myonpload
for both export and import and to unload and load tables in parallel (if you
have LOTS of tables, let me know, I have an updated version that I have not
uploaded yet that can throttle the number of tables that are processed at
once so you don't choke the system).
Art
On Fri, Jun 27, 2008 at 11:07 AM, MIKE MAGIE <jmmagie@yahoo.com> wrote:
> All,
>
> When using fast load and unload jobs with HPL, i.e. no conversion jobs,
> what
> are the limitations as far as taking an unload from one table and loading
> it
> into another table? I want to be able to unload a table from INFORMIXSERVER
> X
> at HOST A and load the data into a table with identical schema on
> INFORMIXSERVER Y at HOST B. Both hosts are running the same version of the
> OS
> and are the exact same versions of Informix. I will be able to test this
> once
> HOST B is available, but it is like down and stuff. Anyone off the top of
> their heads know if I can swing this? Hurl the manual at me if you can find
> the answer there. I could not.
>
> MM
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--
Art S. Kagel
Oninit (www.oninit.com)
IIUG Board of Directors (art@iiug.org)
Disclaimer: Please keep in mind that my own opinions are my own opinions and
do not reflect on my employer, Oninit, the IIUG, nor any other organization
with which I am associated either explicitly or implicitly. Neither do those
opinions reflect those of other individuals affiliated with any entity with
which I am affiliated nor those of the entities themselves.
Oops - I am such a customer. We need a reputation feature here so we can give
props and negs when someone pulls a trick like this... For example in this
case I would get negged 5 reputation points. I will assign my previous rep at
100, based on the # of posts I made and their relative usefullness. So now I
am a 95. Art would get props (or reps) for pointing out my snafu. We'll say
Art's reputation points was 47 bajillion before this post - add his +5 rep
points, he would now be at 47 bajillion and 5.
Using IDS v10.00.UC8 on Sun Solaris 2.8
Thanks for the offer - I will look into it. We've got a handful of tables that
are HPL'able and we've been using awkward conversion jobs via the gui that are
slow, and did I mention awkward? I am loving the onpladm tool and the spec
file. Once I get my arms fully around this I'll holler at you re. the tools
you mentioned.
Thanks!
MM
;-)
Definitely check out Ravi's myonpload package. Simplifies HPLoader jobs
even more than onpladm into simple commanline runs, the only way I could
have used HPLoader in myexport/myimport.
Art
On Fri, Jun 27, 2008 at 11:30 AM, MIKE MAGIE <jmmagie@yahoo.com> wrote:
> Oops - I am such a customer. We need a reputation feature here so we can
> give
> props and negs when someone pulls a trick like this... For example in this
> case I would get negged 5 reputation points. I will assign my previous rep
> at
> 100, based on the # of posts I made and their relative usefullness. So now
> I
> am a 95. Art would get props (or reps) for pointing out my snafu. We'll say
> Art's reputation points was 47 bajillion before this post - add his +5 rep
> points, he would now be at 47 bajillion and 5.
>
> Using IDS v10.00.UC8 on Sun Solaris 2.8
>
> Thanks for the offer - I will look into it. We've got a handful of tables
> that
> are HPL'able and we've been using awkward conversion jobs via the gui that
> are
> slow, and did I mention awkward? I am loving the onpladm tool and the spec
> file. Once I get my arms fully around this I'll holler at you re. the tools
> you mentioned.
>
> Thanks!
>
> MM
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--
Art S. Kagel
Oninit (www.oninit.com)
IIUG Board of Directors (art@iiug.org)
Disclaimer: Please keep in mind that my own opinions are my own opinions and
do not reflect on my employer, Oninit, the IIUG, nor any other organization
with which I am associated either explicitly or implicitly. Neither do those
opinions reflect those of other individuals affiliated with any entity with
which I am affiliated nor those of the entities themselves.