HPL to unload entire database?

Good morning, Because onunload only supports legacy data-types, I'm looking to use the HPL tool. The only problem is, I have to do this one table at a time. Done someone have a script they are will to share for the high performance loader to unload an entire DB, as well as create the new DB on a remote system and load all the tables? Thank-you in advance for any suggestions/scripts. Jonathan Smaby Pomona College ------------------------------------------------------------- This message has been scanned by Postini anti-virus software.

HPL is Great! I have used it for single tables before but recently I needed to do a migration to new hardware and with help from this list I was able to do a lot of tables at the same time. On my old hardware there was a point where to many tables slowed things down but you CAN do more than one at a time using scripts to drive the onpload'er rather than using the ipload gui. The IBM doc's are weak on the subject but someone sent me a sample script that would take a list of tables and build the jobs which I could run in any order or in any simultanious quantity. Attached is an email about the subject and an email with a custom script a guy sent me that does a real nice job of automating the building of the jobs to run in parallel. The only thing I had to do was list all the tables I wanted from the database and remove the system tables. Hope these scripts help! Tim Ertl 413-442-9000 x6211 -----Original Message----- From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of Jonathan Smaby Sent: Wednesday, August 20, 2008 1:49 PM To: ids@iiug.org Subject: Using High Perf Loader to unload entire database? [13164] Good morning, Well, now that we can begun to setup tables using Advanced Data-Types, specifically LVARCHAR and CLOB types, we can no longer use Informix native utilities ONUNLOAD and ONLOAD because both of those utilities only support legacy data-types. So, I have been fuddling around with Informix high performance loader with onpload and ipload (GUI) and I noticed that I can only do one table at a time :o( I=B9m totally bummed. I recall something something from one of the IIUG conference sessions earlier this year that i= t was possible to unload and entire DB to file. My question is, has anyone done that with HPL? Reason why I am asking is that we have a test and training environment for my programmers with Informix that I refresh the databases with onload, and now I would like to use HPL to support advanced data-types. Thank-you very much in advance for any insight, wisdom, or experience with this utility. Jonathan Smaby Pomona College --- My favorite quote about the handling of the Iraq war: If you try to fail, and succeed, which have you done? ~George Carlin (1937-2008) ------------------------------------------------------------- This message has been scanned by Postini anti-virus software. =0D **************************************************************************** *** Forum Note: Use "Reply" to post a response in the discussion forum. -----Original Message----- From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of Jonathan Smaby Sent: Wednesday, September 17, 2008 1:10 PM To: ids@iiug.org Subject: HPL to unload entire database? [13403] Good morning, Because onunload only supports legacy data-types, I'm looking to use the HPL tool. The only problem is, I have to do this one table at a time. Done someone have a script they are will to share for the high performance loader to unload an entire DB, as well as create the new DB on a remote system and load all the tables? Thank-you in advance for any suggestions/scripts. Jonathan Smaby Pomona College ------------------------------------------------------------- This message has been scanned by Postini anti-virus software. **************************************************************************** *** Forum Note: Use "Reply" to post a response in the discussion forum. Tim, Glad to hear it worked for you. We are still running 9.40 and 7.31 so the multiple buffer sizes have never come into play for us. By the way, there was a series of three articles on HPL in an IBM on-line magazine. You might find them interesting. Here are the links: http://www.ibmdatabasemag.com/blog/main/archives/2008/05/the_informix_hi.htm l http://www.ibmdatabasemag.com/blog/main/archives/2008/06/the_informix_hi_1.h tml http://www.ibmdatabasemag.com/blog/main/archives/2008/07/the_informix_hi_2.h tml Rob Schmitz Embarq Data Management 913-534-3474 rob.b.schmitz@embarq.com www.embarq.com -----Original Message----- From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of Tim Ertl Sent: Sunday, July 27, 2008 3:41 PM To: ids@iiug.org Subject: RE: ONPLADM , IPLOAD & ONPLOAD scripts [12915] Bob, I spent the day today using your utility to perform our conversion in 5 hours TOTAL without removing any data before hand. My previous attempt was estimated to be over 32hours. This was GREAT! Many Many thanks for your help! Tim Ertl 413-442-9000 x6211 -----Original Message----- From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of Schmitz, Rob B [EQ] Sent: Friday, July 25, 2008 12:20 PM To: ids@iiug.org Subject: RE: ONPLADM , IPLOAD & ONPLOAD scripts [12904] Tim, I have such a script. It is not intended to cover all situations, just those our group has run into. It serves our needs. You might be able to use it as is or you might be able to start with it and then modify going forward. The script is named hpl_create.ksh and it uses a text file named hpl_create.list. The hpl_create.list file has one line per table. Each line contains the name of the table, the number of devices (unload files), the letter e or d indicating express or deluxe mode, and the root name of the job and device(s). The job name will be the root name with "_job" tacked on the end and the device name will be the root name with "_dvc" tacked on the end. For example, mytab 12 e mytab Will create both a load and an unload job named mytab_job with 12 unload files defined by device name mytab_dvc. The jobs will use express mode. There are restrictions on using express mode (row size, extended data types, etc.) and the script performs a few rudimentary checks and may change an express specification to deluxe if needed. The script expects you to pass the instance name, the database name, and the path for the location of your unload files (device path). With all of our scripts, we source a script that sets our environment for a particular instance. Also, what we call an instance is essentially the extent name of the onconfig file and we use it for many things to identify an instance. It is different (usually shorter) than the INFORMIXSERVER value. The first time a job is created for a table with this script, you will see several errors related to the "delete job" lines in the script. As I say, this is a somewhat crude script that meets our needs and it has never been worth our time to make it squeaky clean. This script was not written to meet anyone's needs but our own; however, you may find some useful bits in it. (caveat lector) Here is the text of the script: ---------------------------------------------------------------------------- ------------- #!/usr/bin/ksh #--------------------------------------------------------------------------- ---- # hpl_create.ksh #@@NL

Jonathan Is this what you are looking for? http://www.iiug.org/forums/ids/index.cgi/noframes/read/13405 --- On Wed, 9/17/08, Jonathan Smaby <Jonathan.Smaby@pomona.edu> wrote: > From: Jonathan Smaby <Jonathan.Smaby@pomona.edu> > Subject: HPL to unload entire database? [13403] > To: ids@iiug.org > Date: Wednesday, September 17, 2008, 12:09 PM > Good morning, > > Because onunload only supports legacy data-types, I'm > looking to use the > HPL tool. The only problem is, I have to do this one table > at a time. > Done someone have a script they are will to share for the > high > performance loader to unload an entire DB, as well as > create the new DB > on a remote system and load all the tables? > > Thank-you in advance for any suggestions/scripts. > > Jonathan Smaby > > Pomona College > > ------------------------------------------------------------- > > This message has been scanned by Postini anti-virus > software. > > > ******************************************************************************* > > Forum Note: Use "Reply" to post a response in > the discussion forum.