Re: unloading a table
Posted in 2000
Topics: Storage & Space Management, Stored Procedures & SPL, Server Administration, Migration, Import/Export & Data Conversion, Platform-Specific Issues
David,
Run ls -l and check the size of file you are trying to unload. It should be
around 2GB. This means that your operating system does not support a single
file size more than 2GB. Try splitting your unload statement by putting some
where condition on date or column so that the single file will not exceed
2GB limit.
>From: David Kulkarni <dnk61@yahoo.com>
>To: informix-list@iiug.org
>Subject: unloading a table
>Date: Mon, 14 Aug 2000 14:33:26 -0700 (PDT)
>
>On Informix ver. 5.10UC5 (OS HP-UX 10.20)
>
>I am trying to unload a table that has 24570444 rows but it keeps failing
>giving me the following
>error message:
>
>Write failed. 16794517 rows unloaded (check ulimit or disk space).
>
>I have a filesystem with 18 gigs of space so I know that space is not a
>problem. What is ulimit?
>Is this a parameter that I have to set for tables over 2GiGs in size. The
>statement I am
>executing is as follows:
>
>unload to cost.unl select * from cost;>
>dbaccess -e son_db unload.sql > unload.out>
>Can anybody tell me where I am going wrong here.
>
>TIA
>
>=====
>David Kulkarni
>New York, NY 10021
>email: dkulkarni@cgsh.com
>
>__________________________________________________
>Do You Yahoo!?
>Yahoo! Mail ' Free email you can access from anywhere!
>http://mail.yahoo.com/
________________________________________________________________________
Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com
David,
ulimit is a kernel environment from the operating system you are
using. If I am not mistaken this parameter is defined per user. You may
indeed be reaching the maximum 2GB file size that your Operating System
allows or you may only have to increase the ulimit parameter for your
user.
In article <8na3t4$9u8$1@news.xmission.com>,
"Prasad Mahale" <gs0528@hotmail.com> wrote:
>
> David,
> Run ls -l and check the size of file you are trying to unload. It
should be
> around 2GB. This means that your operating system does not support a
single
> file size more than 2GB. Try splitting your unload statement by
putting some
> where condition on date or column so that the single file will not
exceed
> 2GB limit.
>
> >From: David Kulkarni <dnk61@yahoo.com>
> >To: informix-list@iiug.org
> >Subject: unloading a table
> >Date: Mon, 14 Aug 2000 14:33:26 -0700 (PDT)
> >
> >On Informix ver. 5.10UC5 (OS HP-UX 10.20)
> >
> >I am trying to unload a table that has 24570444 rows but it keeps
failing
> >giving me the following
> >error message:
> >
> >Write failed. 16794517 rows unloaded (check ulimit or disk space).
> >
> >I have a filesystem with 18 gigs of space so I know that space is not
a
> >problem. What is ulimit?
> >Is this a parameter that I have to set for tables over 2GiGs in size.
The
> >statement I am
> >executing is as follows:
> >
> >unload to cost.unl select * from cost;> >
> >dbaccess -e son_db unload.sql > unload.out> >
> >Can anybody tell me where I am going wrong here.
> >
> >TIA
> >
> >=====
> >David Kulkarni
> >New York, NY 10021
> >email: dkulkarni@cgsh.com
> >
> >__________________________________________________
> >Do You Yahoo!?
> >Yahoo! Mail ' Free email you can access from anywhere!
> >http://mail.yahoo.com/
>
>
________________________________________________________________________
> Get Your Private, Free E-mail from MSN Hotmail at
http://www.hotmail.com
>
>
Sent via Deja.com http://www.deja.com/
Before you buy.
You can configure the High Performance loader to unload into multiple
files or write a program that will select and insert then delete the
row and commit after 1000 rows and then run multiple sessions. This way
you will get a pseudo parallelism.
Vishal
In article <8na3t4$9u8$1@news.xmission.com>,
"Prasad Mahale" <gs0528@hotmail.com> wrote:
>
> David,
> Run ls -l and check the size of file you are trying to unload. It
should be
> around 2GB. This means that your operating system does not support a
single
> file size more than 2GB. Try splitting your unload statement by
putting some
> where condition on date or column so that the single file will not
exceed
> 2GB limit.
>
> >From: David Kulkarni <dnk61@yahoo.com>
> >To: informix-list@iiug.org
> >Subject: unloading a table
> >Date: Mon, 14 Aug 2000 14:33:26 -0700 (PDT)
> >
> >On Informix ver. 5.10UC5 (OS HP-UX 10.20)
> >
> >I am trying to unload a table that has 24570444 rows but it keeps
failing
> >giving me the following
> >error message:
> >
> >Write failed. 16794517 rows unloaded (check ulimit or disk space).
> >
> >I have a filesystem with 18 gigs of space so I know that space is
not a
> >problem. What is ulimit?
> >Is this a parameter that I have to set for tables over 2GiGs in
size. The
> >statement I am
> >executing is as follows:
> >
> >unload to cost.unl select * from cost;> >
> >dbaccess -e son_db unload.sql > unload.out> >
> >Can anybody tell me where I am going wrong here.
> >
> >TIA
> >
> >=====
> >David Kulkarni
> >New York, NY 10021
> >email: dkulkarni@cgsh.com
> >
> >__________________________________________________
> >Do You Yahoo!?
> >Yahoo! Mail ' Free email you can access from anywhere!
> >http://mail.yahoo.com/
>
>
________________________________________________________________________
> Get Your Private, Free E-mail from MSN Hotmail at
http://www.hotmail.com
>
>
Sent via Deja.com http://www.deja.com/
Before you buy.
bullmkt123@my-deja.com wrote:
> You can configure the High Performance loader to unload into multiple
> files or write a program that will select and insert then delete the
> row and commit after 1000 rows and then run multiple sessions. This way
> you will get a pseudo parallelism.
>
> Vishal
Hi,
Thank you for your help, but... how could I do this ?
I've still not found anything !
We soulved our problem by creating the same table as I want to unload but
I add a fragment.
Then I run a "insert into new_fragmented_table select * from old_table
That does the trick, but require a 32Mo table.
I would really like to know how I can make IPLoad to unload 1 million rows
per output file.
Just for remind you : I can't use rowid's, and I can't do multiple select
based on what is in the table...
If you know the answer, you could get rich as even the french Informix
support does not know !!
:)
It seems they never saw a 32Gbs table... (which is the limit on solaris for
a non fragmented table).
Cheers,
>
>
> In article <8na3t4$9u8$1@news.xmission.com>,
> "Prasad Mahale" <gs0528@hotmail.com> wrote:
> >
> > David,
> > Run ls -l and check the size of file you are trying to unload. It
> should be
> > around 2GB. This means that your operating system does not support a
> single
> > file size more than 2GB. Try splitting your unload statement by
> putting some
> > where condition on date or column so that the single file will not
> exceed
> > 2GB limit.
> >
> > >From: David Kulkarni <dnk61@yahoo.com>
> > >To: informix-list@iiug.org
> > >Subject: unloading a table
> > >Date: Mon, 14 Aug 2000 14:33:26 -0700 (PDT)
> > >
> > >On Informix ver. 5.10UC5 (OS HP-UX 10.20)
> > >
> > >I am trying to unload a table that has 24570444 rows but it keeps
> failing
> > >giving me the following
> > >error message:
> > >
> > >Write failed. 16794517 rows unloaded (check ulimit or disk space).
> > >
> > >I have a filesystem with 18 gigs of space so I know that space is
> not a
> > >problem. What is ulimit?
> > >Is this a parameter that I have to set for tables over 2GiGs in
> size. The
> > >statement I am
> > >executing is as follows:
> > >
> > >unload to cost.unl select * from cost;> > >
> > >dbaccess -e son_db unload.sql > unload.out> > >
> > >Can anybody tell me where I am going wrong here.
> > >
> > >TIA
> > >
> > >=====
> > >David Kulkarni
> > >New York, NY 10021
> > >email: dkulkarni@cgsh.com
> > >
> > >__________________________________________________
> > >Do You Yahoo!?
> > >Yahoo! Mail - Free email you can access from anywhere!
> > >http://mail.yahoo.com/
> >
> >
> ________________________________________________________________________
> > Get Your Private, Free E-mail from MSN Hotmail at
> http://www.hotmail.com
> >
> >
>
> Sent via Deja.com http://www.deja.com/
> Before you buy.
--
_______________________________________________
Sebastien THOMAS none networks
System Engineer freesbee
geo:153, rue Saint-Denis, 75002 Paris, France
vox:+33 1 45 08 23 10 - fax:+33 1 45 08 25 29
mailto:sebastien.thomas@none.net