Re: dbimport - 512MB RAM not enough?

In article <Pine.SOL.3.94.1.980306234625.4323A-100000@jfku.edu>, Don Miller <dmiller@jfku.edu> writes > >Greetings, all: > >I've run into a problem using dbimport to re-create a large existing >database in a new dbspace on new disks - although the database unloaded >using dbexport just fine, every time I try to use dbimport, it completes >less than 10 %, and crashes when it fills up all the memory (at which >point swap space is still available - it never seems to even try to use >it). > Why do you think all of memory is used. Could it be you are running out of temp space? Try setting DBTEMP to point to a directory on a filesystem with lots of free space. >I have tried removing all the "create index" and "create unique index" >statements from the import sql file (to be run after the data is loaded, >on the theory that it'd have an easier time if it didn't have to index as >it loaded) - it gets further, but not by much. I've also confirmed that >all the sql is valid, by running the export-generated sql file manually >via dbaccess; it checks out fine - I get an empty database with the same >structure as the one I'm trying to import. > >Here are some particulars: This machine is running Informix Online 5.02 >UC2, it's an RS/6000 machine running AIX 4.1.5, with 512MB RAM and ~ 14 GB >of disk space. *Yes - I know 5.02 is ancient - that's one of the reasons >behind this rearrangement - getting things all "neatened up" before >upgrading to 7...* The database I'm trying to import is ~ 1GB in size in >the unloaded form. In ordinary use, the machine (which is used primarily >for Informix) also seems to eat memory faster than it should; this >phenomenon has been more apparent since it was "upgraded" from AIX 3.2.5 - >at the same time, RAM was increased from 384MB. No changes were made to >tbconf at that time (see the portion of that attached below). > >At the time I've tried to do this dbimport, I am the only user on the >machine, and it has been freshly re-booted, and Informix restarted. I >have always been attempting the import as user "informix". > >I'd appreciate any help... e-mail replies would be especially nice. > >Don Miller >Network Operations >JFK University ><dmiller@jfku.edu> >------------------------- >Here are some possibly relevant excerpts from its tbconf file: > ># Root Dbspace Configuration > >ROOTNAME root # Root dbspace name >ROOTPATH /usr/informix/dev/root.1> # Path for device containing root dbspace >ROOTOFFSET 0 # Offset of root dbspace into device (Kbytes) >ROOTSIZE 716800 # Size of root dbspace (Kbytes)> ># Disk Mirroring Configuration > >MIRROR 1 # Mirroring flag (Yes = 1, No = 0) >MIRRORPATH /usr/informix/dev/root.1-m > # Path for device containing root dbspace mirror >MIRROROFFSET 0 # Offset into mirror device (Kbytes)> ># Physical Log Configuration > >PHYSDBS root # Name of dbspace that contains physical log >PHYSFILE 122880 # Physical log file size (Kbytes)> ># Logical Log Configuration > >LOGFILES 30 # Number of logical log files >LOGSIZE 12288 # Size of each logical log file (Kbytes)> ># Shared Memory Parameters > >RESIDENT 0 # Forced residency flag (Yes = 1, No = 0)>USERS 200 # Maximum number of concurrent user processes >TRANSACTIONS 200 # Maximum number of concurrent transactions >LOCKS 150000 # Maximum number of locks >BUFFERS 1000 # Maximum number of shared memory buffers>TBLSPACES 2250 # Maximum number of active tblspaces >CHUNKS 16 # Maximum number of chunks >DBSPACES 8 # Maximum number of dbspaces and blobspaces >PHYSBUFF 32 # Size of physical log buffers (Kbytes) >LOGBUFF 32 # Size of logical log buffers (Kbytes)>LOGSMAX 60 # Maximum number of logical log files >CLEANERS 3 # Number of page-cleaner processes >SHMBASE 0x30000000 # Shared memory base address >CKPTINTVL 300 # Checkpoint interval (in seconds) >LRUS 8 # Number of LRU queues >LRU_MAX_DIRTY 60 # LRU modified begin-cleaning limit (percent) >LRU_MIN_DIRTY 50 # LRU modified end-cleaning limit (percent) >LTXHWM 80 # Long TX high-water mark (percent) >LTXEHWM 90 # Long TX exclusive high-water mark (percent)> ># Machine- and Product-Specific Parameters > >DYNSHMSZ 0 # Dynamic shared memory size (Kbytes) >GTRID_CMP_SZ 32 # Number of bytes to use in GTRID comparision >DEADLOCK_TIMEOUT 60 # Max time to wait for lock in distributed env. >TXTIMEOUT 300 # Transaction timeout for I-STAR (in seconds)>SPINCNT 0 # No. of times process tries for latch >STAGEBLOB # Reserved for INFORMIX-OnLine/Optical > ># System Page Size > >BUFFSIZE 4096 # Page size (do not change!) > > -- David Williams Maintainer of the Informix FAQ Primary site (Beta Version) http://www.smooth1.demon.co.uk Official site http://www.iiug.org/techinfo/faq/faq_top.html I see you standin', Standin' on your own, It's such a lonely place for you, For you to be If you need a shoulder, Or if you need a friend, I'll be here standing, Until the bitter end... So don't chastise me Or think I, I mean you harm... All I ever wanted Was for you To know that I care