Re: dbimport - 512MB RAM not enough?
Posted in 1998
Don Miller wrote:
> =
> Greetings, all:
> =
> I've run into a problem using dbimport to re-create a large existing
> database in a new dbspace on new disks - although the database unloaded=
> using dbexport just fine, every time I try to use dbimport, it complete=
s
> less than 10 %, and crashes when it fills up all the memory (at which
> point swap space is still available - it never seems to even try to use=
> it).
> =
> I have tried removing all the "create index" and "create unique index"
> statements from the import sql file (to be run after the data is loaded=
,
> on the theory that it'd have an easier time if it didn't have to index =
as
> it loaded) - it gets further, but not by much. I've also confirmed tha=
t
> all the sql is valid, by running the export-generated sql file manually=
> via dbaccess; it checks out fine - I get an empty database with the sam=
e
> structure as the one I'm trying to import.
> =
> Here are some particulars: This machine is running Informix Online 5.0=
2
> UC2, it's an RS/6000 machine running AIX 4.1.5, with 512MB RAM and ~ 14=
GB
> of disk space. *Yes - I know 5.02 is ancient - that's one of the reaso=
ns
> behind this rearrangement - getting things all "neatened up" before
> upgrading to 7...* The database I'm trying to import is ~ 1GB in size i=
n
> the unloaded form. In ordinary use, the machine (which is used primari=
ly
> for Informix) also seems to eat memory faster than it should; this
> phenomenon has been more apparent since it was "upgraded" from AIX 3.2.=
5 -
> at the same time, RAM was increased from 384MB. No changes were made t=
o
> tbconf at that time (see the portion of that attached below).
> =
> At the time I've tried to do this dbimport, I am the only user on the
> machine, and it has been freshly re-booted, and Informix restarted. I
> have always been attempting the import as user "informix".
> =
> I'd appreciate any help... e-mail replies would be especially nice.
> =
> Don Miller
> Network Operations
> JFK University
> <dmiller@jfku.edu>
> -------------------------
> Here are some possibly relevant excerpts from its tbconf file:
> =
> # Root Dbspace Configuration
> =
> ROOTNAME root # Root dbspace name
> ROOTPATH /usr/informix/dev/root.1> # Path for device containing root dbspa=
ce
> ROOTOFFSET 0 # Offset of root dbspace into device (K=
bytes)
> ROOTSIZE 716800 # Size of root dbspace (Kbytes)
> =
> # Disk Mirroring Configuration
> =
> MIRROR 1 # Mirroring flag (Yes =3D 1, No =3D 0)
> MIRRORPATH /usr/informix/dev/root.1-m
> # Path for device containing root dbspa=
ce mirror
> MIRROROFFSET 0 # Offset into mirror device (Kbytes)
> =
> # Physical Log Configuration
> =
> PHYSDBS root # Name of dbspace that contains physica=
l log
> PHYSFILE 122880 # Physical log file size (Kbytes)
> =
> # Logical Log Configuration
> =
> LOGFILES 30 # Number of logical log files
> LOGSIZE 12288 # Size of each logical log file (Kbytes=
)
> =
> # Shared Memory Parameters
> =
> RESIDENT 0 # Forced residency flag (Yes =3D 1, No =
=3D 0)> USERS 200 # Maximum number of concurrent user pro=
cesses
> TRANSACTIONS 200 # Maximum number of concurrent transact=
ions
> LOCKS 150000 # Maximum number of locks
> BUFFERS 1000 # Maximum number of shared memory buffe=rs
> TBLSPACES 2250 # Maximum number of active tblspaces
> CHUNKS 16 # Maximum number of chunks
> DBSPACES 8 # Maximum number of dbspaces and blobsp=
aces
> PHYSBUFF 32 # Size of physical log buffers (Kbytes)=
> LOGBUFF 32 # Size of logical log buffers (Kbytes)> LOGSMAX 60 # Maximum number of logical log files
> CLEANERS 3 # Number of page-cleaner processes
> SHMBASE 0x30000000 # Shared memory base address
> CKPTINTVL 300 # Checkpoint interval (in seconds)
> LRUS 8 # Number of LRU queues
> LRU_MAX_DIRTY 60 # LRU modified begin-cleaning limit (pe=
rcent)
> LRU_MIN_DIRTY 50 # LRU modified end-cleaning limit (perc=
ent)
> LTXHWM 80 # Long TX high-water mark (percent)
> LTXEHWM 90 # Long TX exclusive high-water mark (pe=
rcent)
> =
> # Machine- and Product-Specific Parameters
> =
> DYNSHMSZ 0 # Dynamic shared memory size (Kbytes)
> GTRID_CMP_SZ 32 # Number of bytes to use in GTRID compa=
rision
> DEADLOCK_TIMEOUT 60 # Max time to wait for lock in distrib=
uted env.
> TXTIMEOUT 300 # Transaction timeout for I-STAR (in se=
conds)> SPINCNT 0 # No. of times process tries for latch
> STAGEBLOB # Reserved for INFORMIX-OnLine/Optical
> =
> # System Page Size
> =
> BUFFSIZE 4096 # Page size (do not change!)
Just a question . Are you usings dbimport command with the "-d" option
and telling informix the dbspace in which you want your db , if you
don=B4t say one ( with -d option ) all go to rootdbs and perhaps in
rootdbs you don=F1t have enought space.