dbimport - 512MB RAM not enough?
Posted in 1998
Topics: Installation, Setup & Upgrades, Storage & Space Management, Server Administration, Transactions, Locking & Isolation, Logging & Checkpoints, Migration, Import/Export & Data Conversion, Platform-Specific Issues
Greetings, all:
I've run into a problem using dbimport to re-create a large existing
database in a new dbspace on new disks - although the database unloaded
using dbexport just fine, every time I try to use dbimport, it completes
less than 10 %, and crashes when it fills up all the memory (at which
point swap space is still available - it never seems to even try to use
it).
I have tried removing all the "create index" and "create unique index"
statements from the import sql file (to be run after the data is loaded,
on the theory that it'd have an easier time if it didn't have to index as
it loaded) - it gets further, but not by much. I've also confirmed that
all the sql is valid, by running the export-generated sql file manually
via dbaccess; it checks out fine - I get an empty database with the same
structure as the one I'm trying to import.
Here are some particulars: This machine is running Informix Online 5.02
UC2, it's an RS/6000 machine running AIX 4.1.5, with 512MB RAM and ~ 14 GB
of disk space. *Yes - I know 5.02 is ancient - that's one of the reasons
behind this rearrangement - getting things all "neatened up" before
upgrading to 7...* The database I'm trying to import is ~ 1GB in size in
the unloaded form. In ordinary use, the machine (which is used primarily
for Informix) also seems to eat memory faster than it should; this
phenomenon has been more apparent since it was "upgraded" from AIX 3.2.5 -
at the same time, RAM was increased from 384MB. No changes were made to
tbconf at that time (see the portion of that attached below).
At the time I've tried to do this dbimport, I am the only user on the
machine, and it has been freshly re-booted, and Informix restarted. I
have always been attempting the import as user "informix".
I'd appreciate any help... e-mail replies would be especially nice.
Don Miller
Network Operations
JFK University
<dmiller@jfku.edu>
-------------------------
Here are some possibly relevant excerpts from its tbconf file:
# Root Dbspace Configuration
ROOTNAME root # Root dbspace name
ROOTPATH /usr/informix/dev/root.1 # Path for device containing root dbspace
ROOTOFFSET 0 # Offset of root dbspace into device (Kbytes)
ROOTSIZE 716800 # Size of root dbspace (Kbytes)
# Disk Mirroring Configuration
MIRROR 1 # Mirroring flag (Yes = 1, No = 0)
MIRRORPATH /usr/informix/dev/root.1-m
# Path for device containing root dbspace mirror
MIRROROFFSET 0 # Offset into mirror device (Kbytes)
# Physical Log Configuration
PHYSDBS root # Name of dbspace that contains physical log
PHYSFILE 122880 # Physical log file size (Kbytes)
# Logical Log Configuration
LOGFILES 30 # Number of logical log files
LOGSIZE 12288 # Size of each logical log file (Kbytes)
# Shared Memory Parameters
RESIDENT 0 # Forced residency flag (Yes = 1, No = 0)USERS 200 # Maximum number of concurrent user processes
TRANSACTIONS 200 # Maximum number of concurrent transactions
LOCKS 150000 # Maximum number of locks
BUFFERS 1000 # Maximum number of shared memory buffersTBLSPACES 2250 # Maximum number of active tblspaces
CHUNKS 16 # Maximum number of chunks
DBSPACES 8 # Maximum number of dbspaces and blobspaces
PHYSBUFF 32 # Size of physical log buffers (Kbytes)
LOGBUFF 32 # Size of logical log buffers (Kbytes)LOGSMAX 60 # Maximum number of logical log files
CLEANERS 3 # Number of page-cleaner processes
SHMBASE 0x30000000 # Shared memory base address
CKPTINTVL 300 # Checkpoint interval (in seconds)
LRUS 8 # Number of LRU queues
LRU_MAX_DIRTY 60 # LRU modified begin-cleaning limit (percent)
LRU_MIN_DIRTY 50 # LRU modified end-cleaning limit (percent)
LTXHWM 80 # Long TX high-water mark (percent)
LTXEHWM 90 # Long TX exclusive high-water mark (percent)
# Machine- and Product-Specific Parameters
DYNSHMSZ 0 # Dynamic shared memory size (Kbytes)
GTRID_CMP_SZ 32 # Number of bytes to use in GTRID comparision
DEADLOCK_TIMEOUT 60 # Max time to wait for lock in distributed env.
TXTIMEOUT 300 # Transaction timeout for I-STAR (in seconds)SPINCNT 0 # No. of times process tries for latch
STAGEBLOB # Reserved for INFORMIX-OnLine/Optical
# System Page Size
BUFFSIZE 4096 # Page size (do not change!)