dbexport/dbimport
Posted in 2006
Topics: Migration, Import/Export & Data Conversion, Versions, Editions & End-of-Life, Jobs, Consulting & Announcements
HI,
I am using dbexport/dbimport to migrate db from IDS 9.4 to IDS10.
Two quesstions,
(1) Any tricks to improve the performacne?
(2) If dbimport exited by error( since I need manually modify some table
locations..), can we resume it from the exited point instead of losing a
couple hours?
Thanks,
Quman
We use AWK to modifiy the database sql file.
- For a migration from IDS7.31 to IDS10,
we planned to 'awk' the database.sql file before starting dbimport.
The awk loads an excel file in csv format with dbname, tablename, chunkname,
extentsize, nextextentsize.
Without a manually edit we change a lot in the sql file.
- We do plenty dbimport as try-out, can also run sql file without loading
tables, only creating empty tables and empty indexes as check of the
syuntax.
On D-day, stop production and migration is more comfortely.
Sell it as more rapidly, more accurate, minimalizing risks.
-----Original Message-----
From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org]
Sent: 10 July 2006 19:24
To: ids@iiug.org
Subject: dbexport/dbimport [7097]
HI,
I am using dbexport/dbimport to migrate db from IDS 9.4 to IDS10.
Two quesstions,
(1) Any tricks to improve the performacne?
(2) If dbimport exited by error( since I need manually modify some table
locations..), can we resume it from the exited point instead of losing a
couple hours?
Thanks,
Quman
****************************************************************************
***
Forum Note: Use "Reply" to post a response in the discussion forum.
*****DISCLAIMER*****
Dit bericht en alle bijhorende zijn uitsluitend bestemd voor de geadresseerde
en vertrouwelijk.
Indien dit bericht niet voor U bestemd is, gelieve dit dan te vernietigen en
de verzender te verwittigen.
Openbaring, vermenigvuldiging, verspreiding en verstrekking aan derden is niet
toegestaan, tenzij anders vermeld.
Aangezien internet de integriteit van dit bericht niet kan verzekeren, kan de
Dienst Vreemdelingenzaken niet verantwoordelijk gesteld worden indien dit
bericht gewijzigd is.
Bezoek onze website: http://www.dofi.fgov.be
----------------------------------------
*****DISCLAIMER*****
Ce message et toutes les pieces jointes sont etablis a l'intention exclusive
de ses destinataires et sont confidentiels.
Si vous recevez ce message par erreur, merci de le detruire et d'en avertir
l'expediteur.
Toute utilisation de ce message non conforme a sa destination, toute diffusion
ou toute publication, totale ou partielle, est interdite, sauf autorisation
expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, l'Office des
Etrangers decline toute responsabilite au titre de ce message, dans
l'hypothese ou il aurait ete modifie.
Visiter notre site web: http://www.dofi.fgov.be
I don't use dbexport/dbimport because i have many tables up to 200 milions
records, then i usually use
dbschema -d dbname -ss dbname.sqland use the query below to load/unload
---------------
--create_load.sql to create the sql to load data
output to load.sql without headings
select "load from " || trim(tabname) || ".unl",
" insert into " || tabname || ";"
from systables where tabid > 99 and tabtype = "T"
order by 1;
----------------
--create_unload.sql to create the sql to unload data
output to unload.sql without headings
select "unload to " || trim(tabname) || ".unl",
" select * from " || tabname || ";"
from systables where tabid > 99
order by 1;
--------------------
then I change the name of unload.sql to unload.sh and put the dbaccess sintax
to paralelize the mainly tables including the "set pdqpriority high" in large
table. or even changing the sintax of very large table to HPL jobs (unload and
laod), in this way i can save more than 10 hours of maintanance.
----------------------
--example of unload.sql generate by query
unload to table_large1.unl
select * from table_large1;
unload to t_retornodet.unl
select * from t_retornodet;
unload to t_retornodetobsrec.unl
select * from t_retornodetobsrec;
unload to t_semaforo.unl
select * from t_semaforo;
unload to t_terminais.unl
select * from t_terminais;
unload to t_tmpremdet.unl
select * from t_tmpremdet;
unload to t_tottrafego.unl
select * from t_tottrafego;
unload to t_tracking.unl
select * from t_tracking;----------------------
--example of unload.sh
nohup dbaccess t98db98 <<EOF &
set pdqpriority high;
unload to table_large1.unl
select * from table_large1;EOF
nohup dbaccess t98db98 <<EOF &
set pdqpriority high;
unload to t_retornodet.unl
select * from t_retornodet;EOF
nohup dbaccess t98db98 <<EOF &
unload to t_retornodetobsrec.unl
select * from t_retornodetobsrec;
unload to t_semaforo.unl
select * from t_semaforo;
unload to t_terminais.unl
select * from t_terminais;
unload to t_tmpremdet.unl
select * from t_tmpremdet;
unload to t_tottrafego.unl
select * from t_tottrafego;
unload to t_tracking.unl
select * from t_tracking;EOF
I hope it can help you, as much as it helps me.
Celso Coimbra
ClearTech Ltda
"Unlock your revenue"
NOVO Tel: (019) 2104-4509
E-mail: ccoimbra@cleartech.com.br
-----Mensagem original-----
De: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org]Em nome de Support
Inf....
Enviada em: terça-feira, 11 de julho de 2006 02:52
Para: ids@iiug.org
Assunto: RE: dbexport/dbimport [7104]
We use AWK to modifiy the database sql file.
- For a migration from IDS7.31 to IDS10,
we planned to 'awk' the database.sql file before starting dbimport.
The awk loads an excel file in csv format with dbname, tablename, chunkname,
extentsize, nextextentsize.
Without a manually edit we change a lot in the sql file.
- We do plenty dbimport as try-out, can also run sql file without loading
tables, only creating empty tables and empty indexes as check of the
syuntax.
On D-day, stop production and migration is more comfortely.
Sell it as more rapidly, more accurate, minimalizing risks.
-----Original Message-----
From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org]
Sent: 10 July 2006 19:24
To: ids@iiug.org
Subject: dbexport/dbimport [7097]
HI,
I am using dbexport/dbimport to migrate db from IDS 9.4 to IDS10.
Two quesstions,
(1) Any tricks to improve the performacne?
(2) If dbimport exited by error( since I need manually modify some table
locations..), can we resume it from the exited point instead of losing a
couple hours?
Thanks,
Quman
****************************************************************************
***
Forum Note: Use "Reply" to post a response in the discussion forum.
*****DISCLAIMER*****
Dit bericht en alle bijhorende zijn uitsluitend bestemd voor de geadresseerde
en vertrouwelijk.
Indien dit bericht niet voor U bestemd is, gelieve dit dan te vernietigen en
de verzender te verwittigen.
Openbaring, vermenigvuldiging, verspreiding en verstrekking aan derden is niet
toegestaan, tenzij anders vermeld.
Aangezien internet de integriteit van dit bericht niet kan verzekeren, kan de
Dienst Vreemdelingenzaken niet verantwoordelijk gesteld worden indien dit
bericht gewijzigd is.
Bezoek onze website: http://www.dofi.fgov.be
----------------------------------------
*****DISCLAIMER*****
Ce message et toutes les pieces jointes sont etablis a l'intention exclusive
de ses destinataires et sont confidentiels.
Si vous recevez ce message par erreur, merci de le detruire et d'en avertir
l'expediteur.
Toute utilisation de ce message non conforme a sa destination, toute diffusion
ou toute publication, totale ou partielle, est interdite, sauf autorisation
expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, l'Office des
Etrangers decline toute responsabilite au titre de ce message, dans
l'hypothese ou il aurait ete modifie.
Visiter notre site web: http://www.dofi.fgov.be
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.
Try my dbexport/dbimport replacement utility package, myexport. It will do
everything that dbexport/dbimport can do except work directly with tape. It is
fully compatible with dbimport and dbexport (ie a myexport data set can be
dbimported and vice-versa) but since it uses Jonathan Leffler's sqlcmd package
or the HPLoader (using S. R. Krishna's myonpload package) to extract and
restore
data it uses far fewer resources than dbimport/dbexport and is capable of
parallel exports and imports. Note that using myexport also requires the
packages utils2_ak and either or both of sqlcmd and myonpload.
A new release is being uploaded shortly that implements HPLoader imports
(HPLoader exports were already supported).
Art S. Kagel
----- Original Message -----
From: Support Inf.... <ids@iiug.org>
At: 7/11 1:57:10
We use AWK to modifiy the database sql file.
- For a migration from IDS7.31 to IDS10,
we planned to 'awk' the database.sql file before starting dbimport.
The awk loads an excel file in csv format with dbname, tablename, chunkname,
extentsize, nextextentsize.
Without a manually edit we change a lot in the sql file.
- We do plenty dbimport as try-out, can also run sql file without loading
tables, only creating empty tables and empty indexes as check of the
syuntax.
On D-day, stop production and migration is more comfortely.
Sell it as more rapidly, more accurate, minimalizing risks.
-----Original Message-----
From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org]
Sent: 10 July 2006 19:24
To: ids@iiug.org
Subject: dbexport/dbimport [7097]
HI,
I am using dbexport/dbimport to migrate db from IDS 9.4 to IDS10.
Two quesstions,
(1) Any tricks to improve the performacne?
(2) If dbimport exited by error( since I need manually modify some table
locations..), can we resume it from the exited point instead of losing a
couple hours?
Thanks,
Quman
****************************************************************************
***
Forum Note: Use "Reply" to post a response in the discussion forum.
*****DISCLAIMER*****
Dit bericht en alle bijhorende zijn uitsluitend bestemd voor de geadresseerde
en vertrouwelijk.
Indien dit bericht niet voor U bestemd is, gelieve dit dan te vernietigen en
de verzender te verwittigen.
Openbaring, vermenigvuldiging, verspreiding en verstrekking aan derden is niet
toegestaan, tenzij anders vermeld.
Aangezien internet de integriteit van dit bericht niet kan verzekeren, kan de
Dienst Vreemdelingenzaken niet verantwoordelijk gesteld worden indien dit
bericht gewijzigd is.
Bezoek onze website: http://www.dofi.fgov.be
----------------------------------------
*****DISCLAIMER*****
Ce message et toutes les pieces jointes sont etablis a l'intention exclusive
de ses destinataires et sont confidentiels.
Si vous recevez ce message par erreur, merci de le detruire et d'en avertir
l'expediteur.
Toute utilisation de ce message non conforme a sa destination, toute diffusion
ou toute publication, totale ou partielle, est interdite, sauf autorisation
expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, l'Office des
Etrangers decline toute responsabilite au titre de ce message, dans
l'hypothese ou il aurait ete modifie.
Visiter notre site web: http://www.dofi.fgov.be
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.