Créer une sauvegarde ontape en multifichiers
Posted in 2024
Gerard Kuczynski's ontape level 0 backup to STDIO nearly filled its partition on Informix 12.10.FC11WE (Linux) and he asked about LTAPESIZE. Doug Lawry and Marcus Haarmann advised compressing via a pipe or BACKUP_FILTER/RESTORE_FILTER with gzip or pigz. Gerard got files 8 times smaller and planned to configure it. Art Kagel cited CPU overhead; David Williams suggested zstd.
Auto-generated by Claude from the posts below — may be imperfect; read the full thread.
Topics: Backup & Restore
Bonjour,
La sauvegarde actuelle par ontape -s -L 0 > toto -t STDIO me donne un fichier proche de la taille limite de la partition et donc un probleme en vue. Il ne m'est pas possible de modifier la taille de la partition sur ce serveur, seulement utiliser une autre partition en complément.
Je pensais modifier LTAPESIZE et le mettre à la valeur proche de la partition et aimerais obtenir un message pour préciser la 2eme partition. Je pourrais ainsi gérer les partitions par un script.
Apparemment, mes essais n'ont pas donné le résultat escompté.
Suis je sur la bonne piste pour les parametrages de ONTAPE ?
Bien cordialement
Gérard Kuczynski
------------------------------
Gerard Kuczynski
Développeur
------------------------------
Bonjour Gerard.
I am working from this Google Translate result:
"The current backup by ontape -s -L 0 > foo -t STDIO gives me a file close to the partition size limit and therefore a problem in sight. It is not possible for me to modify the size of the partition on this server, only use another partition in addition.
I was thinking of modifying LTAPESIZE and setting it to the value close to the partition and would like to get a message to specify the 2nd partition. I could thus manage the partitions by a script.
Apparently my attempts did not produce the expected result.
Am I on the right track for the ONTAPE settings?"
What Informix and operating system versions do you have? Is the limit in Informix, operating system, or file system? I will assume there is no simple fix like increasing "ulimit" or changing file system type.
You need to change TAPESIZE (archives) not LTAPESIZE (logical log backups).
Try piping to "split". Otherwise, you might need "expect" to answer prompts.
My reply via Google Translate:
"De quelles versions d'Informix et du système d'exploitation disposez-vous ? La limite est-elle dans Informix, le système d'exploitation ou le système de fichiers ? Je suppose qu'il n'existe pas de solution simple comme augmenter "ulimit" ou changer le type de système de fichiers.
Vous devez modifier TAPESIZE (archives) et non LTAPESIZE (sauvegardes de journaux logiques).
Essayez de canaliser pour "split". Sinon, vous devrez peut-être "expect" pour répondre aux invites."
Unlike emails, I see that the web site is translating everything into English for me anyway. I hope it's using French for you! Bonne journée! ------------------------------ Doug Lawry Oninit Consulting ------------------------------
Bonjour,
ontape via STDOUT can be compressed with a pipe, maybe this would be an easy solution in your case,
just pipe through gzip or something, just remember you need to to this for a restore as well (gunzip in this case).
If your you are on recent version, (which I assume since ontape to STDOUT is not present in very old versions) backup_filter / restore_filter should be supported, so should be able to
use a compressing filter such as pigz/unpigz or gzip/gunzip, resulting in smaller backup files (using that approach, you cannot forget about it when restoring). (gzip is slower as pigz, which runs multi-core)
Otherwise, perform a backup to a remote machine (which does not have the file size limitations,
I suppose you are on a very old machine with a 2GB limit for the filesize or something)
either by a pipe redirecting to ssh or by not performing a STDOUT backup but using the hostname:path syntax in TAPEDEV and call ontape without redirect.
https://help.hcl-software.com/hclinformix/1410/bar/ids_bar_524.html
First case:
ontape -s -L 0 -t STDIO | gzip > toto.gzSecond case:
ontape -s -L 0 -t STDIO | ssh host "cat > /path/toto"(you need to make sure machine can be accessed without password, if you are doing the backup
with a cron job, so a ssh setup with certificates is needed)
Third case:
TAPEDEV hostname:/path/toto
export DBREMOTECMD=ssh (requires working ssh access without password, by trusted certificates)
ontape -s -L 0should result in a remote backup, maybe to a Linux box which does not have the file size limitations
you can add the filters as well as described above in order to result in a smaller file size
BACKUP_FILTER /usr/bin/pigz
RESTORE_FILTER /usr/bin/unpigz
I agree: compression is also a good idea. I believe that ontape to STDIO was in IDS 10 but BACKUP_FILTER wasn't until IDS 11. We really need to know the version!
------------------------------
Doug Lawry
Oninit Consulting
------------------------------
Hello, Thanks to everybody. Informix version is 12.10.FC11WE on a linux suze 12. The partition becoming full cannot be increased as linked to a physical device. I will try a compression and let you know. The BACKUP_FILTER is included in ids 12. I will set it. The backup file is stored on the same server (the organization is defined by customer and cannot be changed now, and your idea to send directly to n other server can be heard in some months by customer!! Thanks for all, Gerard ------------------------------ gerard kuczynski ------------------------------
hello, i tried compression with gzip and obtained 8 times smaller file . So i will set backup and restore parameters in onconfig on the customer site. the previous dba has tried gzip but stoppedusing it. why? i dont find anything about that. Il will also discuss with customer to be able to send directly the backup on the other server. Thanks for all to every body. Best regards Gerard ------------------------------ gerard kuczynski ------------------------------
Usually the reason for giving up on using compression with the archives is the CPU overhead during the run. Art ------------------------------ Art S. Kagel, President and Principal Consultant ASK Database Management Corp. www.askdbmgt.com ------------------------------
If you are using pigz, and you have enough CPU power, you can use multithreaded option (compression should be faster) HTH Hrvoje ------------------------------ Hrvoje Zokovic ------------------------------
HI, Rather than pigz try zstd, could be 4x less cpu time! Regards, David. ------------------------------ David Williams ------------------------------