IDS 9.21 Backup/Recover strat with HDR

Posted in 2005

Summary

A DBA running IDS 9.21 on Solaris with HDR needed to move backups from a retiring, unsupported Legato tape setup to disk, and asked whether to keep ON-Bar (with ISM) or switch to ontape, with minimal downtime and no test system. Replies suggested building a small second instance/HDR pair to test, and outlined the trade-offs: ON-Bar is parallel and unattended but needs a storage manager (ISM can't do remote restores, forcing an 'imported restore' for the secondary), while ontape is simpler to transfer to the secondary but serial and hit by the 2GB file limit. One poster described a working ontape-to-disk setup using ALARMPROGRAM scripts plus 'expect' to automate log backups and renaming, with archives ftp'd to the secondary for 'ontape -p'. The poster said she would pursue expect and a test box; no final outcome is recorded.

Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.

Topics: High Availability & Replication, Backup & Restore, Storage & Space Management, Server Administration, Logging & Checkpoints, Versions, Editions & End-of-Life

TANYA GALLEGOS — Thu, 30 Jun 2005 22:08:18 — source: IIUG Forums & Mailing Lists

I have IDS 2000 9.21.UC4 running on SUNOS 5.8. I'm using HDR, currently have onbar running for nightly level 0 archive and logical log backups. Its writing to a small unsupported Legatto tape drive. I need to change the Backup and Recovery strategy from tape to disk and am looking for the best/easiest transition. I have disk space now, but not sure if it will be better to switch to ontape or stay with onbar and use ISM. I have limited down time, no test system and need to be sure I can back out if necessary. We're working on scripts to break the archive into 2 gig files and an alarmprogram script. I believe I need to change the tapedev and ltapedev parameters and utilize the ISM parameters in both onconfig files. Short down time required. If anyone has some advice or direction it would be greatly appreciated.

↪ replying to TANYA GALLEGOS

Support Informix — Fri, 01 Jul 2005 06:07:29 — source: IIUG Forums & Mailing Lists

You have disk space now. Can't you configure a second little informixserver instance on another onconfig file and use it to test the backups ? This would be more confortable for you. Yves -----Original Message----- From: nobody@ace.iiug.org [mailto:nobody@ace.iiug.org] Sent: 01 July 2005 00:08 To: ids@iiug.org Subject: IDS 9.21 Backup/Recover strat with HDR [5321] I have IDS 2000 9.21.UC4 running on SUNOS 5.8. I'm using HDR, currently have onbar running for nightly level 0 archive and logical log backups. Its writing to a small unsupported Legatto tape drive. I need to change the Backup and Recovery strategy from tape to disk and am looking for the best/easiest transition. I have disk space now, but not sure if it will be better to switch to ontape or stay with onbar and use ISM. I have limited down time, no test system and need to be sure I can back out if necessary. We're working on scripts to break the archive into 2 gig files and an alarmprogram script. I believe I need to change the tapedev and ltapedev parameters and utilize the ISM parameters in both onconfig files. Short down time required. If anyone has some advice or direction it would be greatly appreciated. ------_=_NextPart_001_01C57E02.E0167650 Content-Type: text/html Content-Transfer-Encoding: quoted-printable <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN"> <HTML> <HEAD> <META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; = charset=3Dus-ascii"> <META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version = 5.5.2653.12"> <TITLE>RE: IDS 9.21 Backup/Recover strat with HDR [5321] </TITLE> </HEAD> <BODY> You have disk space now. Can't you configure a second little informixserver = instance on another onconfig file and use it to test the backups = ? This would be more confortable for you. Yves -----Original Message----- From: nobody@ace.iiug.org [<A = HREF=3D"mailto:nobody@ace.iiug.org">mailto:nobody@ace.iiug.org</A>] = Sent: 01 July 2005 00:08 To: ids@iiug.org Subject: IDS 9.21 Backup/Recover strat with HDR = [5321] I have IDS 2000 9.21.UC4 running on SUNOS 5.8.  = I'm using HDR, currently have onbar running for nightly level 0 archive = and logical log backups.  Its writing to a small unsupported = Legatto tape drive. I need to change the Backup and Recovery strategy = from tape to disk and am looking for the best/easiest = transition. I have disk space now, but not sure if it will be = better to switch to ontape or stay with onbar and use ISM. I have limited down time, no test system and need to = be sure I can back out if necessary. We're working on scripts to break the archive into 2 = gig files and an alarmprogram script. I believe I need to change the tapedev and ltapedev = parameters and utilize the ISM parameters in both onconfig files.  = Short down time required. If anyone has some advice or direction it would be = greatly appreciated. </BODY> </HTML> ------_=_NextPart_001_01C57E02.E0167650--

↪ replying to TANYA GALLEGOS

Tanya Gallegos — Fri, 01 Jul 2005 17:51:38 — source: IIUG Forums & Mailing Lists

Thank you for such quick responses. I would like to upgrade Informix but have no say in the decision. The current storage manager is Legato which is unsupported at our level and is being retired. Also because there is no staff to mount tapes at its location. I inherited this system about a year ago, I have a manual procedure to resync the secondary by faking it out to believe its the primary, then legato would use the level 0 and log files and HDR would finish the resync from the buffers. I would feel more comfortable staying with onbar where I know the procedure works, but am not sure of all the parameters needed to change from tape to disk. The onconfig on both servers have the tapedev and ltapedev hardcoded with the legato drives, I hoped all I needed to change were those parameters to point to a file on the server in my backup directory, use scripts to break the archive into 2 gig files and write the logical logs. If a resync was necessary I could ftp the files to the secondary to do the restore. It doesn't sound like it will be as easy as that. Legato will be removed from the server so I need to find another storage manager. TSM will be used to backup the filesystems, it's possible I can install sqlbacktrack to work with onbar. I haven't done that before but I heard it can be done. I'm trying to setup a test instance(standalone) but am having little success. I don't have access to the original software and key to do a fresh install. I have dbas helping with the scripts but don't have a place to test. Without a 2 server hdr test system, I wouldn't be able to do a legit test anyway. I'm a little nervous about putting it on production on the fly. Tanya Gallegos IBM Global Services - Qwest Production DBA (801) 237-6547 tgalleg@us.ibm.com Martin Fuerderer <MARTINFU@de.ibm.com> 07/01/2005 07:14 AM To Tanya Gallegos/Salt Lake City/IBM@IBMUS cc forum.subscriber@iiug.org, ids@iiug.org Subject Re: IDS 9.21 Backup/Recover strat with HDR [5321] Hi, since you now use ON-Bar, with which storage manager do you use it ? - ON-Bar: - can do backup and restore in parallel, which generally will be faster than serial ontape. - can work unattended, especially helpful for log backup. - you have to use a storage manager. - you can use ISM, but it doesn't do remote operation, so restore for secondary (HDR) will be "imported restore" which is somewhat complicated. - ontape: - no storage manager needed. - transfer of backup to secondary and restore is simple. - only serial operation, nothing is parallel. - continuous log backup with ontape will (periodically) halt and require user interactivity to change tapes (LTAPEDEV). - 2 GB limit for files may hit you (I see you're already aware of this). - changes necessary: - switching from current ON-Bar to ontape: - you probably backup the logs via ALARMPROGRAM and ON-Bar (now), so you should change ALARMPROGRAM parameter in onconfig file (e.g. from .../log_full.sh to .../no_log.sh). This change will require a server restart, but not a long down time. - alternatively you can directly edit the shell script currently configured in ALARMPROGRAM. This can be done without server down time. Though eventually you should change ALARMPROGRAM to reflect the reality, but that can be done during some other, planned down time. - LTAPE... and TAPE... onconfig parameters are mainly used by ontape only. The only significant value for the server is, whether LTAPEDEV is "/dev/null" or not. Since you do not have "/dev/null" now, you can change LTAPEDEV to any value (other than "/dev/null") without effect on server. That means LTAPE... and TAPE... parameters can be changed without requiring server down time. - switching ON-Bar from backup to tape to backup to disk: - I've not done this particular thing before, but I think it will require changes in storage manager only. Therefore no server down time should be required. Hopefully this gives you some ideas. As already recommended by others, I strongly advice to test things, possibly with a small HDR pair of test instances. Include the restore for secondary in your tests, so you get a good picture (and a step-by-step procedure) of how to do that in your particular environment. Regards, Martin -- forum.subscriber@iiug.org wrote on 01.07.2005 00:08:22: > I have IDS 2000 9.21.UC4 running on SUNOS 5.8. I'm using HDR, currently have onbar running for nightly > level 0 archive and logical log backups. Its writing to a small unsupported Legatto tape drive. > > I need to change the Backup and Recovery strategy from tape to disk and am looking for the best/easiest transition. > I have disk space now, but not sure if it will be better to switch to ontape or stay with onbar and use ISM. > I have limited down time, no test system and need to be sure I can back out if necessary. > > We're working on scripts to break the archive into 2 gig files and > an alarmprogram script. > I believe I need to change the tapedev and ltapedev parameters and utilize the ISM parameters in both onconfig > files. Short down time required. > > If anyone has some advice or direction it would be greatly appreciated.

↪ replying to Tanya Gallegos

mosserp@wellsfargo.com — Fri, 01 Jul 2005 22:42:44 — source: IIUG Forums & Mailing Lists

> -----Original Message----- > From: forum.subscriber@iiug.org > [mailto:forum.subscriber@iiug.org] On Behalf Of Tanya Gallegos > Sent: Friday, July 01, 2005 10:52 AM > To: ids@iiug.org > Subject: Re: IDS 9.21 Backup/Recover strat with HDR [5338] > > Thank you for such quick responses. > > I would like to upgrade Informix but have no say in the decision. The > current storage manager is Legato which is unsupported at our > level and is > being retired. Also because there is no staff to mount tapes at its > location. > I inherited this system about a year ago, I have a manual > procedure to > resync the secondary by faking it out to believe its the > primary, then > legato would use the level 0 and log files and HDR would > finish the resync > from the buffers. > > I would feel more comfortable staying with onbar where I know the > procedure works, but am not sure of all the parameters needed > to change > from tape to disk. > The onconfig on both servers have the tapedev and ltapedev > hardcoded with > the legato drives, I hoped all I needed to change were those > parameters > to point to a file on the server in my backup directory, use > scripts to > break the archive into 2 gig files and write the logical logs. > If a resync was necessary I could ftp the files to the > secondary to do the > restore. It doesn't sound like it will be as easy as that. > > Legato will be removed from the server so I need to find > another storage > manager. TSM will be used to backup the filesystems, it's > possible I can > install sqlbacktrack to work with onbar. I haven't done that > before but I > heard it can be done. > > I'm trying to setup a test instance(standalone) but am having little > success. I don't have access to the original software and > key to do a > fresh install. > I have dbas helping with the scripts but don't have a place to test. > Without a 2 server hdr test system, I wouldn't be able to do > a legit test > anyway. > I'm a little nervous about putting it on production on the fly. > > > Tanya Gallegos > IBM Global Services - Qwest > Production DBA > (801) 237-6547 > tgalleg@us.ibm.com << snipped >> Tanya, We have been using HDR for quite awhile, for very critical applications, and our archives *and* logbackups are to disk, using ontape. We did check into onbar some time ago, and decided that it would be much simpler, for HDR servers, to stay with ontape. To get around the 2Gb limit, we have used (and are still using) a software package called "expect". The logbackups are handled unattended via the ALARMPROGRAM, which simply calls a little script that does an 'ontape -a' to back up the just-completed log, and then renames the logbackup file (identified by LTAPEDEV) to a date-stamped file. Archive files and logbackup files are picked up daily via NetBackup. Whenever HDR needs to be re-established from scratch (physical restore on secondary), we simply transfer the archive files via ftp, rcp, or scp. We have even automated this transfer process. If you can get ahold of "expect" and get it installed on your machine, I can provide the ksh and expect scripts that we use to do archives, logbackups, and even the physical restore (ontape -p) that needs to be done on the secondary server to get HDR going. HTH, Paul Mosser

↪ replying to Tanya Gallegos

Tanya Gallegos — Thu, 07 Jul 2005 19:43:37 — source: IIUG Forums & Mailing Lists

Thank you, this helps alot. It looks like expect may be a freeware software, I'll have to see if I can get it on our software approved list. My company is now looking for a test system for me to use, I won't have all the bells and whistles or replication but its a start. I'll check into expect a little more and see what we need. Thanks again, I'll let you know if I can get it setup. Tanya Gallegos IBM Global Services - Qwest Production DBA (801) 237-6547 tgalleg@us.ibm.com <mosserp@wellsfargo.com> 07/01/2005 04:36 PM To <ids@iiug.org> cc Tanya Gallegos/Salt Lake City/IBM@IBMUS Subject RE: IDS 9.21 Backup/Recover strat with HDR [5338] > -----Original Message----- > From: forum.subscriber@iiug.org > [mailto:forum.subscriber@iiug.org] On Behalf Of Tanya Gallegos > Sent: Friday, July 01, 2005 10:52 AM > To: ids@iiug.org > Subject: Re: IDS 9.21 Backup/Recover strat with HDR [5338] > > Thank you for such quick responses. > > I would like to upgrade Informix but have no say in the decision. The > current storage manager is Legato which is unsupported at our > level and is > being retired. Also because there is no staff to mount tapes at its > location. > I inherited this system about a year ago, I have a manual > procedure to > resync the secondary by faking it out to believe its the > primary, then > legato would use the level 0 and log files and HDR would > finish the resync > from the buffers. > > I would feel more comfortable staying with onbar where I know the > procedure works, but am not sure of all the parameters needed > to change > from tape to disk. > The onconfig on both servers have the tapedev and ltapedev > hardcoded with > the legato drives, I hoped all I needed to change were those > parameters > to point to a file on the server in my backup directory, use > scripts to > break the archive into 2 gig files and write the logical logs. > If a resync was necessary I could ftp the files to the > secondary to do the > restore. It doesn't sound like it will be as easy as that. > > Legato will be removed from the server so I need to find > another storage > manager. TSM will be used to backup the filesystems, it's > possible I can > install sqlbacktrack to work with onbar. I haven't done that > before but I > heard it can be done. > > I'm trying to setup a test instance(standalone) but am having little > success. I don't have access to the original software and > key to do a > fresh install. > I have dbas helping with the scripts but don't have a place to test. > Without a 2 server hdr test system, I wouldn't be able to do > a legit test > anyway. > I'm a little nervous about putting it on production on the fly. > > > Tanya Gallegos > IBM Global Services - Qwest > Production DBA > (801) 237-6547 > tgalleg@us.ibm.com << snipped >> Tanya, We have been using HDR for quite awhile, for very critical applications, and our archives *and* logbackups are to disk, using ontape. We did check into onbar some time ago, and decided that it would be much simpler, for HDR servers, to stay with ontape. To get around the 2Gb limit, we have used (and are still using) a software package called "expect". The logbackups are handled unattended via the ALARMPROGRAM, which simply calls a little script that does an 'ontape -a' to back up the just-completed log, and then renames the logbackup file (identified by LTAPEDEV) to a date-stamped file. Archive files and logbackup files are picked up daily via NetBackup. Whenever HDR needs to be re-established from scratch (physical restore on secondary), we simply transfer the archive files via ftp, rcp, or scp. We have even automated this transfer process. If you can get ahold of "expect" and get it installed on your machine, I can provide the ksh and expect scripts that we use to do archives, logbackups, and even the physical restore (ontape -p) that needs to be done on the secondary server to get HDR going. HTH, Paul Mosser

IDS 9.21 Backup/Recover strat with HDR

Glossary

Your privacy choices