Enterprise Replication problem
A user on IDS 9.40.UC4 (Linux) aborted a "cdr delete server" with CTRL-C and was left with a broken ER setup: syscdr still exists, no servers listed, and "cdr define server" fails with error 100. Dropping syscdr fails with error -214 on trg_send_stxn, with "LO not found" (12097) warnings in online.log. Suggestions: start with "oninit -D" (the 9.x/10 equivalent of CDRBLOCKOUT) to skip replication threads, drop syscdr, then run $INFORMIXDIR/etc/buildsmi; one poster said the same trick worked for him on 7.31. For the original poster oninit -D didn't help; Madison Pruet diagnosed corruption between the smart blobs and the stable queue table and advised opening an IBM support case. No confirmed fix is recorded in the thread.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Enterprise Replication - INFORMIX 9.40.UC4 LINUX
After a problem with ER, we tried to remove the ER servers executing
"cdr delete server".
After some time executing the command we press CTRL-C.
Now we cannot recreate replication.
- database syscdr exists.
- cdr list server shows no server defined.
- cdr delete server shows that ER is not active.
- cdr define server shows "command failed -- fatal server error (100)"
INFORMIX 7 has an option (CDRBLOCKOUT) to start the database server
without replication, and then remove the database syscdr.
Has INFORMIX 9 something like this?
drop database syscdr shows:214: Cannot remove file for table (informix.trg_send_stxn).
online.log shows:
05:58:21 CDR GC: operation catalog purge (drop) failed (error -214).
Smart blobs and replication dbspaces and chunks are both online.
Jairo
IDS 9.x and 10.00 have the Option "oninit -D" to start the database without
starting the
Replication Threads (CDR and HDR).
After dropping the database syscdr we always start $INFORMIXDIR/etc/buildsmi
as user informix when no one is connected to the database server.
This call cleans up all views and links between the databases sysmaster and
syscdr.
bunny
ids@iiug.org schrieb am 23.01.06 12:03:32:
>
>
> Enterprise Replication - INFORMIX 9.40.UC4 LINUX
>
> After a problem with ER, we tried to remove the ER servers executing
> "cdr delete server".
> After some time executing the command we press CTRL-C.
>
> Now we cannot recreate replication.
> - database syscdr exists.
> - cdr list server shows no server defined.
> - cdr delete server shows that ER is not active.
> - cdr define server shows "command failed -- fatal server error (100)"
>
> INFORMIX 7 has an option (CDRBLOCKOUT) to start the database server
> without replication, and then remove the database syscdr.
> Has INFORMIX 9 something like this?
>
> drop database syscdr shows:> 214: Cannot remove file for table (informix.trg_send_stxn).>
> online.log shows:
> 05:58:21 CDR GC: operation catalog purge (drop) failed (error -214).
>
> Smart blobs and replication dbspaces and chunks are both online.
>
> Jairo
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
______________________________________________________________
Verschicken Sie romantische, coole und witzige Bilder per SMS!
Jetzt bei WEB.DE FreeMail: http://f.web.de/?mc=021193
I tried to start the database with "oninit -D", but the same error
occurs when I try to remove database syscdr.
drop database syscdr shows:
214: Cannot remove file for table (informix.trg_send_stxn).
online.log shows:
12:22:07 IBM Informix Dynamic Server Version 9.40.UC4 Software Serial Numb
er AAA#B000000
12:22:09 IBM Informix Dynamic Server Initialized -- Shared Memory Initialized.
12:22:09 Physical Recovery Started at Page (1:408).
12:22:09 Physical Recovery Complete: 0 Pages Examined, 0 Pages Restored.
12:22:09 Logical Recovery Started.
12:22:09 10 recovery worker threads will be started.
12:22:13 Logical Recovery has reached the transaction cleanup phase.
12:22:13 Logical Recovery Complete.
0 Committed, 0 Rolled Back, 0 Open, 0 Bad Locks
12:22:14 Dataskip is now OFF for all dbspaces
12:22:14 Checkpoint Completed: duration was 0 seconds.
12:22:14 Checkpoint loguniq 11726, logpos 0xc04018, timestamp: 835970335
12:22:14 Maximum server connections 0
12:22:14 On-Line Mode
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097 lo_id=[4,4,49050
] ===> drop database syscdr...
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097 lo_id=[4,4,49071
]
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097 lo_id=[4,4,49044
]
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097 lo_id=[4,4,59942
]
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097 lo_id=[4,4,49023
]
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097 lo_id=[4,4,49026
]
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097 lo_id=[4,4,59941
]
gerd kaluzinski escreveu:
IDS 9.x and 10.00 have the Option "oninit -D" to start the database without
starting the
Replication Threads (CDR and HDR).
After dropping the database syscdr we always start $INFORMIXDIR/etc/buildsmi
as user informix when no one is connected to the database server.
This call cleans up all views and links between the databases sysmaster and
syscdr.
bunny
[1]ids@iiug.org schrieb am 23.01.06 12:03:32:
Enterprise Replication - INFORMIX 9.40.UC4 LINUX
After a problem with ER, we tried to remove the ER servers executing
"cdr delete server".
After some time executing the command we press CTRL-C.
Now we cannot recreate replication.
- database syscdr exists.
- cdr list server shows no server defined.
- cdr delete server shows that ER is not active.
- cdr define server shows "command failed -- fatal server error (100)"
INFORMIX 7 has an option (CDRBLOCKOUT) to start the database server
without replication, and then remove the database syscdr.
Has INFORMIX 9 something like this?
drop database syscdr shows:
214: Cannot remove file for table (informix.trg_send_stxn).
online.log shows:
05:58:21 CDR GC: operation catalog purge (drop) failed (error -214).
Smart blobs and replication dbspaces and chunks are both online.
Jairo
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.
______________________________________________________________
Verschicken Sie romantische, coole und witzige Bilder per SMS!
Jetzt bei WEB.DE FreeMail: [2]http://f.web.de/?mc=021193
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.
--
Jairo Gubler
Analista de Sistemas
APL - IBD (Interfaces e Banco de Dados)
DÍGITRO TECNOLOGIA
E-mail: [3]jairo.gubler@digitro.com.br
Fone: (48) 3281 7213
Fax: (48) 3281 7299
Site:[4]www.digitro.com.br
References
1. mailto:ids@iiug.org
2. http://f.web.de/?mc=021193
3. mailto:jairo.gubler@digitro.com.br
4. http://www.portaldigitro.com.br/
Log a support call with IBM..
only they will know what to do.
----- Original Message -----
From: "Jairo Gubler" <jairo.gubler@digitro.com.br>
To: <ids@iiug.org>
Sent: Monday, January 23, 2006 2:25 PM
Subject: Re: Enterprise Replication problem [6244]
>
> I tried to start the database with "oninit -D", but the same error
>
> occurs when I try to remove database syscdr.
>
> drop database syscdr shows:>
> 214: Cannot remove file for table (informix.trg_send_stxn).>
> online.log shows:
>
> 12:22:07 IBM Informix Dynamic Server Version 9.40.UC4 Software Serial Numb
>
> er AAA#B000000
>
> 12:22:09 IBM Informix Dynamic Server Initialized -- Shared Memory
> Initialized.
>
> 12:22:09 Physical Recovery Started at Page (1:408).
>
> 12:22:09 Physical Recovery Complete: 0 Pages Examined, 0 Pages Restored.
>
> 12:22:09 Logical Recovery Started.
>
> 12:22:09 10 recovery worker threads will be started.
>
> 12:22:13 Logical Recovery has reached the transaction cleanup phase.
>
> 12:22:13 Logical Recovery Complete.
>
> 0 Committed, 0 Rolled Back, 0 Open, 0 Bad Locks
>
> 12:22:14 Dataskip is now OFF for all dbspaces
>
> 12:22:14 Checkpoint Completed: duration was 0 seconds.
>
> 12:22:14 Checkpoint loguniq 11726, logpos 0xc04018, timestamp: 835970335
>
> 12:22:14 Maximum server connections 0
>
> 12:22:14 On-Line Mode
>
> 12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097
> lo_id=[4,4,49050
>
> ] ===> drop database syscdr...
>
> 12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097
> lo_id=[4,4,49071
>
> ]
>
> 12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097
> lo_id=[4,4,49044
>
> ]
>
> 12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097
> lo_id=[4,4,59942
>
> ]
>
> 12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097
> lo_id=[4,4,49023
>
> ]
>
> 12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097
> lo_id=[4,4,49026
>
> ]
>
> 12:22:37 Warning(sq_lo_decrefcount) LO not found, error=12097
> lo_id=[4,4,59941
>
> ]
>
> gerd kaluzinski escreveu:
>
> IDS 9.x and 10.00 have the Option "oninit -D" to start the database
> without
>
> starting the
>
> Replication Threads (CDR and HDR).
>
> After dropping the database syscdr we always start
> $INFORMIXDIR/etc/buildsmi
>
> as user informix when no one is connected to the database server.
>
> This call cleans up all views and links between the databases sysmaster
> and
>
> syscdr.
>
> bunny
>
> [1]ids@iiug.org schrieb am 23.01.06 12:03:32:
>
> Enterprise Replication - INFORMIX 9.40.UC4 LINUX
>
> After a problem with ER, we tried to remove the ER servers executing
>
> "cdr delete server".
>
> After some time executing the command we press CTRL-C.
>
> Now we cannot recreate replication.
>
> - database syscdr exists.
>
> - cdr list server shows no server defined.
>
> - cdr delete server shows that ER is not active.
>
> - cdr define server shows "command failed -- fatal server error (100)"
>
> INFORMIX 7 has an option (CDRBLOCKOUT) to start the database server
>
> without replication, and then remove the database syscdr.
>
> Has INFORMIX 9 something like this?
>
> drop database syscdr shows:>
> 214: Cannot remove file for table (informix.trg_send_stxn).>
> online.log shows:
>
> 05:58:21 CDR GC: operation catalog purge (drop) failed (error -214).
>
> Smart blobs and replication dbspaces and chunks are both online.
>
> Jairo
>
>
>
*******************************************************************************
>
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
> ______________________________________________________________
>
> Verschicken Sie romantische, coole und witzige Bilder per SMS!
>
> Jetzt bei WEB.DE FreeMail: [2]http://f.web.de/?mc=021193
>
>
>
*******************************************************************************
>
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
> --
>
> Jairo Gubler
>
> Analista de Sistemas
>
> APL - IBD (Interfaces e Banco de Dados)
>
> DÍGITRO TECNOLOGIA
>
> E-mail: [3]jairo.gubler@digitro.com.br
>
> Fone: (48) 3281 7213
>
> Fax: (48) 3281 7299
>
> Site:[4]www.digitro.com.br
>
> References
>
> 1. mailto:ids@iiug.org
>
> 2. http://f.web.de/?mc=021193
>
> 3. mailto:jairo.gubler@digitro.com.br
>
> 4. http://www.portaldigitro.com.br/
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
> ---
> [This E-mail has been scanned for viruses but it is your responsibility
> to maintain up to date anti virus software on the device that you are
> currently using to read this email. ]
>
>
>
>
> --
> No virus found in this incoming message.
> Checked by AVG Free Edition.
> Version: 7.1.371 / Virus Database: 267.14.21/236 - Release Date:
> 20/01/2006
>
>
---
[This E-mail has been scanned for viruses but it is your responsibility
to maintain up to date anti virus software on the device that you are
currently using to read this email. ]
I was away today and couldn't respond until now.
The "cdr stop" command can take a bit of time because you have to purge=
the
stable queue. Since the data is stored in a smart blob, the table must=
be
walked to dereference each of the smarb blobs.
The dropping of syscdr will take just as long.
Since you are still having a problem, then that means that somehow you'=
ve
got some corruption between the smart blobs and the table. I'm afraid=
at
this point you're going to need to contact tech support because they ar=
e
going to have to do some 'fancy internal' stuff to get arround the
inconsitancy between the blobspace and the rows. I have a suspision th=
at I
know what they'll do, but I'm not entirely sure...
M.P.
=
"Jairo Gubler" =
<jairo.gubler@dig =
itro.com.br> =
To
Sent by: ids@iiug.org =
ids-bounces@iiug. =
cc
org =
Subj=
ect
Re: Enterprise Replication probl=
em
01/23/2006 08:25 [6244] =
AM =
=
=
Please respond to =
ids =
=
=
I tried to start the database with "oninit -D", but the same error
occurs when I try to remove database syscdr.
drop database syscdr shows:
214: Cannot remove file for table (informix.trg_send_stxn).
online.log shows:
12:22:07 IBM Informix Dynamic Server Version 9.40.UC4 Software Serial N=
umb
er AAA#B000000
12:22:09 IBM Informix Dynamic Server Initialized -- Shared Memory
Initialized.
12:22:09 Physical Recovery Started at Page (1:408).
12:22:09 Physical Recovery Complete: 0 Pages Examined, 0 Pages Restored=
.
12:22:09 Logical Recovery Started.
12:22:09 10 recovery worker threads will be started.
12:22:13 Logical Recovery has reached the transaction cleanup phase.
12:22:13 Logical Recovery Complete.
0 Committed, 0 Rolled Back, 0 Open, 0 Bad Locks
12:22:14 Dataskip is now OFF for all dbspaces
12:22:14 Checkpoint Completed: duration was 0 seconds.
12:22:14 Checkpoint loguniq 11726, logpos 0xc04018, timestamp: 83597033=
5
12:22:14 Maximum server connections 0
12:22:14 On-Line Mode
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=3D12097
lo_id=3D[4,4,49050
] =3D=3D=3D> drop database syscdr...
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=3D12097
lo_id=3D[4,4,49071
]
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=3D12097
lo_id=3D[4,4,49044
]
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=3D12097
lo_id=3D[4,4,59942
]
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=3D12097
lo_id=3D[4,4,49023
]
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=3D12097
lo_id=3D[4,4,49026
]
12:22:37 Warning(sq_lo_decrefcount) LO not found, error=3D12097
lo_id=3D[4,4,59941
]
gerd kaluzinski escreveu:
IDS 9.x and 10.00 have the Option "oninit -D" to start the database wit=
hout
starting the
Replication Threads (CDR and HDR).
After dropping the database syscdr we always start
$INFORMIXDIR/etc/buildsmi
as user informix when no one is connected to the database server.
This call cleans up all views and links between the databases sysmaster=
and
syscdr.
bunny
[1]ids@iiug.org schrieb am 23.01.06 12:03:32:
Enterprise Replication - INFORMIX 9.40.UC4 LINUX
After a problem with ER, we tried to remove the ER servers executing
"cdr delete server".
After some time executing the command we press CTRL-C.
Now we cannot recreate replication.
- database syscdr exists.
- cdr list server shows no server defined.
- cdr delete server shows that ER is not active.
- cdr define server shows "command failed -- fatal server error (100)"
INFORMIX 7 has an option (CDRBLOCKOUT) to start the database server
without replication, and then remove the database syscdr.
Has INFORMIX 9 something like this?
drop database syscdr shows:
214: Cannot remove file for table (informix.trg_send_stxn).
online.log shows:
05:58:21 CDR GC: operation catalog purge (drop) failed (error -214).
Smart blobs and replication dbspaces and chunks are both online.
Jairo
***********************************************************************=
********
Forum Note: Use "Reply" to post a response in the discussion forum.
______________________________________________________________
Verschicken Sie romantische, coole und witzige Bilder per SMS!
Jetzt bei WEB.DE FreeMail: [2]http://f.web.de/?mc=3D021193
***********************************************************************=
********
Forum Note: Use "Reply" to post a response in the discussion forum.
--
Jairo Gubler
Analista de Sistemas
APL - IBD (Interfaces e Banco de Dados)
D=CDGITRO TECNOLOGIA
E-mail: [3]jairo.gubler@digitro.com.br
Fone: (48) 3281 7213
Fax: (48) 3281 7299
Site:[4]www.digitro.com.br
References
1. mailto:ids@iiug.org
2. http://f.web.de/?mc=3D021193
3. mailto:jairo.gubler@digitro.com.br
4. http://www.portaldigitro.com.br/
***********************************************************************=
********
Forum Note: Use "Reply" to post a response in the discussion forum.
=
I had the same problem with 7.31 in the end I set a
variable CDRBLOCKOUT and restarted the instance. This
then allowed me to drop syscdr database and rebuild
sysmaster. Then bounce the instance as normal.
I was then able to recreate the ER replication.
hope this helps.
--- David Williams <david@smooth1.co.uk> wrote:
>
> Log a support call with IBM..
> only they will know what to do.
>
> ----- Original Message -----
> From: "Jairo Gubler" <jairo.gubler@digitro.com.br>
> To: <ids@iiug.org>
> Sent: Monday, January 23, 2006 2:25 PM
> Subject: Re: Enterprise Replication problem [6244]
>
> >
> > I tried to start the database with "oninit -D",
> but the same error
> >
> > occurs when I try to remove database syscdr.
> >
> > drop database syscdr shows:> >
> > 214: Cannot remove file for table
> (informix.trg_send_stxn).> >
> > online.log shows:
> >
> > 12:22:07 IBM Informix Dynamic Server Version
> 9.40.UC4 Software Serial Numb
> >
> > er AAA#B000000
> >
> > 12:22:09 IBM Informix Dynamic Server Initialized
> -- Shared Memory
> > Initialized.
> >
> > 12:22:09 Physical Recovery Started at Page
> (1:408).
> >
> > 12:22:09 Physical Recovery Complete: 0 Pages
> Examined, 0 Pages Restored.
> >
> > 12:22:09 Logical Recovery Started.
> >
> > 12:22:09 10 recovery worker threads will be
> started.
> >
> > 12:22:13 Logical Recovery has reached the
> transaction cleanup phase.
> >
> > 12:22:13 Logical Recovery Complete.
> >
> > 0 Committed, 0 Rolled Back, 0 Open, 0 Bad Locks
> >
> > 12:22:14 Dataskip is now OFF for all dbspaces
> >
> > 12:22:14 Checkpoint Completed: duration was 0
> seconds.
> >
> > 12:22:14 Checkpoint loguniq 11726, logpos
> 0xc04018, timestamp: 835970335
> >
> > 12:22:14 Maximum server connections 0
> >
> > 12:22:14 On-Line Mode
> >
> > 12:22:37 Warning(sq_lo_decrefcount) LO not found,
> error=12097
> > lo_id=[4,4,49050
> >
> > ] ===> drop database syscdr...
> >
> > 12:22:37 Warning(sq_lo_decrefcount) LO not found,
> error=12097
> > lo_id=[4,4,49071
> >
> > ]
> >
> > 12:22:37 Warning(sq_lo_decrefcount) LO not found,
> error=12097
> > lo_id=[4,4,49044
> >
> > ]
> >
> > 12:22:37 Warning(sq_lo_decrefcount) LO not found,
> error=12097
> > lo_id=[4,4,59942
> >
> > ]
> >
> > 12:22:37 Warning(sq_lo_decrefcount) LO not found,
> error=12097
> > lo_id=[4,4,49023
> >
> > ]
> >
> > 12:22:37 Warning(sq_lo_decrefcount) LO not found,
> error=12097
> > lo_id=[4,4,49026
> >
> > ]
> >
> > 12:22:37 Warning(sq_lo_decrefcount) LO not found,
> error=12097
> > lo_id=[4,4,59941
> >
> > ]
> >
> > gerd kaluzinski escreveu:
> >
> > IDS 9.x and 10.00 have the Option "oninit -D" to
> start the database
> > without
> >
> > starting the
> >
> > Replication Threads (CDR and HDR).
> >
> > After dropping the database syscdr we always start
>
> > $INFORMIXDIR/etc/buildsmi
> >
> > as user informix when no one is connected to the
> database server.
> >
> > This call cleans up all views and links between
> the databases sysmaster
> > and
> >
> > syscdr.
> >
> > bunny
> >
> > [1]ids@iiug.org schrieb am 23.01.06 12:03:32:
> >
> > Enterprise Replication - INFORMIX 9.40.UC4 LINUX
> >
> > After a problem with ER, we tried to remove the ER
> servers executing
> >
> > "cdr delete server".
> >
> > After some time executing the command we press
> CTRL-C.
> >
> > Now we cannot recreate replication.
> >
> > - database syscdr exists.
> >
> > - cdr list server shows no server defined.
> >
> > - cdr delete server shows that ER is not active.
> >
> > - cdr define server shows "command failed -- fatal
> server error (100)"
> >
> > INFORMIX 7 has an option (CDRBLOCKOUT) to start
> the database server
> >
> > without replication, and then remove the database
> syscdr.
> >
> > Has INFORMIX 9 something like this?
> >
> > drop database syscdr shows:> >
> > 214: Cannot remove file for table
> (informix.trg_send_stxn).> >
> > online.log shows:
> >
> > 05:58:21 CDR GC: operation catalog purge (drop)
> failed (error -214).
> >
> > Smart blobs and replication dbspaces and chunks
> are both online.
> >
> > Jairo
> >
> >
> >
>
*******************************************************************************
>
> >
> > Forum Note: Use "Reply" to post a response in the
> discussion forum.
> >
> >
>
______________________________________________________________
>
> >
> > Verschicken Sie romantische, coole und witzige
> Bilder per SMS!
> >
> > Jetzt bei WEB.DE FreeMail:
> [2]http://f.web.de/?mc=021193
> >
> >
> >
>
*******************************************************************************
>
> >
> > Forum Note: Use "Reply" to post a response in the
> discussion forum.
> >
>
=== message truncated ===
__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com