SDS Server disconnecting after blocking on checkpo
Posted in 2010
Topics: High Availability & Replication, Installation, Setup & Upgrades, Storage & Space Management, Stored Procedures & SPL, Server Administration, Security, Permissions & Auditing, Logging & Checkpoints, Platform-Specific Issues, Versions, Editions & End-of-Life
Hi,
I am facing a serious problem with a SDS server disconnecting
from the primary on checkpoint.
I've tried to set different values for SDS_TIMEOUT, CKPINTVL.
I also tried to use the RTO functionality, put the secondary on
Read-Only mode, without success.
Both servers were working quite well after installation. Then, one day
the secondary disconnected and started this stranger behaviour.
Can any one help ?
Please find hereafter some informations relating to the
case (I'll send more if requested ) :
*1/ Primary online.log (extract) *:
10:55:05 IBM Informix Dynamic Server Started.
10:55:21 Segment locked: addr=700000000000000, size=11206705152
10:55:37 Segment locked: addr=7000002a0000000, size=10485760000
10:55:38 VP pid=565296 priority fixed at 60, former = 90
10:55:39 Affinitied VP 1 to phys proc 0
10:55:39 Affinitied VP 3 to phys proc 1
10:55:39 Affinitied VP 4 to phys proc 2
10:55:44 DR: DRAUTO is 0 (Off)
10:55:44 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
10:55:44 AIX MP latch code enabled
10:55:44 Fast poll pollset enabled.
10:55:44 Requested shared memory segment size rounded from 2680KB to 2688KB
10:55:44 IBM Informix Dynamic Server Version 11.50.FC4 Software Serial Number
AAA#B000000
10:55:45 DR: Reservation of the last logical log for log backup turned on
10:55:45 SDS Source Node Alias Changed from (svrprd) to (svrprd)
10:55:45 IBM Informix Dynamic Server Initialized -- Shared Memory Initialized.
10:55:45 DR: Reservation of the last logical log for log backup turned on
10:55:45 Physical Recovery Started at Page (3:4926569).
10:55:46 Physical Recovery Complete: 0 Pages Examined, 0 Pages Restored.
10:55:46 Logical Recovery Started.
10:55:46 10 recovery worker threads will be started.
10:55:47 Logical Recovery has reached the transaction cleanup phase.
10:55:47 Logical Recovery Complete.
0 Committed, 0 Rolled Back, 0 Open, 0 Bad Locks
10:55:48 Dataskip is now OFF for all dbspaces
10:55:48 Checkpoint Completed: duration was 0 seconds.
10:55:48 Maximum server connections 0
10:55:48 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked 0,
Plog used 2, Llog used 1
10:55:48 On-Line Mode
10:55:50 SCHAPI: Started dbScheduler thread.
10:55:50 Booting Language <spl> from module <>
10:55:50 Loading Module <SPLNULL>
10:55:50 SCHAPI: Started 2 dbWorker threads.
10:59:55 Maximum server connections 8
10:59:55 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked 0,
Plog used 5745, Llog used 1494
10:59:56 SDS Server srvsds - state is now connected
12:11:58 Checkpoint Completed: duration was 1 seconds.
12:11:58 Maximum server connections 40
12:11:58 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked 0,
Plog used 10477, Llog used 11782
12:27:03 ERROR: Removing SDS Node srvsds has timed out - removing
12:27:03 ERROR: Removing SDS Node srvsds has timed out - removing
12:27:03 SDS Server srvsds - state is now disconnected
*2/ Secondary online.log (extract)
*
10:59:10 IBM Informix Dynamic Server Started.
10:59:26 Segment locked: addr=700000000000000, size=11206705152
10:59:41 Segment locked: addr=7000002a0000000, size=10485760000
10:59:42 VP pid=327898 priority fixed at 60, former = 90
10:59:43 Affinitied VP 1 to phys proc 0
10:59:43 Affinitied VP 3 to phys proc 1
10:59:43 Affinitied VP 4 to phys proc 2
10:59:48 DR: DRAUTO is 0 (Off)
10:59:48 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
10:59:48 AIX MP latch code enabled
10:59:48 Fast poll pollset enabled.
10:59:48 Requested shared memory segment size rounded from 2680KB to 2688KB
10:59:48 IBM Informix Dynamic Server Version 11.50.FC4 Software Serial Number
AAA#B000000
10:59:53 Setting checkpoint 986:15ede018 intvl:5695
10:59:53 SDS Server svrprd - state is now connected
10:59:54 IBM Informix Dynamic Server Initialized -- Shared Memory Initialized.
10:59:54 Requesting logs from 986:15ede
10:59:54 Initializing SDS Temp dbspace tempspace1
10:59:54 Dataskip is now OFF for all dbspaces
10:59:54 Restartable Restore has been ENABLED
10:59:54 Recovery Mode
10:59:54 Logical Recovery Started.
10:59:54 10 recovery worker threads will be started.
10:59:55 Initializing SDS Temp dbspace tempspace2
10:59:55 Start Logical Recovery - Start Log 986, End Log ?
10:59:55 Starting Log Position - 986 0x15ede018
10:59:55 B-tree scanners disabled.
10:59:56 DR: SDS secondary server operational
10:59:56 Started processing open transactions on secondary during startup
10:59:56 Checkpoint Completed: duration was 0 seconds.
10:59:56 Maximum server connections 0
10:59:56 Finished processing open transactions on secondary during startup.
12:11:06 Logical Log 986 Complete, timestamp: 0x8d08cd48.
12:11:56 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked 0,
Plog used 10189, Llog used 0
12:27:02 SDS: Received Shutdown request from svrprd, Reason: onmode -d clear
SDS primary command was run at Primary
12:27:02 DR:Shutting down the server.
12:27:02 IBM Informix Dynamic Server Stopped.
Of course, nobody ran "onmode -d clear SDS primary" on primary. I fact the
secondary stops without any user action.
Once again, please help !!!
Henri MOUKOURI
You didn't include the server version. We removed the check which was
causing this problem a while back. I can't remember the bug number.
You'll need to contact tech support to get the patch.
From: "Henri MOUKOURI" <h.moukouri@moukouri.net>
To: ids@iiug.org
Date: 10/04/2010 09:56 AM
Subject: SDS Server disconnecting after blocking on che.... [21533]
Sent by: ids-bounces@iiug.org
Hi,
I am facing a serious problem with a SDS server disconnecting
from the primary on checkpoint.
I've tried to set different values for SDS_TIMEOUT, CKPINTVL.
I also tried to use the RTO functionality, put the secondary on
Read-Only mode, without success.
Both servers were working quite well after installation. Then, one day
the secondary disconnected and started this stranger behaviour.
Can any one help ?
Please find hereafter some informations relating to the
case (I'll send more if requested ) :
*1/ Primary online.log (extract) *:
10:55:05 IBM Informix Dynamic Server Started.
10:55:21 Segment locked: addr=700000000000000, size=11206705152
10:55:37 Segment locked: addr=7000002a0000000, size=10485760000
10:55:38 VP pid=565296 priority fixed at 60, former = 90
10:55:39 Affinitied VP 1 to phys proc 0
10:55:39 Affinitied VP 3 to phys proc 1
10:55:39 Affinitied VP 4 to phys proc 2
10:55:44 DR: DRAUTO is 0 (Off)
10:55:44 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
10:55:44 AIX MP latch code enabled
10:55:44 Fast poll pollset enabled.
10:55:44 Requested shared memory segment size rounded from 2680KB to 2688KB
10:55:44 IBM Informix Dynamic Server Version 11.50.FC4 Software Serial
Number
AAA#B000000
10:55:45 DR: Reservation of the last logical log for log backup turned on
10:55:45 SDS Source Node Alias Changed from (svrprd) to (svrprd)
10:55:45 IBM Informix Dynamic Server Initialized -- Shared Memory
Initialized.
10:55:45 DR: Reservation of the last logical log for log backup turned on
10:55:45 Physical Recovery Started at Page (3:4926569).
10:55:46 Physical Recovery Complete: 0 Pages Examined, 0 Pages Restored.
10:55:46 Logical Recovery Started.
10:55:46 10 recovery worker threads will be started.
10:55:47 Logical Recovery has reached the transaction cleanup phase.
10:55:47 Logical Recovery Complete.
0 Committed, 0 Rolled Back, 0 Open, 0 Bad Locks
10:55:48 Dataskip is now OFF for all dbspaces
10:55:48 Checkpoint Completed: duration was 0 seconds.
10:55:48 Maximum server connections 0
10:55:48 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
0,
Plog used 2, Llog used 1
10:55:48 On-Line Mode
10:55:50 SCHAPI: Started dbScheduler thread.
10:55:50 Booting Language <spl> from module <>
10:55:50 Loading Module <SPLNULL>
10:55:50 SCHAPI: Started 2 dbWorker threads.
10:59:55 Maximum server connections 8
10:59:55 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
0,
Plog used 5745, Llog used 1494
10:59:56 SDS Server srvsds - state is now connected
12:11:58 Checkpoint Completed: duration was 1 seconds.
12:11:58 Maximum server connections 40
12:11:58 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
0,
Plog used 10477, Llog used 11782
12:27:03 ERROR: Removing SDS Node srvsds has timed out - removing
12:27:03 ERROR: Removing SDS Node srvsds has timed out - removing
12:27:03 SDS Server srvsds - state is now disconnected
*2/ Secondary online.log (extract)
*
10:59:10 IBM Informix Dynamic Server Started.
10:59:26 Segment locked: addr=700000000000000, size=11206705152
10:59:41 Segment locked: addr=7000002a0000000, size=10485760000
10:59:42 VP pid=327898 priority fixed at 60, former = 90
10:59:43 Affinitied VP 1 to phys proc 0
10:59:43 Affinitied VP 3 to phys proc 1
10:59:43 Affinitied VP 4 to phys proc 2
10:59:48 DR: DRAUTO is 0 (Off)
10:59:48 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
10:59:48 AIX MP latch code enabled
10:59:48 Fast poll pollset enabled.
10:59:48 Requested shared memory segment size rounded from 2680KB to 2688KB
10:59:48 IBM Informix Dynamic Server Version 11.50.FC4 Software Serial
Number
AAA#B000000
10:59:53 Setting checkpoint 986:15ede018 intvl:5695
10:59:53 SDS Server svrprd - state is now connected
10:59:54 IBM Informix Dynamic Server Initialized -- Shared Memory
Initialized.
10:59:54 Requesting logs from 986:15ede
10:59:54 Initializing SDS Temp dbspace tempspace1
10:59:54 Dataskip is now OFF for all dbspaces
10:59:54 Restartable Restore has been ENABLED
10:59:54 Recovery Mode
10:59:54 Logical Recovery Started.
10:59:54 10 recovery worker threads will be started.
10:59:55 Initializing SDS Temp dbspace tempspace2
10:59:55 Start Logical Recovery - Start Log 986, End Log ?
10:59:55 Starting Log Position - 986 0x15ede018
10:59:55 B-tree scanners disabled.
10:59:56 DR: SDS secondary server operational
10:59:56 Started processing open transactions on secondary during startup
10:59:56 Checkpoint Completed: duration was 0 seconds.
10:59:56 Maximum server connections 0
10:59:56 Finished processing open transactions on secondary during startup.
12:11:06 Logical Log 986 Complete, timestamp: 0x8d08cd48.
12:11:56 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
0,
Plog used 10189, Llog used 0
12:27:02 SDS: Received Shutdown request from svrprd, Reason: onmode -d
clear
SDS primary command was run at Primary
12:27:02 DR:Shutting down the server.
12:27:02 IBM Informix Dynamic Server Stopped.
Of course, nobody ran "onmode -d clear SDS primary" on primary. I fact the
secondary stops without any user action.
Once again, please help !!!
Henri MOUKOURI
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.
Hi,
Thanks for the reply.
The sever version is 11.50FC4. Did you mean we need to upgrade
to a newer version (which one ?) or just apply a patch ?
Best Regards,
Henri MOUKOURI
Le 04/10/2010 16:15, Madison Pruet a écrit :
> You didn't include the server version. We removed the check which was
> causing this problem a while back. I can't remember the bug number.
> You'll need to contact tech support to get the patch.
>
> From: "Henri MOUKOURI"<h.moukouri@moukouri.net>
>
> To: ids@iiug.org
>
> Date: 10/04/2010 09:56 AM
>
> Subject: SDS Server disconnecting after blocking on che.... [21533]
>
> Sent by: ids-bounces@iiug.org
>
> Hi,
>
> I am facing a serious problem with a SDS server disconnecting
> from the primary on checkpoint.
>
> I've tried to set different values for SDS_TIMEOUT, CKPINTVL.
> I also tried to use the RTO functionality, put the secondary on
> Read-Only mode, without success.
>
> Both servers were working quite well after installation. Then, one day
> the secondary disconnected and started this stranger behaviour.
>
> Can any one help ?
>
> Please find hereafter some informations relating to the
> case (I'll send more if requested ) :
>
> *1/ Primary online.log (extract) *:
>
> 10:55:05 IBM Informix Dynamic Server Started.
>
> 10:55:21 Segment locked: addr=700000000000000, size=11206705152
> 10:55:37 Segment locked: addr=7000002a0000000, size=10485760000
> 10:55:38 VP pid=565296 priority fixed at 60, former = 90
>
> 10:55:39 Affinitied VP 1 to phys proc 0
> 10:55:39 Affinitied VP 3 to phys proc 1
> 10:55:39 Affinitied VP 4 to phys proc 2
> 10:55:44 DR: DRAUTO is 0 (Off)
> 10:55:44 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
> 10:55:44 AIX MP latch code enabled
> 10:55:44 Fast poll pollset enabled.
> 10:55:44 Requested shared memory segment size rounded from 2680KB to 2688KB
>
> 10:55:44 IBM Informix Dynamic Server Version 11.50.FC4 Software Serial
> Number
> AAA#B000000
>
> 10:55:45 DR: Reservation of the last logical log for log backup turned on
> 10:55:45 SDS Source Node Alias Changed from (svrprd) to (svrprd)
> 10:55:45 IBM Informix Dynamic Server Initialized -- Shared Memory
> Initialized.
>
> 10:55:45 DR: Reservation of the last logical log for log backup turned on
> 10:55:45 Physical Recovery Started at Page (3:4926569).
> 10:55:46 Physical Recovery Complete: 0 Pages Examined, 0 Pages Restored.
> 10:55:46 Logical Recovery Started.
> 10:55:46 10 recovery worker threads will be started.
> 10:55:47 Logical Recovery has reached the transaction cleanup phase.
> 10:55:47 Logical Recovery Complete.
>
> 0 Committed, 0 Rolled Back, 0 Open, 0 Bad Locks
>
> 10:55:48 Dataskip is now OFF for all dbspaces
> 10:55:48 Checkpoint Completed: duration was 0 seconds.
>
> 10:55:48 Maximum server connections 0
> 10:55:48 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
> 0,
> Plog used 2, Llog used 1
>
> 10:55:48 On-Line Mode
> 10:55:50 SCHAPI: Started dbScheduler thread.
> 10:55:50 Booting Language<spl> from module<>
> 10:55:50 Loading Module<SPLNULL>
> 10:55:50 SCHAPI: Started 2 dbWorker threads.
>
> 10:59:55 Maximum server connections 8
> 10:59:55 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
> 0,
> Plog used 5745, Llog used 1494
>
> 10:59:56 SDS Server srvsds - state is now connected
> 12:11:58 Checkpoint Completed: duration was 1 seconds.
>
> 12:11:58 Maximum server connections 40
> 12:11:58 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
> 0,
> Plog used 10477, Llog used 11782
>
> 12:27:03 ERROR: Removing SDS Node srvsds has timed out - removing
> 12:27:03 ERROR: Removing SDS Node srvsds has timed out - removing
> 12:27:03 SDS Server srvsds - state is now disconnected
>
> *2/ Secondary online.log (extract)
> *
> 10:59:10 IBM Informix Dynamic Server Started.
>
> 10:59:26 Segment locked: addr=700000000000000, size=11206705152
> 10:59:41 Segment locked: addr=7000002a0000000, size=10485760000
> 10:59:42 VP pid=327898 priority fixed at 60, former = 90
>
> 10:59:43 Affinitied VP 1 to phys proc 0
> 10:59:43 Affinitied VP 3 to phys proc 1
> 10:59:43 Affinitied VP 4 to phys proc 2
> 10:59:48 DR: DRAUTO is 0 (Off)
> 10:59:48 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
> 10:59:48 AIX MP latch code enabled
> 10:59:48 Fast poll pollset enabled.
> 10:59:48 Requested shared memory segment size rounded from 2680KB to 2688KB
>
> 10:59:48 IBM Informix Dynamic Server Version 11.50.FC4 Software Serial
> Number
> AAA#B000000
> 10:59:53 Setting checkpoint 986:15ede018 intvl:5695
> 10:59:53 SDS Server svrprd - state is now connected
> 10:59:54 IBM Informix Dynamic Server Initialized -- Shared Memory
> Initialized.
>
> 10:59:54 Requesting logs from 986:15ede
> 10:59:54 Initializing SDS Temp dbspace tempspace1
> 10:59:54 Dataskip is now OFF for all dbspaces
> 10:59:54 Restartable Restore has been ENABLED
> 10:59:54 Recovery Mode
> 10:59:54 Logical Recovery Started.
> 10:59:54 10 recovery worker threads will be started.
> 10:59:55 Initializing SDS Temp dbspace tempspace2
> 10:59:55 Start Logical Recovery - Start Log 986, End Log ?
> 10:59:55 Starting Log Position - 986 0x15ede018
> 10:59:55 B-tree scanners disabled.
> 10:59:56 DR: SDS secondary server operational
> 10:59:56 Started processing open transactions on secondary during startup
> 10:59:56 Checkpoint Completed: duration was 0 seconds.
>
> 10:59:56 Maximum server connections 0
> 10:59:56 Finished processing open transactions on secondary during startup.
>
> 12:11:06 Logical Log 986 Complete, timestamp: 0x8d08cd48.
> 12:11:56 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns blocked
> 0,
> Plog used 10189, Llog used 0
>
> 12:27:02 SDS: Received Shutdown request from svrprd, Reason: onmode -d
> clear
> SDS primary command was run at Primary
> 12:27:02 DR:Shutting down the server.
> 12:27:02 IBM Informix Dynamic Server Stopped.
>
> Of course, nobody ran "onmode -d clear SDS primary" on primary. I fact the
> secondary stops without any user action.
>
> Once again, please help !!!
>
> Henri MOUKOURI
>
>
>
*******************************************************************************
>
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
It'd probably be better to consider an upgrade.
Part of the reason that we removed the check at checkpoint time was bec=
ause
we had put in a bunch of logic to maintain a safe delta between primary=
and
secondary and doing the checkpoint check was not needed and was somewha=
t
broken.
=
From: "Henri MOUKOURI" <h.moukouri@moukouri.net> =
=
To: ids@iiug.org =
=
Date: 10/04/2010 10:53 AM =
=
Subject: Re: SDS Server disconnecting after blocking on.... [2153=
6]
=
Sent by: ids-bounces@iiug.org =
=
Hi,
Thanks for the reply.
The sever version is 11.50FC4. Did you mean we need to upgrade
to a newer version (which one ?) or just apply a patch ?
Best Regards,
Henri MOUKOURI
Le 04/10/2010 16:15, Madison Pruet a =E9crit :
> You didn't include the server version. We removed the check which was=
> causing this problem a while back. I can't remember the bug number.
> You'll need to contact tech support to get the patch.
>
> From: "Henri MOUKOURI"<h.moukouri@moukouri.net>
>
> To: ids@iiug.org
>
> Date: 10/04/2010 09:56 AM
>
> Subject: SDS Server disconnecting after blocking on che.... [21533]
>
> Sent by: ids-bounces@iiug.org
>
> Hi,
>
> I am facing a serious problem with a SDS server disconnecting
> from the primary on checkpoint.
>
> I've tried to set different values for SDS_TIMEOUT, CKPINTVL.
> I also tried to use the RTO functionality, put the secondary on
> Read-Only mode, without success.
>
> Both servers were working quite well after installation. Then, one da=
y
> the secondary disconnected and started this stranger behaviour.
>
> Can any one help ?
>
> Please find hereafter some informations relating to the
> case (I'll send more if requested ) :
>
> *1/ Primary online.log (extract) *:
>
> 10:55:05 IBM Informix Dynamic Server Started.
>
> 10:55:21 Segment locked: addr=3D700000000000000, size=3D11206705152
> 10:55:37 Segment locked: addr=3D7000002a0000000, size=3D10485760000
> 10:55:38 VP pid=3D565296 priority fixed at 60, former =3D 90
>
> 10:55:39 Affinitied VP 1 to phys proc 0
> 10:55:39 Affinitied VP 3 to phys proc 1
> 10:55:39 Affinitied VP 4 to phys proc 2
> 10:55:44 DR: DRAUTO is 0 (Off)
> 10:55:44 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
> 10:55:44 AIX MP latch code enabled
> 10:55:44 Fast poll pollset enabled.
> 10:55:44 Requested shared memory segment size rounded from 2680KB to
2688KB
>
> 10:55:44 IBM Informix Dynamic Server Version 11.50.FC4 Software Seria=
l
> Number
> AAA#B000000
>
> 10:55:45 DR: Reservation of the last logical log for log backup turne=
d on
> 10:55:45 SDS Source Node Alias Changed from (svrprd) to (svrprd)
> 10:55:45 IBM Informix Dynamic Server Initialized -- Shared Memory
> Initialized.
>
> 10:55:45 DR: Reservation of the last logical log for log backup turne=
d on
> 10:55:45 Physical Recovery Started at Page (3:4926569).
> 10:55:46 Physical Recovery Complete: 0 Pages Examined, 0 Pages Restor=
ed.
> 10:55:46 Logical Recovery Started.
> 10:55:46 10 recovery worker threads will be started.
> 10:55:47 Logical Recovery has reached the transaction cleanup phase.
> 10:55:47 Logical Recovery Complete.
>
> 0 Committed, 0 Rolled Back, 0 Open, 0 Bad Locks
>
> 10:55:48 Dataskip is now OFF for all dbspaces
> 10:55:48 Checkpoint Completed: duration was 0 seconds.
>
> 10:55:48 Maximum server connections 0
> 10:55:48 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns
blocked
> 0,
> Plog used 2, Llog used 1
>
> 10:55:48 On-Line Mode
> 10:55:50 SCHAPI: Started dbScheduler thread.
> 10:55:50 Booting Language<spl> from module<>
> 10:55:50 Loading Module<SPLNULL>
> 10:55:50 SCHAPI: Started 2 dbWorker threads.
>
> 10:59:55 Maximum server connections 8
> 10:59:55 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns
blocked
> 0,
> Plog used 5745, Llog used 1494
>
> 10:59:56 SDS Server srvsds - state is now connected
> 12:11:58 Checkpoint Completed: duration was 1 seconds.
>
> 12:11:58 Maximum server connections 40
> 12:11:58 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns
blocked
> 0,
> Plog used 10477, Llog used 11782
>
> 12:27:03 ERROR: Removing SDS Node srvsds has timed out - removing
> 12:27:03 ERROR: Removing SDS Node srvsds has timed out - removing
> 12:27:03 SDS Server srvsds - state is now disconnected
>
> *2/ Secondary online.log (extract)
> *
> 10:59:10 IBM Informix Dynamic Server Started.
>
> 10:59:26 Segment locked: addr=3D700000000000000, size=3D11206705152
> 10:59:41 Segment locked: addr=3D7000002a0000000, size=3D10485760000
> 10:59:42 VP pid=3D327898 priority fixed at 60, former =3D 90
>
> 10:59:43 Affinitied VP 1 to phys proc 0
> 10:59:43 Affinitied VP 3 to phys proc 1
> 10:59:43 Affinitied VP 4 to phys proc 2
> 10:59:48 DR: DRAUTO is 0 (Off)
> 10:59:48 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
> 10:59:48 AIX MP latch code enabled
> 10:59:48 Fast poll pollset enabled.
> 10:59:48 Requested shared memory segment size rounded from 2680KB to
2688KB
>
> 10:59:48 IBM Informix Dynamic Server Version 11.50.FC4 Software Seria=
l
> Number
> AAA#B000000
> 10:59:53 Setting checkpoint 986:15ede018 intvl:5695
> 10:59:53 SDS Server svrprd - state is now connected
> 10:59:54 IBM Informix Dynamic Server Initialized -- Shared Memory
> Initialized.
>
> 10:59:54 Requesting logs from 986:15ede
> 10:59:54 Initializing SDS Temp dbspace tempspace1
> 10:59:54 Dataskip is now OFF for all dbspaces
> 10:59:54 Restartable Restore has been ENABLED
> 10:59:54 Recovery Mode
> 10:59:54 Logical Recovery Started.
> 10:59:54 10 recovery worker threads will be started.
> 10:59:55 Initializing SDS Temp dbspace tempspace2
> 10:59:55 Start Logical Recovery - Start Log 986, End Log ?
> 10:59:55 Starting Log Position - 986 0x15ede018
> 10:59:55 B-tree scanners disabled.
> 10:59:56 DR: SDS secondary server operational
> 10:59:56 Started processing open transactions on secondary during sta=
rtup
> 10:59:56 Checkpoint Completed: duration was 0 seconds.
>
> 10:59:56 Maximum server connections 0
> 10:59:56 Finished processing open transactions on secondary during
startup.
>
> 12:11:06 Logical Log 986 Complete, timestamp: 0x8d08cd48.
> 12:11:56 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns
blocked
> 0,
> Plog used 10189, Llog used 0
>
> 12:27:02 SDS: Received Shutdown request from svrprd, Reason: onmode -=
d
> clear
> SDS primary command was run at Primary
> 12:27:02 DR:Shutting down the server.
> 12:27:02 IBM Informix Dynamic Server Stopped.
>
> Of course, nobody ran "onmode -d clear SDS primary" on primary. I fac=
t
the
> secondary stops without any user action.
>
> Once again, please help !!!
>
> Henri MOUKOURI
>
>
>
***********************************************************************=
********
>
> Forum Note: Use "Reply" to post a response
Hi,
We'll then consider upgrading to newer version.
Thanks, once again.
Best Regards,
Henri MOUKOURI
Le 04/10/2010 16:56, Madison Pruet a écrit :
> It'd probably be better to consider an upgrade.
>
> Part of the reason that we removed the check at checkpoint time was bec=
> ause
> we had put in a bunch of logic to maintain a safe delta between primary=
> and
> secondary and doing the checkpoint check was not needed and was somewha=
> t
> broken.
>
> =
>
> From: "Henri MOUKOURI"<h.moukouri@moukouri.net> =
>
> =
>
> To: ids@iiug.org =
>
> =
>
> Date: 10/04/2010 10:53 AM =
>
> =
>
> Subject: Re: SDS Server disconnecting after blocking on.... [2153=
> 6]
>
> =
>
> Sent by: ids-bounces@iiug.org =
>
> =
>
> Hi,
>
> Thanks for the reply.
>
> The sever version is 11.50FC4. Did you mean we need to upgrade
> to a newer version (which one ?) or just apply a patch ?
>
> Best Regards,
> Henri MOUKOURI
>
> Le 04/10/2010 16:15, Madison Pruet a =E9crit :
>> You didn't include the server version. We removed the check which was=
>> causing this problem a while back. I can't remember the bug number.
>> You'll need to contact tech support to get the patch.
>>
>> From: "Henri MOUKOURI"<h.moukouri@moukouri.net>
>>
>> To: ids@iiug.org
>>
>> Date: 10/04/2010 09:56 AM
>>
>> Subject: SDS Server disconnecting after blocking on che.... [21533]
>>
>> Sent by: ids-bounces@iiug.org
>>
>> Hi,
>>
>> I am facing a serious problem with a SDS server disconnecting
>> from the primary on checkpoint.
>>
>> I've tried to set different values for SDS_TIMEOUT, CKPINTVL.
>> I also tried to use the RTO functionality, put the secondary on
>> Read-Only mode, without success.
>>
>> Both servers were working quite well after installation. Then, one da=
> y
>> the secondary disconnected and started this stranger behaviour.
>>
>> Can any one help ?
>>
>> Please find hereafter some informations relating to the
>> case (I'll send more if requested ) :
>>
>> *1/ Primary online.log (extract) *:
>>
>> 10:55:05 IBM Informix Dynamic Server Started.
>>
>> 10:55:21 Segment locked: addr=3D700000000000000, size=3D11206705152
>> 10:55:37 Segment locked: addr=3D7000002a0000000, size=3D10485760000
>> 10:55:38 VP pid=3D565296 priority fixed at 60, former =3D 90
>>
>> 10:55:39 Affinitied VP 1 to phys proc 0
>> 10:55:39 Affinitied VP 3 to phys proc 1
>> 10:55:39 Affinitied VP 4 to phys proc 2
>> 10:55:44 DR: DRAUTO is 0 (Off)
>> 10:55:44 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
>> 10:55:44 AIX MP latch code enabled
>> 10:55:44 Fast poll pollset enabled.
>> 10:55:44 Requested shared memory segment size rounded from 2680KB to
> 2688KB
>> 10:55:44 IBM Informix Dynamic Server Version 11.50.FC4 Software Seria=
> l
>> Number
>> AAA#B000000
>>
>> 10:55:45 DR: Reservation of the last logical log for log backup turne=
> d on
>
>> 10:55:45 SDS Source Node Alias Changed from (svrprd) to (svrprd)
>> 10:55:45 IBM Informix Dynamic Server Initialized -- Shared Memory
>> Initialized.
>>
>> 10:55:45 DR: Reservation of the last logical log for log backup turne=
> d on
>
>> 10:55:45 Physical Recovery Started at Page (3:4926569).
>> 10:55:46 Physical Recovery Complete: 0 Pages Examined, 0 Pages Restor=
> ed.
>> 10:55:46 Logical Recovery Started.
>> 10:55:46 10 recovery worker threads will be started.
>> 10:55:47 Logical Recovery has reached the transaction cleanup phase.
>> 10:55:47 Logical Recovery Complete.
>>
>> 0 Committed, 0 Rolled Back, 0 Open, 0 Bad Locks
>>
>> 10:55:48 Dataskip is now OFF for all dbspaces
>> 10:55:48 Checkpoint Completed: duration was 0 seconds.
>>
>> 10:55:48 Maximum server connections 0
>> 10:55:48 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns
> blocked
>> 0,
>> Plog used 2, Llog used 1
>>
>> 10:55:48 On-Line Mode
>> 10:55:50 SCHAPI: Started dbScheduler thread.
>> 10:55:50 Booting Language<spl> from module<>
>> 10:55:50 Loading Module<SPLNULL>
>> 10:55:50 SCHAPI: Started 2 dbWorker threads.
>>
>> 10:59:55 Maximum server connections 8
>> 10:59:55 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns
> blocked
>> 0,
>> Plog used 5745, Llog used 1494
>>
>> 10:59:56 SDS Server srvsds - state is now connected
>> 12:11:58 Checkpoint Completed: duration was 1 seconds.
>>
>> 12:11:58 Maximum server connections 40
>> 12:11:58 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns
> blocked
>> 0,
>> Plog used 10477, Llog used 11782
>>
>> 12:27:03 ERROR: Removing SDS Node srvsds has timed out - removing
>> 12:27:03 ERROR: Removing SDS Node srvsds has timed out - removing
>> 12:27:03 SDS Server srvsds - state is now disconnected
>>
>> *2/ Secondary online.log (extract)
>> *
>> 10:59:10 IBM Informix Dynamic Server Started.
>>
>> 10:59:26 Segment locked: addr=3D700000000000000, size=3D11206705152
>> 10:59:41 Segment locked: addr=3D7000002a0000000, size=3D10485760000
>> 10:59:42 VP pid=3D327898 priority fixed at 60, former =3D 90
>>
>> 10:59:43 Affinitied VP 1 to phys proc 0
>> 10:59:43 Affinitied VP 3 to phys proc 1
>> 10:59:43 Affinitied VP 4 to phys proc 2
>> 10:59:48 DR: DRAUTO is 0 (Off)
>> 10:59:48 DR: ENCRYPT_HDR is 0 (HDR encryption Disabled)
>> 10:59:48 AIX MP latch code enabled
>> 10:59:48 Fast poll pollset enabled.
>> 10:59:48 Requested shared memory segment size rounded from 2680KB to
> 2688KB
>> 10:59:48 IBM Informix Dynamic Server Version 11.50.FC4 Software Seria=
> l
>> Number
>> AAA#B000000
>> 10:59:53 Setting checkpoint 986:15ede018 intvl:5695
>> 10:59:53 SDS Server svrprd - state is now connected
>> 10:59:54 IBM Informix Dynamic Server Initialized -- Shared Memory
>> Initialized.
>>
>> 10:59:54 Requesting logs from 986:15ede
>> 10:59:54 Initializing SDS Temp dbspace tempspace1
>> 10:59:54 Dataskip is now OFF for all dbspaces
>> 10:59:54 Restartable Restore has been ENABLED
>> 10:59:54 Recovery Mode
>> 10:59:54 Logical Recovery Started.
>> 10:59:54 10 recovery worker threads will be started.
>> 10:59:55 Initializing SDS Temp dbspace tempspace2
>> 10:59:55 Start Logical Recovery - Start Log 986, End Log ?
>> 10:59:55 Starting Log Position - 986 0x15ede018
>> 10:59:55 B-tree scanners disabled.
>> 10:59:56 DR: SDS secondary server operational
>> 10:59:56 Started processing open transactions on secondary during sta=
> rtup
>
>> 10:59:56 Checkpoint Completed: duration was 0 seconds.
>>
>> 10:59:56 Maximum server connections 0
>> 10:59:56 Finished processing open transactions on secondary during
> startup.
>> 12:11:06 Logical Log 986 Complete, timestamp: 0x8d08cd48.
>> 12:11:56 Checkpoint Statistics - Avg. Txn Block Time 0.000, # Txns
> blocked
>> 0,
>> Plog used 10189, Llog used 0
>>
>> 12:27:02 SDS: Received Shutdown request from svrprd, Reason: onmode -=
> d
>> clear
>> SDS primary command was run at Primary
>> 12:27:02 DR:Shutting down the server.
>> 12:27:02 IBM Informix Dynamic Server