ER time to define a replicate in 11.50 and 12.10
Frank found that 'cdr define replicate' for a three-node update-anywhere setup ran in 1-2 seconds on 11.50.FC8 but took 40-60 seconds on 12.10.FC4W1X1, a real problem with ~150 tables to define. Output showed 12.10 was treating it as a master replicate and running a per-node table verification step. Network/connection issues were ruled out (dbaccess connections were fast, same environment as 11.50). Madison Pruet's answer: add the --classic flag to 'cdr define replicate' so it isn't defined as a master replicate and the verification is skipped. No follow-up confirmation from Frank is recorded.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Folks, In 11.50 FC8, it only takes 1 or 2 seconds to run the following to define a replicate in three sites, cdr define replicate --conflict=ignore aip_inv_iasi1c_repl \\\\ "noaa@g_nsofops101:informix.aip_inv_iasi1c" "select * from aip_inv_iasi1c" \\\\ "noaa@g_ncdcops101:informix.aip_inv_iasi1c" "select * from aip_inv_iasi1c" \\\\ "noaa@g_ngdcops101:informix.aip_inv_iasi1c" "select * from aip_inv_iasi1c" But, it takes more than 60 seconds to do it in 12.10 FC4W1X1. It seems 12.10 ER takes a while to verify/check table ....for each site. We have 150 tables replicated, so the total time needed to define them gives us a downtime issue there. Any comments? Thanks Frank --001a11c1e878dce4d10508b14f9b
Hello, Frank. Have you tried to use templates, instead of using simple (and several) replicate definitions? It's a much more simple way to create a primary target replication... is that your case? Or do you really need bidirectional traffic way between nodes??? My suggestion would be trying it in 12.10, instead of your long command lines. Maybe the internal code would also be easier to complete than regular replicate definitions (mainly because there were several new features in ER, designed for consolidation purposes). Hope it helps. Regards. Alexandre Marini IBM Informix Certified Professional v10 / v11.50 / v11.70 / v12.10 IBM Information Management Informix Technical Professional IBM Certified Developer - Informix Genero BRIUG website administrator Informix independent consultant > To: ids@iiug.org > From: yunyaoqu@gmail.com > Subject: ER time to define a replicate in 11.50 and 12.10 [34211] > Date: Tue, 25 Nov 2014 11:22:11 -0500 > > Folks, > > In 11.50 FC8, it only takes 1 or 2 seconds to run the following to define a > replicate in three sites, > > cdr define replicate --conflict=ignore aip_inv_iasi1c_repl \\\\ > > "noaa@g_nsofops101:informix.aip_inv_iasi1c" "select * from > aip_inv_iasi1c" \\\\ > > "noaa@g_ncdcops101:informix.aip_inv_iasi1c" "select * from > aip_inv_iasi1c" \\\\ > > "noaa@g_ngdcops101:informix.aip_inv_iasi1c" "select * from > aip_inv_iasi1c" > > But, it takes more than 60 seconds to do it in 12.10 FC4W1X1. > It seems 12.10 ER takes a while to verify/check table ....for each site. > > We have 150 tables replicated, so the total time needed to define them > gives us a downtime issue there. > > Any comments? > > Thanks > Frank > > --001a11c1e878dce4d10508b14f9b > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. >
HI, Alex, We need ER update anywhere, so it is a bidirectional traffic between sites. Not sure other options to do it, might test/try next if possible. Group definition can have extra benefits ? Thanks Frank On Tue, Nov 25, 2014 at 11:58 AM, Alexandre Marini <alexandre@briug.org> wrote: > Hello, Frank. > Have you tried to use templates, instead of using simple (and several) > replicate definitions? > It's a much more simple way to create a primary target replication... is > that > your case? Or do you really need bidirectional traffic way between nodes??? > > My suggestion would be trying it in 12.10, instead of your long command > lines. > Maybe the internal code would also be easier to complete than regular > replicate definitions (mainly because there were several new features in > ER, > designed for consolidation purposes). > > Hope it helps. > Regards. > > Alexandre Marini > IBM Informix Certified Professional v10 / v11.50 / v11.70 / v12.10 > > IBM Information Management Informix Technical Professional > > IBM Certified Developer - Informix Genero > BRIUG website administrator > Informix independent consultant > > > To: ids@iiug.org > > From: yunyaoqu@gmail.com > > Subject: ER time to define a replicate in 11.50 and 12.10 [34211] > > Date: Tue, 25 Nov 2014 11:22:11 -0500 > > > > Folks, > > > > In 11.50 FC8, it only takes 1 or 2 seconds to run the following to > define a > > replicate in three sites, > > > > cdr define replicate --conflict=ignore aip_inv_iasi1c_repl \\\\ > > > > "noaa@g_nsofops101:informix.aip_inv_iasi1c" "select * from > > aip_inv_iasi1c" \\\\ > > > > "noaa@g_ncdcops101:informix.aip_inv_iasi1c" "select * from > > aip_inv_iasi1c" \\\\ > > > > "noaa@g_ngdcops101:informix.aip_inv_iasi1c" "select * from > > aip_inv_iasi1c" > > > > But, it takes more than 60 seconds to do it in 12.10 FC4W1X1. > > It seems 12.10 ER takes a while to verify/check table ....for each site. > > > > We have 150 tables replicated, so the total time needed to define them > > gives us a downtime issue there. > > > > Any comments? > > > > Thanks > > Frank > > > > --001a11c1e878dce4d10508b14f9b > > > > > > > > ******************************************************************************* > > Forum Note: Use "Reply" to post a response in the discussion forum. > > > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --001a11c297941aa0680508b23f2c
How long does it take to connect to each of the servers via DBACCESS? = If it is taking over 60 seconds for the cdr utility to connect and verify = the tables in 12.10, then it would also take about the same time for 11.50 because we started verifying the tables in version 10 (or 9 - can't remember).... So to me it sounds like there is a problem with either the network, or = with the authentication of a client connection. Don't forget that the cdr utility is nothing but an esql/c program. M.P. From: "FRANK" <yunyaoqu@gmail.com> To: ids@iiug.org Date: 11/25/2014 10:22 AM Subject: ER time to define a replicate in 11.50 and 12.10 [34211] Sent by: ids-bounces@iiug.org Folks, In 11.50 FC8, it only takes 1 or 2 seconds to run the following to defi= ne a replicate in three sites, cdr define replicate --conflict=3Dignore aip_inv_iasi1c_repl \\\\ "noaa@g_nsofops101:informix.aip_inv_iasi1c" "select * from aip_inv_iasi1c" \\\\ "noaa@g_ncdcops101:informix.aip_inv_iasi1c" "select * from aip_inv_iasi1c" \\\\ "noaa@g_ngdcops101:informix.aip_inv_iasi1c" "select * from aip_inv_iasi1c" But, it takes more than 60 seconds to do it in 12.10 FC4W1X1. It seems 12.10 ER takes a while to verify/check table ....for each site= . We have 150 tables replicated, so the total time needed to define them gives us a downtime issue there. Any comments? Thanks Frank --001a11c1e878dce4d10508b14f9b ***********************************************************************= ******** Forum Note: Use "Reply" to post a response in the discussion forum. =
HI, Madison,
dbaccess is fast to connect to other sites ( 1-2 seconds).
We tested the same cdr define replicate command in the same box /same
network with two versions, it is running incomparably fast in 11.50 FC8.
The 12.10 output of the running command showed it was doing some
verification works ( took time in each node) which is not needed or
showed in 11.50.
Thanks
Frank
On Tue, Nov 25, 2014 at 12:40 PM, Madison Pruet <mpruet@us.ibm.com> wrote:
> How long does it take to connect to each of the servers via DBACCESS? =
> If
> it is taking over 60 seconds for the cdr utility to connect and verify =
> the
> tables in 12.10, then it would also take about the same time for 11.50
> because we started verifying the tables in version 10 (or 9 - can't
> remember)....
>
> So to me it sounds like there is a problem with either the network, or =
> with
> the authentication of a client connection. Don't forget that the cdr
> utility is nothing but an esql/c program.
>
> M.P.
>
> From: "FRANK" <yunyaoqu@gmail.com>
> To: ids@iiug.org
> Date: 11/25/2014 10:22 AM
> Subject: ER time to define a replicate in 11.50 and 12.10 [34211]
> Sent by: ids-bounces@iiug.org
>
> Folks,
>
> In 11.50 FC8, it only takes 1 or 2 seconds to run the following to defi=
> ne a
>
> replicate in three sites,
>
> cdr define replicate --conflict=3Dignore aip_inv_iasi1c_repl \\\\
>
> "noaa@g_nsofops101:informix.aip_inv_iasi1c" "select * from
> aip_inv_iasi1c" \\\\
>
> "noaa@g_ncdcops101:informix.aip_inv_iasi1c" "select * from
> aip_inv_iasi1c" \\\\
>
> "noaa@g_ngdcops101:informix.aip_inv_iasi1c" "select * from
> aip_inv_iasi1c"
>
> But, it takes more than 60 seconds to do it in 12.10 FC4W1X1.
> It seems 12.10 ER takes a while to verify/check table ....for each site=
> ..
>
> We have 150 tables replicated, so the total time needed to define them
> gives us a downtime issue there.
>
> Any comments?
>
> Thanks
> Frank
>
> --001a11c1e878dce4d10508b14f9b
>
> ***********************************************************************=
> ********
>
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
> =
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--001a11c1e8788f6ffa0508b2af92
When you say it's fast to connect I assume you tried from the server running 12.10. Is this correct? And if you try to connecto to that server (12.10) and then do a remote query to the other servers? Fast? Finally, did you change anything in your resolver configuration recently? (/etc/nsswitch.con , /etc/resolv.conf etc.) --089e013a213ef5e04f0508b42013
Fernando, I should be able to answer the questions next , the env now is changed and need setup again. Thanks for your response, will verify all things and let you know next. Thanks Frank On Tue, Nov 25, 2014 at 2:43 PM, Fernando Nunes <domusonline@gmail.com> wrote: > When you say it's fast to connect I assume you tried from the server > running 12.10. Is this correct? > And if you try to connecto to that server (12.10) and then do a remote > query to the other servers? Fast? > Finally, did you change anything in your resolver configuration recently? > (/etc/nsswitch.con , /etc/resolv.conf etc.) > > --089e013a213ef5e04f0508b42013 > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --001a1139126c90b85c0508b47514
OK. Today, I am able to do a test /verification on this again.
[informix@maggie ER_benchmark]$ onstat -version
Program Name: onstat
Build Version: 12.10.FC4W1X1
Build Number: N028
Build Host: lxvm-l172
Build OS: Linux 2.6.18-128.el5
Build Date: Tue Sep 16 15:07:24 CDT 2014
Build Timestamp: 16-Sep-2014.14:53:46UTC-05
GLS Version: glslib-6.00.FC4
Command file:
[informix@maggie ER_benchmark]$ more define_ds_head_repl
date
cdr define replicate --conflict=ignore --ats --ris my_ds_head_repl \\\\
"noaa@g_nsofops:informix.my_ds_head" "select * from my_ds_head" \\\\
"noaa@g_ncdcops:informix.my_ds_head" "select * from my_ds_head" \\\\
"noaa@g_ngdcops:informix.my_ds_head" "select * from my_ds_head"
date
Running output and time:
[informix@maggie ER_benchmark]$ time define_ds_head_repl
Mon Jan 12 17:57:15 UTC 2015
Interpreting this replicate as a master replicate.
Verification of noaa@g_nsofops:informix.my_ds_head started
Verification of noaa@g_nsofops:informix.my_ds_head is successful
Verification of noaa@g_ncdcops:informix.my_ds_head started
Verification of noaa@g_ncdcops:informix.my_ds_head is successful
Verification of noaa@g_ngdcops:informix.my_ds_head started
Verification of noaa@g_ngdcops:informix.my_ds_head is successful
Mon Jan 12 17:57:56 UTC 2015
real 0m41.826s
user 0m5.075s
sys 0m0.173s
You can see "cdr define repl " command takes more than 40 seconds . It
only took a 2 or 3 seconds in 11.50.
Seems the new table verification process takes time (which is not needed
in 11.50 ?)
Can the verification process be disabled ? or other options ? ( we have
hundred of tables which could save huge time)
Yes. all other types of connections( dbaccess ...) are running very fast
. Actually this is the same environment we used for 11.50 which run all
fast.
Thanks
Frank
On Tue, Nov 25, 2014 at 3:07 PM, FRANK <yunyaoqu@gmail.com> wrote:
> Fernando,
> I should be able to answer the questions next , the env now is changed
> and need setup again.
>
> Thanks for your response, will verify all things and let you know next.
>
> Thanks
> Frank
>
>
> On Tue, Nov 25, 2014 at 2:43 PM, Fernando Nunes <domusonline@gmail.com>
> wrote:
>
>> When you say it's fast to connect I assume you tried from the server
>> running 12.10. Is this correct?
>> And if you try to connecto to that server (12.10) and then do a remote
>> query to the other servers? Fast?
>> Finally, did you change anything in your resolver configuration recently?
>> (/etc/nsswitch.con , /etc/resolv.conf etc.)
>>
>> --089e013a213ef5e04f0508b42013
>>
>>
>>
>>
*******************************************************************************
>> Forum Note: Use "Reply" to post a response in the discussion forum.
>>
>>
>
--089e0149d2dcbaaec2050c788230
define repl..... --classic
From: "FRANK" <yunyaoqu@gmail.com>
To: ids@iiug.org
Date: 01/12/2015 12:17 PM
Subject: Re: ER time to define a replicate in 11.50 and.... [34449]
Sent by: ids-bounces@iiug.org
OK. Today, I am able to do a test /verification on this again.
[informix@maggie ER_benchmark]$ onstat -version
Program Name: onstat
Build Version: 12.10.FC4W1X1
Build Number: N028
Build Host: lxvm-l172
Build OS: Linux 2.6.18-128.el5
Build Date: Tue Sep 16 15:07:24 CDT 2014
Build Timestamp: 16-Sep-2014.14:53:46UTC-05
GLS Version: glslib-6.00.FC4
Command file:
[informix@maggie ER_benchmark]$ more define_ds_head_repl
date
cdr define replicate --conflict=3Dignore --ats --ris my_ds_head_repl \\\\
"noaa@g_nsofops:informix.my_ds_head" "select * from my_ds_head" \\\\
"noaa@g_ncdcops:informix.my_ds_head" "select * from my_ds_head" \\\\
"noaa@g_ngdcops:informix.my_ds_head" "select * from my_ds_head"
date
Running output and time:
[informix@maggie ER_benchmark]$ time define_ds_head_repl
Mon Jan 12 17:57:15 UTC 2015
Interpreting this replicate as a master replicate.
Verification of noaa@g_nsofops:informix.my_ds_head started
Verification of noaa@g_nsofops:informix.my_ds_head is successful
Verification of noaa@g_ncdcops:informix.my_ds_head started
Verification of noaa@g_ncdcops:informix.my_ds_head is successful
Verification of noaa@g_ngdcops:informix.my_ds_head started
Verification of noaa@g_ngdcops:informix.my_ds_head is successful
Mon Jan 12 17:57:56 UTC 2015
real 0m41.826s
user 0m5.075s
sys 0m0.173s
You can see "cdr define repl " command takes more than 40 seconds . It
only took a 2 or 3 seconds in 11.50.
Seems the new table verification process takes time (which is not neede=
d
in 11.50 ?)
Can the verification process be disabled ? or other options ? ( we have=
hundred of tables which could save huge time)
Yes. all other types of connections( dbaccess ...) are running very fas=
t
.. Actually this is the same environment we used for 11.50 which run al=
l
fast.
Thanks
Frank
On Tue, Nov 25, 2014 at 3:07 PM, FRANK <yunyaoqu@gmail.com> wrote:
> Fernando,
> I should be able to answer the questions next , the env now is change=
d
> and need setup again.
>
> Thanks for your response, will verify all things and let you know nex=
t.
>
> Thanks
> Frank
>
>
> On Tue, Nov 25, 2014 at 2:43 PM, Fernando Nunes <domusonline@gmail.co=
m>
> wrote:
>
>> When you say it's fast to connect I assume you tried from the server=
>> running 12.10. Is this correct?
>> And if you try to connecto to that server (12.10) and then do a remo=
te
>> query to the other servers? Fast?
>> Finally, did you change anything in your resolver configuration
recently?
>> (/etc/nsswitch.con , /etc/resolv.conf etc.)
>>
>> --089e013a213ef5e04f0508b42013
>>
>>
>>
>>
***********************************************************************=
********
>> Forum Note: Use "Reply" to post a response in the discussion forum.
>>
>>
>
--089e0149d2dcbaaec2050c788230
***********************************************************************=
********
Forum Note: Use "Reply" to post a response in the discussion forum.
=