slow response of cdr list server command
User reported slow response from 'cdr list server' command on one of three ER-replicated servers, while the other two were fast. Responders suggested the slow server likely had overall performance issues and recommended checking CPU usage with 'top'. A probable cause identified was shared memory being swapped to disk, causing delays when accessing memory blocks. No resolution was confirmed in the thread.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Hi, Folks, I have 3 boxes ER replicated each other. We see performance issue with ER data transferring between sites. Another observation is, The command : cdr list server runs fast in two sites( immediately get response), but very SLOW in another box. Any explanation why "cdr list server" run slow ? possibly related factors ? Thanks Frank --001a11346b5433d55404fadbdc82
Since cdr list server is only an exql/c program, if it is running slow = on one server, then I suspect everything else is running slow on that serv= er as well. You might want to run 'top' on the slow server and try to get an idea a= s to what process is eating up your cpu cycles. M.Pruet |------------> | From: | |------------> >--------------------------------------------------------------------= -----------------------------------------------------------------------= -------| |"FRANK" <yunyaoqu@gmail.com> = = | >--------------------------------------------------------------------= -----------------------------------------------------------------------= -------| |------------> | To: | |------------> >--------------------------------------------------------------------= -----------------------------------------------------------------------= -------| |ids@iiug.org, = = | >--------------------------------------------------------------------= -----------------------------------------------------------------------= -------| |------------> | Date: | |------------> >--------------------------------------------------------------------= -----------------------------------------------------------------------= -------| |06/02/2014 09:16 AM = = | >--------------------------------------------------------------------= -----------------------------------------------------------------------= -------| |------------> | Subject: | |------------> >--------------------------------------------------------------------= -----------------------------------------------------------------------= -------| |slow response of cdr list server command [33136] = = | >--------------------------------------------------------------------= -----------------------------------------------------------------------= -------| |------------> | Sent by: | |------------> >--------------------------------------------------------------------= -----------------------------------------------------------------------= -------| |ids-bounces@iiug.org = = | >--------------------------------------------------------------------= -----------------------------------------------------------------------= -------| Hi, Folks, I have 3 boxes ER replicated each other. We see performance issue with ER data transferring between sites. Another observation is, The command : cdr list server runs fast in two sites( immediately get response), but very SLOW in another box. Any explanation why "cdr list server" run slow ? possibly related factors ? Thanks Frank --001a11346b5433d55404fadbdc82 ***********************************************************************= ******** Forum Note: Use "Reply" to post a response in the discussion forum. =
Is it possible that you are seeing shared memory being swapped out on the slow system? Art Art S. Kagel, Principal Consultant ASK Database Management Blog: http://informix-myview.blogspot.com/ Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on the IIUG, nor any other organization with which I am associated either explicitly, implicitly, or by inference. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves. On Mon, Jun 2, 2014 at 11:15 AM, FRANK <yunyaoqu@gmail.com> wrote: > Hi, Folks, > > I have 3 boxes ER replicated each other. > > We see performance issue with ER data transferring between sites. > > Another observation is, > > The command : cdr list server runs fast in two sites( immediately get > response), but very SLOW in another box. > > Any explanation why "cdr list server" run slow ? possibly related > factors ? > > Thanks > Frank > > --001a11346b5433d55404fadbdc82 > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --047d7b3a88066ca17d04fadc0583
Do you mean shared memory being swapped out to the disk, which causes more = IO slowness issues? Thanks, Ernie Knox - Informix\\\\MySQL DBA Team Lead ----- Original Message ----- From: Art Kagel [mailto:art.kagel@gmail.com] Sent: Monday, June 02, 2014 11:26 AM Eastern Standard Time To: ids@iiug.org <ids@iiug.org> Subject: Re: slow response of cdr list server command [33138] Is it possible that you are seeing shared memory being swapped out on the=20 slow system?=20 Art=20 Art S. Kagel, Principal Consultant=20 ASK Database Management=20 Blog: http://informix-myview.blogspot.com/=20 Disclaimer: Please keep in mind that my own opinions are my own opinions=20 and do not reflect on the IIUG, nor any other organization with which I am= =20 associated either explicitly, implicitly, or by inference. Neither do=20 those opinions reflect those of other individuals affiliated with any=20 entity with which I am affiliated nor those of the entities themselves.=20 On Mon, Jun 2, 2014 at 11:15 AM, FRANK <yunyaoqu@gmail.com> wrote:=20 > Hi, Folks,=20 >=20 > I have 3 boxes ER replicated each other.=20 >=20 > We see performance issue with ER data transferring between sites.=20 >=20 > Another observation is,=20 >=20 > The command : cdr list server runs fast in two sites( immediately get=20 > response), but very SLOW in another box.=20 >=20 > Any explanation why "cdr list server" run slow ? possibly related=20 > factors ?=20 >=20 > Thanks=20 > Frank=20 >=20 > --001a11346b5433d55404fadbdc82=20 >=20 >=20 >=20 >=20 ***************************************************************************= ****=20 > Forum Note: Use "Reply" to post a response in the discussion forum.=20 >=20 >=20 --047d7b3a88066ca17d04fadc0583=20 ***************************************************************************= ****=20 Forum Note: Use "Reply" to post a response in the discussion forum.=20 This message, including any attachments, is the property of Sears Holdings = Corporation and/or one of its subsidiaries. It is confidential and may cont= ain proprietary or legally privileged information. If you are not the inten= ded recipient, please delete it without reading the contents. Thank you.
That, yes, but it would also cause a delay in connecting to and reading shared memory while the memory blocks are being read back into memory from disk. Art Art S. Kagel, Principal Consultant ASK Database Management Blog: http://informix-myview.blogspot.com/ Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on the IIUG, nor any other organization with which I am associated either explicitly, implicitly, or by inference. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves. On Mon, Jun 2, 2014 at 11:42 AM, Knox, Ernest <Ernest.Knox@searshc.com> wrote: > Do you mean shared memory being swapped out to the disk, which causes more > = > IO slowness issues? > > Thanks, > > Ernie Knox - Informix\\\\MySQL DBA Team Lead > > ----- Original Message ----- > From: Art Kagel [mailto:art.kagel@gmail.com] > Sent: Monday, June 02, 2014 11:26 AM Eastern Standard Time > To: ids@iiug.org <ids@iiug.org> > Subject: Re: slow response of cdr list server command [33138] > > Is it possible that you are seeing shared memory being swapped out on > the=20 > slow system?=20 > > Art=20 > > Art S. Kagel, Principal Consultant=20 > ASK Database Management=20 > > Blog: http://informix-myview.blogspot.com/=20 > > Disclaimer: Please keep in mind that my own opinions are my own opinions=20 > and do not reflect on the IIUG, nor any other organization with which I am= > =20 > associated either explicitly, implicitly, or by inference. Neither do=20 > those opinions reflect those of other individuals affiliated with any=20 > entity with which I am affiliated nor those of the entities themselves.=20 > > On Mon, Jun 2, 2014 at 11:15 AM, FRANK <yunyaoqu@gmail.com> wrote:=20 > > > Hi, Folks,=20 > >=20 > > I have 3 boxes ER replicated each other.=20 > >=20 > > We see performance issue with ER data transferring between sites.=20 > >=20 > > Another observation is,=20 > >=20 > > The command : cdr list server runs fast in two sites( immediately get=20 > > response), but very SLOW in another box.=20 > >=20 > > Any explanation why "cdr list server" run slow ? possibly related=20 > > factors ?=20 > >=20 > > Thanks=20 > > Frank=20 > >=20 > > --001a11346b5433d55404fadbdc82=20 > >=20 > >=20 > >=20 > >=20 > > ***************************************************************************= > ****=20 > > Forum Note: Use "Reply" to post a response in the discussion forum.=20 > >=20 > >=20 > > --047d7b3a88066ca17d04fadc0583=20 > > > ***************************************************************************= > ****=20 > Forum Note: Use "Reply" to post a response in the discussion forum.=20 > > This message, including any attachments, is the property of Sears Holdings > = > Corporation and/or one of its subsidiaries. It is confidential and may > cont= > ain proprietary or legally privileged information. If you are not the > inten= > ded recipient, please delete it without reading the contents. Thank you. > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --047d7b3a8aa836e5fd04fadc49a7
All, Forgot to mention: Linux RHEL6, IDS11.50 FC8. Now it is back to normal ( did Not captured any more evidence ), ER data replication is back to fast too. All suddenly work well. I think Something related to either that box or network were changed by people..... By the way, do you think changing value of, /proc/sys/net/ipv4/tcp_max_orphans Can have such type of impact? Thanks Frank On Mon, Jun 2, 2014 at 11:45 AM, Art Kagel <art.kagel@gmail.com> wrote: > That, yes, but it would also cause a delay in connecting to and reading > shared memory while the memory blocks are being read back into memory from > disk. > > Art > > Art S. Kagel, Principal Consultant > ASK Database Management > > Blog: http://informix-myview.blogspot.com/ > > Disclaimer: Please keep in mind that my own opinions are my own opinions > and do not reflect on the IIUG, nor any other organization with which I am > associated either explicitly, implicitly, or by inference. Neither do > those opinions reflect those of other individuals affiliated with any > entity with which I am affiliated nor those of the entities themselves. > > On Mon, Jun 2, 2014 at 11:42 AM, Knox, Ernest <Ernest.Knox@searshc.com> > wrote: > > > Do you mean shared memory being swapped out to the disk, which causes > more > > = > > IO slowness issues? > > > > Thanks, > > > > Ernie Knox - Informix\\\\MySQL DBA Team Lead > > > > ----- Original Message ----- > > From: Art Kagel [mailto:art.kagel@gmail.com] > > Sent: Monday, June 02, 2014 11:26 AM Eastern Standard Time > > To: ids@iiug.org <ids@iiug.org> > > Subject: Re: slow response of cdr list server command [33138] > > > > Is it possible that you are seeing shared memory being swapped out on > > the=20 > > slow system?=20 > > > > Art=20 > > > > Art S. Kagel, Principal Consultant=20 > > ASK Database Management=20 > > > > Blog: http://informix-myview.blogspot.com/=20 > > > > Disclaimer: Please keep in mind that my own opinions are my own > opinions=20 > > and do not reflect on the IIUG, nor any other organization with which I > am= > > =20 > > associated either explicitly, implicitly, or by inference. Neither do=20 > > those opinions reflect those of other individuals affiliated with any=20 > > entity with which I am affiliated nor those of the entities > themselves.=20 > > > > On Mon, Jun 2, 2014 at 11:15 AM, FRANK <yunyaoqu@gmail.com> wrote:=20 > > > > > Hi, Folks,=20 > > >=20 > > > I have 3 boxes ER replicated each other.=20 > > >=20 > > > We see performance issue with ER data transferring between sites.=20 > > >=20 > > > Another observation is,=20 > > >=20 > > > The command : cdr list server runs fast in two sites( immediately > get=20 > > > response), but very SLOW in another box.=20 > > >=20 > > > Any explanation why "cdr list server" run slow ? possibly related=20 > > > factors ?=20 > > >=20 > > > Thanks=20 > > > Frank=20 > > >=20 > > > --001a11346b5433d55404fadbdc82=20 > > >=20 > > >=20 > > >=20 > > >=20 > > > > > ***************************************************************************= > > ****=20 > > > Forum Note: Use "Reply" to post a response in the discussion forum.=20 > > >=20 > > >=20 > > > > --047d7b3a88066ca17d04fadc0583=20 > > > > > > > ***************************************************************************= > > ****=20 > > Forum Note: Use "Reply" to post a response in the discussion forum.=20 > > > > This message, including any attachments, is the property of Sears > Holdings > > = > > Corporation and/or one of its subsidiaries. It is confidential and may > > cont= > > ain proprietary or legally privileged information. If you are not the > > inten= > > ded recipient, please delete it without reading the contents. Thank you. > > > > > > > > > > ******************************************************************************* > > Forum Note: Use "Reply" to post a response in the discussion forum. > > > > > > --047d7b3a8aa836e5fd04fadc49a7 > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --001a1134215a34afe604fadcbe2a