concurrent connections problem
On Solaris 10 with IDS 10.00.FC8, remote client connections slowed to over a minute once concurrent connections hit ~1000-1024, while local connections stayed fine; the poster also asked what MAX_INCOMPLETE_CONNECTIONS and LISTEN_TIMEOUT do. Art Kagel asked for the sqlhosts/NETTYPE details (four TLITCP aliases, NETTYPE tlitcp,12,350,NET) and advised that 350 connections per poll thread exceeds IBM's recommended 200 - likely the cause - suggesting something like NETTYPE tlitcp,10,200,NET and always using NET VPs rather than CPU VPs for network polling. He also questioned the need for four ports on one address. The poster thanked him, but no confirmation of a fix is recorded.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Hi all, We're facing a problem when concurrent connections reach 1000 or 1024 connections (monitor by "netstat -a" command ) then the application cannot connect more. ("cannot connect" means exceed timeout , 5 sec) We have 1 Database server : Sun Solaris 10 , IDS 10.00 FC8 , ESQL/C 2.9 2 Application server : ESQL/C 2.9 We split database port to 4 port ; port_a, port_b ,port_c ,port_d Under 1000, every connection look good. It takes not over 1sec. After reaching 1000 connections , the database still connectable for local connection (any port) , but remote connection cannot perform (all port). It 's not error but It takes more than a minute to connect. I see in the Admin Guide about a parameter "MAX_INCOMPLETE_ CONNECTIONS" and "LISTEN_TIMEOUT" , Can you tell me what's this parameter use for and how to use ? Best Regards, Jakkrit A. IDS guy.
What are your NETTYPE settings? Art On Mon, Nov 10, 2008 at 6:47 AM, jak aka <jakkritakeng@yahoo.com> wrote: > Hi all, > > We're facing a problem when concurrent connections reach 1000 or 1024 > connections (monitor by "netstat -a" command ) then the application cannot > connect more. ("cannot connect" means exceed timeout , 5 sec) > > We have > 1 Database server : Sun Solaris 10 , IDS 10.00 FC8 , ESQL/C 2.9 > 2 Application server : ESQL/C 2.9 > > We split database port to 4 port ; port_a, port_b ,port_c ,port_d > > Under 1000, every connection look good. It takes not over 1sec. After > reaching > 1000 connections , the database still connectable for local connection (any > port) , but remote connection cannot perform (all port). It 's not error > but > It takes more than a minute to connect. > > I see in the Admin Guide about a parameter "MAX_INCOMPLETE_ CONNECTIONS" > and > "LISTEN_TIMEOUT" , Can you tell me what's this parameter use for and how to > use ? > > Best Regards, > Jakkrit A. > IDS guy. > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > -- Art S. Kagel Oninit (www.oninit.com) IIUG Board of Directors (art@iiug.org) Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on my employer, Oninit, the IIUG, nor any other organization with which I am associated either explicitly or implicitly. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves.
ontlitcp ________________________________ From: Art Kagel <art.kagel@gmail.com> To: ids@iiug.org Sent: Monday, November 10, 2008 7:04:44 PM Subject: Re: concurrent connections problem [13947] What are your NETTYPE settings? Art On Mon, Nov 10, 2008 at 6:47 AM, jak aka <jakkritakeng@yahoo.com> wrote: > Hi all, > > We're facing a problem when concurrent connections reach 1000 or 1024 > connections (monitor by "netstat -a" command ) then the application cannot > connect more. ("cannot connect" means exceed timeout , 5 sec) > > We have > 1 Database server : Sun Solaris 10 , IDS 10.00 FC8 , ESQL/C 2.9 > 2 Application server : ESQL/C 2.9 > > We split database port to 4 port ; port_a, port_b ,port_c ,port_d > > Under 1000, every connection look good. It takes not over 1sec. After > reaching > 1000 connections , the database still connectable for local connection (any > port) , but remote connection cannot perform (all port). It 's not error > but > It takes more than a minute to connect. > > I see in the Admin Guide about a parameter "MAX_INCOMPLETE_ CONNECTIONS" > and > "LISTEN_TIMEOUT" , Can you tell me what's this parameter use for and how to > use ? > > Best Regards, > Jakkrit A. > IDS guy. > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > -- Art S. Kagel Oninit (www.oninit.com) IIUG Board of Directors (art@iiug.org) Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on my employer, Oninit, the IIUG, nor any other organization with which I am associated either explicitly or implicitly. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves. ******************************************************************************* Forum Note: Use "Reply" to post a response in the discussion forum.
port_a ontlitcp SERVER XXX1 r=0, s=2 port_b ontlitcp SERVER XXX2 r=0, s=2 port_c ontlitcp SERVER XXX3 r=0, s=2 port_d ontlitcp SERVER XXX4 r=0, s=2 Best regards, Jakkrit A. ________________________________ From: Art Kagel <art.kagel@gmail.com> To: ids@iiug.org Sent: Monday, November 10, 2008 7:04:44 PM Subject: Re: concurrent connections problem [13947] What are your NETTYPE settings? Art On Mon, Nov 10, 2008 at 6:47 AM, jak aka <jakkritakeng@yahoo.com> wrote: > Hi all, > > We're facing a problem when concurrent connections reach 1000 or 1024 > connections (monitor by "netstat -a" command ) then the application cannot > connect more. ("cannot connect" means exceed timeout , 5 sec) > > We have > 1 Database server : Sun Solaris 10 , IDS 10.00 FC8 , ESQL/C 2.9 > 2 Application server : ESQL/C 2.9 > > We split database port to 4 port ; port_a, port_b ,port_c ,port_d > > Under 1000, every connection look good. It takes not over 1sec. After > reaching > 1000 connections , the database still connectable for local connection (any > port) , but remote connection cannot perform (all port). It 's not error > but > It takes more than a minute to connect. > > I see in the Admin Guide about a parameter "MAX_INCOMPLETE_ CONNECTIONS" > and > "LISTEN_TIMEOUT" , Can you tell me what's this parameter use for and how to > use ? > > Best Regards, > Jakkrit A. > IDS guy. > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > -- Art S. Kagel Oninit (www.oninit.com) IIUG Board of Directors (art@iiug.org) Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on my employer, Oninit, the IIUG, nor any other organization with which I am associated either explicitly or implicitly. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves. ******************************************************************************* Forum Note: Use "Reply" to post a response in the discussion forum.
NETTYPE tlitcp,12,350,NET
(we try both NET and CPU)
________________________________
From: jak aka <jakkritakeng@yahoo.com>
To: ids@iiug.org
Sent: Monday, November 10, 2008 8:23:39 PM
Subject: Re: concurrent connections problem [13947]
port_a ontlitcp SERVER XXX1 r=0, s=2
port_b ontlitcp SERVER XXX2 r=0, s=2
port_c ontlitcp SERVER XXX3 r=0, s=2
port_d ontlitcp SERVER XXX4 r=0, s=2
Best regards,
Jakkrit A.
________________________________
From: Art Kagel <art.kagel@gmail.com>
To: ids@iiug.org
Sent: Monday, November 10, 2008 7:04:44 PM
Subject: Re: concurrent connections problem [13947]
What are your NETTYPE settings?
Art
On Mon, Nov 10, 2008 at 6:47 AM, jak aka <jakkritakeng@yahoo.com> wrote:
> Hi all,
>
> We're facing a problem when concurrent connections reach 1000 or 1024
> connections (monitor by "netstat -a" command ) then the application cannot
> connect more. ("cannot connect" means exceed timeout , 5 sec)
>
> We have
> 1 Database server : Sun Solaris 10 , IDS 10.00 FC8 , ESQL/C 2.9
> 2 Application server : ESQL/C 2.9
>
> We split database port to 4 port ; port_a, port_b ,port_c ,port_d
>
> Under 1000, every connection look good. It takes not over 1sec. After
> reaching
> 1000 connections , the database still connectable for local connection (any
> port) , but remote connection cannot perform (all port). It 's not error
> but
> It takes more than a minute to connect.
>
> I see in the Admin Guide about a parameter "MAX_INCOMPLETE_ CONNECTIONS"
> and
> "LISTEN_TIMEOUT" , Can you tell me what's this parameter use for and how to
> use ?
>
> Best Regards,
> Jakkrit A.
> IDS guy.
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--
Art S. Kagel
Oninit (www.oninit.com)
IIUG Board of Directors (art@iiug.org)
Disclaimer: Please keep in mind that my own opinions are my own opinions and
do not reflect on my employer, Oninit, the IIUG, nor any other organization
with which I am associated either explicitly or implicitly. Neither do
those opinions reflect those of other individuals affiliated with any entity
with which I am affiliated nor those of the entities themselves.
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.
No, I guessed that, network connections on Solaris are only TLITCP. In your ONCONFIG file, do you have any settings for the configuration parameter NETTYPE, or are you living with the default? What settings if any? Is the TLITCP connection name entered as DBSERVERNAME or in DBSERVERALIASES in the ONCONFIG file? All of this affects how the server is working and how we reply to your question. The default is to use a single TLI listener/poll thread configured initially for only 50 connections. To run that listener/poll in the first CPU VP if the TLITCP connection name is the DBSERVERNAME or in a single NET VP if it is in DBSERVERALIASES. Obviously with four connection names at least three of these names are in DBSERVERALIASES, but indulge me. Art On Mon, Nov 10, 2008 at 8:20 AM, jak aka <jakkritakeng@yahoo.com> wrote: > ontlitcp > > ________________________________ > From: Art Kagel <art.kagel@gmail.com> > To: ids@iiug.org > Sent: Monday, November 10, 2008 7:04:44 PM > Subject: Re: concurrent connections problem [13947] > > What are your NETTYPE settings? > > Art > > On Mon, Nov 10, 2008 at 6:47 AM, jak aka <jakkritakeng@yahoo.com> wrote: > > > Hi all, > > > > We're facing a problem when concurrent connections reach 1000 or 1024 > > connections (monitor by "netstat -a" command ) then the application > cannot > > connect more. ("cannot connect" means exceed timeout , 5 sec) > > > > We have > > 1 Database server : Sun Solaris 10 , IDS 10.00 FC8 , ESQL/C 2.9 > > 2 Application server : ESQL/C 2.9 > > > > We split database port to 4 port ; port_a, port_b ,port_c ,port_d > > > > Under 1000, every connection look good. It takes not over 1sec. After > > reaching > > 1000 connections , the database still connectable for local connection > (any > > port) , but remote connection cannot perform (all port). It 's not error > > but > > It takes more than a minute to connect. > > > > I see in the Admin Guide about a parameter "MAX_INCOMPLETE_ CONNECTIONS" > > and > > "LISTEN_TIMEOUT" , Can you tell me what's this parameter use for and how > to > > use ? > > > > Best Regards, > > Jakkrit A. > > IDS guy. > > > > > > > > > > > ******************************************************************************* > > Forum Note: Use "Reply" to post a response in the discussion forum. > > > > > > -- > Art S. Kagel > Oninit (www.oninit.com) > IIUG Board of Directors (art@iiug.org) > > Disclaimer: Please keep in mind that my own opinions are my own opinions > and > do not reflect on my employer, Oninit, the IIUG, nor any other organization > with which I am associated either explicitly or implicitly. Neither do > those opinions reflect those of other individuals affiliated with any > entity > with which I am affiliated nor those of the entities themselves. > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > -- Art S. Kagel Oninit (www.oninit.com) IIUG Board of Directors (art@iiug.org) Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on my employer, Oninit, the IIUG, nor any other organization with which I am associated either explicitly or implicitly. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves.
Those are the sqlhosts entries, not the NETTYPE settings, but it is helpful and I see the NETTYPE message just arrived. I'll reply to that one. Art On Mon, Nov 10, 2008 at 8:23 AM, jak aka <jakkritakeng@yahoo.com> wrote: > port_a ontlitcp SERVER XXX1 r=0, s=2 > port_b ontlitcp SERVER XXX2 r=0, s=2 > port_c ontlitcp SERVER XXX3 r=0, s=2 > port_d ontlitcp SERVER XXX4 r=0, s=2 > > Best regards, > Jakkrit A. > > ________________________________ > From: Art Kagel <art.kagel@gmail.com> > To: ids@iiug.org > Sent: Monday, November 10, 2008 7:04:44 PM > Subject: Re: concurrent connections problem [13947] > > What are your NETTYPE settings? > > Art > > On Mon, Nov 10, 2008 at 6:47 AM, jak aka <jakkritakeng@yahoo.com> wrote: > > > Hi all, > > > > We're facing a problem when concurrent connections reach 1000 or 1024 > > connections (monitor by "netstat -a" command ) then the application > cannot > > connect more. ("cannot connect" means exceed timeout , 5 sec) > > > > We have > > 1 Database server : Sun Solaris 10 , IDS 10.00 FC8 , ESQL/C 2.9 > > 2 Application server : ESQL/C 2.9 > > > > We split database port to 4 port ; port_a, port_b ,port_c ,port_d > > > > Under 1000, every connection look good. It takes not over 1sec. After > > reaching > > 1000 connections , the database still connectable for local connection > (any > > port) , but remote connection cannot perform (all port). It 's not error > > but > > It takes more than a minute to connect. > > > > I see in the Admin Guide about a parameter "MAX_INCOMPLETE_ CONNECTIONS" > > and > > "LISTEN_TIMEOUT" , Can you tell me what's this parameter use for and how > to > > use ? > > > > Best Regards, > > Jakkrit A. > > IDS guy. > > > > > > > > > > > ******************************************************************************* > > Forum Note: Use "Reply" to post a response in the discussion forum. > > > > > > -- > Art S. Kagel > Oninit (www.oninit.com) > IIUG Board of Directors (art@iiug.org) > > Disclaimer: Please keep in mind that my own opinions are my own opinions > and > do not reflect on my employer, Oninit, the IIUG, nor any other organization > with which I am associated either explicitly or implicitly. Neither do > those opinions reflect those of other individuals affiliated with any > entity > with which I am affiliated nor those of the entities themselves. > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > -- Art S. Kagel Oninit (www.oninit.com) IIUG Board of Directors (art@iiug.org) Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on my employer, Oninit, the IIUG, nor any other organization with which I am associated either explicitly or implicitly. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves.
Twelve poll threads seems excessive - how many CPU cores are on this
machine? Also 350 connections permitted per poll thread is too many. IBM
recommends that you not allow more than 200 connections per poll thread -
that may be your problem. So, estimate the maximum number of connections
you expect to see and divide that by 200 to get the number of required poll
threads.
Also, why have four ports on the same network address for a single server?
Lets allow for 2000 connections, so I would recommend:
NETTYPE tlitcp,10,200,NET -- Always use NET VP poll threads for network
connections, never CPU VPs.
Art
On Mon, Nov 10, 2008 at 8:30 AM, jak aka <jakkritakeng@yahoo.com> wrote:
> NETTYPE tlitcp,12,350,NET>
> (we try both NET and CPU)
>
> ________________________________
> From: jak aka <jakkritakeng@yahoo.com>
> To: ids@iiug.org
> Sent: Monday, November 10, 2008 8:23:39 PM
> Subject: Re: concurrent connections problem [13947]
>
> port_a ontlitcp SERVER XXX1 r=0, s=2
> port_b ontlitcp SERVER XXX2 r=0, s=2
> port_c ontlitcp SERVER XXX3 r=0, s=2
> port_d ontlitcp SERVER XXX4 r=0, s=2
>
> Best regards,
> Jakkrit A.
>
> ________________________________
> From: Art Kagel <art.kagel@gmail.com>
> To: ids@iiug.org
> Sent: Monday, November 10, 2008 7:04:44 PM
> Subject: Re: concurrent connections problem [13947]
>
> What are your NETTYPE settings?
>
> Art
>
> On Mon, Nov 10, 2008 at 6:47 AM, jak aka <jakkritakeng@yahoo.com> wrote:
>
> > Hi all,
> >
> > We're facing a problem when concurrent connections reach 1000 or 1024
> > connections (monitor by "netstat -a" command ) then the application
> cannot
> > connect more. ("cannot connect" means exceed timeout , 5 sec)
> >
> > We have
> > 1 Database server : Sun Solaris 10 , IDS 10.00 FC8 , ESQL/C 2.9
> > 2 Application server : ESQL/C 2.9
> >
> > We split database port to 4 port ; port_a, port_b ,port_c ,port_d
> >
> > Under 1000, every connection look good. It takes not over 1sec. After
> > reaching
> > 1000 connections , the database still connectable for local connection
> (any
> > port) , but remote connection cannot perform (all port). It 's not error
> > but
> > It takes more than a minute to connect.
> >
> > I see in the Admin Guide about a parameter "MAX_INCOMPLETE_ CONNECTIONS"
> > and
> > "LISTEN_TIMEOUT" , Can you tell me what's this parameter use for and how
> to
> > use ?
> >
> > Best Regards,
> > Jakkrit A.
> > IDS guy.
> >
> >
> >
> >
>
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --
> Art S. Kagel
> Oninit (www.oninit.com)
> IIUG Board of Directors (art@iiug.org)
>
> Disclaimer: Please keep in mind that my own opinions are my own opinions
> and
> do not reflect on my employer, Oninit, the IIUG, nor any other organization
> with which I am associated either explicitly or implicitly. Neither do
> those opinions reflect those of other individuals affiliated with any
> entity
> with which I am affiliated nor those of the entities themselves.
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--
Art S. Kagel
Oninit (www.oninit.com)
IIUG Board of Directors (art@iiug.org)
Disclaimer: Please keep in mind that my own opinions are my own opinions and
do not reflect on my employer, Oninit, the IIUG, nor any other organization
with which I am associated either explicitly or implicitly. Neither do
those opinions reflect those of other individuals affiliated with any entity
with which I am affiliated nor those of the entities themselves.
Thank you very much Art
We have 16 CPU and use for VPs only 12 cpu.
Jakkrit A.
________________________________
From: Art Kagel <art.kagel@gmail.com>
To: ids@iiug.org
Sent: Monday, November 10, 2008 9:33:46 PM
Subject: Re: concurrent connections problem [13953]
Twelve poll threads seems excessive - how many CPU cores are on this
machine? Also 350 connections permitted per poll thread is too many. IBM
recommends that you not allow more than 200 connections per poll thread -
that may be your problem. So, estimate the maximum number of connections
you expect to see and divide that by 200 to get the number of required poll
threads.
Also, why have four ports on the same network address for a single server?
Lets allow for 2000 connections, so I would recommend:
NETTYPE tlitcp,10,200,NET -- Always use NET VP poll threads for network
connections, never CPU VPs.
Art
On Mon, Nov 10, 2008 at 8:30 AM, jak aka <jakkritakeng@yahoo.com> wrote:
> NETTYPE tlitcp,12,350,NET>
> (we try both NET and CPU)
>
> ________________________________
> From: jak aka <jakkritakeng@yahoo.com>
> To: ids@iiug.org
> Sent: Monday, November 10, 2008 8:23:39 PM
> Subject: Re: concurrent connections problem [13947]
>
> port_a ontlitcp SERVER XXX1 r=0, s=2
> port_b ontlitcp SERVER XXX2 r=0, s=2
> port_c ontlitcp SERVER XXX3 r=0, s=2
> port_d ontlitcp SERVER XXX4 r=0, s=2
>
> Best regards,
> Jakkrit A.
>
> ________________________________
> From: Art Kagel <art.kagel@gmail.com>
> To: ids@iiug.org
> Sent: Monday, November 10, 2008 7:04:44 PM
> Subject: Re: concurrent connections problem [13947]
>
> What are your NETTYPE settings?
>
> Art
>
> On Mon, Nov 10, 2008 at 6:47 AM, jak aka <jakkritakeng@yahoo.com> wrote:
>
> > Hi all,
> >
> > We're facing a problem when concurrent connections reach 1000 or 1024
> > connections (monitor by "netstat -a" command ) then the application
> cannot
> > connect more. ("cannot connect" means exceed timeout , 5 sec)
> >
> > We have
> > 1 Database server : Sun Solaris 10 , IDS 10.00 FC8 , ESQL/C 2.9
> > 2 Application server : ESQL/C 2.9
> >
> > We split database port to 4 port ; port_a, port_b ,port_c ,port_d
> >
> > Under 1000, every connection look good. It takes not over 1sec. After
> > reaching
> > 1000 connections , the database still connectable for local connection
> (any
> > port) , but remote connection cannot perform (all port). It 's not error
> > but
> > It takes more than a minute to connect.
> >
> > I see in the Admin Guide about a parameter "MAX_INCOMPLETE_ CONNECTIONS"
> > and
> > "LISTEN_TIMEOUT" , Can you tell me what's this parameter use for and how
> to
> > use ?
> >
> > Best Regards,
> > Jakkrit A.
> > IDS guy.
> >
> >
> >
> >
>
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --
> Art S. Kagel
> Oninit (www.oninit.com)
> IIUG Board of Directors (art@iiug.org)
>
> Disclaimer: Please keep in mind that my own opinions are my own opinions
> and
> do not reflect on my employer, Oninit, the IIUG, nor any other organization
> with which I am associated either explicitly or implicitly. Neither do
> those opinions reflect those of other individuals affiliated with any
> entity
> with which I am affiliated nor those of the entities themselves.
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--
Art S. Kagel
Oninit (www.oninit.com)
IIUG Board of Directors (art@iiug.org)
Disclaimer: Please keep in mind that my own opinions are my own opinions and
do not reflect on my employer, Oninit, the IIUG, nor any other organization
with which I am associated either explicitly or implicitly. Neither do
those opinions reflect those of other individuals affiliated with any entity
with which I am affiliated nor those of the entities themselves.
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.