hpl load in HDR cluster - "Cannot express load to
Posted in 2013
A user loading ~3.7M rows via HPL on the primary of an HDR cluster (12.10.FC1 on Linux) hit "Cannot express load to logged table on HDR Secondary server" (failpoints 11430/11008). Replies explained that express mode bypasses logging, and HDR replication is log-based, so express loads and raw/unlogged tables can't be used in a cluster; deluxe (logged) mode is required, just slower. The poster changed onpladm's -fl option to -flc to force deluxe mode and the load ran fine. Art Kagel also suggested external tables plus his dbcopy/dbmove utilities as a faster alternative.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Topics: High Availability & Replication, Platform-Specific Issues, Clustering, Grid & MACH11
Hi, I have a new (empty) table in our cluster that I need to populate with about 3.7 million rows. I have these in the standard pipe delimited format and ready for importing. On the primary, I created the hpl load job, but when I go to run it I get the following output: Cannot express load to logged table on HDR Secondary server Error occured at HPL failpoint: 11430 Error occured at HPL failpoint: 11008 Is there something I need to do on the secondary server to enable this to work properly? I've looked around a bit and it seems that maybe I should create the table initially as a RAW table, hpl load the data, and then convert it to a standard table. Is this the preferred method, and will the data successfully update my HDR secondary and RSS servers? We're running 12.10FC1 on Linux servers. Thanks, -Justin
You cannot use raw or unlogged tables in HDR cluster. Express works by adding data without logging to the tables... So can't be used in HDR On Fri, Dec 6, 2013 at 6:22 PM, Justin Killen < jkillen@allamericanasphalt.com> wrote: > Hi, > > I have a new (empty) table in our cluster that I need to populate with > about > 3.7 million rows. I have these in the standard pipe delimited format and > ready > for importing. On the primary, I created the hpl load job, but when I go to > run it I get the following output: > > Cannot express load to logged table on HDR Secondary server > Error occured at HPL failpoint: 11430 > Error occured at HPL failpoint: 11008 > > Is there something I need to do on the secondary server to enable this to > work > properly? > > I've looked around a bit and it seems that maybe I should create the table > initially as a RAW table, hpl load the data, and then convert it to a > standard > table. Is this the preferred method, and will the data successfully update > my > HDR secondary and RSS servers? > > We're running 12.10FC1 on Linux servers. > > Thanks, > -Justin > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > -- Fernando Nunes Portugal http://informix-technology.blogspot.com My email works... but I don't check it frequently... --001a1134caf21cd72e04ece1db4f
HDR is logged based so you can't use express mode Cheers Paul > -----Original Message----- > From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of > Justin Killen > Sent: Friday, December 06, 2013 12:23 PM > To: ids@iiug.org > Subject: hpl load in HDR cluster - "Cannot express load.... [32097] > > Hi, > > I have a new (empty) table in our cluster that I need to populate with about > 3.7 million rows. I have these in the standard pipe delimited format and > ready > for importing. On the primary, I created the hpl load job, but when I go to > run it I get the following output: > > Cannot express load to logged table on HDR Secondary server > Error occured at HPL failpoint: 11430 > Error occured at HPL failpoint: 11008 > > Is there something I need to do on the secondary server to enable this to > work > properly? > > I've looked around a bit and it seems that maybe I should create the table > initially as a RAW table, hpl load the data, and then convert it to a standard > table. Is this the preferred method, and will the data successfully update my > HDR secondary and RSS servers? > > We're running 12.10FC1 on Linux servers. > > Thanks, > -Justin > > > ********************************************************** > ********************* > Forum Note: Use "Reply" to post a response in the discussion forum.
So, I just need to setup the HPL job in deluxe mode, and then it should work? -Justin -----Original Message----- From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of Fernando Nunes Sent: Friday, December 06, 2013 10:32 AM To: ids@iiug.org Subject: Re: hpl load in HDR cluster - "Cannot express .... [32098] You cannot use raw or unlogged tables in HDR cluster. Express works by adding data without logging to the tables... So can't be used in HDR On Fri, Dec 6, 2013 at 6:22 PM, Justin Killen < jkillen@allamericanasphalt.com> wrote: > Hi, > > I have a new (empty) table in our cluster that I need to populate with > about > 3.7 million rows. I have these in the standard pipe delimited format and > ready > for importing. On the primary, I created the hpl load job, but when I go to > run it I get the following output: > > Cannot express load to logged table on HDR Secondary server > Error occured at HPL failpoint: 11430 > Error occured at HPL failpoint: 11008 > > Is there something I need to do on the secondary server to enable this to > work > properly? > > I've looked around a bit and it seems that maybe I should create the table > initially as a RAW table, hpl load the data, and then convert it to a > standard > table. Is this the preferred method, and will the data successfully update > my > HDR secondary and RSS servers? > > We're running 12.10FC1 on Linux servers. > > Thanks, > -Justin > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > -- Fernando Nunes Portugal http://informix-technology.blogspot.com My email works... but I don't check it frequently... --001a1134caf21cd72e04ece1db4f ******************************************************************************* Forum Note: Use "Reply" to post a response in the discussion forum.
As if by magic Cheers Paul > -----Original Message----- > From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of > Justin Killen > Sent: Friday, December 06, 2013 12:55 PM > To: ids@iiug.org > Subject: RE: hpl load in HDR cluster - "Cannot express .... [32103] > > So, I just need to setup the HPL job in deluxe mode, and then it should work? > > -Justin > -----Original Message----- > From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of > Fernando > Nunes > Sent: Friday, December 06, 2013 10:32 AM > To: ids@iiug.org > Subject: Re: hpl load in HDR cluster - "Cannot express .... [32098] > > You cannot use raw or unlogged tables in HDR cluster. > Express works by adding data without logging to the tables... So can't be > used in HDR > > On Fri, Dec 6, 2013 at 6:22 PM, Justin Killen < > jkillen@allamericanasphalt.com> wrote: > > > Hi, > > > > I have a new (empty) table in our cluster that I need to populate with > > about > > 3.7 million rows. I have these in the standard pipe delimited format and > > ready > > for importing. On the primary, I created the hpl load job, but when I go to > > run it I get the following output: > > > > Cannot express load to logged table on HDR Secondary server > > Error occured at HPL failpoint: 11430 > > Error occured at HPL failpoint: 11008 > > > > Is there something I need to do on the secondary server to enable this to > > work > > properly? > > > > I've looked around a bit and it seems that maybe I should create the table > > initially as a RAW table, hpl load the data, and then convert it to a > > standard > > table. Is this the preferred method, and will the data successfully update > > my > > HDR secondary and RSS servers? > > > > We're running 12.10FC1 on Linux servers. > > > > Thanks, > > -Justin > > > > > > > > > > ********************************************************** > ********************* > > Forum Note: Use "Reply" to post a response in the discussion forum. > > > > > > -- > Fernando Nunes > Portugal > > http://informix-technology.blogspot.com > My email works... but I don't check it frequently... > > --001a1134caf21cd72e04ece1db4f > > > ********************************************************** > ********************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > > ********************************************************** > ********************* > Forum Note: Use "Reply" to post a response in the discussion forum.
Yes... Slower... But for 3M records it should not be a big deal... On Fri, Dec 6, 2013 at 6:55 PM, Justin Killen < jkillen@allamericanasphalt.com> wrote: > So, I just need to setup the HPL job in deluxe mode, and then it should > work? > > -Justin > -----Original Message----- > From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of > Fernando > Nunes > Sent: Friday, December 06, 2013 10:32 AM > To: ids@iiug.org > Subject: Re: hpl load in HDR cluster - "Cannot express .... [32098] > > You cannot use raw or unlogged tables in HDR cluster. > Express works by adding data without logging to the tables... So can't be > used in HDR > > On Fri, Dec 6, 2013 at 6:22 PM, Justin Killen < > jkillen@allamericanasphalt.com> wrote: > > > Hi, > > > > I have a new (empty) table in our cluster that I need to populate with > > about > > 3.7 million rows. I have these in the standard pipe delimited format and > > ready > > for importing. On the primary, I created the hpl load job, but when I go > to > > run it I get the following output: > > > > Cannot express load to logged table on HDR Secondary server > > Error occured at HPL failpoint: 11430 > > Error occured at HPL failpoint: 11008 > > > > Is there something I need to do on the secondary server to enable this to > > work > > properly? > > > > I've looked around a bit and it seems that maybe I should create the > table > > initially as a RAW table, hpl load the data, and then convert it to a > > standard > > table. Is this the preferred method, and will the data successfully > update > > my > > HDR secondary and RSS servers? > > > > We're running 12.10FC1 on Linux servers. > > > > Thanks, > > -Justin > > > > > > > > > > > ******************************************************************************* > > Forum Note: Use "Reply" to post a response in the discussion forum. > > > > > > -- > Fernando Nunes > Portugal > > http://informix-technology.blogspot.com > My email works... but I don't check it frequently... > > --001a1134caf21cd72e04ece1db4f > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > -- Fernando Nunes Portugal http://informix-technology.blogspot.com My email works... but I don't check it frequently... --001a1135f1805b96f804ece246a9
You should try using an external table to map the load file in and then you can use my dbcopy or dbmove utilities to move the data from the external table to the permanent one. I should be a bit faster than HPL in deluxe mode. Art Art S. Kagel, Principal Consultant Advanced DataTools (www.advancedatatools.com) Blog: http://informix-myview.blogspot.com/ Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on my employer, Advanced DataTools, the IIUG, nor any other organization with which I am associated either explicitly, implicitly, or by inference. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves. On Fri, Dec 6, 2013 at 1:22 PM, Justin Killen < jkillen@allamericanasphalt.com> wrote: > Hi, > > I have a new (empty) table in our cluster that I need to populate with > about > 3.7 million rows. I have these in the standard pipe delimited format and > ready > for importing. On the primary, I created the hpl load job, but when I go to > run it I get the following output: > > Cannot express load to logged table on HDR Secondary server > Error occured at HPL failpoint: 11430 > Error occured at HPL failpoint: 11008 > > Is there something I need to do on the secondary server to enable this to > work > properly? > > I've looked around a bit and it seems that maybe I should create the table > initially as a RAW table, hpl load the data, and then convert it to a > standard > table. Is this the preferred method, and will the data successfully update > my > HDR secondary and RSS servers? > > We're running 12.10FC1 on Linux servers. > > Thanks, > -Justin > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --089e015382aa1d7ded04ece56de6
Changed the -fl on the onpladm job creation to -flc to force deluxe mode.
Now it works without complaining - Thanks!
-Justin
-----Original Message-----
From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of Fernando
Nunes
Sent: Friday, December 06, 2013 11:10 AM
To: ids@iiug.org
Subject: Re: hpl load in HDR cluster - "Cannot express .... [32107]
Yes... Slower... But for 3M records it should not be a big deal...
On Fri, Dec 6, 2013 at 6:55 PM, Justin Killen <
jkillen@allamericanasphalt.com> wrote:
> So, I just need to setup the HPL job in deluxe mode, and then it should
> work?
>
> -Justin
> -----Original Message-----
> From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of
> Fernando
> Nunes
> Sent: Friday, December 06, 2013 10:32 AM
> To: ids@iiug.org
> Subject: Re: hpl load in HDR cluster - "Cannot express .... [32098]
>
> You cannot use raw or unlogged tables in HDR cluster.
> Express works by adding data without logging to the tables... So can't be
> used in HDR
>
> On Fri, Dec 6, 2013 at 6:22 PM, Justin Killen <
> jkillen@allamericanasphalt.com> wrote:
>
> > Hi,
> >
> > I have a new (empty) table in our cluster that I need to populate with
> > about
> > 3.7 million rows. I have these in the standard pipe delimited format and
> > ready
> > for importing. On the primary, I created the hpl load job, but when I go
> to
> > run it I get the following output:
> >
> > Cannot express load to logged table on HDR Secondary server
> > Error occured at HPL failpoint: 11430
> > Error occured at HPL failpoint: 11008
> >
> > Is there something I need to do on the secondary server to enable this to
> > work
> > properly?
> >
> > I've looked around a bit and it seems that maybe I should create the
> table
> > initially as a RAW table, hpl load the data, and then convert it to a
> > standard
> > table. Is this the preferred method, and will the data successfully
> update
> > my
> > HDR secondary and RSS servers?
> >
> > We're running 12.10FC1 on Linux servers.
> >
> > Thanks,
> > -Justin
> >
> >
> >
> >
>
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --
> Fernando Nunes
> Portugal
>
> http://informix-technology.blogspot.com
> My email works... but I don't check it frequently...
>
> --001a1134caf21cd72e04ece1db4f
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--
Fernando Nunes
Portugal
http://informix-technology.blogspot.com
My email works... but I don't check it frequently...
--001a1135f1805b96f804ece246a9
*******************************************************************************
Forum Note: Use "Reply" to post a response in the discussion forum.
For this particular import speed is not really an issue, but I'll keep in mind using dbmove in the future. -Justin -----Original Message----- From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of Art Kagel Sent: Friday, December 06, 2013 2:47 PM To: ids@iiug.org Subject: Re: hpl load in HDR cluster - "Cannot express .... [32113] You should try using an external table to map the load file in and then you can use my dbcopy or dbmove utilities to move the data from the external table to the permanent one. I should be a bit faster than HPL in deluxe mode. Art Art S. Kagel, Principal Consultant Advanced DataTools (www.advancedatatools.com) Blog: http://informix-myview.blogspot.com/ Disclaimer: Please keep in mind that my own opinions are my own opinions and do not reflect on my employer, Advanced DataTools, the IIUG, nor any other organization with which I am associated either explicitly, implicitly, or by inference. Neither do those opinions reflect those of other individuals affiliated with any entity with which I am affiliated nor those of the entities themselves. On Fri, Dec 6, 2013 at 1:22 PM, Justin Killen < jkillen@allamericanasphalt.com> wrote: > Hi, > > I have a new (empty) table in our cluster that I need to populate with > about > 3.7 million rows. I have these in the standard pipe delimited format and > ready > for importing. On the primary, I created the hpl load job, but when I go to > run it I get the following output: > > Cannot express load to logged table on HDR Secondary server > Error occured at HPL failpoint: 11430 > Error occured at HPL failpoint: 11008 > > Is there something I need to do on the secondary server to enable this to > work > properly? > > I've looked around a bit and it seems that maybe I should create the table > initially as a RAW table, hpl load the data, and then convert it to a > standard > table. Is this the preferred method, and will the data successfully update > my > HDR secondary and RSS servers? > > We're running 12.10FC1 on Linux servers. > > Thanks, > -Justin > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --089e015382aa1d7ded04ece56de6 ******************************************************************************* Forum Note: Use "Reply" to post a response in the discussion forum.