Oninit cdi / Archive
Talk to an expert →

IWA: Error loading datamart

Posted in 2012

Topics: General Discussion

VICENTE SALVADOR — — source: IIUG Forums & Mailing Lists

I can connect IWA to IDS, deploy a datamart, but when trying to load it, an error occurs. Due to the lack of logs on IWA, it's very difficult to know the real reason for the failure, but the datamart starts loading and all nodes status is: receiving "informix"."datamart" (1 of 7) after some seconds, loading finishes and ondwa tasks presents a software maintenance message: [root@iwa1 bin]# ./ondwa tasks TaskManager tracking 2 task(s): ------------------+--------------------------------+---------+---------+-------- +------------ Task 52354345668182081 (of type 'SOFTWARE MAINTENANCE' with name SOFTWARE UPDATE - 0:00) ------------------+--------------------------------+---------+---------+-------- +------------ Location | Status | Progr. | Upd. ms | Memory | Monitor ------------------+--------------------------------+---------+---------+-------- +------------ Primary Node 0 | List packages | 0 | 436 | 0 | Fine (Total Memory) | | | | 0 | ------------------+--------------------------------+---------+---------+-------- +------------ Used Resources | ListPackages on node 0 ------------------+--------------------------------+---------+---------+-------- +------------ Task 100205091708993536 (of type 'DAEMON' with name DRDADaemon - 2:04) ------------------+--------------------------------+---------+---------+-------- +------------ Location | Status | Progr. | Upd. ms | Memory | Monitor ------------------+--------------------------------+---------+---------+-------- +------------ Primary Node 0 | Running | 2 | 449 | 0 | Fine (Total Memory) | | | | 0 | ------------------+--------------------------------+---------+---------+-------- +------------ Used Resources | DRDA device: 'eth0' address: '192.168.10.71:21022' on node 0 | Unbound on node 0 ------------------+--------------------------------+---------+---------+-------- +------------ - End of Tasklist - ¿some clues about this kind of problem? ¿Can I do something to know the real reason of the problem?

↪ replying to VICENTE SALVADOR
Carlton Doe — — source: IIUG Forums & Mailing Lists

How are trying to load? Graphically or from java cli? If cli, your conn.prop= file may messed up. There is debugging available from the cli.=20 It (loading) is pretty straight forward. What lock mode did you use? Are the= tables changing underneath you? It may be that a lock can't be made.=20 Carlton Doe cdoe@us.ibm.com Sent from my iPhone, typos and all On Jul 23, 2012, at 11:56 AM, "VICENTE SALVADOR" <vsalvador@deister.es> wrot= e: > I can connect IWA to IDS, deploy a datamart, but when trying to load it, a= n=20 > error occurs.=20 >=20 > Due to the lack of logs on IWA, it's very difficult to know the real reaso= n=20 > for the failure, but the datamart starts loading and all nodes status is:=20= >=20 > receiving "informix"."datamart" (1 of 7)=20 >=20 > after some seconds, loading finishes and ondwa tasks presents a software=20= > maintenance message:=20 >=20 > [root@iwa1 bin]# ./ondwa tasks=20 > TaskManager tracking 2 task(s):=20 >=20 > ------------------+--------------------------------+---------+---------+--= ------+------------=20 > Task 52354345668182081 (of type 'SOFTWARE MAINTENANCE' with name SOFTWARE=20= > UPDATE - 0:00)=20 >=20 > ------------------+--------------------------------+---------+---------+--= ------+------------=20 > Location | Status | Progr. | Upd. ms | Memory | Monitor=20 >=20 > ------------------+--------------------------------+---------+---------+--= ------+------------=20 > Primary Node 0 | List packages | 0 | 436 | 0 | Fine=20 > (Total Memory) | | | | 0 |=20 >=20 > ------------------+--------------------------------+---------+---------+--= ------+------------=20 > Used Resources | ListPackages on node 0=20 >=20 > ------------------+--------------------------------+---------+---------+--= ------+------------=20 > Task 100205091708993536 (of type 'DAEMON' with name DRDADaemon - 2:04)=20 >=20 > ------------------+--------------------------------+---------+---------+--= ------+------------=20 > Location | Status | Progr. | Upd. ms | Memory | Monitor=20 >=20 > ------------------+--------------------------------+---------+---------+--= ------+------------=20 > Primary Node 0 | Running | 2 | 449 | 0 | Fine=20 > (Total Memory) | | | | 0 |=20 >=20 > ------------------+--------------------------------+---------+---------+--= ------+------------=20 > Used Resources | DRDA device: 'eth0' address: '192.168.10.71:21022' on nod= e 0=20 >=20 > | Unbound on node 0=20 >=20 > ------------------+--------------------------------+---------+---------+--= ------+------------=20 > - End of Tasklist -=20 >=20 > =EF=BF=BDsome clues about this kind of problem?=20 > =EF=BF=BDCan I do something to know the real reason of the problem?=20 >=20 >=20 > **************************************************************************= *****=20 > Forum Note: Use "Reply" to post a response in the discussion forum.=20 >=20

↪ replying to VICENTE SALVADOR
Martin Fuerderer — — source: IIUG Forums & Mailing Lists

Hi, after following up on the suggestions from Carlton Doe ... please consider the following: - a binary called ifxpipecat in $INORMIXDIR/bin is needed to forward load data to the accelerator. Please check that it is installed correctly (-> permissions), e.g. % ls -l $INFORMIXDIR/bin/ifxpip* -rwxr-xr-x 1 informix informix 15601 Apr 12 18:28 .../bin/ifxpipecat - check in /tmp for files with names "iwaunl*". Data is extracted from IDS using external tables. If there's a problem on this side, you may find info in one of those iwaunl* files in /tmp. (Normally they are all cleaned up after a successful load.) - check for more detailed error messages of the accelerator in /var/log/messages. You may run out of memory or disk space on the accelerator machine, or the maximum allowed space for /dev/shm/... files may be insufficient. - you say "an error occurs" ... is there any more detail about this error available (a number, some error text fragment)? Regards, Martin -- Martin Fuerderer IBM Informix Development Munich, Germany Information Management Read about the Informix Warehouse Accelerator: http://tinyurl.com/the-iwa-blog IBM Deutschland Research & Development GmbH Chairman of the Supervisory Board: Martina Koederitz Board of Management: Dirk Wittkopp Corporate Seat: Boeblingen, Germany Reg.-Gericht: Amtsgericht Stuttgart, HRB 243294 ids-bounces@iiug.org wrote on 07/23/2012 07:56:33 PM: > From: "VICENTE SALVADOR" <vsalvador@deister.es> > To: ids@iiug.org, > Date: 07/23/2012 07:56 PM > Subject: IWA: Error loading datamart [27766] > Sent by: ids-bounces@iiug.org > > I can connect IWA to IDS, deploy a datamart, but when trying to load it, an > error occurs. > > Due to the lack of logs on IWA, it's very difficult to know the real reason > for the failure, but the datamart starts loading and all nodes status is: > > receiving "informix"."datamart" (1 of 7) > > after some seconds, loading finishes and ondwa tasks presents a software > maintenance message: > > [root@iwa1 bin]# ./ondwa tasks > TaskManager tracking 2 task(s): > > ------------------+--------------------------------+---------+---------+-------- +------------ > Task 52354345668182081 (of type 'SOFTWARE MAINTENANCE' with name SOFTWARE > UPDATE - 0:00) > > ------------------+--------------------------------+---------+---------+-------- +------------ > Location | Status | Progr. | Upd. ms | Memory | Monitor > > ------------------+--------------------------------+---------+---------+-------- +------------ > Primary Node 0 | List packages | 0 | 436 | 0 | Fine > (Total Memory) | | | | 0 | > > ------------------+--------------------------------+---------+---------+-------- +------------ > Used Resources | ListPackages on node 0 > > ------------------+--------------------------------+---------+---------+-------- +------------ > Task 100205091708993536 (of type 'DAEMON' with name DRDADaemon - 2:04) > > ------------------+--------------------------------+---------+---------+-------- +------------ > Location | Status | Progr. | Upd. ms | Memory | Monitor > > ------------------+--------------------------------+---------+---------+-------- +------------ > Primary Node 0 | Running | 2 | 449 | 0 | Fine > (Total Memory) | | | | 0 | > > ------------------+--------------------------------+---------+---------+-------- +------------ > Used Resources | DRDA device: 'eth0' address: '192.168.10.71:21022' on node 0 > > | Unbound on node 0 > > ------------------+--------------------------------+---------+---------+-------- +------------ > - End of Tasklist - > > ¿some clues about this kind of problem? > ¿Can I do something to know the real reason of the problem? > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. >

↪ replying to Martin Fuerderer
VICENTE SALVADOR — — source: IIUG Forums & Mailing Lists

This is the error returnet: loadMart IWA1 rips_ac_consulta NONE -------------------------------------------------------------------------------- Warning: AQT10205I DETAILS IN MESSAGE OUTPUT PARAMETER 4 / SQLSTATE: 01H08 -------------------------------------------------------------------------------- result message: <?xml version="1.0" encoding="UTF-8" ?> <dwa:messageOutput xmlns:dwa="http://www.ibm.com/xmlns/prod/dwa"; version="1.0"> <message severity="severe" reason-code="AQT10205I"><text>An internal processing error occurred in the stored procedure. Diagnostic information: An assertion 'false' failed. Additional info: timeout while reading from /tmp/iwapipe.d6f14231-40fa-4bf7-8128-3ae05e5377ce</text></message></dwa:messageO utput> And this is the /var/log/messages Jul 24 18:40:53 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:40:53.696339] [ERROR] [Task: 0] [Thread: 1332504896] [Component: DRDA] [EXCEPTION] /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/DBMSControllerBas e.cpp:392 ForceDRDAConnectionCloseException: A irreparable error occured. The connection to the peer needs to be closed. The reason to do this is: Base exception caught in Controller Framework. Close the network connection. Thrown at /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/DBMSControllerBas e.cpp:392 Jul 24 18:40:53 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:40:53.696433] [ERROR] [Task: 0] [Thread: 1332504896] [Component: CONTROLLER] [MESSAGE] /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/DBMSControllerBas e.cpp:443 DRDAForceConnectionCloseException rethrown to notify the DRDA daemon. Jul 24 18:41:23 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:41:23.998527] [ERROR] [Task: 101330991615836180] [Thread: 1363974464] [Component: DRDA] [EXCEPTION] /vobs/tristarp/iwa/dwaroot/accelerator/sources/drda/DRDAElement.cpp:372 DRDATCPIPException: DRDATCPIPException: A network connection is gone where it is not expected to be on message type 0x0000: While trying to receive message data Thrown at /vobs/tristarp/iwa/dwaroot/accelerator/sources/drda/DRDAElement.cpp:372 Jul 24 18:41:24 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:41:24.025244] [ERROR] [Task: 101330991615836180] [Thread: 1363974464] [Component: LOAD] [MESSAGE] /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/load_mart/LoadMessageC onverter.cpp:327 Exception in job 0: DRDATCPIPException: A network connection is gone where it is not expected to be on message type 0x0000: While trying to receive message data Jul 24 18:41:24 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:41:24.025328] [ERROR] [Task: 101330991615836180] [Thread: 1112217920] [Component: SERVICES] [MESSAGE] /vobs/tristarp/iwa/dwaroot/accelerator/sources/services/thread/ProducerConsumerQ ueue.hpp:270 Queue was aborted with exception DRDATCPIPException: A network connection is gone where it is not expected to be on message type 0x0000: While trying to receive message data Jul 24 18:41:24 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:41:24.036477] [ERROR] [Task: 101330991615836180] [Thread: 1112217920] [Component: LOAD] [MESSAGE] /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/load_mart/CoordinatorL oadController.cpp:115 Load for mart rips_ac_consulta, task 101330991615836180 (type=2; subtask=false) aborting with error in task status receiving "informix"."rips_ac_consulta"(1 of 1) Jul 24 18:41:24 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:41:24.100583] [ERROR] [Task: 101330991615836180] [Thread: 1112217920] [Component: CONTROLLER] [EXCEPTION] /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/ControllerBase.cp p:1796 TriggerTaskAbortionException: The abortion of task 101330991615836180 was triggered by the coordinator controller. Thrown at /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/ControllerBase.cp p:1796 Jul 24 18:41:24 iwa1 DWA[4416]: [TRACER][ERROR]: [2012-07-24 18:41:24.100810] [ERROR] [Task: 101330991615836180] [Thread: 1186740544] [Component: CONTROLLER] [MESSAGE] /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/ControllerBase.cp p:1850 Received remote exception from node 0 on controller for orchestrating task 101330991615836180 (type=2; subtask=true) from task 101330991615836180 (type=2; subtask=false) Jul 24 18:41:24 iwa1 DWA[4413]: [TRACER][ERROR]: [2012-07-24 18:41:24.100823] [ERROR] [Task: 101330991615836180] [Thread: 1182566720] [Component: CONTROLLER] [MESSAGE] /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/ControllerBase.cp p:1850 Received remote exception from node 0 on controller for orchestrating task 101330991615836180 (type=2; subtask=true) from task 101330991615836180 (type=2; subtask=false) Jul 24 18:41:24 iwa1 DWA[4416]: [TRACER][ERROR]: [2012-07-24 18:41:24.100885] [ERROR] [Task: 101330991615836180] [Thread: 1323108672] [Component: CONTROLLER] [MESSAGE] /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/ControllerBase.cp p:2079 Task LOAD MART (101330991615836180 (type=2; subtask=true)) is failing because an exception has been received

↪ replying to VICENTE SALVADOR
Martin Fuerderer — — source: IIUG Forums & Mailing Lists

Hi, > ...<text>An internal processing error occurred > in the stored procedure. Diagnostic information: > An assertion 'false' failed. Additional info: > timeout while reading from > /tmp/iwapipe.d6f14231-40fa-4bf7-8128-3ae05e5377ce > </text>... This message points to a problem on the side of generating the load data, i.e. the IDS side rather than the side of the accelerator. The load data is extracted from IDS via external tables that use a pipe, from where the data is read and then sent to the accelerator. The message suggests, that for some reason there's no (more) data arriving at the pipe. There's a good possibility, that in /tmp there's some file of a name beginning with "iwa" containing more information as to what went wrong ... Try to remove all /tmp/iwa* files, then start another attempt at loading the data mart, then check again in /tmp to see what files of a name starting with "iwa" are there. Regards, Martin -- Martin Fuerderer IBM Informix Development Munich, Germany Information Management Read about the Informix Warehouse Accelerator: http://tinyurl.com/the-iwa-blog IBM Deutschland Research & Development GmbH Chairman of the Supervisory Board: Martina Koederitz Board of Management: Dirk Wittkopp Corporate Seat: Boeblingen, Germany Reg.-Gericht: Amtsgericht Stuttgart, HRB 243294 ids-bounces@iiug.org wrote on 07/24/2012 04:46:41 PM: > From: "VICENTE SALVADOR" <vsalvador@deister.es> > To: ids@iiug.org, > Date: 07/24/2012 04:47 PM > Subject: Re: IWA: Error loading datamart [27795] > Sent by: ids-bounces@iiug.org > > This is the error returnet: > > loadMart IWA1 rips_ac_consulta NONE > > -------------------------------------------------------------------------------- > Warning: AQT10205I DETAILS IN MESSAGE OUTPUT PARAMETER 4 / SQLSTATE: 01H08 > > -------------------------------------------------------------------------------- > result message: > <?xml version="1.0" encoding="UTF-8" ?> <dwa:messageOutput > xmlns:dwa="http://www.ibm.com/xmlns/prod/dwa"; version="1.0"> <message > severity="severe" reason-code="AQT10205I"><text>An internal processing error > occurred in the stored procedure. Diagnostic information: An assertion 'false' > failed. Additional info: timeout while reading from > /tmp/iwapipe.d6f14231-40fa-4bf7-8128-3ae05e5377ce</text></message></dwa:messageO utput> > > And this is the /var/log/messages > > Jul 24 18:40:53 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:40:53.696339] > [ERROR] [Task: 0] [Thread: 1332504896] [Component: DRDA] [EXCEPTION] > /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/DBMSControllerBas e.cpp:392 > ForceDRDAConnectionCloseException: A irreparable error occured. The connection > to the peer needs to be closed. The reason to do this is: Base exception > caught in Controller Framework. Close the network connection. Thrown at > /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/DBMSControllerBas e.cpp:392 > Jul 24 18:40:53 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:40:53.696433] > [ERROR] [Task: 0] [Thread: 1332504896] [Component: CONTROLLER] [MESSAGE] > /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/DBMSControllerBas e.cpp:443 > DRDAForceConnectionCloseException rethrown to notify the DRDA daemon. > Jul 24 18:41:23 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:41:23.998527] > [ERROR] [Task: 101330991615836180] [Thread: 1363974464] [Component: DRDA] > [EXCEPTION] > /vobs/tristarp/iwa/dwaroot/accelerator/sources/drda/DRDAElement.cpp:372 > DRDATCPIPException: DRDATCPIPException: A network connection is gone where it > is not expected to be on message type 0x0000: While trying to receive message > data Thrown at > /vobs/tristarp/iwa/dwaroot/accelerator/sources/drda/DRDAElement.cpp:372 > Jul 24 18:41:24 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:41:24.025244] > [ERROR] [Task: 101330991615836180] [Thread: 1363974464] [Component: LOAD] > [MESSAGE] > /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/load_mart/LoadMessageC onverter.cpp:327 > Exception in job 0: DRDATCPIPException: A network connection is gone where it > is not expected to be on message type 0x0000: While trying to receive message > data > Jul 24 18:41:24 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:41:24.025328] > [ERROR] [Task: 101330991615836180] [Thread: 1112217920] [Component: SERVICES] > [MESSAGE] > /vobs/tristarp/iwa/dwaroot/accelerator/sources/services/thread/ProducerConsumerQ ueue.hpp:270 > Queue was aborted with exception DRDATCPIPException: A network connection is > gone where it is not expected to be on message type 0x0000: While trying to > receive message data > Jul 24 18:41:24 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:41:24.036477] > [ERROR] [Task: 101330991615836180] [Thread: 1112217920] [Component: LOAD] > [MESSAGE] > /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/load_mart/CoordinatorL oadController.cpp:115 > Load for mart rips_ac_consulta, task 101330991615836180 (type=2; > subtask=false) aborting with error in task status receiving > "informix"."rips_ac_consulta"(1 of 1) > Jul 24 18:41:24 iwa1 DWA[4389]: [TRACER][ERROR]: [2012-07-24 18:41:24.100583] > [ERROR] [Task: 101330991615836180] [Thread: 1112217920] [Component: > CONTROLLER] [EXCEPTION] > /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/ControllerBase.cp p:1796 > TriggerTaskAbortionException: The abortion of task 101330991615836180 was > triggered by the coordinator controller. Thrown at > /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/ControllerBase.cp p:1796 > Jul 24 18:41:24 iwa1 DWA[4416]: [TRACER][ERROR]: [2012-07-24 18:41:24.100810] > [ERROR] [Task: 101330991615836180] [Thread: 1186740544] [Component: > CONTROLLER] [MESSAGE] > /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/ControllerBase.cp p:1850 > Received remote exception from node 0 on controller for orchestrating task > 101330991615836180 (type=2; subtask=true) from task 101330991615836180 > (type=2; subtask=false) > Jul 24 18:41:24 iwa1 DWA[4413]: [TRACER][ERROR]: [2012-07-24 18:41:24.100823] > [ERROR] [Task: 101330991615836180] [Thread: 1182566720] [Component: > CONTROLLER] [MESSAGE] > /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/ControllerBase.cp p:1850 > Received remote exception from node 0 on controller for orchestrating task > 101330991615836180 (type=2; subtask=true) from task 101330991615836180 > (type=2; subtask=false) > Jul 24 18:41:24 iwa1 DWA[4416]: [TRACER][ERROR]: [2012-07-24 18:41:24.100885] > [ERROR] [Task: 101330991615836180] [Thread: 1323108672] [Component: > CONTROLLER] [MESSAGE] > /vobs/tristarp/iwa/dwaroot/accelerator/sources/controller/base/ControllerBase.cp p:2079 > Task LOAD MART (101330991615836180 (type=2; subtask=true)) is fail