Error: DR: Couldn't send add dbspace/chunk request

Hi, We have primary Instance: IBM Informix Dynamic Server Version 11.70.FC3 -- On-Line (Prim) -- Up 38 days 01:40:22 -- 2428320 Kbytes Both primary and secondary with HDR on IBM Power 7 with AIX 6.1 (64 Bits) plataform. Primary AIX DCCPLD02 1 6 00F633A24C00 Secondary AIX DCMPLD02 1 6 00F633A64C00 IBM Informix Dynamic Server Version 11.70.FC3 -- Read-Only (Sec) -- Up 39 days 20:40:53 -- 2428320 Kbytes And every time we tryed to add a new chunk to Dbspaces we get this error message: onspaces -a datos00 -p /ifxpld02/chunks/datos00_16 -o 0 -s 4096000Verifying physical disk space, please wait ... DR: Couldn't send add dbspace/chunk request to HDR secondary (pld_ids1170mty_hdr)

Primary SQLHOSTS cat /ifxpld02/etc/sqlhosts.pld_ids1170 pld_ids1170 onsoctcp 10.36.193.86 9088 dr_pld_ids1170 onipcshm 10.36.193.86 9089 coppel_tcp onsoctcp 10.36.193.51 1525 coppel_cor onsoctcp 10.36.193.51 1525 # SEPARACION CONTABLE coppelcont_tcp onsoctcp 10.36.193.81 12525 ### REPLICAS LOCAL Y REMOTA STAGING pld_ids1170_hdr onsoctcp 10.36.193.86 9988 pld_ids1170mty_hdr onsoctcp 10.36.197.86 9989 ### PRUEBAS Humberto ### ###coppelsm_tcp onsoctcp 10.36.193.212 1230 Secondary SQLHOSTS cat /ifxpld02/etc/sqlhosts.pld_ids1170 # INSTANCIA LOCAL pld_ids1170 onsoctcp 10.36.197.86 9088 dr_pld_ids1170 onipcshm 10.36.197.86 9089 # INSTANCIA OLTP coppel_tcp onsoctcp 10.36.197.51 1525 coppel_cor onsoctcp 10.36.197.51 1525 # SEPARACION CONTABLE coppelcont_tcp onsoctcp 10.36.197.81 12525 ### REPLICAS LOCAL Y REMOTA STAGING pld_ids1170_hdr onsoctcp 10.36.193.86 9988 pld_ids1170mty_hdr onsoctcp 10.36.197.86 9989 ### PRUEBAS Humberto ### ###coppelsm_tcp onsoctcp 10.36.193.212 1230

Primary Onconfig: Configuration File: /ifxpld02/etc/onconfig.pld_ids1170 ROOTNAME rootdbsROOTPATH /ifxpld02/chunks/rootdbs ROOTOFFSET 0 ROOTSIZE 200000MIRROR 0 MIRRORPATH $INFORMIXDIR/tmp/demo_on.root_mirror MIRROROFFSET 0 PHYSFILE 40960 PLOG_OVERFLOW_PATH $INFORMIXDIR/tmp LOGFILES 121 LOGSIZE 3000 DYNAMIC_LOGS 2 LOGBUFF 256 LTXHWM 70 LTXEHWM 80 MSGPATH /ifxpld02/pld_ids1170.log CONSOLE $INFORMIXDIR/tmp/online.con TBLTBLFIRST 32768 TBLTBLNEXT 4096 TBLSPACE_STATS 1 DBSPACETEMP tempdbs SBSPACETEMP SBSPACENAME SYSSBSPACENAME ONDBSPACEDOWN 1 # parar en caso de que falte algun Chunk SERVERNUM 0 DBSERVERNAME pld_ids1170 DBSERVERALIASES dr_pld_ids1170,pld_ids1170_hdr FULL_DISK_INIT 0 NETTYPE ipcshm,1,50,CPU LISTEN_TIMEOUT 60 MAX_INCOMPLETE_CONNECTIONS 1024 FASTPOLL 1 NUMFDSERVERS 4 NS_CACHE host=900,service=900,user=900,group=900 MULTIPROCESSOR 1 VPCLASS cpu,num=2,noage VP_MEMORY_CACHE_KB 800 SINGLE_CPU_VP 0 CLEANERS 8AUTO_AIOVPS 1 DIRECT_IO 0 # recomendacion de IBM PMR 35337,999,781 - Juan Carlos LOCKS 500000 DEF_TABLE_LOCKMODE row RESIDENT 1 SHMBASE 0x700000010000000L SHMVIRTSIZE 1500000 SHMADD 500000 EXTSHMADD 250000 SHMTOTAL 0 SHMVIRT_ALLOCSEG 0,3 SHMNOACCESS CKPTINTVL 300AUTO_CKPTS 1 RTO_SERVER_RESTART 0 BLOCKTIMEOUT 3600 CONVERSION_GUARD 2 RESTORE_POINT_DIR $INFORMIXDIR/tmp TXTIMEOUT 300 DEADLOCK_TIMEOUT 60 HETERO_COMMIT 0 TAPEDEV /dev/rmt2 #Tape device path TAPEBLK 1024 TAPESIZE 838860800 # Maximum amount of data to put on tape (Kbytes) LTAPEDEV LTAPEBLK 32 LTAPESIZE 0 BAR_ACT_LOG $INFORMIXDIR/tmp/bar_act.log BAR_DEBUG_LOG $INFORMIXDIR/tmp/bar_dbug.log BAR_DEBUG 0 BAR_MAX_BACKUP 0 BAR_RETRY 1 BAR_NB_XPORT_COUNT 20 BAR_XFER_BUF_SIZE 31 RESTARTABLE_RESTORE ON BAR_PROGRESS_FREQ 0 BAR_BSALIB_PATH BACKUP_FILTER RESTORE_FILTER BAR_PERFORMANCE 0 BAR_CKPTSEC_TIMEOUT 15 ISM_DATA_POOL ISMData ISM_LOG_POOL ISMLogs DD_HASHSIZE 31 DD_HASHMAX 10 DS_HASHSIZE 31 DS_POOLSIZE 127 PC_HASHSIZE 31 PC_POOLSIZE 127 PRELOAD_DLL_FILE STMT_CACHE 0 STMT_CACHE_HITS 0 STMT_CACHE_SIZE 512 STMT_CACHE_NOLIMIT 0 STMT_CACHE_NUMPOOL 1 USEOSTIME 0 STACKSIZE 128 ALLOW_NEWLINE 0 USELASTCOMMITTED NONE FILLFACTOR 90 MAX_FILL_DATA_PAGES 1 BTSCANNER num=5,threshold=2500,rangesize=-1,alice=6,compression=default ONLIDX_MAXMEM 5120 MAX_PDQPRIORITY 90 DS_MAX_QUERIES 10 DS_TOTAL_MEMORY 1024000 DS_MAX_SCANS 1048576 DS_NONPDQ_QUERY_MEM 256000 DATASKIP OPTCOMPIND 2 DIRECTIVES 1 EXT_DIRECTIVES 0 OPT_GOAL -1 IFX_FOLDVIEW 0AUTO_REPREPARE 1 AUTO_STAT_MODE 1 STATCHANGE 10 BATCHEDREAD_TABLE 1 BATCHEDREAD_INDEX 1BATCHEDREAD_KEYONLY 0 AUTO_READAHEAD 1 EXPLAIN_STAT 1 DBCREATE_PERMISSION informix IFX_EXTEND_ROLE 1 SECURITY_LOCALCONNECTION UNSECURE_ONSTAT ADMIN_USER_MODE_WITH_DBSA ADMIN_MODE_USERS SSL_KEYSTORE_LABEL PLCY_POOLSIZE 127 PLCY_HASHSIZE 31 USRC_POOLSIZE 127 USRC_HASHSIZE 31 STAGEBLOB OPCACHEMAX 0 SQL_LOGICAL_CHAR OFF SEQ_CACHE_SIZE 10 ENCRYPT_HDR ENCRYPT_SMX ENCRYPT_CDR 0 ENCRYPT_CIPHERS ENCRYPT_MAC ENCRYPT_MACFILE ENCRYPT_SWITCH CDR_EVALTHREADS 1,2 CDR_DSLOCKWAIT 5 CDR_QUEUEMEM 4096 CDR_NIFCOMPRESS 0 CDR_SERIAL 0 CDR_DBSPACE CDR_QHDR_DBSPACE CDR_QDATA_SBSPACE CDR_SUPPRESS_ATSRISWARN CDR_DELAY_PURGE_DTC 0 CDR_LOG_LAG_ACTION ddrblock CDR_LOG_STAGING_MAXSIZE 0 CDR_MAX_DYNAMIC_LOGS 0 DRAUTO 0 DRINTERVAL 30 DRTIMEOUT 30 HA_ALIASDRLOSTFOUND $INFORMIXDIR/etc/dr.lostfound DRIDXAUTO 0 LOG_INDEX_BUILDS 0 SDS_ENABLE SDS_TIMEOUT 20 SDS_TEMPDBS SDS_PAGING SDS_LOGCHECK 0 UPDATABLE_SECONDARY 0 FAILOVER_CALLBACK FAILOVER_TX_TIMEOUT 0 TEMPTAB_NOLOG 1 DELAY_APPLY 0 STOP_APPLY 0 LOG_STAGING_DIR RSS_FLOW_CONTROL 0 ENABLE_SNAPSHOT_COPY 0 SMX_COMPRESS 0 ON_RECVRY_THREADS 100 OFF_RECVRY_THREADS 100 DUMPDIR /INFORMIXDUMP DUMPSHMEM 1 DUMPGCORE 0 DUMPCORE 0 DUMPCNT 1 ALARMPROGRAM $INFORMIXDIR/etc/alarmprogram.sh ALRM_ALL_EVENTS 0 STORAGE_FULL_ALARM 600,3 SYSALARMPROGRAM $INFORMIXDIR/etc/evidence.sh RAS_PLOG_SPEED 45781 RAS_LLOG_SPEED 0 EILSEQ_COMPAT_MODE 0 QSTATS 0 WSTATS 0 USERMAPPING OFF SP_AUTOEXPAND 0 SP_THRESHOLD 0 SP_WAITTIME 30 DEFAULTESCCHAR \\\\ MQSERVER MQCHLLIB MQCHLTAB REMOTE_SERVER_CFG REMOTE_USERS_CFG LOW_MEMORY_RESERVE 0 LOW_MEMORY_MGR 0 JVPPROPFILE $INFORMIXDIR/extend/krakatoa/.jvpprops JVPLOGFILE $INFORMIXDIR/tmp/jvp.log JVPARGS -Dcom.ibm.tools.attach.enable=no JVPCLASSPATH $INFORMIXDIR/extend/krakatoa/krakatoa.jar:$INFORMIXDIR/extend/krakatoa/jdbc.jar BUFFERPOOL size=4K,buffers=200000,lrus=8,lru_min_dirty=50.00,lru_max_dirty=60.00 AUTO_LRU_TUNING 1 NETTYPE onsoctcp,1,150,NET NETTYPE drsoctcp,1,150,NET PHYSBUFF 128 BUFFERPOOL size=8K,buffers=1000,lrus=4,lru_min_dirty=50.00,lru_max_dirty=60.00

Secondary Onconfig: Configuration File: /ifxpld02/etc/onconfig.pld_ids1170 ROOTNAME rootdbsROOTPATH /ifxpld02/chunks/rootdbs ROOTOFFSET 0 ROOTSIZE 200000MIRROR 0 MIRRORPATH $INFORMIXDIR/tmp/demo_on.root_mirror MIRROROFFSET 0 PHYSFILE 40960 PLOG_OVERFLOW_PATH $INFORMIXDIR/tmp LOGFILES 121 LOGSIZE 3000 DYNAMIC_LOGS 2 LOGBUFF 256 LTXHWM 70 LTXEHWM 80 MSGPATH /ifxpld02/pld_ids1170.log CONSOLE $INFORMIXDIR/tmp/online.con TBLTBLFIRST 32768 TBLTBLNEXT 4096 TBLSPACE_STATS 1 DBSPACETEMP tempdbs SBSPACETEMP SBSPACENAME SYSSBSPACENAME ONDBSPACEDOWN 1 # parar en caso de que falte algun Chunk SERVERNUM 0 DBSERVERNAME pld_ids1170 DBSERVERALIASES dr_pld_ids1170,pld_ids1170mty_hdr FULL_DISK_INIT 0 NETTYPE ipcshm,1,50,CPU LISTEN_TIMEOUT 60 MAX_INCOMPLETE_CONNECTIONS 1024 FASTPOLL 1 NUMFDSERVERS 4 NS_CACHE host=900,service=900,user=900,group=900 MULTIPROCESSOR 1 VPCLASS cpu,num=2,noage VP_MEMORY_CACHE_KB 800 SINGLE_CPU_VP 0 CLEANERS 8AUTO_AIOVPS 1 DIRECT_IO 0 # recomendacion de IBM PMR 35337,999,781 - Juan Carlos LOCKS 500000 DEF_TABLE_LOCKMODE row RESIDENT 1 SHMBASE 0x700000010000000L SHMVIRTSIZE 1500000 SHMADD 500000 EXTSHMADD 250000 SHMTOTAL 0 SHMVIRT_ALLOCSEG 0,3 SHMNOACCESS CKPTINTVL 300AUTO_CKPTS 1 RTO_SERVER_RESTART 0 BLOCKTIMEOUT 3600 CONVERSION_GUARD 2 RESTORE_POINT_DIR $INFORMIXDIR/tmp TXTIMEOUT 300 DEADLOCK_TIMEOUT 60 HETERO_COMMIT 0 TAPEDEV /dev/rmt2 #Tape device path TAPEBLK 1024 TAPESIZE 838860800 # Maximum amount of data to put on tape (Kbytes) LTAPEDEV LTAPEBLK 32 LTAPESIZE 0 BAR_ACT_LOG $INFORMIXDIR/tmp/bar_act.log BAR_DEBUG_LOG $INFORMIXDIR/tmp/bar_dbug.log BAR_DEBUG 0 BAR_MAX_BACKUP 0 BAR_RETRY 1 BAR_NB_XPORT_COUNT 20 BAR_XFER_BUF_SIZE 31 RESTARTABLE_RESTORE ON BAR_PROGRESS_FREQ 0 BAR_BSALIB_PATH BACKUP_FILTER RESTORE_FILTER BAR_PERFORMANCE 0 BAR_CKPTSEC_TIMEOUT 15 ISM_DATA_POOL ISMData ISM_LOG_POOL ISMLogs DD_HASHSIZE 31 DD_HASHMAX 10 DS_HASHSIZE 31 DS_POOLSIZE 127 PC_HASHSIZE 31 PC_POOLSIZE 127 PRELOAD_DLL_FILE STMT_CACHE 0 STMT_CACHE_HITS 0 STMT_CACHE_SIZE 512 STMT_CACHE_NOLIMIT 0 STMT_CACHE_NUMPOOL 1 USEOSTIME 0 STACKSIZE 128 ALLOW_NEWLINE 0 USELASTCOMMITTED NONE FILLFACTOR 90 MAX_FILL_DATA_PAGES 1 BTSCANNER num=5,threshold=2500,rangesize=-1,alice=6,compression=default ONLIDX_MAXMEM 5120 MAX_PDQPRIORITY 90 DS_MAX_QUERIES 10 DS_TOTAL_MEMORY 1024000 DS_MAX_SCANS 1048576 DS_NONPDQ_QUERY_MEM 256000 DATASKIP OPTCOMPIND 2 DIRECTIVES 1 EXT_DIRECTIVES 0 OPT_GOAL -1 IFX_FOLDVIEW 0AUTO_REPREPARE 1 AUTO_STAT_MODE 1 STATCHANGE 10 BATCHEDREAD_TABLE 1 BATCHEDREAD_INDEX 1BATCHEDREAD_KEYONLY 0 AUTO_READAHEAD 1 EXPLAIN_STAT 1 DBCREATE_PERMISSION informix IFX_EXTEND_ROLE 1 SECURITY_LOCALCONNECTION UNSECURE_ONSTAT ADMIN_USER_MODE_WITH_DBSA ADMIN_MODE_USERS SSL_KEYSTORE_LABEL PLCY_POOLSIZE 127 PLCY_HASHSIZE 31 USRC_POOLSIZE 127 USRC_HASHSIZE 31 STAGEBLOB OPCACHEMAX 0 SQL_LOGICAL_CHAR OFF SEQ_CACHE_SIZE 10 ENCRYPT_HDR ENCRYPT_SMX ENCRYPT_CDR 0 ENCRYPT_CIPHERS ENCRYPT_MAC ENCRYPT_MACFILE ENCRYPT_SWITCH CDR_EVALTHREADS 1,2 CDR_DSLOCKWAIT 5 CDR_QUEUEMEM 4096 CDR_NIFCOMPRESS 0 CDR_SERIAL 0 CDR_DBSPACE CDR_QHDR_DBSPACE CDR_QDATA_SBSPACE CDR_SUPPRESS_ATSRISWARN CDR_DELAY_PURGE_DTC 0 CDR_LOG_LAG_ACTION ddrblock CDR_LOG_STAGING_MAXSIZE 0 CDR_MAX_DYNAMIC_LOGS 0 DRAUTO 0 DRINTERVAL 30 DRTIMEOUT 30 HA_ALIASDRLOSTFOUND $INFORMIXDIR/etc/dr.lostfound DRIDXAUTO 0 LOG_INDEX_BUILDS 0 SDS_ENABLE SDS_TIMEOUT 20 SDS_TEMPDBS SDS_PAGING SDS_LOGCHECK 0 UPDATABLE_SECONDARY 0 FAILOVER_CALLBACK FAILOVER_TX_TIMEOUT 0 TEMPTAB_NOLOG 1 DELAY_APPLY 0 STOP_APPLY 0 LOG_STAGING_DIR RSS_FLOW_CONTROL 0 ENABLE_SNAPSHOT_COPY 0 SMX_COMPRESS 0 ON_RECVRY_THREADS 100 OFF_RECVRY_THREADS 100 DUMPDIR /INFORMIXDUMP DUMPSHMEM 1 DUMPGCORE 0 DUMPCORE 0 DUMPCNT 1 ALARMPROGRAM $INFORMIXDIR/etc/alarmprogram.sh ALRM_ALL_EVENTS 0 STORAGE_FULL_ALARM 600,3 SYSALARMPROGRAM $INFORMIXDIR/etc/evidence.sh RAS_PLOG_SPEED 45781 RAS_LLOG_SPEED 0 EILSEQ_COMPAT_MODE 0 QSTATS 0 WSTATS 0 USERMAPPING OFF SP_AUTOEXPAND 0 SP_THRESHOLD 0 SP_WAITTIME 30 DEFAULTESCCHAR \\\\ MQSERVER MQCHLLIB MQCHLTAB REMOTE_SERVER_CFG REMOTE_USERS_CFG LOW_MEMORY_RESERVE 0 LOW_MEMORY_MGR 0 JVPPROPFILE $INFORMIXDIR/extend/krakatoa/.jvpprops JVPLOGFILE $INFORMIXDIR/tmp/jvp.log JVPARGS -Dcom.ibm.tools.attach.enable=no JVPCLASSPATH $INFORMIXDIR/extend/krakatoa/krakatoa.jar:$INFORMIXDIR/extend/krakatoa/jdbc.jar BUFFERPOOL size=4K,buffers=200000,lrus=8,lru_min_dirty=50.00,lru_max_dirty=60.00 AUTO_LRU_TUNING 1 NETTYPE onsoctcp,1,150,NET NETTYPE drsoctcp,1,150,NET PHYSBUFF 128 BUFFERPOOL size=8K,buffers=1000,lrus=4,lru_min_dirty=50.00,lru_max_dirty=60.00

Does the file exist on the secondary with the correct permissions? Wh= en we create a new chunk on an HDR pair, we also have to create it on the secondary. This error indicates that the path name does not exist on t= he secondary and/or it does not have the correct permissions. = From: "CESAR CRUZ" <en.ki17@gmail.com> = = To: ids@iiug.org, = = Date: 08/12/2013 04:44 PM = = Subject: Error: DR: Couldn't send add dbspace/chunk request [3114= 6] = Sent by: ids-bounces@iiug.org = = Hi, We have primary Instance: IBM Informix Dynamic Server Version 11.70.FC3= -- On-Line (Prim) -- Up 38 days 01:40:22 -- 2428320 Kbytes Both primary and secondary with HDR on IBM Power 7 with AIX 6.1 (64 Bit= s) plataform. Primary AIX DCCPLD02 1 6 00F633A24C00 Secondary AIX DCMPLD02 1 6 00F633A64C00 IBM Informix Dynamic Server Version 11.70.FC3 -- Read-Only (Sec) -- Up =39 days 20:40:53 -- 2428320 Kbytes And every time we tryed to add a new chunk to Dbspaces we get this erro= r message: onspaces -a datos00 -p /ifxpld02/chunks/datos00_16 -o 0 -s 4096000Verifying physical disk space, please wait ... DR: Couldn't send add dbspace/chunk request to HDR secondary (pld_ids1170mty_hdr) ***********************************************************************= ******** Forum Note: Use "Reply" to post a response in the discussion forum. =

Hi, We have the same name, owner, permissons in both servers. Primary Server (simbolic link & rawdevice): DCCPLD02:/ifxpld02/chunks$ ls -l datos00_16 lrwxrwxrwx 1 informix informix 16 Aug 08 12:08 datos00_16 -> /dev/rdatos00_16 DCCPLD02:/ifxpld02/chunks$ ls -l /dev/rdatos00_16 crw-rw---- 1 informix informix 131, 10 Aug 07 18:56 /dev/rdatos00_16 Secondary Server (simbolic link & rawdevice): DCMPLD02:/ifxpld02/chunks$ ls -l datos00_16 lrwxrwxrwx 1 informix informix 16 Aug 08 12:07 datos00_16 -> /dev/rdatos00_16 DCMPLD02:/ifxpld02/chunks$ ls -l /dev/rdatos00_16 crw-rw---- 1 informix informix 43, 10 Aug 08 11:25 /dev/rdatos00_16

Could be that /ifxpld02/chunks/datos00_16 doesnt exist, renamed, or other issue like the dbspace doesnt exist?

Hi, We have the same name, owner, permissons and file exists in both servers. Primary Server (simbolic link & rawdevice): DCCPLD02:/ifxpld02/chunks$ ls -l datos00_16 lrwxrwxrwx 1 informix informix 16 Aug 08 12:08 datos00_16 -> /dev/rdatos00_16 DCCPLD02:/ifxpld02/chunks$ ls -l /dev/rdatos00_16 crw-rw---- 1 informix informix 131, 10 Aug 07 18:56 /dev/rdatos00_16 Secondary Server (simbolic link & rawdevice): DCMPLD02:/ifxpld02/chunks$ ls -l datos00_16 lrwxrwxrwx 1 informix informix 16 Aug 08 12:07 datos00_16 -> /dev/rdatos00_16 DCMPLD02:/ifxpld02/chunks$ ls -l /dev/rdatos00_16 crw-rw---- 1 informix informix 43, 10 Aug 08 11:25 /dev/rdatos00_16

Well I'm going to ask a dumb question. Are you sure that the raw devices actually exist? Can you use Dd to read those those files? Sent from my iPad On Aug 12, 2013, at 8:01 PM, "CESAR CRUZ" <en.ki17@gmail.com> wrote: > Hi, > > We have the same name, owner, permissons and file exists in both servers. > > Primary Server (simbolic link & rawdevice): > > DCCPLD02:/ifxpld02/chunks$ ls -l datos00_16 > lrwxrwxrwx 1 informix informix 16 Aug 08 12:08 datos00_16 -> /dev/rdatos00_16 > > DCCPLD02:/ifxpld02/chunks$ ls -l /dev/rdatos00_16 > crw-rw---- 1 informix informix 131, 10 Aug 07 18:56 /dev/rdatos00_16 > > Secondary Server (simbolic link & rawdevice): > > DCMPLD02:/ifxpld02/chunks$ ls -l datos00_16 > lrwxrwxrwx 1 informix informix 16 Aug 08 12:07 datos00_16 -> /dev/rdatos00_16 > > DCMPLD02:/ifxpld02/chunks$ ls -l /dev/rdatos00_16 > crw-rw---- 1 informix informix 43, 10 Aug 08 11:25 /dev/rdatos00_16 > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. >

Original Post: Hi, We have primary Instance: IBM Informix Dynamic Server Version 11.70.FC3 -- On-Line (Prim) -- Up 38 days 01:40:22 -- 2428320 Kbytes Both primary and secondary with HDR on IBM Power 7 with AIX 6.1 (64 Bits) plataform. Primary AIX DCCPLD02 1 6 00F633A24C00 Secondary AIX DCMPLD02 1 6 00F633A64C00 IBM Informix Dynamic Server Version 11.70.FC3 -- Read-Only (Sec) -- Up 39 days 20:40:53 -- 2428320 Kbytes And every time we tryed to add a new chunk to Dbspaces we get this error message: onspaces -a datos00 -p /ifxpld02/chunks/datos00_16 -o 0 -s 4096000Verifying physical disk space, please wait ... DR: Couldn't send add dbspace/chunk request to HDR secondary (pld_ids1170mty_hdr) Response: I've seen this before, but it involved demoting a HDR secondary to a RSS, and it involved something set in HA_ALIAS on the secondary server that the secondary then connected to the primary as, but that HA_ALIAS server name didn't exist on the primary's sqlhosts file. I looked at the sqlhosts and onconfig files you uploaded and that doesn't look like that's the problem. If you need to get the space added, if you bring your HDR secondary down (assuming the chunk path exists and is set up correctly etc...) add the space on the primary, and then bring your secondary up and it should add the space to the secondary via logical recovery. With the secondary down, it stops the code from trying to send a request to the secondary to verify the space exists...and in the case I was talking about, that was what the server was having the problem with, it couldn't connect to the RSS to send the request so it wouldn't add the space while the RSS was up. So I don't know why you are getting that error, but you should be able to possibly work around the issue by adding the space while the secondary is off-line. Jacques Renaut IBM Informix Advanced Support APD Team

I had a similar issue once. I eventually dropped the secondary, added the space then re-established replication. I wish I had pursued it further with a PMR. I later discovered that one of the DB in my instance ( I was not the actual owner ) was a non-logged DB. I expect that was related to the issue. Informix will not allow logging to be turned on, on a non-logged DB in and HDR pair ( or if there is an RSS instance ) I am not certain about SDS, never had reason to try. Check through sysmaster:sysdatabases or onmonitor if any of your DB are non-logged. Also any raw tables within a DB will short circuit HDR replication and possible produce the same results. I am just curious. Let us know. Thanks. George. From: "JACQUES RENAUT" <jrenaut@us.ibm.com> To: ids@iiug.org Date: 08/13/2013 08:50 AM Subject: Re: Error: DR: Couldn't send add dbspace/chunk.... [31172] Sent by: ids-bounces@iiug.org Original Post: Hi, We have primary Instance: IBM Informix Dynamic Server Version 11.70.FC3 -- On-Line (Prim) -- Up 38 days 01:40:22 -- 2428320 Kbytes Both primary and secondary with HDR on IBM Power 7 with AIX 6.1 (64 Bits) plataform. Primary AIX DCCPLD02 1 6 00F633A24C00 Secondary AIX DCMPLD02 1 6 00F633A64C00 IBM Informix Dynamic Server Version 11.70.FC3 -- Read-Only (Sec) -- Up 39days 20:40:53 -- 2428320 Kbytes And every time we tryed to add a new chunk to Dbspaces we get this error message: onspaces -a datos00 -p /ifxpld02/chunks/datos00_16 -o 0 -s 4096000Verifying physical disk space, please wait ... DR: Couldn't send add dbspace/chunk request to HDR secondary (pld_ids1170mty_hdr) Response: I've seen this before, but it involved demoting a HDR secondary to a RSS, and it involved something set in HA_ALIAS on the secondary server that the secondary then connected to the primary as, but that HA_ALIAS server name didn't exist on the primary's sqlhosts file. I looked at the sqlhosts and onconfig files you uploaded and that doesn't look like that's the problem. If you need to get the space added, if you bring your HDR secondary down (assuming the chunk path exists and is set up correctly etc...) add the space on the primary, and then bring your secondary up and it should add the space to the secondary via logical recovery. With the secondary down, it stops the code from trying to send a request to the secondary to verify the space exists...and in the case I was talking about, that was what the server was having the problem with, it couldn't connect to the RSS to send the request so it wouldn't add the space while the RSS was up. So I don't know why you are getting that error, but you should be able to possibly work around the issue by adding the space while the secondary is off-line. Jacques Renaut IBM Informix Advanced Support APD Team ******************************************************************************* Forum Note: Use "Reply" to post a response in the discussion forum.

Hi, All user databases are logging. Primary DCCPLD02:/ifxpld02/chunks$ dbaccess sysmaster -<<EOF > set isolation to dirty read; > select * from sysdatabases > order by name;> EOF Database selected. Isolation level set. name bdiauditor partnum 5243104 owner informix created 06/10/2013 is_logging 1 is_buff_log 1 is_ansi 0 is_nls 0 is_case_insens 0 flags -12285 name bdicheq partnum 5243232 owner informix created 04/19/2013 is_logging 1 is_buff_log 1 is_ansi 0 is_nls 0 is_case_insens 0 flags -12285 name bdicred partnum 5243297 owner informix created 04/19/2013 is_logging 1 is_buff_log 1 is_ansi 0 is_nls 0 is_case_insens 0 flags -12285 name bdinteg partnum 5243362 owner informix created 04/19/2013 is_logging 1 is_buff_log 1 is_ansi 0 is_nls 0 is_case_insens 0 flags -12285 name bdinvers partnum 5243427 owner informix created 04/19/2013 is_logging 1 is_buff_log 1 is_ansi 0 is_nls 0 is_case_insens 0 flags -12285 name bdisac partnum 5243557 owner informix created 04/19/2013 is_logging 1 is_buff_log 1 is_ansi 0 is_nls 0 is_case_insens 0 flags -12285 name bdisolic partnum 5243622 owner informix created 04/19/2013 is_logging 1 is_buff_log 1 is_ansi 0 is_nls 0 is_case_insens 0 flags -12285 name bdispei partnum 5243492 owner informix created 04/19/2013 is_logging 1 is_buff_log 1 is_ansi 0 is_nls 0 is_case_insens 0 flags -12285 name onpload partnum 1048645 owner informix created 11/18/2012 is_logging 1 is_buff_log 0 is_ansi 0 is_nls 0 is_case_insens 0 flags -12287 name sysadmin partnum 1049025 owner informix created 11/15/2012 is_logging 1 is_buff_log 0 is_ansi 0 is_nls 0 is_case_insens 0 flags -12255 name sysmaster partnum 1048580 owner informix created 11/15/2012 is_logging 1 is_buff_log 0 is_ansi 0 is_nls 0 is_case_insens 0 flags -12279 name sysuser partnum 1048951 owner informix created 11/15/2012 is_logging 1 is_buff_log 0 is_ansi 0 is_nls 0 is_case_insens 0 flags -12255 name sysutils partnum 1048868 owner informix created 11/15/2012 is_logging 1 is_buff_log 0 is_ansi 0 is_nls 0 is_case_insens 0 flags -12255 13 row(s) retrieved. Database closed.

Hi, I could test the sim link in both servers (Primary and secondary - HDR). PRIMARY: DCCPLD02:/ifxpld02/chunks$ dd if=/ifxpld02/chunks/datos00_16 of=/dev/null bs=4k 1048576+0 records in. 1048576+0 records out. SECONDARY: DCMPLD02:/ifxpld02/chunks$ dd if=/ifxpld02/chunks/datos00_16 of=/dev/null bs=4k 1048576+0 records in. 1048576+0 records out. I could test the raw devices in both servers (Primary and secondary - HDR). primary: DCCPLD02:/ifxpld02/chunks$ dd if=/dev/rdatos00_16 of=/dev/null bs=4k 1048576+0 records in. 1048576+0 records out. secondary: DCMPLD02:/ifxpld02/chunks$ dd if=/dev/rdatos00_16 of=/dev/null bs=4k 1048576+0 records in. 1048576+0 records out.

Hi, Because it's a production environment I have to request authorization from Tech Support Manager to do that test. If i do not he could blow off my nuts.

Did you confirm that you could read the raw space using dd from the secondary? Sent from my iPad On Aug 13, 2013, at 1:59 PM, "CESAR CRUZ" <en.ki17@gmail.com> wrote: > Hi, > > Because it's a production environment I have to request authorization from > Tech Support Manager to do that test. > > If i do not he could blow off my nuts. > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. >

Hi, Because it's a production environment I have to request authorization from Tech Support Manager to do that test. We already have opened an IBM PMR: 38369,999,781 since Aug 8 but we don't have any response from them. And every day we running with less free space.

Hi, I could test the sim link in both servers (Primary and secondary - HDR). PRIMARY: DCCPLD02:/ifxpld02/chunks$ dd if=/ifxpld02/chunks/datos00_16 of=/dev/null bs=4k 1048576+0 records in. 1048576+0 records out. SECONDARY: DCMPLD02:/ifxpld02/chunks$ dd if=/ifxpld02/chunks/datos00_16 of=/dev/null bs=4k 1048576+0 records in. 1048576+0 records out. I could test the raw devices in both servers (Primary and secondary - HDR). primary: DCCPLD02:/ifxpld02/chunks$ dd if=/dev/rdatos00_16 of=/dev/null bs=4k 1048576+0 records in. 1048576+0 records out. secondary: DCMPLD02:/ifxpld02/chunks$ dd if=/dev/rdatos00_16 of=/dev/null bs=4k 1048576+0 records in. 1048576+0 records out.

Are you reaching the pages limit? Until the problem gets resolved, I would try to make more free space within. Perhaps increasing the page size could reduce the number of pages used if page limit is problem, or archiving old data, etc. can buy you more time?

What was the onspaces command? = From: "CESAR CRUZ" <en.ki17@gmail.com> = = To: ids@iiug.org, = = Date: 08/13/2013 02:29 PM = = Subject: Re: Error: DR: Couldn't send add dbspace/chunk.... [3118= 2] = Sent by: ids-bounces@iiug.org = = Hi, I could test the sim link in both servers (Primary and secondary - HDR)= . PRIMARY: DCCPLD02:/ifxpld02/chunks$ dd if=3D/ifxpld02/chunks/datos00_16 of=3D/de= v/null bs=3D4k 1048576+0 records in. 1048576+0 records out. SECONDARY: DCMPLD02:/ifxpld02/chunks$ dd if=3D/ifxpld02/chunks/datos00_16 of=3D/de= v/null bs=3D4k 1048576+0 records in. 1048576+0 records out. I could test the raw devices in both servers (Primary and secondary - H= DR). primary: DCCPLD02:/ifxpld02/chunks$ dd if=3D/dev/rdatos00_16 of=3D/dev/null bs=3D= 4k 1048576+0 records in. 1048576+0 records out. secondary: DCMPLD02:/ifxpld02/chunks$ dd if=3D/dev/rdatos00_16 of=3D/dev/null bs=3D= 4k 1048576+0 records in. 1048576+0 records out. ***********************************************************************= ******** Forum Note: Use "Reply" to post a response in the discussion forum. =

Hi, onspaces -a datos00 -p /ifxpld02/chunks/datos00_16 -o 0 -s 4096000 Then we get: Verifying physical disk space, please wait ... DR: Couldn't send add dbspace/chunk request to HDR secondary (pld_ids1170mty_hdr)

???

Eso mismo!.. How how much free space remaining in the dbspace? Are your existing chunks maked as extendable? If they're not, you can't manually extend them. Try optimizing the dbspace to increase free space until problem solved. You can increase it by compressing and repacking tables or fragments. I'm also wondering whether your same problem would happen if the space was cooked versus raw?

hi, 92 % occupied - 8 Gb free (maybe a week). Today I run again the command and suddenly it Works (WT?) DCCPLD02:/ifxpld02/chunks$ onspaces -a datos00 -p /ifxpld02/chunks/datos00_16 -o 0 -s 4096000 Verifying physical disk space, please wait ... Chunk successfully added. Now we have tested with SQL Admin Facility (to add the second chunk for dbspace: datos01). DCCPLD02:/ifxpld02/chunks$ dbaccess sysadmin -<<EOF > EXECUTE FUNCTION task("addchunk","datos01","/ifxpld02/chunks/datos01_01","4096000","0"); > EOF Database selected. (expression) Error creating or verifying chunk on secondary.Unable to create f ile for chunk /ifxpld02/chunks/datos01_01 1 row(s) retrieved. Database closed. then we try to add the second chunk for dbspace: datos01 with onspaces. DCCPLD02:/ifxpld02/chunks$ onspaces -a datos01 -p /ifxpld02/chunks/datos01_01 -o 0 -s 4096000 Verifying physical disk space, please wait ... DR: Couldn't send add dbspace/chunk request to HDR secondary (pld_ids1170mty_hdr)