Oninit Logo
The Down System Specialists
+1-913-674-0360
+44-2081-337529
Introduction Health Check Standby Admin Remote Admin Remote Monitoring Backup and Restore Custom Support Down Systems
Unix SQL Advanced SQL 4GL Applications Advanced 4GL IDS Admin Migrating to V14 IDS Performance Managing & Optimising SPL and Triggers IDS V14 Upgrading Very Old Versions Custom Training
Onstat Guide Error Code Guide Reference Datablades The Dumb DBA Sysmaster Fault Finder
Co-Location Web Hosting Managed Servers Web Development
BenchMark Tookkit RegExp Datablade
Partnerships Contact
Onstat
-g act -g afr -g all -g amx -g aqt -g arc -g ath -g btc -g buf -g cac -g cdr -g cluster -g cdr config -g cfg -g cmsm -g con -g cpu -g dbc -g ddr -g dic -g dis -g dll -g dmp -g dri -g dsc -g dsk -g dss
-g env -g ffr -g glo -g grp -g imc -g ioa -g iob -g iof -g iog -g ioq -g iov -g ipl -g lap -g laq -g lmm -g lmx -g lsc -g mem -g mgm -g nbm -g nif -g nsc -g nsd -g nss -g nta -g ntd -g ntm -g ntt -g ntu
-g opn -g osi -g pgp -g pos -g ppd -g ppf -g pqs -g prc -g proxy -g qst -g rah -g ras -g rbm -g rcv -g rep -g rea -g rss -g sch -g scn -g sds -g seg -g ses -g sle -g smb -g smx -g spi -g sql -g src -g ssc -g stk -g stm -g stq -g sts -g sym -g sync
-g rwm -g tgp -g tpf -g ufr -g wai -g vpcache -g wmx -g wst
-b/-B -F -g cac -g dic -g dsc -g prc -g ssc -g vpcache -h -p -X
-t/-T -g buf -g lap -g opn -g ppf -g scn
-g cat -g cdr -g cdrconfig -g ddr -g dss -g dtc -g grp -g nif -g que -g rcv -g rep -g rqm -g sync
-g cluster -g cmsm -g dri -g ipl -g laq -g proxy -g rss -g sds -g smx
-R -g afr -g ffr -g lmm -g lsc -g mem -g mgm -g nbm -g rbm -g seg -g ses -g stm -g stq -g ufr
-g imc -g nsc -g nsd -g nss -g nta -g ntd -g ntm -g ntt -g ntu
-G -u -x -g env -g his -g pqs -g ses -g sql
-g act -g ath -g cpu -g rea -g sle -g stk -g sts -g tpf -g wai -g wst
-a -b/-B -C -c -d/-D -F -f -G -h -i -j -k/-K -L -l -m -o -P -p -R -r -s -t/-T -u -X -x -z

onstat -g rcv ER Statistics for the Receive Manager

The onstat -g rcv command displays the statistics for the receive manager.

The Statistics by Source section of the onstat -g rcv command output shows the following information for each source server. For each replicate ID:

  • The number of transactions that are applied from the source servers
  • The number of inserts, deletes, and updates within the applied transactions
  • The timestamp of the most recently applied transaction on the target server
  • The timestamp of the commit on the source server for the most recently applied transaction
onstat -g rcv full

ServerId: 1
Flags 0x0

Threads:
         Id Name         State  Handle
        285461 CDRACK_6       Idle 0x3d9d09778
        228884 CDRACK_5       Idle 0x3dcce65c8
        148457 CDRACK_4       Idle 0x3dce11128
        13832 CDRACK_3       Idle 0x3d9a02de8
        13013 CDRACK_2       Idle 0x3d9d0a208
        522 CDRACK_1       Idle 0x3d89cb750
        521 CDRACK_0       Idle 0x3d89cb610

 Receive Manager global  block 0x3d9718028
         cdrRM_inst_ct:                          1
         cdrRM_State:                    00000040
         cdrRM_numSleepers:              21
         cdrRM_DsCreated:                23
         cdrRM_MinDSThreads:             6
         cdrRM_MaxDSThreads:             24
         cdrRM_DSBlock                   0
         cdrRM_DSParallelPL              0
         cdrRM_DSFailRate                0.000675
         cdrRM_DSNumRun:                 37027814
         cdrRM_DSNumLockTimeout          121
         cdrRM_DSNumLockRB               1965
         cdrRM_DSNumDeadLocks            41474
         cdrRM_DSNumPCommits             2111170
         cdrRM_ACKwaiting                0
         cdrRM_totSleep:                 527
         cdrRM_Sleeptime:                45
         cdrRM_Workload:                 0
         cdrRM_optscale:                 4
         cdrRM_MinFloatThreads:          2
         cdrRM_MaxFloatThreads:          7
         cdrRM_AckThreadCount:           7
         cdrRM_AckWaiters:               7
         cdrRM_AckCreateStamp:           Fri May 17 20:56:37 2013
         cdrRM_DSCreateStamp:            Tue Jun  4 10:32:25 2013
         cdrRM_acksInList:               0
         cdrRM_BlobErrorBufs:            0

Receive Parallelism Statistics
Server Tot.Txn. Pending Active MaxPnd MaxAct  AvgPnd  AvgAct CommitRt
     1 37027814       313      2  14309     24  507.66   17.48   24.05

Tot Pending:313   Tot Active:2  Avg Pending:507.66  Avg Active:17.48
Commit Rate:24.05

Time Spent In RM Parallel Pipeline Levels
Lev. TimeInSec  Pcnt.
   0   1538595  99.98%
   1        90   0.01%
   2       165   0.01%

Statistics by Source

Server 1
Repl        Txn     Ins     Del     Upd Last Target Apply   Last Source Commit
131277  26828667 26760220 26730686 26764607 2013/06/04 10:34:55 2013/06/04 10:34:54
131073    85983   42989   42994       0 2013/06/04 10:34:55 2013/06/04 10:34:54
131132  3576204       0       0 3576204 2013/06/04 10:31:39 2013/06/04 10:31:38
131217  3208448 3175834 3169772 3176427 2013/06/04 10:31:56 2013/06/04 10:31:55
131087  1507674 1629310 1629111 1479734 2013/06/04 10:35:12 2013/06/04 10:35:08
131094    32052 3402854 3402854 6805708 2013/06/04 10:35:03 2013/06/04 10:35:00
131091  1677074 1666392 1666392 1666392 2013/06/04 10:30:24 2013/06/04 10:30:09
131218    42692 3175852 3175850 6351702 2013/06/04 10:31:55 2013/06/04 10:31:55
131214    58479   58377       0   58377 2013/06/04 02:17:04 2013/06/04 02:17:04
131213       32      20       0      20 2013/06/03 00:15:18 2013/06/03 00:15:17
131131     5166       0       0    5166 2013/06/04 03:06:23 2013/06/04 03:06:14
131216        2       1       0       1 2013/06/02 00:15:17 2013/06/02 00:15:17

Replicates Being Throttled
Repid      Max
           Concurrent
131213     3

TimeSeries Statistics by Source

Server 1
Repl        Txn   TSIns   TSDel   TSCmd Last Target Apply   Last Source Commit 
131084     5339    5263       0    5263 2013/06/04 00:01:02 2013/06/04 00:00:32

Receive Manager section

FieldDescription
cdrRM_DSParallelPLShows the current level of Apply Parallelism, 0 (zero) being the highest
cdrRM_DSNumLockTimeout cdrRM_DSNumLockRB cdrRM_DSNumDeadLocksIndicate the number of collisions between various apply threads
cdrRM_acksinListShows acknowledgments that are received but not yet processed

Receive Parallelism Statistics

FieldDescription
ServerSource server ID
ConcurNumber of transactions currently being applied in parallel
Tot.Txn.Total number of transactions that are applied from this source server
PendingNumber of current transactions in the pending list for this source server
ActiveNumber of current transactions currently being applied from this source server
MaxPndMaximum number of transactions in the pending list queue
MaxActMaximum number of transactions in the active list queue
AvgPndAverage depth of the pending list queue
AvgActAverage depth of the active list queue
CommitRtCommit rate of transaction from this source server, based on transactions per second

Notes

    CommitRt is a good metric to monitor, a drop in rate is normally an indication of a problem
    If a replicate encounters a deadlock situation or otherwise reduces the degree of parallelism by which transactions are applied, the Statistics by Source section shows the replicate and the maximum number of concurrent transactions that are possible.
    Replicates that have a TimeSeries column are listed separately
    A ratio of greater than 1% for cdrRM_DSNumRun:cdrRM_DSNumDeadLocks is a cause for concern

To discuss how Oninit ® can assist please call on +1-913-674-0360 or alternatively just send an email specifying your requirements.