Onbar Block Size
Dave asked what block size IDS 11.50.FC6 uses when writing data to raw disk during an ON-Bar restore, since his storage vendor wanted it for tuning. Early replies pointed at BAR_XFER_BUF_SIZE (pages per data buffer) and noted that the archive-side block size is set by the storage manager (ISM/PSM/Tivoli), not by onbar. IBM's John Miller clarified that BAR_XFER_BUF_SIZE governs the buffer exchanged with the storage manager, and that no single write size exists: because only used pages are backed up, writes can be as small as 2 KB when pages aren't contiguous, up to BAR_XFER_BUF_SIZE at most.
Auto-generated by DrWatson from the posts below — may be imperfect; read the full thread.
Hello,
Running 11.50.FC6. Does anyone know what the block size is (of data
getting written to disk) when running an onbar restore?
--Dave
--001a11c32ed8e9e93d04dfe86248
Hello.
You should look for the block size transfer generally, in your SM software
documentation.
Informix is configurable, through BAR_XFER_BUF_SIZE onconfig variable you can
adjust to your SM.
The size, in pages, of each data buffer. Acceptable values are 1 through 15
for 4 KB pages and 1 through 31 for 2 KB pages.
Paralel backups and restores are also configurable in Informix side, which can
speed up your backup/restore process.
Also pay attention to your OFF_RECVRY_THREADS configuration. In case of a cold
restore, it would also speed up your logical recovery process.
More details can be obtained from your Informix Information Center website.
Hope it helps.
Regards.
Alexandre Marini
IBM Informix Certified Professional v10 / v11.50 / v11.70
IBM Information Management Informix Technical Professional
IBM Infosphere DataStage Technical Professional
Informix Senior DBA - Orizon Brasil
BRIUG website administrator
Informix independent consultant
> To: ids@iiug.org
> From: in4mixdba@gmail.com
> Subject: Onbar Block Size [30613]
> Date: Mon, 24 Jun 2013 11:51:44 -0400
>
> Hello,
>
> Running 11.50.FC6. Does anyone know what the block size is (of data
> getting written to disk) when running an onbar restore?
>
> --Dave
>
> --001a11c32ed8e9e93d04dfe86248
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
We have BAR_XFER_BUF_SIZE set to 31. We have 2,4 & 8 k page sizes for the
various DBSPACES. Though what size is onbar writing it to the disk?
--Dave
On Mon, Jun 24, 2013 at 12:51 PM, Alexandre Marini <alexandre@briug.org>wrote:
> Hello.
> You should look for the block size transfer generally, in your SM software
> documentation.
> Informix is configurable, through BAR_XFER_BUF_SIZE onconfig variable you
> can
> adjust to your SM.
> The size, in pages, of each data buffer. Acceptable values are 1 through 15
> for 4 KB pages and 1 through 31 for 2 KB pages.
>
> Paralel backups and restores are also configurable in Informix side, which
> can
> speed up your backup/restore process.
>
> Also pay attention to your OFF_RECVRY_THREADS configuration. In case of a
> cold
> restore, it would also speed up your logical recovery process.
>
> More details can be obtained from your Informix Information Center website.
>
> Hope it helps.
> Regards.
>
> Alexandre Marini
> IBM Informix Certified Professional v10 / v11.50 / v11.70
>
> IBM Information Management Informix Technical Professional
>
> IBM Infosphere DataStage Technical Professional
> Informix Senior DBA - Orizon Brasil
> BRIUG website administrator
> Informix independent consultant
>
> > To: ids@iiug.org
> > From: in4mixdba@gmail.com
> > Subject: Onbar Block Size [30613]
> > Date: Mon, 24 Jun 2013 11:51:44 -0400
> >
> > Hello,
> >
> > Running 11.50.FC6. Does anyone know what the block size is (of data
> > getting written to disk) when running an onbar restore?
> >
> > --Dave
> >
> > --001a11c32ed8e9e93d04dfe86248
> >
> >
> >
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--001a11c36b307d3f5004dfe96afe
As Alexandre tried to point out, onbar doesn't ever write to the archive
output, that is the job of the storage manager, so look to how your storage
manager is configured.
As a side note: block size is rarely relevant when writing archives out to
disk and reading them back in, only when writing to to tape.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Mon, Jun 24, 2013 at 1:05 PM, Informix DBA <in4mixdba@gmail.com> wrote:
> We have BAR_XFER_BUF_SIZE set to 31. We have 2,4 & 8 k page sizes for the
> various DBSPACES. Though what size is onbar writing it to the disk?
>
> --Dave
>
> On Mon, Jun 24, 2013 at 12:51 PM, Alexandre Marini <alexandre@briug.org
> >wrote:
>
> > Hello.
> > You should look for the block size transfer generally, in your SM
> software
> > documentation.
> > Informix is configurable, through BAR_XFER_BUF_SIZE onconfig variable you
> > can
> > adjust to your SM.
> > The size, in pages, of each data buffer. Acceptable values are 1 through
> 15
> > for 4 KB pages and 1 through 31 for 2 KB pages.
> >
> > Paralel backups and restores are also configurable in Informix side,
> which
> > can
> > speed up your backup/restore process.
> >
> > Also pay attention to your OFF_RECVRY_THREADS configuration. In case of a
> > cold
> > restore, it would also speed up your logical recovery process.
> >
> > More details can be obtained from your Informix Information Center
> website.
> >
> > Hope it helps.
> > Regards.
> >
> > Alexandre Marini
> > IBM Informix Certified Professional v10 / v11.50 / v11.70
> >
> > IBM Information Management Informix Technical Professional
> >
> > IBM Infosphere DataStage Technical Professional
> > Informix Senior DBA - Orizon Brasil
> > BRIUG website administrator
> > Informix independent consultant
> >
> > > To: ids@iiug.org
> > > From: in4mixdba@gmail.com
> > > Subject: Onbar Block Size [30613]
> > > Date: Mon, 24 Jun 2013 11:51:44 -0400
> > >
> > > Hello,
> > >
> > > Running 11.50.FC6. Does anyone know what the block size is (of data
> > > getting written to disk) when running an onbar restore?
> > >
> > > --Dave
> > >
> > > --001a11c32ed8e9e93d04dfe86248
> > >
> > >
> > >
> >
> >
>
>
*******************************************************************************
> > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > >
> >
> >
> >
> >
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --001a11c36b307d3f5004dfe96afe
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--089e0158acf057671e04dfe981b6
Thank you. Though we are wondering what is the block size when doing an
onbar restore to the raw disks. The DB must be writing data to the disk in
certain block sizes. Our storage vendor has requested this information to
help properly tune the storage. Is the DB writing the onbar restore data
in 2k, 4k block sizes or a different size?
--Dave
On Mon, Jun 24, 2013 at 1:11 PM, Art Kagel <art.kagel@gmail.com> wrote:
> As Alexandre tried to point out, onbar doesn't ever write to the archive
> output, that is the job of the storage manager, so look to how your storage
> manager is configured.
>
> As a side note: block size is rarely relevant when writing archives out to
> disk and reading them back in, only when writing to to tape.
>
> Art
>
> Art S. Kagel
> Advanced DataTools (www.advancedatatools.com)
> Blog: http://informix-myview.blogspot.com/
>
> Disclaimer: Please keep in mind that my own opinions are my own opinions
> and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
> other organization with which I am associated either explicitly,
> implicitly, or by inference. Neither do those opinions reflect those of
> other individuals affiliated with any entity with which I am affiliated nor
> those of the entities themselves.
>
> On Mon, Jun 24, 2013 at 1:05 PM, Informix DBA <in4mixdba@gmail.com> wrote:
>
> > We have BAR_XFER_BUF_SIZE set to 31. We have 2,4 & 8 k page sizes for the
> > various DBSPACES. Though what size is onbar writing it to the disk?
> >
> > --Dave
> >
> > On Mon, Jun 24, 2013 at 12:51 PM, Alexandre Marini <alexandre@briug.org
> > >wrote:
> >
> > > Hello.
> > > You should look for the block size transfer generally, in your SM
> > software
> > > documentation.
> > > Informix is configurable, through BAR_XFER_BUF_SIZE onconfig variable
> you
> > > can
> > > adjust to your SM.
> > > The size, in pages, of each data buffer. Acceptable values are 1
> through
> > 15
> > > for 4 KB pages and 1 through 31 for 2 KB pages.
> > >
> > > Paralel backups and restores are also configurable in Informix side,
> > which
> > > can
> > > speed up your backup/restore process.
> > >
> > > Also pay attention to your OFF_RECVRY_THREADS configuration. In case
> of a
> > > cold
> > > restore, it would also speed up your logical recovery process.
> > >
> > > More details can be obtained from your Informix Information Center
> > website.
> > >
> > > Hope it helps.
> > > Regards.
> > >
> > > Alexandre Marini
> > > IBM Informix Certified Professional v10 / v11.50 / v11.70
> > >
> > > IBM Information Management Informix Technical Professional
> > >
> > > IBM Infosphere DataStage Technical Professional
> > > Informix Senior DBA - Orizon Brasil
> > > BRIUG website administrator
> > > Informix independent consultant
> > >
> > > > To: ids@iiug.org
> > > > From: in4mixdba@gmail.com
> > > > Subject: Onbar Block Size [30613]
> > > > Date: Mon, 24 Jun 2013 11:51:44 -0400
> > > >
> > > > Hello,
> > > >
> > > > Running 11.50.FC6. Does anyone know what the block size is (of data
> > > > getting written to disk) when running an onbar restore?
> > > >
> > > > --Dave
> > > >
> > > > --001a11c32ed8e9e93d04dfe86248
> > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
*******************************************************************************
> > > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > > >
> > >
> > >
> > >
> > >
> >
> >
>
>
*******************************************************************************
> > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > >
> > >
> >
> > --001a11c36b307d3f5004dfe96afe
> >
> >
> >
> >
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --089e0158acf057671e04dfe981b6
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--001a11c3ecde8d2d6804dfe99b78
Ask your storage manager. If you are using ISM or PSM then their
configuration files will have the output block size. If you are using
another storage manager (Tivoli, etc.) then I have no idea.
Art
Art S. Kagel
Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.
On Mon, Jun 24, 2013 at 1:19 PM, Informix DBA <in4mixdba@gmail.com> wrote:
> Thank you. Though we are wondering what is the block size when doing an
> onbar restore to the raw disks. The DB must be writing data to the disk in
> certain block sizes. Our storage vendor has requested this information to
> help properly tune the storage. Is the DB writing the onbar restore data
> in 2k, 4k block sizes or a different size?
>
> --Dave
>
> On Mon, Jun 24, 2013 at 1:11 PM, Art Kagel <art.kagel@gmail.com> wrote:
>
> > As Alexandre tried to point out, onbar doesn't ever write to the archive
> > output, that is the job of the storage manager, so look to how your
> storage
> > manager is configured.
> >
> > As a side note: block size is rarely relevant when writing archives out
> to
> > disk and reading them back in, only when writing to to tape.
> >
> > Art
> >
> > Art S. Kagel
> > Advanced DataTools (www.advancedatatools.com)
> > Blog: http://informix-myview.blogspot.com/
> >
> > Disclaimer: Please keep in mind that my own opinions are my own opinions
> > and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
> > other organization with which I am associated either explicitly,
> > implicitly, or by inference. Neither do those opinions reflect those of
> > other individuals affiliated with any entity with which I am affiliated
> nor
> > those of the entities themselves.
> >
> > On Mon, Jun 24, 2013 at 1:05 PM, Informix DBA <in4mixdba@gmail.com>
> wrote:
> >
> > > We have BAR_XFER_BUF_SIZE set to 31. We have 2,4 & 8 k page sizes for
> the
> > > various DBSPACES. Though what size is onbar writing it to the disk?
> > >
> > > --Dave
> > >
> > > On Mon, Jun 24, 2013 at 12:51 PM, Alexandre Marini <
> alexandre@briug.org
> > > >wrote:
> > >
> > > > Hello.
> > > > You should look for the block size transfer generally, in your SM
> > > software
> > > > documentation.
> > > > Informix is configurable, through BAR_XFER_BUF_SIZE onconfig variable
> > you
> > > > can
> > > > adjust to your SM.
> > > > The size, in pages, of each data buffer. Acceptable values are 1
> > through
> > > 15
> > > > for 4 KB pages and 1 through 31 for 2 KB pages.
> > > >
> > > > Paralel backups and restores are also configurable in Informix side,
> > > which
> > > > can
> > > > speed up your backup/restore process.
> > > >
> > > > Also pay attention to your OFF_RECVRY_THREADS configuration. In case
> > of a
> > > > cold
> > > > restore, it would also speed up your logical recovery process.
> > > >
> > > > More details can be obtained from your Informix Information Center
> > > website.
> > > >
> > > > Hope it helps.
> > > > Regards.
> > > >
> > > > Alexandre Marini
> > > > IBM Informix Certified Professional v10 / v11.50 / v11.70
> > > >
> > > > IBM Information Management Informix Technical Professional
> > > >
> > > > IBM Infosphere DataStage Technical Professional
> > > > Informix Senior DBA - Orizon Brasil
> > > > BRIUG website administrator
> > > > Informix independent consultant
> > > >
> > > > > To: ids@iiug.org
> > > > > From: in4mixdba@gmail.com
> > > > > Subject: Onbar Block Size [30613]
> > > > > Date: Mon, 24 Jun 2013 11:51:44 -0400
> > > > >
> > > > > Hello,
> > > > >
> > > > > Running 11.50.FC6. Does anyone know what the block size is (of data
> > > > > getting written to disk) when running an onbar restore?
> > > > >
> > > > > --Dave
> > > > >
> > > > > --001a11c32ed8e9e93d04dfe86248
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
*******************************************************************************
> > > > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
*******************************************************************************
> > > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > > >
> > > >
> > >
> > > --001a11c36b307d3f5004dfe96afe
> > >
> > >
> > >
> > >
> >
> >
>
>
*******************************************************************************
> > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > >
> > >
> >
> > --089e0158acf057671e04dfe981b6
> >
> >
> >
> >
>
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --001a11c3ecde8d2d6804dfe99b78
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--089e013c6760d0ecfa04dfe9a85c
The blocksize upon which the informix server send/receives the data to/from
the storage manager is defined by the onconfig BAR_XFER_BUF_SIZE. This
is not the size the servers reads/writes data, but rather the buffer
size the interacts with the storage manager.
# BAR_XFER_BUF_SIZE - The size, in pages, of each data buffer.
# Acceptable values are 1 through 15 for
# 4 KB pages and 1 through 31 for 2 KB pages.
# If PSM is the storage manager, higher values
# can be used.
John F. Miller III
STSM, Lead Architect
miller3@us.ibm.com
503-747-1366
IBM Informix Dynamic Server (IDS)
ids-bounces@iiug.org wrote on 06/24/2013 10:19:17 AM:
> From: "Informix DBA" <in4mixdba@gmail.com>
> To: ids@iiug.org,
> Date: 06/24/2013 10:26 AM
> Subject: Re: Onbar Block Size [30622]
> Sent by: ids-bounces@iiug.org
>
> Thank you. Though we are wondering what is the block size when doing an
> onbar restore to the raw disks. The DB must be writing data to the disk
in
> certain block sizes. Our storage vendor has requested this information to
> help properly tune the storage. Is the DB writing the onbar restore data
> in 2k, 4k block sizes or a different size?
>
> --Dave
>
> On Mon, Jun 24, 2013 at 1:11 PM, Art Kagel <art.kagel@gmail.com> wrote:
>
> > As Alexandre tried to point out, onbar doesn't ever write to the
archive
> > output, that is the job of the storage manager, so look to how your
storage
> > manager is configured.
> >
> > As a side note: block size is rarely relevant when writing archives out
to
> > disk and reading them back in, only when writing to to tape.
> >
> > Art
> >
> > Art S. Kagel
> > Advanced DataTools (www.advancedatatools.com)
> > Blog: http://informix-myview.blogspot.com/
> >
> > Disclaimer: Please keep in mind that my own opinions are my own
opinions
> > and do not reflect on my employer, Advanced DataTools, the IIUG, nor
any
> > other organization with which I am associated either explicitly,
> > implicitly, or by inference. Neither do those opinions reflect those of
> > other individuals affiliated with any entity with which I am affiliated
nor
> > those of the entities themselves.
> >
> > On Mon, Jun 24, 2013 at 1:05 PM, Informix DBA <in4mixdba@gmail.com>
wrote:
> >
> > > We have BAR_XFER_BUF_SIZE set to 31. We have 2,4 & 8 k page sizes for
the
> > > various DBSPACES. Though what size is onbar writing it to the disk?
> > >
> > > --Dave
> > >
> > > On Mon, Jun 24, 2013 at 12:51 PM, Alexandre Marini
<alexandre@briug.org
> > > >wrote:
> > >
> > > > Hello.
> > > > You should look for the block size transfer generally, in your SM
> > > software
> > > > documentation.
> > > > Informix is configurable, through BAR_XFER_BUF_SIZE onconfig
variable
> > you
> > > > can
> > > > adjust to your SM.
> > > > The size, in pages, of each data buffer. Acceptable values are 1
> > through
> > > 15
> > > > for 4 KB pages and 1 through 31 for 2 KB pages.
> > > >
> > > > Paralel backups and restores are also configurable in Informix
side,
> > > which
> > > > can
> > > > speed up your backup/restore process.
> > > >
> > > > Also pay attention to your OFF_RECVRY_THREADS configuration. In
case
> > of a
> > > > cold
> > > > restore, it would also speed up your logical recovery process.
> > > >
> > > > More details can be obtained from your Informix Information Center
> > > website.
> > > >
> > > > Hope it helps.
> > > > Regards.
> > > >
> > > > Alexandre Marini
> > > > IBM Informix Certified Professional v10 / v11.50 / v11.70
> > > >
> > > > IBM Information Management Informix Technical Professional
> > > >
> > > > IBM Infosphere DataStage Technical Professional
> > > > Informix Senior DBA - Orizon Brasil
> > > > BRIUG website administrator
> > > > Informix independent consultant
> > > >
> > > > > To: ids@iiug.org
> > > > > From: in4mixdba@gmail.com
> > > > > Subject: Onbar Block Size [30613]
> > > > > Date: Mon, 24 Jun 2013 11:51:44 -0400
> > > > >
> > > > > Hello,
> > > > >
> > > > > Running 11.50.FC6. Does anyone know what the block size is (of
data
> > > > > getting written to disk) when running an onbar restore?
> > > > >
> > > > > --Dave
> > > > >
> > > > > --001a11c32ed8e9e93d04dfe86248
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
*******************************************************************************
> > > > > Forum Note: Use "Reply" to post a response in the discussion
forum.
> > > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
*******************************************************************************
> > > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > > >
> > > >
> > >
> > > --001a11c36b307d3f5004dfe96afe
> > >
> > >
> > >
> > >
> >
> >
>
*******************************************************************************
> > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > >
> > >
> >
> > --089e0158acf057671e04dfe981b6
> >
> >
> >
> >
>
*******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --001a11c3ecde8d2d6804dfe99b78
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
Thank you John. We are looking for the block size of the data getting
written to disk by Informix when doing an OnBar restore.
--Dave
On Mon, Jun 24, 2013 at 1:53 PM, John Miller iii <miller3@us.ibm.com> wrote:
> The blocksize upon which the informix server send/receives the data to/from
> the storage manager is defined by the onconfig BAR_XFER_BUF_SIZE. This
> is not the size the servers reads/writes data, but rather the buffer
> size the interacts with the storage manager.
>
> # BAR_XFER_BUF_SIZE - The size, in pages, of each data buffer.
> # Acceptable values are 1 through 15 for
> # 4 KB pages and 1 through 31 for 2 KB pages.
> # If PSM is the storage manager, higher values
> # can be used.
>
> John F. Miller III
> STSM, Lead Architect
> miller3@us.ibm.com
> 503-747-1366
> IBM Informix Dynamic Server (IDS)
>
> ids-bounces@iiug.org wrote on 06/24/2013 10:19:17 AM:
>
> > From: "Informix DBA" <in4mixdba@gmail.com>
> > To: ids@iiug.org,
> > Date: 06/24/2013 10:26 AM
> > Subject: Re: Onbar Block Size [30622]
> > Sent by: ids-bounces@iiug.org
> >
> > Thank you. Though we are wondering what is the block size when doing an
> > onbar restore to the raw disks. The DB must be writing data to the disk
> in
> > certain block sizes. Our storage vendor has requested this information to
>
> > help properly tune the storage. Is the DB writing the onbar restore data
> > in 2k, 4k block sizes or a different size?
> >
> > --Dave
> >
> > On Mon, Jun 24, 2013 at 1:11 PM, Art Kagel <art.kagel@gmail.com> wrote:
> >
> > > As Alexandre tried to point out, onbar doesn't ever write to the
> archive
> > > output, that is the job of the storage manager, so look to how your
> storage
> > > manager is configured.
> > >
> > > As a side note: block size is rarely relevant when writing archives out
> to
> > > disk and reading them back in, only when writing to to tape.
> > >
> > > Art
> > >
> > > Art S. Kagel
> > > Advanced DataTools (www.advancedatatools.com)
> > > Blog: http://informix-myview.blogspot.com/
> > >
> > > Disclaimer: Please keep in mind that my own opinions are my own
> opinions
> > > and do not reflect on my employer, Advanced DataTools, the IIUG, nor
> any
> > > other organization with which I am associated either explicitly,
> > > implicitly, or by inference. Neither do those opinions reflect those of
>
> > > other individuals affiliated with any entity with which I am affiliated
> nor
> > > those of the entities themselves.
> > >
> > > On Mon, Jun 24, 2013 at 1:05 PM, Informix DBA <in4mixdba@gmail.com>
> wrote:
> > >
> > > > We have BAR_XFER_BUF_SIZE set to 31. We have 2,4 & 8 k page sizes for
> the
> > > > various DBSPACES. Though what size is onbar writing it to the disk?
> > > >
> > > > --Dave
> > > >
> > > > On Mon, Jun 24, 2013 at 12:51 PM, Alexandre Marini
> <alexandre@briug.org
> > > > >wrote:
> > > >
> > > > > Hello.
> > > > > You should look for the block size transfer generally, in your SM
> > > > software
> > > > > documentation.
> > > > > Informix is configurable, through BAR_XFER_BUF_SIZE onconfig
> variable
> > > you
> > > > > can
> > > > > adjust to your SM.
> > > > > The size, in pages, of each data buffer. Acceptable values are 1
> > > through
> > > > 15
> > > > > for 4 KB pages and 1 through 31 for 2 KB pages.
> > > > >
> > > > > Paralel backups and restores are also configurable in Informix
> side,
> > > > which
> > > > > can
> > > > > speed up your backup/restore process.
> > > > >
> > > > > Also pay attention to your OFF_RECVRY_THREADS configuration. In
> case
> > > of a
> > > > > cold
> > > > > restore, it would also speed up your logical recovery process.
> > > > >
> > > > > More details can be obtained from your Informix Information Center
> > > > website.
> > > > >
> > > > > Hope it helps.
> > > > > Regards.
> > > > >
> > > > > Alexandre Marini
> > > > > IBM Informix Certified Professional v10 / v11.50 / v11.70
> > > > >
> > > > > IBM Information Management Informix Technical Professional
> > > > >
> > > > > IBM Infosphere DataStage Technical Professional
> > > > > Informix Senior DBA - Orizon Brasil
> > > > > BRIUG website administrator
> > > > > Informix independent consultant
> > > > >
> > > > > > To: ids@iiug.org
> > > > > > From: in4mixdba@gmail.com
> > > > > > Subject: Onbar Block Size [30613]
> > > > > > Date: Mon, 24 Jun 2013 11:51:44 -0400
> > > > > >
> > > > > > Hello,
> > > > > >
> > > > > > Running 11.50.FC6. Does anyone know what the block size is (of
> data
> > > > > > getting written to disk) when running an onbar restore?
> > > > > >
> > > > > > --Dave
> > > > > >
> > > > > > --001a11c32ed8e9e93d04dfe86248
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
>
>
>
*******************************************************************************
>
> > > > > > Forum Note: Use "Reply" to post a response in the discussion
> forum.
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
>
>
>
*******************************************************************************
>
> > > > > Forum Note: Use "Reply" to post a response in the discussion forum.
>
> > > > >
> > > > >
> > > >
> > > > --001a11c36b307d3f5004dfe96afe
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
>
>
>
*******************************************************************************
>
> > > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > > >
> > > >
> > >
> > > --089e0158acf057671e04dfe981b6
> > >
> > >
> > >
> > >
> >
>
>
>
*******************************************************************************
>
> > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > >
> > >
> >
> > --001a11c3ecde8d2d6804dfe99b78
> >
> >
> >
>
>
>
*******************************************************************************
>
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
>
>
>
>
*******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--001a11c32ed89d7ccb04dfea4f3c
This is not easy to say, because informix does not backup all the pages=
.
It only backs up used pages. So if used
pages are not contiguous then it could be 2KB. The largest it will be=
is
BAR_XFER_BUF_SIZE as we do notwant to move(byte copy) the data from one buffer to another.
John F. Miller III
STSM, Lead Architect
miller3@us.ibm.com
503-747-1366
IBM Informix Dynamic Server (IDS)
From: "Informix DBA" <in4mixdba@gmail.com>
To: ids@iiug.org,
Date: 06/24/2013 11:12 AM
Subject: Re: Onbar Block Size [30626]
Sent by: ids-bounces@iiug.org
Thank you John. We are looking for the block size of the data getting
written to disk by Informix when doing an OnBar restore.
--Dave
On Mon, Jun 24, 2013 at 1:53 PM, John Miller iii <miller3@us.ibm.com>
wrote:
> The blocksize upon which the informix server send/receives the data
to/from
> the storage manager is defined by the onconfig BAR_XFER_BUF_SIZE. Thi=
s
> is not the size the servers reads/writes data, but rather the buffer
> size the interacts with the storage manager.
>
> # BAR_XFER_BUF_SIZE - The size, in pages, of each data buffer.
> # Acceptable values are 1 through 15 for
> # 4 KB pages and 1 through 31 for 2 KB pages.
> # If PSM is the storage manager, higher values
> # can be used.
>
> John F. Miller III
> STSM, Lead Architect
> miller3@us.ibm.com
> 503-747-1366
> IBM Informix Dynamic Server (IDS)
>
> ids-bounces@iiug.org wrote on 06/24/2013 10:19:17 AM:
>
> > From: "Informix DBA" <in4mixdba@gmail.com>
> > To: ids@iiug.org,
> > Date: 06/24/2013 10:26 AM
> > Subject: Re: Onbar Block Size [30622]
> > Sent by: ids-bounces@iiug.org
> >
> > Thank you. Though we are wondering what is the block size when doin=
g an
> > onbar restore to the raw disks. The DB must be writing data to the =
disk
> in
> > certain block sizes. Our storage vendor has requested this informat=
ion
to
>
> > help properly tune the storage. Is the DB writing the onbar restore=
data
> > in 2k, 4k block sizes or a different size?
> >
> > --Dave
> >
> > On Mon, Jun 24, 2013 at 1:11 PM, Art Kagel <art.kagel@gmail.com> wr=
ote:
> >
> > > As Alexandre tried to point out, onbar doesn't ever write to the
> archive
> > > output, that is the job of the storage manager, so look to how yo=
ur
> storage
> > > manager is configured.
> > >
> > > As a side note: block size is rarely relevant when writing archiv=
es
out
> to
> > > disk and reading them back in, only when writing to to tape.
> > >
> > > Art
> > >
> > > Art S. Kagel
> > > Advanced DataTools (www.advancedatatools.com)
> > > Blog: http://informix-myview.blogspot.com/
> > >
> > > Disclaimer: Please keep in mind that my own opinions are my own
> opinions
> > > and do not reflect on my employer, Advanced DataTools, the IIUG, =
nor
> any
> > > other organization with which I am associated either explicitly,
> > > implicitly, or by inference. Neither do those opinions reflect th=
ose
of
>
> > > other individuals affiliated with any entity with which I am
affiliated
> nor
> > > those of the entities themselves.
> > >
> > > On Mon, Jun 24, 2013 at 1:05 PM, Informix DBA <in4mixdba@gmail.co=
m>
> wrote:
> > >
> > > > We have BAR_XFER_BUF_SIZE set to 31. We have 2,4 & 8 k page siz=
es
for
> the
> > > > various DBSPACES. Though what size is onbar writing it to the d=
isk?
> > > >
> > > > --Dave
> > > >
> > > > On Mon, Jun 24, 2013 at 12:51 PM, Alexandre Marini
> <alexandre@briug.org
> > > > >wrote:
> > > >
> > > > > Hello.
> > > > > You should look for the block size transfer generally, in you=
r SM
> > > > software
> > > > > documentation.
> > > > > Informix is configurable, through BAR_XFER_BUF_SIZE onconfig
> variable
> > > you
> > > > > can
> > > > > adjust to your SM.
> > > > > The size, in pages, of each data buffer. Acceptable values ar=
e 1
> > > through
> > > > 15
> > > > > for 4 KB pages and 1 through 31 for 2 KB pages.
> > > > >
> > > > > Paralel backups and restores are also configurable in Informi=
x
> side,
> > > > which
> > > > > can
> > > > > speed up your backup/restore process.
> > > > >
> > > > > Also pay attention to your OFF_RECVRY_THREADS configuration. =
In
> case
> > > of a
> > > > > cold
> > > > > restore, it would also speed up your logical recovery process=
.
> > > > >
> > > > > More details can be obtained from your Informix Information
Center
> > > > website.
> > > > >
> > > > > Hope it helps.
> > > > > Regards.
> > > > >
> > > > > Alexandre Marini
> > > > > IBM Informix Certified Professional v10 / v11.50 / v11.70
> > > > >
> > > > > IBM Information Management Informix Technical Professional
> > > > >
> > > > > IBM Infosphere DataStage Technical Professional
> > > > > Informix Senior DBA - Orizon Brasil
> > > > > BRIUG website administrator
> > > > > Informix independent consultant
> > > > >
> > > > > > To: ids@iiug.org
> > > > > > From: in4mixdba@gmail.com
> > > > > > Subject: Onbar Block Size [30613]
> > > > > > Date: Mon, 24 Jun 2013 11:51:44 -0400
> > > > > >
> > > > > > Hello,
> > > > > >
> > > > > > Running 11.50.FC6. Does anyone know what the block size is =
(of
> data
> > > > > > getting written to disk) when running an onbar restore?
> > > > > >
> > > > > > --Dave
> > > > > >
> > > > > > --001a11c32ed8e9e93d04dfe86248
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
>
>
>
***********************************************************************=
********
>
> > > > > > Forum Note: Use "Reply" to post a response in the discussio=
n
> forum.
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
>
>
>
***********************************************************************=
********
>
> > > > > Forum Note: Use "Reply" to post a response in the discussion
forum.
>
> > > > >
> > > > >
> > > >
> > > > --001a11c36b307d3f5004dfe96afe
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
>
>
>
***********************************************************************=
********
>
> > > > Forum Note: Use "Reply" to post a response in the discussion fo=
rum.
> > > >
> > > >
> > >
> > > --089e0158acf057671e04dfe981b6
> > >
> > >
> > >
> > >
> >
>
>
>
***********************************************************************=
********
>
> > > Forum Note: Use "Reply" to post a response in the discussion foru=
m.
> > >
> > >
> >
> > --001a11c3ecde8d2d6804dfe99b78
> >
> >
> >
>
>
>
***********************************************************************=
********
Are there plans to increase the maximum for BAR_XFER_BUF_SIZE?
64K is quite small these days!
Regards,
David.
On 24 June 2013 at 21:13 John Miller iii <miller3@us.ibm.com> wrote:
> This is not easy to say, because informix does not backup all the pages=
> ..
> It only backs up used pages. So if used
> pages are not contiguous then it could be 2KB. The largest it will be=
> is
> BAR_XFER_BUF_SIZE as we do not> want to move(byte copy) the data from one buffer to another.
>
> John F. Miller III
> STSM, Lead Architect
> miller3@us.ibm.com
> 503-747-1366
> IBM Informix Dynamic Server (IDS)
>
> From: "Informix DBA" <in4mixdba@gmail.com>
> To: ids@iiug.org,
> Date: 06/24/2013 11:12 AM
> Subject: Re: Onbar Block Size [30626]
> Sent by: ids-bounces@iiug.org
>
> Thank you John. We are looking for the block size of the data getting
> written to disk by Informix when doing an OnBar restore.
>
> --Dave
>
> On Mon, Jun 24, 2013 at 1:53 PM, John Miller iii <miller3@us.ibm.com>
> wrote:
>
> > The blocksize upon which the informix server send/receives the data
> to/from
> > the storage manager is defined by the onconfig BAR_XFER_BUF_SIZE. Thi=
> s
> > is not the size the servers reads/writes data, but rather the buffer
> > size the interacts with the storage manager.
> >
> > # BAR_XFER_BUF_SIZE - The size, in pages, of each data buffer.
> > # Acceptable values are 1 through 15 for
> > # 4 KB pages and 1 through 31 for 2 KB pages.
> > # If PSM is the storage manager, higher values
> > # can be used.
> >
> > John F. Miller III
> > STSM, Lead Architect
> > miller3@us.ibm.com
> > 503-747-1366
> > IBM Informix Dynamic Server (IDS)
> >
> > ids-bounces@iiug.org wrote on 06/24/2013 10:19:17 AM:
> >
> > > From: "Informix DBA" <in4mixdba@gmail.com>
> > > To: ids@iiug.org,
> > > Date: 06/24/2013 10:26 AM
> > > Subject: Re: Onbar Block Size [30622]
> > > Sent by: ids-bounces@iiug.org
> > >
> > > Thank you. Though we are wondering what is the block size when doin=
> g an
>
> > > onbar restore to the raw disks. The DB must be writing data to the =
> disk
>
> > in
> > > certain block sizes. Our storage vendor has requested this informat=
> ion
> to
> >
> > > help properly tune the storage. Is the DB writing the onbar restore=
>
> data
> > > in 2k, 4k block sizes or a different size?
> > >
> > > --Dave
> > >
> > > On Mon, Jun 24, 2013 at 1:11 PM, Art Kagel <art.kagel@gmail.com> wr=
> ote:
>
> > >
> > > > As Alexandre tried to point out, onbar doesn't ever write to the
> > archive
> > > > output, that is the job of the storage manager, so look to how yo=
> ur
> > storage
> > > > manager is configured.
> > > >
> > > > As a side note: block size is rarely relevant when writing archiv=
> es
> out
> > to
> > > > disk and reading them back in, only when writing to to tape.
> > > >
> > > > Art
> > > >
> > > > Art S. Kagel
> > > > Advanced DataTools (www.advancedatatools.com)
> > > > Blog: http://informix-myview.blogspot.com/
> > > >
> > > > Disclaimer: Please keep in mind that my own opinions are my own
> > opinions
> > > > and do not reflect on my employer, Advanced DataTools, the IIUG, =
> nor
> > any
> > > > other organization with which I am associated either explicitly,
> > > > implicitly, or by inference. Neither do those opinions reflect th=
> ose
> of
> >
> > > > other individuals affiliated with any entity with which I am
> affiliated
> > nor
> > > > those of the entities themselves.
> > > >
> > > > On Mon, Jun 24, 2013 at 1:05 PM, Informix DBA <in4mixdba@gmail.co=
> m>
> > wrote:
> > > >
> > > > > We have BAR_XFER_BUF_SIZE set to 31. We have 2,4 & 8 k page siz=
> es
> for
> > the
> > > > > various DBSPACES. Though what size is onbar writing it to the d=
> isk?
>
> > > > >
> > > > > --Dave
> > > > >
> > > > > On Mon, Jun 24, 2013 at 12:51 PM, Alexandre Marini
> > <alexandre@briug.org
> > > > > >wrote:
> > > > >
> > > > > > Hello.
> > > > > > You should look for the block size transfer generally, in you=
> r SM
>
> > > > > software
> > > > > > documentation.
> > > > > > Informix is configurable, through BAR_XFER_BUF_SIZE onconfig
> > variable
> > > > you
> > > > > > can
> > > > > > adjust to your SM.
> > > > > > The size, in pages, of each data buffer. Acceptable values ar=
> e 1
> > > > through
> > > > > 15
> > > > > > for 4 KB pages and 1 through 31 for 2 KB pages.
> > > > > >
> > > > > > Paralel backups and restores are also configurable in Informi=
> x
> > side,
> > > > > which
> > > > > > can
> > > > > > speed up your backup/restore process.
> > > > > >
> > > > > > Also pay attention to your OFF_RECVRY_THREADS configuration. =
> In
> > case
> > > > of a
> > > > > > cold
> > > > > > restore, it would also speed up your logical recovery process=
> ..
> > > > > >
> > > > > > More details can be obtained from your Informix Information
> Center
> > > > > website.
> > > > > >
> > > > > > Hope it helps.
> > > > > > Regards.
> > > > > >
> > > > > > Alexandre Marini
> > > > > > IBM Informix Certified Professional v10 / v11.50 / v11.70
> > > > > >
> > > > > > IBM Information Management Informix Technical Professional
> > > > > >
> > > > > > IBM Infosphere DataStage Technical Professional
> > > > > > Informix Senior DBA - Orizon Brasil
> > > > > > BRIUG website administrator
> > > > > > Informix independent consultant
> > > > > >
> > > > > > > To: ids@iiug.org
> > > > > > > From: in4mixdba@gmail.com
> > > > > > > Subject: Onbar Block Size [30613]
> > > > > > > Date: Mon, 24 Jun 2013 11:51:44 -0400
> > > > > > >
> > > > > > > Hello,
> > > > > > >
> > > > > > > Running 11.50.FC6. Does anyone know what the block size is =
> (of
> > data
> > > > > > > getting written to disk) when running an onbar restore?
> > > > > > >
> > > > > > > --Dave
> > > > > > >
> > > > > > > --001a11c32ed8e9e93d04dfe86248
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> >
> >
> >
> ***********************************************************************=
> ********
>
> >
> > > > > > > Forum Note: Use "Reply" to post a response in the discussio=
> n
> > forum.
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> >
> >
> >
> ***********************************************************************=
> ********
>
> >
> > > > > > Forum Note: Use "Reply" to post a response in the discussion
> forum.
> >
> > > > > >
> > > > > >
> > > > >
> > > > > --001a11c36b307d3f5004dfe96afe
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> >
> >
> >
> ********************************************************************
Original post: Are there plans to increase the maximum for BAR_XFER_BUF_SIZE? 64K is quite small these days! Regards, David. Response: In 12.10, I believe if you use PSM you can have larger values for BAR_XFER_BUF_SIZE, but I don't think the limit was increased for other storage managers (if I'm reading this feature summary correctly). Jacques Renaut IBM Informix Advanced Support APD Team
Actually, I'm a bit puzzled by this feature of PSM... If you care to follow this rationale: Here: http://archive.opengroup.org/publications/archive/CDROM/c425.pdf We see that: (p73:) int BSASendData(long bsaHandle, BSA_DataBlock32 *dataBlockPtr) and (p79:) BSA_DataBlock32 The BSA_DataBlock32 structure is used to pass data between an XBSA Application and the Backup Service. It is defined as follows: typedef struct { BSA_UInt32 bufferLen; BSA_UInt32 numBytes; BSA_UInt32 headerBytes; BSA_ShareId shareId; BSA_UInt32 shareOffset; void *bufferPtr } BSA_DataBlock32; and on p75: 32-bit Unsigned Integer | BSA_UInt32 | typedef unsigned int BSA_UInt32; So... I may be wrong, and for sure I'm not the best person to evaluate this, but it looks like the maximum buffer size is a BSA_UInt32 which is a 32 unsigned integer... much larger than 64KB if I am right. It's true that we can find some references stating it must be 64KB -1... But I'd go for the published standard... Can you check/clarify/escalate this (if needed?) And yes... I'd say 64KB is very small... just look at what we did with FET_BUF_SIZE and why... Regards On Tue, Jun 25, 2013 at 9:53 PM, JACQUES RENAUT <jrenaut@us.ibm.com> wrote: > Original post: > > Are there plans to increase the maximum for BAR_XFER_BUF_SIZE? > > 64K is quite small these days! > > Regards, > David. > > Response: > > In 12.10, I believe if you use PSM you can have larger values for > BAR_XFER_BUF_SIZE, but I don't think the limit was increased for other > storage > managers (if I'm reading this feature summary correctly). > > Jacques Renaut > IBM Informix Advanced Support > APD Team > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > -- Fernando Nunes Portugal http://informix-technology.blogspot.com My email works... but I don't check it frequently... --20cf307d066a54080804e0027fdd