Home | Previous Page | Next Page   Managing the High-Performance Loader > Performance >

Usage Models

Three major usage models are envisioned for the HPL, as follows:

Reorganizing Computer Configuration

If you are not changing the table schema, use a no-conversion job to unload and load when you need to reorganize the configuration of your computer or change to a different computer. The no-conversion mode is the fastest means of performing an unload or load because rows are unloaded in Informix internal format with no conversion and reloaded in the same fashion.

Important:
You cannot use a no-conversion job when the source and target computers use different internal byte representations. For information about the byte-order type, see Machines Window.

For information about preparing for a no-conversion unload/load with ipload, see Using the No Conversion Job Option. To set no-conversion mode when you are using the onpload utility at the command line, use the -fn option. For more information, see The onpload Utility.

Altering the Schema of a Table

When you need to alter a table (add, drop, or change the data type of columns), use the Fixed Internal format. In Fixed Internal format, rows are unloaded in Informix internal format on a column-by-column basis. Thus you can drop, add, or modify columns and still minimize conversion overhead. For more information, see Format Type Group.

Loading and Unloading Data

When you load or unload data from an external source, you must assess the type of data and the amount of conversion that is required so that you can choose appropriate configuration parameters.

The following sections show possible configuration parameters for two different types of load jobs. Suppose your hardware has the following configuration:

You also have this information about your system:

Settings for a No-Conversion Load or Unload

A no-conversion load or unload is not highly CPU intensive because no conversion is involved. In this case, the load or unload is expected to be limited by the speed of the tape devices. No-conversion loads and unloads are always completed in express mode. For more information, see Using the No Conversion Job Option.

The following table lists sample values of configuration parameters for a raw load.

Configuration Parameter Suggested
Value
Comment
CONVERTVPS 4 This process is not CPU intensive.
CONVERTTHREADS 1 This process is not CPU intensive.
STRMBUFSIZE 128 Choose some multiple of the AIOBUFSIZE, up to about 8*AIOBUFSIZE.
STRMBUFFERS 5 Should be CONVERTTHREADS + 4.
AIOBUFSIZE 32 Choose a buffer size to match the best block size for the tape drive. Large buffers increase performance if sufficient memory is available.
AIOBUFFERS 5 CONVERTTHREADS + 4 or
2 * CONVERTTHREADS, whichever is larger

Express-Mode Load with Delimited ASCII

In an express-mode load with delimited ASCII, the load or unload job is limited by the available CPU. The conversion to or from Informix types to ASCII is the most expensive portion of these operations. Hence, the following configuration might be more appropriate.

The following table lists sample values of configuration parameters for an express-mode load with delimited ASCII.

Configuration Parameter Sample
Value
Comment
CONVERTVPS 8 One convert VP per CPU
CONVERTTHREADS 2 Four devices * 2 thread/device = 8 threads
STRMBUFSIZE 32 Should be some multiple of AIOBUFSIZE. For this CPU-intensive case, 1 or 2 * AIOBUFSIZE is sufficient.
STRMBUFFERS 4 CONVERTTHREADS + 4
AIOBUFSIZE 32 Choose a buffer size to match the best block size for the tape drive. Large buffers increase performance if sufficient memory is available.
AIOBUFFERS 5 CONVERTTHREADS + 4 or
2 * CONVERTTHREADS, whichever is larger
Home | [ Top of Page | Previous Page | Next Page | Contents | Index ]