Re: Dbload performance
Posted in 1995
Scott Ellard (cse@wetware.com) wrote:
: On multi-cpu machines, I've had more fun having multiple dbloads reading
: multiple named pipes. I wrote a simple program that splits (round-robin)
: an input stream into multiple output streams feeding the dbloads.
: Many times a single dbload is cpu-bound vs. disk-bound. I did this
: on a 16 processor Sequent and was amazed at the increase.
I did something similar on my four processor Pyramid. I had a C program
pulling big blocks out of the ascii flat file, and then had it fork off
seperate processes running dbload to try to pump data into the database
faster. Even with the table frag'd round-robin it actually ran slower
than just the single nawk/dbload pipeline.
--
+----------------+-------------------------+---------------------------------+
| Michael Faurot | mfaurot@phzzzt.atww.org | I programmed COBOL in college. |
| ------- ------ | ------- ------ ---- --- | But I never compiled . . . :-) |
+----------------+-------------------------+---------------------------------+