CERC Performance Question

Neil Jones ncjones at cs.ucsd.edu
Thu Jul 27 10:43:31 CDT 2006


Grant ---

These numbers seem right.  I have the same system (4 drives, 500 Gb  
each) on a dual processor PE1800.

I get slightly worse performance under RAID 5, actually. And the  
kicker is that the write blocksize doesn't really affect performance  
so there doesn't seem to be any case where RAID5 works really well.   
Load avg jumping to 18 is also about right, and when that happens two  
things can occur:
   - it's almost impossible to use the system, even from a console
   - over prolonged periods (> 1 day), the aacraid driver starts  
falling into an error mode and emits messages to syslog---and the  
system needs to be rebooted

This happens with RHEL 4 and 3, and I do not believe it is specific  
to RH --- it seems like a hardware "feature".  If someone has the  
right kung-fu to suddenly make this configuration speedy, I'm all ears.

My solution was to split the data into "stuff I really need to be  
safe" and "stuff I can back up periodically".  Then I made two raid  
arrays: one RAID 0 and another RAID 1; I put the stuff I didn't need  
recoverable on the RAID 0 and the important stuff on the RAID 1.  Now  
the system is only somewhat slow compared to incredibly slow.   
(Writes are slow, but load only jumps to 2-3 and the system can be  
used concurrently.  Reads are tolerably fast but no stellar.)

Truthfully, this all seems quite slow for an SATA system but it's  
usable.  Dell, if you're listening, I think you should either  
*clearly mark* the CERC controller as a stop-gap measure for  
academics and flailing internet startups, or not offer it at all.   
Without a doubt, you need to remove the "supports RAID 5" from the  
website; while the controller might literally support the RAID5  
storage scheme, it is too slow for even casual single user usage.  I  
was thrilled to be able to get 1.5 Tb of RAIDed space on a system  
good for database serving for about $5k, but it was deceptively  
inexpensive.

..Neil

On Jul 25, 2006, at 7:41 AM, Sturgis, Grant wrote:

> Can anyone comment if these numbers look normal or not?
>
> Thanks.
>
> Sturgis, Grant wrote:
>> Greetings List,
>>
>> I am experiencing very poor performance with a CERC SATA 1.5/6ch RAID
>> card wtih firmware v4.1-0.  Four disks are configured in RAID 5  
>> and the
>> OS is RHEL ES 4.0.  I understand that this is not a high performance
>> RAID card or RAID configuration (write penalty associated with  
>> RAID 5),
>> but this just seems ridiculous.
>>
>> Created a 5GB file with the command:
>>
>> dd if=/dev/zero of=big_file bs=1024 count=5120000
>>
>> and then timed a move operation from an NFS mount to the local RAID
>> array connected at 1000Mbps end-to-end:
>>
>> time mv /hosts/server/test/big_file local_test_folder
>>
>> and the results were:
>>
>> 0.623u 34.342s 9:44.65 5.9%     0+0k 0+0io 3pf+0w
>>
>> This is over 10 minutes to move that much data over a gigabit
>> connection.  What's even worse is that the load average on the system
>> exceeded 18 resulting in an unusable system for all other users.   
>> There
>> was no response to any commands or login attempts.
>>
>> Does this seem reasonable to you?  What can I do to improve this
>> performance (short of doing away with RAID 5)?
>>
>> Any comments and suggestions are very much appreciated.
>>
>> Thanks,
>>
>> Grant
>> ----------------
>>
>>
>>
>>
>> Pardon this rubbish:
>>
>
>
> This electronic message transmission is a PRIVATE communication  
> which contains
> information which may be confidential or privileged. The  
> information is intended
> to be for the use of the individual or entity named above. If you  
> are not the
> intended recipient, please be aware that any disclosure, copying,  
> distribution
> or use of the contents of this information is prohibited. Please  
> notify the
> sender  of the delivery error by replying to this message, or  
> notify us by
> telephone (877-633-2436, ext. 0), and then delete it from your system.
>
> _______________________________________________
> Linux-PowerEdge mailing list
> Linux-PowerEdge at dell.com
> http://lists.us.dell.com/mailman/listinfo/linux-poweredge
> Please read the FAQ at http://lists.us.dell.com/faq



More information about the Linux-PowerEdge mailing list