I did observe similar behaviour on four X4100 M2 as well (two with one
socket dual-core, two with two sockets dual-core Opterons) using amd64
bsd.mp snapshots from 23 and 28 Aug..

Currently, amd64 bsd.mp snapshot 28. Aug is running stable on those
four servers, although using a single SAS disk without RAID.

Several days ago, there was a commit in kernel CVS about delaying
start of IPMI which is causing annoying delays at startup of amd64.
Eventually, a more recent snapshot becomes available which includes
this modification, before I get around to build a -current kernel.

Rolf

[ message continues ]

You said same action above for 23 & 28, and here you say stable for 28? 


I justed look now on the site and the latest snapshots was done just a 
few hours ago:

ftp> ls pub/OpenBSD/snapshots/amd64/bsd.mp
227 Entering Passive Mode (129,128,5,191,167,61)
150 Have a Gorilla.
-r--r--r--    1 1114     1114      6708422 Sep 11 23:14 bsd.mp
226 There, everyone likes a Gorilla.
ftp>

So, I am not sure what testing you did, unless you built your own. new 
Snapshots was just release now, witch I will be happy to test tonight 
and see the results and report back.

Thanks

Daniel

[ message continues ]

Here is the new dmesg for current.

So far the boot process is much faster and do not hang anymore.

I am doing install on three more boxes now and will do a bunch of reboot 
cycles to see the end results.

Still some acpi not configure in the dmesg, but so far does look better.

Also, note this is on the latest bios and ilom as well as the latest SAS 
drivers as well. Not the one that comes directly from Sun.

ILOM: 1.1.8
BIOS: 39, not the standard 34 version.
SAS: 1.16.40, not the 1.16.00

More later.

Daniel

==========================================================

OpenBSD 4.2-current (GENERIC.MP) #1384: Tue Sep 11 22:09:44 MDT 2007
     deraadt@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 3757625344 (3583MB)
avail mem = 3635904512 (3467MB)
User Kernel Config
UKC> enable acpi
270 acpi0 enabled
UKC> exit
Continuing...
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.3 @ 0xfbd50 (70 entries)
bios0: vendor American Megatrends Inc. version "0ABJX039" date 04/11/2007
bios0: Sun Microsystems Sun Fire X4100 M2
acpi0 at mainbus0: rev 2
acpi0: tables DSDT FACP APIC SPCR SLIT OEMB HPET IPET SRAT SSDT
acpitimer at acpi0 not configured
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Dual-Core AMD Opteron(tm) Processor 2216, 2393.94 MHz
cpu0: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,CX16,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB 
64b/line 16-way L2 cache
cpu0: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative
cpu0: DTLB 32 4KB entries fully associative, 8 4MB entries fully associative
cpu0: apic clock running at 199MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Dual-Core AMD Opteron(tm) Processor 2216, 2393.64 MHz
cpu1: ...
[ message continues ]

Those devices (acpicpu, acpibtn...) are not compiled in GENERIC or
GENERIC.MP, if you want to test them

[ message continues ]