> Sorry about forgetting dmesg, thanks for the info about inline/pastebin.
> Since this was very long information, I really wasn't sure. Here are all
> the details inline:
>
> ===================================================
> DMESG
> ===================================================
> OpenBSD 4.7 (GENERIC.MP) #130: Wed Mar 17 20:48:50 MDT 2010
> deraadt@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> real mem = 2141519872 (2042MB)
> avail mem = 2075058176 (1978MB)
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x7fb9c000 (67 entries)
> bios0: vendor Dell Inc. version "2.3.1" date 04/29/2008
> bios0: Dell Inc. PowerEdge 1950
> acpi0 at bios0: rev 2
> acpi0: tables DSDT FACP APIC SPCR HPET MCFG WD__ SLIC ERST HEST BERT
> EINJ TCPA
> acpi0: wakeup devices PCI0(S5)
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 1995.27 MHz
> cpu0:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,TM2,CX16,xTPR,NXE,LONG
>
> cpu0: 6MB 64b/line 16-way L2 cache
> cpu0: apic clock running at 332MHz
> cpu1 at mainbus0: apid 4 (application processor)
> cpu1: Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 1995.02 MHz
> cpu1:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,TM2,CX16,xTPR,NXE,LONG
>
> cpu1: 6MB 64b/line 16-way L2 cache
> cpu2 at mainbus0: apid 2 (application processor)
> cpu2: Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 1995.02 MHz
> cpu2:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,TM2,CX16,xTPR,NXE,LONG
>
> cpu2: 6MB 64b/line 16-way L2 cache
> cpu3 at mainbus0: apid 6 (application processor)
> cpu3: Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 1995.02 MHz
> cpu3:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,TM2,CX16,xTPR,NXE,LONG
>
> cpu3: 6MB 64b/line 16-way L2 cache
> cpu4 at mainbus0: apid 1 (application processor)
> cpu4: Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 1995.02 MHz
> cpu4:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,TM2,CX16,xTPR,NXE,LONG
>
> cpu4: 6MB 64b/line 16-way L2 cache
> cpu5 at mainbus0: apid 5 (application processor)
> cpu5: Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 1995.02 MHz
> cpu5:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,TM2,CX16,xTPR,NXE,LONG
>
> cpu5: 6MB 64b/line 16-way L2 cache
> cpu6 at mainbus0: apid 3 (application processor)
> cpu6: Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 1995.02 MHz
> cpu6:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,TM2,CX16,xTPR,NXE,LONG
>
> cpu6: 6MB 64b/line 16-way L2 cache
> cpu7 at mainbus0: apid 7 (application processor)
> cpu7: Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 1995.02 MHz
> cpu7:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,TM2,CX16,xTPR,NXE,LONG
>
> cpu7: 6MB 64b/line 16-way L2 cache
> ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
> ioapic0: misconfigured as apic 0, remapped to apid 8
> acpihpet0 at acpi0: 14318179 Hz
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus 4 (PEX2)
> acpiprt2 at acpi0: bus 5 (UPST)
> acpiprt3 at acpi0: bus 6 (DWN1)
> acpiprt4 at acpi0: bus 8 (DWN2)
> acpiprt5 at acpi0: bus 1 (PEX3)
> acpiprt6 at acpi0: bus 0 (PE2P)
> acpiprt6: no apic found for irq 64
> acpiprt6: no apic found for irq 65
> acpiprt6: no apic found for irq 78
> acpiprt7 at acpi0: bus 10 (PEX4)
> acpiprt8 at acpi0: bus 15 (PEX6)
> acpiprt9 at acpi0: bus 2 (SBEX)
> acpiprt10 at acpi0: bus 17 (COMP)
> acpicpu0 at acpi0: C3
> acpicpu1 at acpi0: C3
> acpicpu2 at acpi0: C3
> acpicpu3 at acpi0: C3
> acpicpu4 at acpi0: C3
> acpicpu5 at acpi0: C3
> acpicpu6 at acpi0: C3
> acpicpu7 at acpi0: C3
> ipmi at mainbus0 not configured
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel 5000X Host" rev 0x12
> ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE" rev 0x12
> pci1 at ppb0 bus 4
> ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
> pci2 at ppb1 bus 5
> ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
> pci3 at ppb2 bus 6
> ppb3 at pci3 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xc3
> pci4 at ppb3 bus 7
> bnx0 at pci4 dev 0 function 0 "Broadcom BCM5708" rev 0x12: apic 8 int 16
> (irq 6)
> ppb4 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01
> pci5 at ppb4 bus 8
> ppb5 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01
> pci6 at ppb5 bus 9
> ppb6 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0x12
> pci7 at ppb6 bus 1
> mfi0 at pci7 dev 0 function 0 "Symbios Logic SAS1078" rev 0x04: apic 8
> int 16 (irq 6), Dell PERC 6/i integrated
> mfi0: logical drives 1, version 6.0.3-0002, 256MB RAM
> scsibus0 at mfi0: 1 targets
> sd0 at scsibus0 targ 0 lun 0: <DELL, PERC 6/i, 1.11> SCSI3 0/direct fixed
> sd0: 69376MB, 512 bytes/sec, 142082048 sec total
> ppb7 at pci0 dev 4 function 0 "Intel 5000 PCIE x8" rev 0x12: apic 8 int
> 16 (irq 0)
> pci8 at ppb7 bus 10
> ppb8 at pci8 dev 0 function 0 "IDT 89HPES12N3A" rev 0x0e
> pci9 at ppb8 bus 11
> ppb9 at pci9 dev 2 function 0 "IDT 89HPES12N3A" rev 0x0e
> pci10 at ppb9 bus 12
> em0 at pci10 dev 0 function 0 "Intel PRO/1000 QP (82575GB)" rev 0x02:
> apic 8 int 18 (irq 5), address 00:1b:21:20:bc:e8
> em1 at pci10 dev 0 function 1 "Intel PRO/1000 QP (82575GB)" rev 0x02:
> apic 8 int 19 (irq 11), address 00:1b:21:20:bc:e9
> ppb10 at pci9 dev 4 function 0 "IDT 89HPES12N3A" rev 0x0e
> pci11 at ppb10 bus 13
> em2 at pci11 dev 0 function 0 "Intel PRO/1000 QP (82575GB)" rev 0x02:
> apic 8 int 16 (irq 6), address 00:1b:21:20:bc:ec
> em3 at pci11 dev 0 function 1 "Intel PRO/1000 QP (82575GB)" rev 0x02:
> apic 8 int 17 (irq 10), address 00:1b:21:20:bc:ed
> ppb11 at pci0 dev 5 function 0 "Intel 5000 PCIE" rev 0x12
> pci12 at ppb11 bus 14
> ppb12 at pci0 dev 6 function 0 "Intel 5000 PCIE x8" rev 0x12: apic 8 int
> 16 (irq 0)
> pci13 at ppb12 bus 15
> ppb13 at pci0 dev 7 function 0 "Intel 5000 PCIE" rev 0x12
> pci14 at ppb13 bus 16
> pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting" rev 0x12
> pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting" rev 0x12
> pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting" rev 0x12
> pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0x12
> pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0x12
> pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0x12
> pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0x12
> ppb14 at pci0 dev 28 function 0 "Intel 6321ESB PCIE" rev 0x09
> pci15 at ppb14 bus 2
> ppb15 at pci15 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xc3
> pci16 at ppb15 bus 3
> bnx1 at pci16 dev 0 function 0 "Broadcom BCM5708" rev 0x12: apic 8 int
> 16 (irq 6)
> uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09: apic 8 int
> 21 (irq 11)
> uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09: apic 8 int
> 20 (irq 10)
> uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09: apic 8 int
> 21 (irq 11)
> uhci3 at pci0 dev 29 function 3 "Intel 6321ESB USB" rev 0x09: apic 8 int
> 20 (irq 10)
> ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09: apic 8 int
> 21 (irq 11)
> usb0 at ehci0: USB revision 2.0
> uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
> ppb16 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xd9
> pci17 at ppb16 bus 17
> vga1 at pci17 dev 13 function 0 "ATI ES1000" rev 0x02
> wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
> wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
> radeondrm0 at vga1: apic 8 int 19 (irq 11)
> drm0 at radeondrm0
> pcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09
> pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09: DMA,
> channel 0 configured to compatibility, channel 1 configured to
> compatibility
> atapiscsi0 at pciide0 channel 0 drive 0
> scsibus1 at atapiscsi0: 2 targets
> cd0 at scsibus1 targ 0 lun 0: <HL-DT-ST, CDRW/DVD GCCT10N, A102> ATAPI
> 5/cdrom removable
> cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2
> pciide0: channel 1 ignored (disabled)
> usb1 at uhci0: USB revision 1.0
> uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
> usb2 at uhci1: USB revision 1.0
> uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
> usb3 at uhci2: USB revision 1.0
> uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
> usb4 at uhci3: USB revision 1.0
> uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> pckbc0 at isa0 port 0x60/5
> pcppi0 at isa0 port 0x61
> midi0 at pcppi0: <PC speaker>
> spkr0 at pcppi0
> mtrr: Pentium Pro MTRR support
> uhub5 at uhub0 port 5 "Cypress Semiconductor USB2 Hub" rev 2.00/0.0b addr 2
> vscsi0 at root
> scsibus2 at vscsi0: 256 targets
> softraid0 at root
> root on sd0a swap on sd0b dump on sd0b
> bnx0: address 00:1e:c9:b2:64:cf
> brgphy0 at bnx0 phy 1: BCM5708C 10/100/1000baseT PHY, rev. 6
> bnx1: address 00:1e:c9:b2:64:cd
> brgphy1 at bnx1 phy 1: BCM5708C 10/100/1000baseT PHY, rev. 6
>
> On 2010-08-06 22:28:45, Stuart Henderson wrote:
> >It's not for nothing that we ask for the dmesg.
> >http://www.openbsd.org/report.html
> >
> >Save pastebin for chat, inline is better in emails..
> >
> >
> >On 08/05/2010 02:15 PM, Steve Johnson wrote:
> >> Hi,
> >>
> >> I had written below some details on the problem that I was seeing,
> and I
> >> was doing a bit more investigating and did a port monitor on our
> >> switches on the OBSD relative interface, as well as some TCP dumps on
> >> the OBSD box.
> >>
> >> The dump on the OBSD box shows that ARP replies include 802.1Q traffic
> >> for ARP replies of both the real VLAN interface IP address, as well as
> >> the CARP interface on that VLAN interface.
> >>
> >> However, the port monitor of the switch only shows the ARP reply from
> >> the real interface as having the 802.1Q information, and is not seeing
> >> any 802.1Q information for the ARP reply of the CARP interface.
> >>
> >> I've again added the full traces in a pastebin, to not overcrowd the
> >> email, but feel free to let me know if it's not viewed as a good
> >> practice :-)
> >>
http://pastebin.com/mS8U1KXe
> >>
> >> Would anyone have a clue as to why I would see this behaviour or what I
> >> could do to correct it? I'm pretty sure that this would be the reason
> >> why ARP replies are not getting to the requesting system.
> >>
> >> Thanks again,
> >> Steve
> >>
> >>
> >> On 08/03/2010 12:57 PM, Steve Johnson wrote:
> >>> Hi,
> >>>
> >>> I have an issue with setting up CARP interfaces for VLAN system
> >>> interfaces. For some reason, the CARP interface is unreachable from
> any
> >>> host except the MASTER node, and it seems like the ARP requests are
> not
> >>> reaching the destination hosts, yet they are sent by the OBSD systems,
> >>> on both the VLAN interface, and the real interface with a vid tag
> on the
> >>> proper VLAN ID. The switches do have the the MAC address in their ARP
> >>> tables though. The weird thing is that the same setup creates no
> issues
> >>> whatsoever for all CARP interfaces bound to physical interfaces,
> and not
> >>> to VLAN interfaces. Here is a drilldown of the situation:
> >>>
> >>> - PF is disabled
> >>> - All systems (including both nodes) can reach the VLAN interface IP
> >>> addresses
> >>> - All CARP interfaces are part of a secondary group
> >>> - CARP demotes, system reboots and shutting interfaces all properly
> >>> switch the CARP master and backup for the whole group
> >>> - A CARP master/backup switch properly updates the MAC address
> table in
> >>> the switches
> >>> - All systems can reach the CARP interface IPs for CARP interfaces set
> >>> on non-VLAN interfaces
> >>> - No system (except the system that is the CARP MASTER) can reach the
> >>> CARP interface IPs that are set on VLAN interfaces
> >>>
> >>> Below are configuration details, tcpdumps and logs that detail the
> setup.
> >>>
http://pastebin.com/hbwrKmVr
> >>>
> >>> Any idea as to what could be causing this would be appreciated!
> >>>
> >>> Thanks,
> >>> Steve Johnson
