Re: RAID scrubbing

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

From: Justin Maggard

Date: Wednesday, April 14, 2010 - 5:51 pm

On Fri, Apr 9, 2010 at 7:01 PM, Michael Evans <mjevans1983@gmail.com> wrote:
quoted text> On Fri, Apr 9, 2010 at 6:46 PM, Justin Maggard <jmaggard10@gmail.com> wrote:
>> On Fri, Apr 9, 2010 at 6:41 PM, Michael Evans <mjevans1983@gmail.com> wrote:
>>> On Fri, Apr 9, 2010 at 6:28 PM, Justin Maggard <jmaggard10@gmail.com> wrote:
>>>> Hi all,
>>>>
>>>> I've got a system using two RAID5 arrays that share some physical
>>>> devices, combined using LVM.  Oddly, when I "echo repair >
>>>> /sys/block/md0/md/sync_action", once it finishes, it automatically
>>>> starts a repair on md1 also, even though I haven't requested it.
>>>> Also, if I try to stop it using "echo idle >
>>>> /sys/block/md0/md/sync_action", a repair starts on md1 within a few
>>>> seconds.  If I stop that md1 repair immediately, sometimes it will
>>>> respawn and start doing the repair again on md1.  What should I be
>>>> expecting here?  If I start a repair on one array, is it supposed to
>>>> automatically go through and do it on all arrays sharing that
>>>> personality?
>>>>
>>>> Thanks!
>>>> -Justin
>>>>
>>>
>>> Is md1 degraded with an active spare?  It might be delaying resync on
>>> it until the other devices are idle.
>>
>> No, both arrays are redundant.  I'm just trying to do scrubbing
>> (repair) on md0; no resync is going on anywhere.
>>
>> -Justin
>>
>
> First: Reply to all.
>
> Second, if you insist that things are not as I suspect:
>
> cat /proc/mdstat
>
> mdadm -Dvvs
>
> mdadm -Evvs
>

I insist it's something different. :)  Just ran into it again on
another system.  Here's the requested output:

JMAGGARD:~# cat /proc/mdstat
Personalities : [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
md3 : active raid5 sde6[0] sdc6[1]
      976750832 blocks super 1.2 level 5, 16k chunk, algorithm 2 [2/2] [UU]

md2 : active raid5 sda5[0] sdf5[5] sde5[4] sdd5[3] sdc5[2] sdb5[1]
      4860206480 blocks super 1.2 level 5, 16k chunk, algorithm 2 [6/6] [UUUUUU]

unused devices: <none>
JMAGGARD:~# ls /sys/block/dm-0/slaves/
md2  md3
JMAGGARD:~# cat /sys/block/dm-0/slaves/md?/md/sync_action
idle
idle
JMAGGARD:~# echo repair > /sys/block/md2/md/sync_action
JMAGGARD:~# dmesg -c
md: requested-resync of RAID array md2
md: minimum _guaranteed_  speed: 1000 KB/sec/disk.
md: using maximum available idle IO bandwidth (but not more than
200000 KB/sec) for requested-resync.
md: using 128k window, over a total of 972041296 blocks.
JMAGGARD:~#
JMAGGARD:~# cat /proc/mdstat
Personalities : [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
md3 : active raid5 sde6[0] sdc6[1]
      976750832 blocks super 1.2 level 5, 16k chunk, algorithm 2 [2/2] [UU]

md2 : active raid5 sda5[0] sdf5[5] sde5[4] sdd5[3] sdc5[2] sdb5[1]
      4860206480 blocks super 1.2 level 5, 16k chunk, algorithm 2 [6/6] [UUUUUU]
      [>....................]  resync =  0.1% (1409104/972041296)
finish=195.1min speed=82888K/sec

unused devices: <none>
JMAGGARD:~# echo idle > /sys/block/md2/md/sync_action
JMAGGARD:~# dmesg -c
md: md_do_sync() got signal ... exiting
JMAGGARD:~# dmesg -c
JMAGGARD:~# cat /proc/mdstat
Personalities : [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
md3 : active raid5 sde6[0] sdc6[1]
      976750832 blocks super 1.2 level 5, 16k chunk, algorithm 2 [2/2] [UU]

md2 : active raid5 sda5[0] sdf5[5] sde5[4] sdd5[3] sdc5[2] sdb5[1]
      4860206480 blocks super 1.2 level 5, 16k chunk, algorithm 2 [6/6] [UUUUUU]

unused devices: <none>
JMAGGARD:~# cat /proc/mdstat
Personalities : [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
md3 : active raid5 sde6[0] sdc6[1]
      976750832 blocks super 1.2 level 5, 16k chunk, algorithm 2 [2/2] [UU]
      [>....................]  resync =  0.1% (1213304/976750832)
finish=227.8min speed=71370K/sec

md2 : active raid5 sda5[0] sdf5[5] sde5[4] sdd5[3] sdc5[2] sdb5[1]
      4860206480 blocks super 1.2 level 5, 16k chunk, algorithm 2 [6/6] [UUUUUU]

unused devices: <none>
JMAGGARD:~# dmesg -c
md: requested-resync of RAID array md3
md: minimum _guaranteed_  speed: 1000 KB/sec/disk.
md: using maximum available idle IO bandwidth (but not more than
200000 KB/sec) for requested-resync.
md: using 128k window, over a total of 976750832 blocks.
JMAGGARD:~# tail -10 /var/log/kern.log
Apr 14 16:36:31 JMAGGARD kernel: usb 1-2: new high speed USB device
using ehci_hcd and address 2
Apr 14 17:32:23 JMAGGARD kernel: md: requested-resync of RAID array md2
Apr 14 17:32:23 JMAGGARD kernel: md: minimum _guaranteed_  speed: 1000
KB/sec/disk.
Apr 14 17:32:23 JMAGGARD kernel: md: using maximum available idle IO
bandwidth (but not more than 200000 KB/sec) for requested-resync.
Apr 14 17:32:23 JMAGGARD kernel: md: using 128k window, over a total
of 972041296 blocks.
Apr 14 17:32:51 JMAGGARD kernel: md: md_do_sync() got signal ... exiting
Apr 14 17:33:35 JMAGGARD kernel: md: requested-resync of RAID array md3
Apr 14 17:33:35 JMAGGARD kernel: md: minimum _guaranteed_  speed: 1000
KB/sec/disk.
Apr 14 17:33:35 JMAGGARD kernel: md: using maximum available idle IO
bandwidth (but not more than 200000 KB/sec) for requested-resync.
Apr 14 17:33:35 JMAGGARD kernel: md: using 128k window, over a total
of 976750832 blocks.
JMAGGARD:~#
JMAGGARD:~# mdadm -Dvvs
/dev/md3:
        Version : 1.2
  Creation Time : Wed Apr 14 10:30:07 2010
     Raid Level : raid5
     Array Size : 976750832 (931.50 GiB 1000.19 GB)
  Used Dev Size : 976750832 (931.50 GiB 1000.19 GB)
   Raid Devices : 2
  Total Devices : 2
    Persistence : Superblock is persistent

    Update Time : Wed Apr 14 16:11:08 2010
          State : active, resyncing
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0

         Layout : left-symmetric
     Chunk Size : 16K

 Rebuild Status : 0% complete

           Name : 001AD408C964:3
           UUID : 34522369:e16f6b97:c9ba035d:392c01ea
         Events : 27

    Number   Major   Minor   RaidDevice State
       0       8       70        0      active sync   /dev/sde6
       1       8       38        1      active sync   /dev/sdc6
JMAGGARD:~# mdadm -Evvs
mdadm: No md superblock detected on /dev/md3.
mdadm: No md superblock detected on /dev/c/c.
mdadm: No md superblock detected on /dev/md2.
/dev/sdf5:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x0
     Array UUID : 002a8919:5d4f3b2d:99a502c5:6ad57a52
           Name : 001AD408C964:2
  Creation Time : Tue Apr 13 19:31:40 2010
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 1944082604 (927.01 GiB 995.37 GB)
     Array Size : 9720412960 (4635.05 GiB 4976.85 GB)
  Used Dev Size : 1944082592 (927.01 GiB 995.37 GB)
    Data Offset : 272 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : c190fc75:fbf482b0:6e7ec0f1:bbc3f1f4

    Update Time : Wed Apr 14 17:32:51 2010
       Checksum : 418c175c - correct
         Events : 71

         Layout : left-symmetric
     Chunk Size : 16K

   Device Role : Active device 5
   Array State : AAAAAA ('A' == active, '.' == missing)
/dev/sde6:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x0
     Array UUID : 34522369:e16f6b97:c9ba035d:392c01ea
           Name : 001AD408C964:3
  Creation Time : Wed Apr 14 10:30:07 2010
     Raid Level : raid5
   Raid Devices : 2

 Avail Dev Size : 1953501952 (931.50 GiB 1000.19 GB)
     Array Size : 1953501664 (931.50 GiB 1000.19 GB)
  Used Dev Size : 1953501664 (931.50 GiB 1000.19 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
          State : active
    Device UUID : 56016c35:ebb5b3b1:732a20a9:2e03e8e0

    Update Time : Wed Apr 14 16:11:08 2010
       Checksum : 8fec23c5 - correct
         Events : 27

         Layout : left-symmetric
     Chunk Size : 16K

   Device Role : Active device 0
   Array State : AA ('A' == active, '.' == missing)
/dev/sde5:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x0
     Array UUID : 002a8919:5d4f3b2d:99a502c5:6ad57a52
           Name : 001AD408C964:2
  Creation Time : Tue Apr 13 19:31:40 2010
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 1944082604 (927.01 GiB 995.37 GB)
     Array Size : 9720412960 (4635.05 GiB 4976.85 GB)
  Used Dev Size : 1944082592 (927.01 GiB 995.37 GB)
    Data Offset : 272 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 4604bf53:fa8b8f98:29ac1273:ddd7d318

    Update Time : Wed Apr 14 17:32:51 2010
       Checksum : ac8f63ba - correct
         Events : 71

         Layout : left-symmetric
     Chunk Size : 16K

   Device Role : Active device 4
   Array State : AAAAAA ('A' == active, '.' == missing)
/dev/sdd5:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x0
     Array UUID : 002a8919:5d4f3b2d:99a502c5:6ad57a52
           Name : 001AD408C964:2
  Creation Time : Tue Apr 13 19:31:40 2010
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 1944082604 (927.01 GiB 995.37 GB)
     Array Size : 9720412960 (4635.05 GiB 4976.85 GB)
  Used Dev Size : 1944082592 (927.01 GiB 995.37 GB)
    Data Offset : 272 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 162d3da0:9e796a82:e9811a93:5e21fc47

    Update Time : Wed Apr 14 17:32:51 2010
       Checksum : 3218996f - correct
         Events : 71

         Layout : left-symmetric
     Chunk Size : 16K

   Device Role : Active device 3
   Array State : AAAAAA ('A' == active, '.' == missing)
/dev/sdc6:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x0
     Array UUID : 34522369:e16f6b97:c9ba035d:392c01ea
           Name : 001AD408C964:3
  Creation Time : Wed Apr 14 10:30:07 2010
     Raid Level : raid5
   Raid Devices : 2

 Avail Dev Size : 1953501952 (931.50 GiB 1000.19 GB)
     Array Size : 1953501664 (931.50 GiB 1000.19 GB)
  Used Dev Size : 1953501664 (931.50 GiB 1000.19 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
          State : active
    Device UUID : fc30ef80:1341367e:e611bc15:ae905745

    Update Time : Wed Apr 14 16:11:08 2010
       Checksum : 78fd5386 - correct
         Events : 27

         Layout : left-symmetric
     Chunk Size : 16K

   Device Role : Active device 1
   Array State : AA ('A' == active, '.' == missing)
/dev/sdc5:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x0
     Array UUID : 002a8919:5d4f3b2d:99a502c5:6ad57a52
           Name : 001AD408C964:2
  Creation Time : Tue Apr 13 19:31:40 2010
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 1944082604 (927.01 GiB 995.37 GB)
     Array Size : 9720412960 (4635.05 GiB 4976.85 GB)
  Used Dev Size : 1944082592 (927.01 GiB 995.37 GB)
    Data Offset : 272 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 45e19226:873f8207:49543089:a8d14f46

    Update Time : Wed Apr 14 17:32:51 2010
       Checksum : 31ef962f - correct
         Events : 71

         Layout : left-symmetric
     Chunk Size : 16K

   Device Role : Active device 2
   Array State : AAAAAA ('A' == active, '.' == missing)
/dev/sdb5:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x0
     Array UUID : 002a8919:5d4f3b2d:99a502c5:6ad57a52
           Name : 001AD408C964:2
  Creation Time : Tue Apr 13 19:31:40 2010
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 1944082604 (927.01 GiB 995.37 GB)
     Array Size : 9720412960 (4635.05 GiB 4976.85 GB)
  Used Dev Size : 1944082592 (927.01 GiB 995.37 GB)
    Data Offset : 272 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 5d9c342e:569c096d:63efac3b:28912736

    Update Time : Wed Apr 14 17:32:51 2010
       Checksum : 416d08af - correct
         Events : 71

         Layout : left-symmetric
     Chunk Size : 16K

   Device Role : Active device 1
   Array State : AAAAAA ('A' == active, '.' == missing)
/dev/sda5:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x0
     Array UUID : 002a8919:5d4f3b2d:99a502c5:6ad57a52
           Name : 001AD408C964:2
  Creation Time : Tue Apr 13 19:31:40 2010
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 1944082604 (927.01 GiB 995.37 GB)
     Array Size : 9720412960 (4635.05 GiB 4976.85 GB)
  Used Dev Size : 1944082592 (927.01 GiB 995.37 GB)
    Data Offset : 272 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 50327e35:a1b602d2:da883a40:e0314bed

    Update Time : Wed Apr 14 17:32:51 2010
       Checksum : 6960f31c - correct
         Events : 71

         Layout : left-symmetric
     Chunk Size : 16K

   Device Role : Active device 0
   Array State : AAAAAA ('A' == active, '.' == missing)
JMAGGARD:~#
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:

RAID scrubbing, Justin Maggard, (Fri Apr 9, 6:28 pm)

Re: RAID scrubbing, Michael Evans, (Fri Apr 9, 6:41 pm)

Re: RAID scrubbing, Michael Evans, (Fri Apr 9, 7:01 pm)

Re: RAID scrubbing, Justin Maggard, (Wed Apr 14, 5:51 pm)

Re: RAID scrubbing, Neil Brown, (Wed Apr 14, 6:22 pm)

Re: RAID scrubbing, Justin Maggard, (Fri Apr 16, 5:03 pm)

Re: RAID scrubbing, Berkey B Walker, (Fri Apr 16, 5:19 pm)


linux-kernel:
Greg KH	Og dreams of kernels
Jens Axboe	[PATCH 31/33] Fusion: sg chaining support
Arnd Bergmann	Re: finding your own dead "CONFIG_" variables
Mark Brown	[PATCH 2/2] Subject: natsemi: Allow users to disable workaround for DspCfg reset
Tony Breeds	[LGUEST] Look in object dir for .config
git:
Brian Downing	Re: Git in a Nutshell guide
John Benes	Re: master has some toys
Matthias Lederhofer	[PATCH 4/7] introduce GIT_WORK_TREE to specify the work tree
Alexander Sulfrian	[RFC/PATCH] RE: git calls SSH_ASKPASS even if DISPLAY is not set
Junio C Hamano	Re: Rss produced by git is not valid xml?
git-commits-head:
Linux Kernel Mailing List	iSeries: fix section mismatch in iseries_veth
Linux Kernel Mailing List	ixbge: remove TX lock and redo TX accounting.
Linux Kernel Mailing List	ixgbe: fix several counter register errata
Linux Kernel Mailing List	b43: fix build with CONFIG_SSB_PCIHOST=n
Linux Kernel Mailing List	9p: block-based virtio client
linux-netdev:
Michael Breuer	Re: [PATCH] af_packet: Don't use skb after dev_queue_xmit()
Michael Breuer	Re: [PATCH] af_packet: Don't use skb after dev_queue_xmit()
David Daney	[PATCH 5/7] Staging: Octeon Ethernet: Convert to NAPI.
Wolfgang Grandegger	[PATCH net-next v4 1/3] can: mscan: fix improper return if dlc < 8 in start_xmi...
Amit Kumar Salecha	[PATCHv3 NEXT 2/2] NET: Add Qlogic ethernet driver for CNA devices
openbsd-misc:
Theo de Raadt	Re: Old IPSEC bug
Tomáš Bodžár	Problem with vpnc connection - check group password !
Insan Praja SW	Mandoc Compiling Error
Carl Roberso	Re: Cannot change MTU of carp interface?
Richard Daemon	Re: booting openbsd on eee without cd-rom