Hi list, I'm trying on a spare machine dm-integrity with mdadm raid1. This is an old machine (i7-2600k). I'm using 2x500GB wd caviar black SATA3. I'm trying to run some test and see how much performance changes using dm-integrity. First I created a raid1 with mdadm and checked the performances and writing 50G I got 100 MB/s Then I destroied the md device and on every disk I run: # integritysetup format --integrity xxhash64 /dev/sdb1 # integritysetup format --integrity xxhash64 /dev/sdc1 During this process the performances was good ~95MB/s. After this I opened the devices with: # integritysetup open integrity xxhash64 /dev/sdb1 sdb1 # integritysetup open integrity xxhash64 /dev/sdc1 sdc1 and created the mdadm array with: # mdadm --create /dev/md10 --level=raid1 --raid-devices=2 /dev/mapper/sdb1 /dev/mapper/sdc1 and reading on /proc/mdstat I got this: [>....................] resync = 1.1% (4929792/443175424) finish=677.3min speed=10782K/sec Why there is so big drop on speed during the sync? I'm missing something? I'll need 11 hours to sync 2x500GB hdd? Why so slow? Before this I tried the same on a newer machine with i7 8700k and 2x2TB WD gold and I get a drop sync speed at ~35MB/s. There is something that I can do to improve this? Thank you in advance. Alessandro.
You can adjust the mdadm rebuild rate pretty easily. By default it's quite slow to avoid causing strain on system resources. See #1 at https://www.cyberciti.biz/tips/linux-raid-increase-resync-rebuild-speed.html On Wed, Apr 10, 2024 at 10:36 AM Alessandro Baggi < alessandro.baggi@gmail.com> wrote:
Hi list, I'm trying on a spare machine dm-integrity with mdadm raid1. This is an old machine (i7-2600k). I'm using 2x500GB wd caviar black SATA3.
I'm trying to run some test and see how much performance changes using dm-integrity.
First I created a raid1 with mdadm and checked the performances and writing 50G I got 100 MB/s
Then I destroied the md device and on every disk I run:
# integritysetup format --integrity xxhash64 /dev/sdb1 # integritysetup format --integrity xxhash64 /dev/sdc1
During this process the performances was good ~95MB/s. After this I opened the devices with:
# integritysetup open integrity xxhash64 /dev/sdb1 sdb1 # integritysetup open integrity xxhash64 /dev/sdc1 sdc1
and created the mdadm array with:
# mdadm --create /dev/md10 --level=raid1 --raid-devices=2 /dev/mapper/sdb1 /dev/mapper/sdc1
and reading on /proc/mdstat I got this:
[>....................] resync = 1.1% (4929792/443175424) finish=677.3min speed=10782K/sec
Why there is so big drop on speed during the sync?
I'm missing something?
I'll need 11 hours to sync 2x500GB hdd? Why so slow?
Before this I tried the same on a newer machine with i7 8700k and 2x2TB WD gold and I get a drop sync speed at ~35MB/s.
There is something that I can do to improve this?
Thank you in advance.
Alessandro. _______________________________________________ AlmaLinux Users mailing list -- users@lists.almalinux.org To unsubscribe send an email to users-leave@lists.almalinux.org
-- Jonathan Wright AlmaLinux Foundation Mattermost: chat https://chat.almalinux.org/almalinux/messages/@jonathan
Hi Jonathan, and thank you for your answer. I followed the suggestion on the link you purposed but setting speed_limit_min to 200000 does not change anything. The rsync speed is always speed=9984K/sec and # sysctl dev.raid.speed_limit_min dev.raid.speed_limit_min = 200000 The sync speed limit seems not to be the problem. (I received another email that says I'm a moderated member and my email need to approved...why this?) Thank you in advance. Alessandro. Il 10/04/24 17:44, Jonathan Wright ha scritto:
You can adjust the mdadm rebuild rate pretty easily. By default it's quite slow to avoid causing strain on system resources.
See #1 at https://www.cyberciti.biz/tips/linux-raid-increase-resync-rebuild-speed.html https://www.cyberciti.biz/tips/linux-raid-increase-resync-rebuild-speed.html
On Wed, Apr 10, 2024 at 10:36 AM Alessandro Baggi
mailto:alessandro.baggi@gmail.com> wrote: Hi list, I'm trying on a spare machine dm-integrity with mdadm raid1. This is an old machine (i7-2600k). I'm using 2x500GB wd caviar black SATA3.
I'm trying to run some test and see how much performance changes using dm-integrity.
First I created a raid1 with mdadm and checked the performances and writing 50G I got 100 MB/s
Then I destroied the md device and on every disk I run:
# integritysetup format --integrity xxhash64 /dev/sdb1 # integritysetup format --integrity xxhash64 /dev/sdc1
During this process the performances was good ~95MB/s. After this I opened the devices with:
# integritysetup open integrity xxhash64 /dev/sdb1 sdb1 # integritysetup open integrity xxhash64 /dev/sdc1 sdc1
and created the mdadm array with:
# mdadm --create /dev/md10 --level=raid1 --raid-devices=2 /dev/mapper/sdb1 /dev/mapper/sdc1
and reading on /proc/mdstat I got this:
[>....................] resync = 1.1% (4929792/443175424) finish=677.3min speed=10782K/sec
Why there is so big drop on speed during the sync?
I'm missing something?
I'll need 11 hours to sync 2x500GB hdd? Why so slow?
Before this I tried the same on a newer machine with i7 8700k and 2x2TB WD gold and I get a drop sync speed at ~35MB/s.
There is something that I can do to improve this?
Thank you in advance.
Alessandro. _______________________________________________ AlmaLinux Users mailing list -- users@lists.almalinux.org mailto:users@lists.almalinux.org To unsubscribe send an email to users-leave@lists.almalinux.org mailto:users-leave@lists.almalinux.org
-- Jonathan Wright AlmaLinux Foundation Mattermost: chat https://chat.almalinux.org/almalinux/messages/@jonathan
Try this: sysctl -w dev.raid.speed_limit_min=200000 sysctl -w dev.raid.speed_limit_max=200000 On Wed, Apr 10, 2024 at 12:01 PM Alessandro Baggi < alessandro.baggi@gmail.com> wrote:
Hi Jonathan, and thank you for your answer.
I followed the suggestion on the link you purposed but setting speed_limit_min to 200000 does not change anything. The rsync speed is always speed=9984K/sec
and # sysctl dev.raid.speed_limit_min dev.raid.speed_limit_min = 200000
The sync speed limit seems not to be the problem.
(I received another email that says I'm a moderated member and my email need to approved...why this?)
Thank you in advance.
Alessandro.
Il 10/04/24 17:44, Jonathan Wright ha scritto:
You can adjust the mdadm rebuild rate pretty easily. By default it's quite slow to avoid causing strain on system resources.
See #1 at
https://www.cyberciti.biz/tips/linux-raid-increase-resync-rebuild-speed.html < https://www.cyberciti.biz/tips/linux-raid-increase-resync-rebuild-speed.html
On Wed, Apr 10, 2024 at 10:36 AM Alessandro Baggi
mailto:alessandro.baggi@gmail.com> wrote: Hi list, I'm trying on a spare machine dm-integrity with mdadm raid1. This is an old machine (i7-2600k). I'm using 2x500GB wd caviar black SATA3.
I'm trying to run some test and see how much performance changes
using
dm-integrity.
First I created a raid1 with mdadm and checked the performances and writing 50G I got 100 MB/s
Then I destroied the md device and on every disk I run:
# integritysetup format --integrity xxhash64 /dev/sdb1 # integritysetup format --integrity xxhash64 /dev/sdc1
During this process the performances was good ~95MB/s. After this I opened the devices with:
# integritysetup open integrity xxhash64 /dev/sdb1 sdb1 # integritysetup open integrity xxhash64 /dev/sdc1 sdc1
and created the mdadm array with:
# mdadm --create /dev/md10 --level=raid1 --raid-devices=2 /dev/mapper/sdb1 /dev/mapper/sdc1
and reading on /proc/mdstat I got this:
[>....................] resync = 1.1% (4929792/443175424) finish=677.3min speed=10782K/sec
Why there is so big drop on speed during the sync?
I'm missing something?
I'll need 11 hours to sync 2x500GB hdd? Why so slow?
Before this I tried the same on a newer machine with i7 8700k and
2x2TB
WD gold and I get a drop sync speed at ~35MB/s.
There is something that I can do to improve this?
Thank you in advance.
Alessandro. _______________________________________________ AlmaLinux Users mailing list -- users@lists.almalinux.org mailto:users@lists.almalinux.org To unsubscribe send an email to users-leave@lists.almalinux.org mailto:users-leave@lists.almalinux.org
-- Jonathan Wright AlmaLinux Foundation Mattermost: chat <
https://chat.almalinux.org/almalinux/messages/@jonathan> _______________________________________________ AlmaLinux Users mailing list -- users@lists.almalinux.org To unsubscribe send an email to users-leave@lists.almalinux.org
-- Jonathan Wright AlmaLinux Foundation Mattermost: chat https://chat.almalinux.org/almalinux/messages/@jonathan
participants (2)
-
Alessandro Baggi
-
Jonathan Wright