{"id":137,"date":"2019-05-30T17:50:03","date_gmt":"2019-05-30T15:50:03","guid":{"rendered":"https:\/\/mattyb.co.za\/?p=137"},"modified":"2019-05-30T17:52:41","modified_gmt":"2019-05-30T15:52:41","slug":"fakeraid-linux-and-r1soft","status":"publish","type":"post","link":"https:\/\/mattyb.co.za\/index.php\/2019\/05\/30\/fakeraid-linux-and-r1soft\/","title":{"rendered":"FakeRAID, Linux, and R1Soft"},"content":{"rendered":"\n

FakeRAID and Linux aren’t really friends.
<\/p>\n\n\n\n

What is fakeRAID?
In the last few years, a number of hardware products have come onto the market claiming to be IDE or SATA RAID controllers. These have shown up in a number of desktop\/workstation motherboards and lower-end servers. Virtually none of these are true hardware RAID controllers. Instead, they are simply multi-channel disk controllers combined with special BIOS configuration options and software drivers to assist the OS in performing RAID operations. This gives the appearance of a hardware RAID, because the RAID configuration is done using a BIOS setup screen, and the operating system can be booted from the RAID. With the advent of Terabyte disk drives, FakeRAID is becoming a popular option for entry-level small business servers to simply mirror 2 1.5 TB drives, and dispense with an expensive hardware RAID 5 array.<\/p>

Older Windows versions required a driver loaded during the Windows install process for these cards, but that is changing. Under Linux, which has built-in softRAID functionality that pre-dates these devices, the hardware is normally seen for what it is \u2014 multiple hard drives and a multi-channel IDE\/SATA controller. Hence, fakeRAID.<\/p>Source: https:\/\/help.ubuntu.com\/community\/FakeRaidHowto<\/cite><\/blockquote>\n\n\n\n

As above, normally in Linux your BIOS RAID can’t be seen, you’ll rather have your normal \/dev\/sd[abc] disks, which proves challenging. <\/p>\n\n\n\n

Historically, there has been no need to use the BIOS RAID with Linux, MDADM has done a good enough, or even better job, that is, until a unique use-case came up.<\/p>\n\n\n\n

R1Soft by Idera provides file-level and block-level backups via their software. It works rather well, and has a bare-metal agent to boot into when you run into a rock and need your data for some reason.
We wanted to test a restore of a physical Windows server, which is normally just 2 x 1TB disks in a software RAID 1 mirror, and would be easy enough to do, boot to the rescue restore CD, point to a disk, and shoot, then just re-add your second disk to the RAID, but in this case, the client had 3 x 1TB disks in RAID 5, so a single disk restore wasn’t an option. <\/p>\n\n\n\n

We needed the FakeRAID to hand over a 1.8TB disk to the restore agent in order to send over the data, and Linux doesn’t see our FakeRAID. An easy fix would be to slot in a RAID card, or, a single 2TB disk for the sake of the restore, but, Douglas said half-jobs are bad. <\/p>\n\n\n\n

“Paul Marrapese” wrote a great article “Arch Linux and Intel RST (\u201cFake RAID\u201d)<\/a>”
In the article, he writes about creating your raid in Linux by telling MDADM to use external metadata, and that actually works perfectly, the RAID is even detected by the RST BIOS ROM, but in the Ubuntu rescue CD, it was totally unusable. The RAID remained resync pending, and read-only. Nothing I could think of could get the raid r\/w. <\/p>\n\n\n\n

I blame the Ubuntu version the CD is running, the modules compiled with it, or something. <\/p>\n\n\n\n

Moving on, booting into a CentOS 7 Live Rescue, it detects and starts the RAID volume and even starts the resync without any prompt, and read\/write. So we’re gonna need to find a way to do it from here. <\/p>\n\n\n\n

\"\"
FakeRAID seems to work out the box with CentOS 7’s rescue environment!<\/figcaption><\/figure>\n\n\n\n

YUM isn’t really usable on the live ISO, so I installing the R1 Agent here isn’t really an option.
I decided to mount my CD to the second media port via the BMC on the server, and get a CHROOT into the rescue CD. That worked, and my R1 Agent could start, but a CD is read-only, so services couldn’t start correctly, so this wasn’t gonna work.
How did they get the system rw on the bootable restore? Let’s go back and see: <\/p>\n\n\n\n

\"\"
Here we see our root volume is overlayfs, WTF is that?!<\/figcaption><\/figure>\n\n\n\n

OverlayFS provides a great way to merge directories or filesystems such that one of the filesystems (called the “lower” one) never gets written to, but all changes are made to the “upper” one. This is great for systems that rely on having read-only data, but the view needs to be editable, such as Live CD’s and Docker containers\/images (image is read only). This also allows you to quickly add some storage to an existing filesystem that is running out of space, without having to alter any structures. It could also be a useful component of a backup\/snapshot system.<\/p>https:\/\/blog.programster.org\/overlayfs<\/cite><\/blockquote>\n\n\n\n

Right, that makes perfect sense! You have a read-only volume, and a scratch area, where all the differencing is saved. Above, we see the the cd on \/dev\/loop0 is moutned to \/rofs, read only. Magic? <\/p>\n\n\n\n

Lets get back to CentOS then and see if we can make this work. An example on the link above shows how we can get it going:
<\/p>\n\n\n\n

\"\"
Mount it!<\/figcaption><\/figure>\n\n\n\n

Once our filesystem is read-write, we do the usual mounting of sys, proc and dev, then we chroot into our rw filesystem, configure our IP addresses, and start the CDP agent.<\/p>\n\n\n\n

\"\"
Yay!<\/figcaption><\/figure>\n\n\n\n

Now we get back to R1Soft’s web UI, point to our agent, restore partitions to the FakeRAID, and run the restore. <\/p>\n\n\n\n

\"\"
Job done.<\/figcaption><\/figure>\n","protected":false},"excerpt":{"rendered":"

FakeRAID and Linux aren’t really friends. What is fakeRAID? In the last few years, a number of hardware products have come onto the market claiming to be IDE or SATA RAID controllers. These have shown up in a number of desktop\/workstation motherboards and lower-end servers. Virtually none of these are true hardware RAID controllers. Instead, … Continue reading FakeRAID, Linux, and R1Soft<\/span> →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[1],"tags":[27,25,28,24,29,23,26],"class_list":["post-137","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-backups","tag-bare-metal","tag-fakeraid","tag-idera","tag-intel-raid","tag-r1soft","tag-restore"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p71fL2-2d","jetpack-related-posts":[{"id":19,"url":"https:\/\/mattyb.co.za\/index.php\/2015\/10\/05\/rage-2015-post-4\/","url_meta":{"origin":137,"position":0},"title":"rAge 2015 Post 4","author":"admin","date":"October 5, 2015","format":false,"excerpt":"So, it is in motion! The event is slowly being built up, and its quite impressive to see. From the LAN side, we have put out the 12KM odd of LAN cable, and the associated power cables. Nothing is live quite yet, and we await the networking equipment, but this\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":131,"url":"https:\/\/mattyb.co.za\/index.php\/2018\/11\/26\/linux-raid-mdadm-lockout\/","url_meta":{"origin":137,"position":1},"title":"Linux Raid Mdadm lockout.","author":"admin","date":"November 26, 2018","format":false,"excerpt":"MDADM - Meta Device Admin. Apparently. Sometimes, you wanna trash your RAID. But Linux starts it up while you're not looking, and locks your block devices. In a terminal, lets break it. sudo -i Here we become root, not user. cat \/proc\/mdstat Here, we can see our RAID devices that\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":6,"url":"https:\/\/mattyb.co.za\/index.php\/2015\/09\/26\/rage-lan-2015\/","url_meta":{"origin":137,"position":2},"title":"rAge LAN 2015 Post 1","author":"admin","date":"September 26, 2015","format":false,"excerpt":"So I am a part of building the NAG LAN at the biggest Gaming Expo in South Africa. rAge My main purpose at the event will be to set-up the the LAN cache, as done here by Multiplay. I have 2 x the below to work with: 2 x Intel\u2026","rel":"","context":"In "rAge 2015"","block_context":{"text":"rAge 2015","link":"https:\/\/mattyb.co.za\/index.php\/category\/rage-2015\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":87,"url":"https:\/\/mattyb.co.za\/index.php\/2016\/02\/15\/serial-killer\/","url_meta":{"origin":137,"position":3},"title":"SERIAL KILLER","author":"admin","date":"February 15, 2016","format":false,"excerpt":"A long while back, a friend of mine gave me a 24 Port 10\/100 3COM switch. It was quite nice of him, but I couldn't get access to this switch. It had a management port on it, so I had to go out and buy a NULL-MODEM adapter to use\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":129,"url":"https:\/\/mattyb.co.za\/index.php\/2018\/01\/20\/cpanel-nginx-hack-mirror-sometimes-breaks\/","url_meta":{"origin":137,"position":4},"title":"CPanel NGINX hack-mirror, sometimes breaks","author":"admin","date":"January 20, 2018","format":false,"excerpt":"We had a few clients complaining about corrupted downloads from our mirror when trying to run upcp CPanel update, so I checked it out. It looks like the NGINX Proxy Cache had corruption, and it had a file \"http:\/\/cpproxy.afrixx.com\/cpanelsync\/11.68.0.26\/binaries\/linux-c7-x86_64\/bin\/setsiteip.xz\" that was invalid, and corrupted based on the expected checksum. I've\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":147,"url":"https:\/\/mattyb.co.za\/index.php\/2020\/08\/12\/routers-are-secure-right-asus-lyra-hacked\/","url_meta":{"origin":137,"position":5},"title":"Routers are secure, right? Asus Lyra hacked.","author":"admin","date":"August 12, 2020","format":false,"excerpt":"We take the small things for granted in life. Like, say breathing. Or, the security on our embedded network devices... As our devices become more and more complicated and sophisticated, we use them in the hope that so are their security features become more advanced at the same time. Sure,\u2026","rel":"","context":"In \"asus\"","block_context":{"text":"asus","link":"https:\/\/mattyb.co.za\/index.php\/tag\/asus\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2020\/08\/image.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2020\/08\/image.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2020\/08\/image.png?resize=700%2C400&ssl=1 2x"},"classes":[]}],"_links":{"self":[{"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/posts\/137","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/comments?post=137"}],"version-history":[{"count":3,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/posts\/137\/revisions"}],"predecessor-version":[{"id":145,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/posts\/137\/revisions\/145"}],"wp:attachment":[{"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/media?parent=137"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/categories?post=137"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/tags?post=137"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}