VMware
HomeLab MEGA Storage – Home Data Center Guide | 60 Bay
HomeLab MEGA Storage – Home Data Center Guide | 60 Bay JBOD Disk Shelf | NetApp DE6600 / MD3060e
#HomeLab #MEGA #Storage #Home #Data #Center #Guide #Bay
“Digital Spaceport”
Written article
Cheap HDDs
FEATURED GEAR
Netapp de6600
Dell MD3060e
DE6600 SAS2 Modules…
source
To see the full content, share this page by clicking one of the buttons below |
What rail mounts did you use ?
All your drives show as sold out ๐ Any idea of when they will be back?
16:50 that expander is for their san systems. Netapp DE like stands for disk expansion so that is made for their own san systems so the fiber optic connects to the san box and it controls the disk arrays (wich are raid controllers) and they connect to eac other using the qsfp connections so they require their san to work. Tho netapp made some expanders to work on normal pcs, it is not really ment to do that. The DS line stands for disk shelf and it is for connecting as das to a normal pc. That's why they can also be used as san expansion.
I would really hate to see your monthly power bill. Cool product regardless, I use NetApp hardware at my current job and did not know about this product line.
:(( Why do you have such awesome prices for electronics in the US vs Europe? The HDD listed there are around 9-10 Dollar per Terrabite
Hi Jarod, I saw that when you daisy chain (bridge between jbods) you use two controllers. I noticed that it works well for me even with just one controller per JBOD, is there an explanation why you use it with two controllers for each jbod? It's better? A thousand thanks
I would love to repurpose some of the obsolete Netapp shelfs at my work behind Linux, but there is one problem to wich I cannot find a solution: How can i physically identify a disk that needs replacing when I only have an HBA and Linux ? That is the prerequisite to any open source storage project. Anybody have an idea?
Great video and information. Thank you for sharing. I had a few questions i just got a POWERVAULT MD3460 and a few Dell 640 server as the main. Would love to see how to fully connect and configure to a server. What PDU are you are using? You also stated that theses arrays work on 220V i currently have 208 would not work correct? thank you
Hi Jeremy and congratulations for all the videos you make, we already spoke a few days ago about the DE6600 but with another account but the same logo and I decided to support your channel. I received 3 NETAPP DE6600 but with I/F-6 controller (11-03426), I have a sas3 9300 8e HBA card, it doesn't read my hard disks and I get the yellow signal in front of me. Were you able to find a solution for these controllers? A thousand thanks
4:20 THANK YOU FOR DOING dBa VOLUME MEASUREMENT! (not enough equipment demos do this)
Iโm new to this stuff can I get one of these and fit it in any server rack ? Wanting to get one of these to just fill for my plex or storage in general
Damn if I can find those sas esm modules in Australia all my 4 of my de6600 are fibre channel. ๐ข
Iโve got a DE6600 and noticed that I cannot use SATA drives. How did you get your DE6600 see SATA drives?
Worked a lot with things like dell ISCI, eg. MD3220i and you actually need 3 things to get those if-6 working, first is out of band management going (special software, somewhat easy to find), then because they're pulled from god knows where you need to telnet and do a "lemClearLockdown" on each module, finally you need to let the controllers know there are 2 of them and that's "redundancyMode=duplex". You need the so called "root" password (it's not gonna be called root just fyi), which I can not share (but you do find it on the internet with enough searching). If you're really interested, you're going to find the answers. After that, you need to actually go in the management software, define your FC or IB, make same modifications on switches and be sure you configure the FC or IB adapters accordingly in linux (multipath is a b***h on linux). Heck of a headache, but the speeds are just like running the drives locally… PS: if the controllers still have passwords on them for the out of band management you're going to need to reset them "sysWipeAllConfigData"
Did you do any more with these with FC? I have a bunch of these with the FC controllers I'm going to try to get working before I give in and source SAS controllers at huge cost.
Hello, what controller and hba card are you using? I use 9207-8e and IBM 90Y8595 ESM controller, but can not recognize sata hard disk, I see yours can use sata hard disk, may I ask how to do it?
Incredible content!!! Epic
Hi Buddy, thanks for the excellent tutorial, Please can u clarify for me if the ''Dell PowerVault MD3860f'' will work with Truenas?
Too late, I already got myself a DE6600 delivered today. It is much heavier than I anticipated! I noticed some HDD indicator lights are not working, but all drives are detected in Ubuntu. Can I ask please what is the best way to manage the drives, for example how do I find out which drive is bad should one goes faulty?
Your contents are gold, thank you so much! Can I ask your opinion, costs aside, do you think it is less headache to go for 12 x 10 bay usb enclosures, or to go for 2 x DE6600? Noise is also a concern as I'll be putting this inside my house ๐
ะ ั ะบัะตะนะทะธ!
I've never seen any hard drive in stock on your store, how often do you get stock replenishments?
Something is not clear to me, all this in your house? How much electricity do you pay?
if you dont mine me asking what is your power bill monthly
Love that old style NetApp disk shelf on the left of that DE6600 so many Datacenters still use them. Those SFF 8088 connections on the back are rock solid.
Have you tried to look under the copper heatsink in the "active" EMM/IOM ? Also have you tried to see what does comes from it's IOIO (miniUSB) connector? I guess it could be some sort of service port meaning serial console. I think, it could be x86 based (socketed Intel CPU) and you probably could install different OS on it.
Few years ago I got my HB-1235 JBOD and as I was working a bit around Dell Compellent storages at that time, I got myself Dell SCv2020 controller marked as "for parts" (it got only broken SAS connector, that was probably causing POST issues and not passed manufacturing control)… and I knew, that especially Dell Compellent line is Intel CPU based (SCv2000/SCv2020 or SC4020 are E3-1265L v2 with 8 or 16 GB DDR3L RAM respectively in 2 slots and "management" ports are actually Intel X540-T2 10GbT chipset, it also has PCIe 3.0 x8 slot for different I/O types).
I managed to thinker with it a bit, as I saw at my job, how they update SCOS in SC4020, it has IPMI built in – yaay and also adapter from 3,5mm jack to serial console was handy. I wasn't able to successfully install SCOS on it without original drives, but I managed to install TrueNAS and even VMware ESXi on it ๐ (it has 32GB SATA DOM inside), I just needed to reflash the firmware on the integrated LSI 2308 controller to non-OEM one to see the drives in the HB-1235 shelf. Now few years later, I still run it as off-site backup unit.
My observation is, that most of those Dell Compellent / MDxxxx / EqualLogic / NetApp / HPE 3Par / IBM and probably others (except EMC afaik) disk enclosures/controllers are OEM/ODM manufactured by former Xyratex (now Seagate) and use same Xyratex SBB format of controller I/O (as you mentioned one missing pin array in the controller I/O, I guess it could be for inter-controller communications e.g. cluster link).
Another interesting controller to look for is Flextronics SATIT2 (for Microsoft StorSimple arrays), I was looking for it for a while, but not needed to purchase one yet. It looks interesting as it is Intel socket 2011 based (=E5 v1 or v2 CPUs), has 4 memory slots and ConnectX-3 onboard with QSFP+ (probably 40Gb, but marked as 10GbE and not mentioned anywhere what are the real speed capabilities).
good stuff!
I bought one of those about half a year ago, and after days of searching i still absolutely need detailed documentation for the configuration interface that you access via telnet (/serial).
This applies especially to the command line options, most importantly sescntl and the hex codes for different options.
The only thing I find for this low level configuration is how to use it to make a log dump via telnet (thanks dell…).
I do currently need to configure the fan settings for testing and potential power saving purposes as it uses more power than the connected server even. That is for just 24 drives atm.
Otherwise i am getting my head ripped off brutally. With alot of blood and a high energy bill too (*cries in german energy costs*).
From what i found, this is actually a substantial part of the power draw, as the fans ramping up to full speed like on startup eats up like 200 extra watts from the "3rd highest speed", so my bet is on the fans. This is frankly not needed when in use with TrueNAS and not when used for farming i suppose.
@DigitalSpaceport did you ever find documentation for this by chance? I would be very grateful for getting my hands on this.
Great video! Especially the part about the EMMs came in quite handy as the last video about these JBODs left me wondering. The only thing that isn't quite clear to me yet is the exact power consumption. Do you have some in depth numbers like: what's the power consumption using a singe power supply and a single EMM without any drives? How much additional power consumption for adding the redundant power supply, or for the redundant EMM?
Great content! This was actually on my wish list. Thank you!
Thanks g
Thank you. Always look forward to your content.. …
I recently bought a NetApp 4246 and am using SATA drives (details below) with no interposers and hooking a QSFP+ to 8088 cable from NetApp top IOM to LSI SAS9207-8e HBA in my HP Z440 workstation running Ubuntu.
When I install the SATA drives in any port other than the upper left drive slot (what I call Slot 0) they are all recognized by the LSI 9207 and I see them in Ubuntu. If I install a drive in Slot 0, even by itself with no other drives in the NetApp, the Option ROM window for the LSI 9207 sits and spins "Initializing" forever preventing Ubuntu from even starting. When I remove the drive from Slot 0 the workstation boots fine and all drives are recognized.
1 – 500 GB SATA Drive (Tested in Slot 0 with no other drives installed)
1 – 640 GB SATA Drive
1 – 2 TB SATA Drive
9 – 18 TB SATA Drives (Tested one of these in Slot 0 with and without other drives installed)
Am I missing something here? Is there something special I have to do to get a drive to work in Slot 0?
Thanks in advance for any help that can be provided.
Wow. Super detailed video. I didn't catch if you stated what the power usage tended to be for 1 fully loaded unit. Those power connectors on the back of it are C19/C20. Those are more and more common in datacenters now, but usually are plugged into C19/C20 sockets on the PDUs to make sure it can handle the heat and current. I don't often see them cabled up to standard C13/C14 plugs. Not sure that there is any actual risk to doing it the way you did. (as long as the current doesn't exceed the cord or the plug)
Hey, that's a cool shirt, bro ๐
I have 1 PB and other than Hard drives cost I only have to spend an extra 600 for 33 drives, that's only $19 per drive and that's with good cooling and vibration-dampening, Power supply, HBA, cables, and expansion cards. I use an empty 4U JBOD with strips of foam in between drives, and I still think I'm spending too much in order to make an ok return at today's prices. I have no idea how you are going to make your money back. If you think the price is going to go up that much, then just buy XCH
Excellent video, thanks for all your hard work.
Nice. I have 8 DS4246 JBODs with caddies and I0M6s if you know anyone looking for some. In Las Vegas