VMWare storage

[TheAngryDog]

Does anyone here use VMWare on a regular basis?

I currently have a HP Microserver with VMWare ESXi 5.5 installed. It has 3 separate drives in it (2TB, 250GB and 160GB). I am planning on putting another 2-4TB drive in it.

It boots from a 16gb USB pen drive and has 8GB of RAM in it (looking to double this to 16GB, especially if the VM's I install arent capable of running properly).

My main question at the moment is centred around the storage configuration. I plan on running the following VM's;

Windows 8 Enterprise
Windows 2008 R2 x2
Windows 2012 x2

One of them is going to act as a media server, the other 4 will be part of an internal domain. My laptop isn't a Pro or Enterprise version so I will not be connecting it to the network.

How would be best to provision the storage for these VM's? While I work a little with VMWare in my job, I do not get involved in the configuring too much, more so using vSphere to access the VM's and move them onto different hosts.

In this instance I currently on have one host.

Thanks in advance!

[colin79666]

Out of interest why ESXi? With your choice of guests I'd consider using the HyperV functionality build into Server 2012. If the Standard version you can run 1 as the host and still have up to 3 2012 guests within the license.
For best performance and some redundancy you are going to want to use hardware RAID. Unless you have a separate card I'm fairly sure the Microserver is limited to RAID 0, 1 or 5 but I could be wrong.

[bitchstewie]

The "best" way would be a single RAID10 or multiple RAID1's depending on how many identical pairs of drives you have.

With 4TB drives I'd be worried about using RAID5, just make sure you have good backups

Hyper-V and Storage Spaces may be worth looking into - ESXi is geared around enterprise RAID controllers (VSAN excluded) which is your main limitation here.

[TheAngryDog]

Thanks guys

It's a home lab that I am using this for mainly.

Why ESXi? Its what the customers at my work use hence why I am using it.

I don't have a full licence for 2012, only evaluation ones which last 6 months.

I work In IT but I've never really used RAID. What benefits would I get from it? Would I lose storage space?

Thanks.

[bitchstewie]

TheAngryDog said:

Thanks guys
I work In IT but I've never really used RAID. What benefits would I get from it? Would I lose storage space?

The main benefits are performance, capacity, and resilience in varying combinations depending on the number of drives and the RAID level.

For a lab environment, with a bunch of drives of different sizes, you may be OK without any kind of RAID on the assumption that if you lose a single drive you're happy to lose whatever is on that drive.

There are a ton of tutorials out there but start here:

https://www.youtube.com/watch?v=x533qY_Fhk0
https://www.youtube.com/watch?v=y6WZr3kw3_o

Single biggest thing with any RAID level (and it's a bit of an IT mantra) is "RAID is not a substitute for backup", RAID is only meant to help protect you from drive failures.

[TonyRPH]

I don't think VMWare has support for the on board RAID in the micro server (at least it doesn't in mine...).

You'll need a separate RAID control (one that is on VMWare's HCL).

The HP P410i will work and is relatively cheap on Ebay.

You don't say which micro server you have, but IIRC most of them have the same SATA connector which will plug straight into a P410i (bit not a P400).

Then use RAID 6 / 10 / 50 whichever the card you buy will support.

[jjlynn27]

Raid 10 or 1 are the realistic options or jbod. If you plan to learn storage and esxi, create freenas/openfiler vm and 're-publish' storage as iscsi/nfs.

[TheAngryDog]

bhstewie said:

TheAngryDog said:

Thanks guys
I work In IT but I've never really used RAID. What benefits would I get from it? Would I lose storage space?

The main benefits are performance, capacity, and resilience in varying combinations depending on the number of drives and the RAID level.

For a lab environment, with a bunch of drives of different sizes, you may be OK without any kind of RAID on the assumption that if you lose a single drive you're happy to lose whatever is on that drive.

There are a ton of tutorials out there but start here:

https://www.youtube.com/watch?v=x533qY_Fhk0
https://www.youtube.com/watch?v=y6WZr3kw3_o

Single biggest thing with any RAID level (and it's a bit of an IT mantra) is "RAID is not a substitute for backup", RAID is only meant to help protect you from drive failures.

Cheers, I'll take a look at those links!

I have anything important backed up onto an external drive, and then then I have another backup of that. I don't have much important stuff mind.

Yeah I am well aware of that mantra! . I suppose I could buy a few more 2TB drives, rather than one 4TB drive, that way I could look at RAID. Then I could use the other drives in my spare desktop and maybe use that for something. Its a very old desktop that supports SATA but but virtualisation etc.

TonyRPH said:

I don't think VMWare has support for the on board RAID in the micro server (at least it doesn't in mine...).

You'll need a separate RAID control (one that is on VMWare's HCL).

The HP P410i will work and is relatively cheap on Ebay.

You don't say which micro server you have, but IIRC most of them have the same SATA connector which will plug straight into a P410i (bit not a P400).

Then use RAID 6 / 10 / 50 whichever the card you buy will support.

I have a G7 N54L. Thanks I'll take a look.

jjlynn27 said:

Raid 10 or 1 are the realistic options or jbod. If you plan to learn storage and esxi, create freenas/openfiler vm and 're-publish' storage as iscsi/nfs.

What is JBOD? My initial plan is Windows and Networking, to get my knowledge improved. I want a new job as I hate my current one, but most places down my way want you to be able to do x y and z, and given how many people apply for them, I need to have this as well, backed by my work experience and certs.

[TonyRPH]

JBOD = just a bunch of disks.

It refers to 'n' disks but not in any kind of RAID array.

• where 'n' is any number of disks.

[Vaud]

Join the VMware user group as well - there are often regional events where you might network into a new job. The community is pretty active as I understand it.

Free, if I remember correctly.

[TheAngryDog]

bhstewie said:

https://www.youtube.com/watch?v=x533qY_Fhk0
https://www.youtube.com/watch?v=y6WZr3kw3_o

I've just watched this. The first video seemed more appropriate to my current situation.

I can see the benefits of all types. 0 is ideal for VM's if you have a good backup source, which I could use my desktop pc for, to store backups giving me optimum performance. The downside is that I'd need to do a full restore of everything when a replacement drive is added.

However, Raid 5 gives me the best redundancy, if not best performance, and I'd lose one drive, but if I had 4 2TB drives, that still gives me 6TB, and all I would need to do would be to put a new drive in, let it rebuild and then I am back up and running. I'd still need to take backups mind (could always lose 2 or more drives in one go).

I think Raid 5, if supported, would be the way to go?

[TheAngryDog]

TonyRPH said:

JBOD = just a bunch of disks.

It refers to 'n' disks but not in any kind of RAID array.

• where 'n' is any number of disks.

Cheers, I'd seen that mentioned on one of the above videos .

Vaud said:

Join the VMware user group as well - there are often regional events where you might network into a new job. The community is pretty active as I understand it.

Free, if I remember correctly.

Is that on the VMWare web site?

[Vaud]

https://www.vmug.com

[TheAngryDog]

Vaud said:

https://www.vmug.com

Thank you!

[bitchstewie]

TheAngryDog said:

I think Raid 5, if supported, would be the way to go?

This is where it gets interesting.

RAID5 is parity RAID, again do a Google as there's tons of info on it, but with drives that large, and a pretty weak "software" RAID controller behind the scenes, a rebuild could take a couple of days and if you have a read error on any of the other drives you *could* lose the lot.

If you buy a proper storage array RAID5 is all but dead these days, most vendors don't recommend it, and some pretty much call it malpractice to use it - it's generally RAID10 or RAID6 if you're happy to compromise performance for capacity.

Again there's a bit of context here in that it's a lab environment vs. a production system but it's worth doing some homework on it to understand the pros and cons.

[TheAngryDog]

bhstewie said:

TheAngryDog said:

I think Raid 5, if supported, would be the way to go?

This is where it gets interesting.

RAID5 is parity RAID, again do a Google as there's tons of info on it, but with drives that large, and a pretty weak "software" RAID controller behind the scenes, a rebuild could take a couple of days and if you have a read error on any of the other drives you *could* lose the lot.

If you buy a proper storage array RAID5 is all but dead these days, most vendors don't recommend it, and some pretty much call it malpractice to use it - it's generally RAID10 or RAID6 if you're happy to compromise performance for capacity.

Again there's a bit of context here in that it's a lab environment vs. a production system but it's worth doing some homework on it to understand the pros and cons.

Ah I see, thank you. Raid 10 sounds good, though I would lose half of my storage? If I had 4 4TB drives, only 8TB would be usable, and until I replaced the failed drive, I'd have no server?

Would Raid array rebuild the replacement drive from the mirror?

[bitchstewie]

TheAngryDog said:

Ah I see, thank you. Raid 10 sounds good, though I would lose half of my storage? If I had 4 4TB drives, only 8TB would be usable, and until I replaced the failed drive, I'd have no server?

Would Raid array rebuild the replacement drive from the mirror?

It's a question you see often "But that means I lose half my storage?" and the short answer is yes, but RAID10 offers the best reliability with the lowest speed penalty of any RAID type (except RAID0) and with just 4 drives there really isn't another sensible choice if you want to have any redundancy.

Now regards rebuilds, I'm not familiar with how the Microserver onboard RAID handles it, but let's say you have a server like a HP DL380 or a Dell T/R series, and you have hot swap bays and a hardware RAID controller, if a drive fails you literally just pull it out and drop in the new drive and the RAID controller handles the rest.

With the Microserver it might need some manual intervention to kick a rebuild off, I'm not sure I'm just guessing because it's a basic controller, but I would hope the server would be useable (albeit slow) during the rebuild - you have to remember it's reading and writing 2TB of data during the rebuild so performance will be down.

[TheAngryDog]

bhstewie said:

TheAngryDog said:

Ah I see, thank you. Raid 10 sounds good, though I would lose half of my storage? If I had 4 4TB drives, only 8TB would be usable, and until I replaced the failed drive, I'd have no server?

Would Raid array rebuild the replacement drive from the mirror?

It's a question you see often "But that means I lose half my storage?" and the short answer is yes, but RAID10 offers the best reliability with the lowest speed penalty of any RAID type (except RAID0) and with just 4 drives there really isn't another sensible choice if you want to have any redundancy.

Now regards rebuilds, I'm not familiar with how the Microserver onboard RAID handles it, but let's say you have a server like a HP DL380 or a Dell T/R series, and you have hot swap bays and a hardware RAID controller, if a drive fails you literally just pull it out and drop in the new drive and the RAID controller handles the rest.

With the Microserver it might need some manual intervention to kick a rebuild off, I'm not sure I'm just guessing because it's a basic controller, but I would hope the server would be useable (albeit slow) during the rebuild - you have to remember it's reading and writing 2TB of data during the rebuild so performance will be down.

Thanks again, I appreciate your input here.

I suppose that it still be quicker than having to restore everything from a backup, and as long as 2 drives dont go down (of the same mirror) then it would work well.

Otherwise the backup would be needed!

Hmmmm, might be a while before I can implement it though, I dont have the cash for 4 new 4TB drives / 3 new 2TB drives, depending on whether I think 4TB of storage is enough, or if I need 8TB..

[TheAngryDog]

I suppose there is nothing stopping me continuing to build some VM's and adding storage when I can afford it, and then backing up everything, configuring raid and then restoring my VM's?

[bitchstewie]

Keep in mind you don't *need* RAID if it's just for messing around.

We have one of the original Microservers which we used to use for a very specific lightweight job, and we ran VMware on it on a single HDD with no problem.

Main thing is you have remember it's not a powerhouse, even if you stuff it full of memory the CPU is quite weak so just be realistic if you're expecting to run several instances of Windows on it.

That isn't me trying to scaremonger, but you sometimes see posts where people think virtualizing is some kind of magic bullet and they wonder why they can't run a dozen Windows VM's on a server with 2 cores and 4GB of RAM - not suggesting that's the case but all I'm saying is don't blame ESXi if things are a little slow