One thing that I just learned overnight is that you really should keep an eye on the Snapshots in ESX/vSphere. We are running the AVVI backups from Backup Exec 2010, and it uses the vSphere storage APIs to do it’s business. BE has vSphere run a snapshot by calling the API and then it grabs that snapshot and sends it to whatever your backup medium is.
In the past I have seen where a snapshot gets left behind and not deleted. Last night I started getting paged from our monitoring system that one of our AD servers was offline. After having to jump through some hoops to get in via VPN (because the AD server was the one used to authenticate and give DHCP to VPN users) I was able to get onto the ESX server. There I saw that the snapshots had hogged up all available disk space on the ESX box and my AD server was stalled as a result. It turns out that the snapshots for my Exchange server were piled up and I had to delete them. Once there was free space again my AD server was back online and everything is OK again.
Now I need to figure out a way to monitor my ESX server for datastore space so that this does not happen again.
5 thoughts on “ESX Datstore filled up by AVVI Snapshots”
Thanks for the note. I am interested in checking out the new updates, but I don’t have maintenance so I haven’t really been able to check it out properly!
Kevin, Thanks for the tips on BE. I work with the product team if you have any questions or want to check out the virtualization updates in 2012.
Im liking it so far, lots of summary information.
It is another thing to log into but to glance at storage and snapshot info its pretty handy!
I had forgotten about RVTools! I’ll have to go and get that again. Thanks for the tip.
hey mate I am experiencing the same thing with AVVI. Trying out RVTools @ http://www.robware.net/ and it gives a summarised view on the vSnapshot tab without having to drill down to each VM in the Vi Client! 🙂