PowerCli, vmdk’s “Device or resource busy,” and host MAC – oh my…

We have been having a number of problems with our backup software and its vStorage backups locking disks and thereby creating multiple phantom snapshots.   We are having this problem so often I thought I better post our quick fix to it, which involved some PowerCli goodness.

  • Determine the locked files. Go to the directory, and touch all the files in the directory to determine which are locked

touch *

  • Discover which host locked the vmdk disk.


vmkfstools -D servername.vmdk

Indicates not locked or locked by service console process (may post later on how to solve this one)

[root@phovmwareXX vm]# vmkfstools -D vm-flat.vmdk
Lock [type 10c00001 offset 80693248 v 66, hb offset 3219456
gen 11609, mode 2, owner 00000000-00000000-0000-000000000000 mtime 1100232]
Addr <4, 135, 1>, gen 3, links 1, type reg, flags 0, uid 0, gid 0, mode 600
len 2144047674368, nb 255581 tbz 0, cow 0, zla 3, bs 8388608
Indicates host with MAC 3c:4a:92:78:0c:2a
[root@phovmwareXX vm]# vmkfstools -D vm-ctk.vmdk
Lock [type 10c00001 offset 67147776 v 35, hb offset 3219456
gen 11611, mode 1, owner 4d921417-f871d30a-27df-3c4a92780c2a mtime 743957]
Addr <4, 102, 3>, gen 4, links 1, type reg, flags 0, uid 0, gid 0, mode 600
len 8179408, nb 1 tbz 0, cow 0, zla 1, bs 8388608
  • Discover which host has the specific MAC address.  I created a simple little PowerCli script to that for me.

#Enter which cluster the locked file is within
$cluster = Read-Host "Enter Cluster"
#Enter MAC Address of host (00:00:00:00:00:00 format)
$MAC = Read-Host "Enter Desired MAC (00:00:00:00:00:00 format)"
get-cluster cluster4 | get-vmhost | Get-VMHostNetworkAdapter | where {$_.Mac -match "$MAC" } | select-object VMHost, Name, MAC, IP, BitRatePerSec | ft -autosize

This should tell you immediately which host has locked it open.  You can PuTTy to the host and attempt to kill any process with it locked (lsof or ps -auwwwx | grep filename ).  Alternatively, you can put the host into maintenance mode and reboot.



With coming home from VMworld, I got inspired to finally do what I have meant to do for awhile — separate my eclectic blog.  I have seen the problem for awhile that while my URL for this blog features network administration and virtualization the actual blog does not.  It used to until my Youtube career or habit depending on your perspective developed, and then this blog became an amalgamation of a number of different topics.  After today that is different.  I have started a new blog for my weight loss and exercise events called, Atkins Diet Geek (http://www.atkinsdietgeek.com/).

The new blog should feature the same content that the old weight loss/exercise categories.  My hope is this help the reader find the information they wanted easier, and encourage me to blog again on more topics than just what videos I have produced.


2009 State of the world address

I wanted to just post a state of the union or world message or where my life sits today type post. It is sort of New Year’s post 3 weeks late post to reflect with what 2008 meant to me, and where I plan to head this year.

My running in 2008 in many ways take a step back even though I set a marathon PR in September Quad Cities Marathon. I ran about 110 miles less this year than I did in 2007. Why were so few miles ran? Injuries and changing perspective. My knee and legs are finally getting healthy after the knee pain of the early year and the sprained ankle in November. It was somewhat frustrating as I saw my running get slower and more difficult. It definitely made me rethink what I was doing. I also started P90x a couple times, and its every day hour-long exercise also drained some of my long runs. I also did not participate in the Thursday night tempo group this year (it wasn’t offered), which I think really helped my speed last year. The only really good piece of running this year was meeting a bunch of new running friends and figuring out my electrolytes formula for long runs.

Where will 2009 lead? I am hoping to do 2 marathons. The one in the spring simply to keep my base up, and keep me running. After basketball season completes, I plan on helping the daughter train for her first half marathon or 20k (Dam to Dam maybe?). Until then, my mileage will be low in the winter. The fall race I really hope is my sub 4 hour race. It should be as QCM is now an experienced course. After that, we’ll see if I pace the full Des Moines Marathon 4:45 or the half again. I had a blast last year encouraging people to reach their goals.

I am right where I was last year at this time. 5 pounds over goal weight more likely due to the lack of exercise training time than anything else. There has also been a lot of stress lately, but all that is over. It is now time to buckle down and get to 220 for this year. I have 10 pounds to go and all the motivation to do it. My videos have taken off this year, and I produced over 40 videos in 2008. Low carbing is definitely coming back if my viewership is any clue. I also was just notified I will be featured in a weekly supermarket magazine not sure if web only or web and print feature yet.

Here’s my latest video:

Professional or Career-wise:
Same responsibilities at work – no change there in 2008. I did help Microsoft certify validate a number of their Windows 2008 exams this year. I also completed my MCITP: Server Administrator certification and started working on my VCDX certification by passing the Enterprise Exam. I really wish the VMware Design exam would be released.

One difference is I did complete my training commitments to Polk City Fire Department this year. In the first half of the year, I completed my fire fighter training program to achieve FFI certification. From there, in the second half I completed the twice week EMT program at Mercy College outreach. Shortly after the first of the year, I passed my final NREMT written exam to complete my EMT-B certification. I am glad that 2009 will feature a LOT, LOT less mandatory training to give me time to focus on other things. November and December were months I am not looking to repeat any time soon.


VMware and IBM xSeries 3850 M2 Support Tickets

I have had two recent support tickets that just exhibit the state of coding in the networking world. The first one is in the case of VMware. We were getting this error message ever since upgrading to ESX 3.5 Update 2 from 3.0.2. The error message was “Unable to apply DRS resource settings on host (Reason: . . . → Read More: VMware and IBM xSeries 3850 M2 Support Tickets


Tagged by Jeri – 5 Questions

1. Where was I 10 years ago?

10 years ago, I was just forced out of the Guard in February.  I started a new job a new job at First Dakota National Bank in Yankton, SD.  This is my first real IT job, and it forced me to wear suits every day to work — no . . . → Read More: Tagged by Jeri – 5 Questions


On the clock again – VMware Enterprise Administration Exam scheduled

In a quest to prove I am never busy enough, I am “on the clock” for taking the VMware Enterprise Administration Exam on June 9th in Chicago, IL. Ever since getting my VCP in 2.x days, that certification and technology has been probably one of my keenest areas to stay versed and up to date. To . . . → Read More: On the clock again – VMware Enterprise Administration Exam scheduled


4 years later – Results of Atkineer Blood Work

One of the comments I routinely hear regarding my Youtube videos is that fine you were successful with the diet, but you are doing this at the expense of your organs, brain, blood vessels, heart, etc. I have been accused that I am literally on a precipice of a health disaster. I keep pointing back to . . . → Read More: 4 years later – Results of Atkineer Blood Work


Busy-ness – the curse of an IT Professional,Fire-fighter, Marathoner

I have been extremely busy lately, and I am coming to realize that not all plans I have made are doable in light of it.  For example, my dreams of running a spring ultra-marathon are probably out the window.  I am missing multiple training runs with the cold weather.  This past week I even had to . . . → Read More: Busy-ness – the curse of an IT Professional,Fire-fighter, Marathoner


70-646 Beta and Other certification happenings!

As I have written in the past, I took 71-643 beta exam in December. At the time, I thought it was a beast of an exam, and after the exam during the comments section, I put down what I thought about the exam. I recorded items like that I believe virtualization products should have . . . → Read More: 70-646 Beta and Other certification happenings!


Took 71-643 – what a beast!

Just took the 71-643 beta yesterday, it is a beast of sorts. My prep was the virtual lab sessions and installing 2008 Terminal Services (playing with RemoteApps – although RC1 broke it by requiring SP1 on Vista), installing WDS, and looking at the differences in IIS7. I obviously was not as well prepared as I should . . . → Read More: Took 71-643 – what a beast!