I will have to test that. 

 

I did go to lunch and now that an hour as passed I was able to move the file.  I guess the process that had a stranglehold on the file timed out.

 

EDIT:  Yes, restarting IIS released the process that has all files recently uploaded locked down.