There is nothing else open, but windows still won't let me delete the folder.

I think I've had a similair problem before! Turning off the "preview pane" might help if you have that option enabled. I've had trouble with renaming files that were also open in the preview pane in the past, but turning it off fixed the issue