Possibly caused by updates this week.

You need to delete the Recycle bin that is within the user profile section.

You can either shadow the user and browse to C:\users\%username% and delete the $recycle.bin folder or get the user to log off, then mount the VHDK file and delete it that way.

Users are able to then delete form the desktop.