Actually: slight amendment to the above.
One of the folders which contained music files did allow me to delete the files individually but then would not allow me to delete the folder, even though it was empty at that point.