`--remove-build-files` don't remove empty folders

[un-pogaz]

The --remove-build-files action is very usefull, however it performed only against files, thus leaving a tree of empty folders. It would therefore be greatly appreciated if yaycache also clean the empty folders after deleted the files.