When in recursive mode, following/testing directory listings would retrieve even more files than just scanning .html and .css files.