Deleting `.mypy_cache` did not work, because the directories were not
empty.  They contain JSON files instead of compiled byte-code.

This extends the cleanup by also getting rid of `.pytest_cache`
directories.