attribute: panic in places that should be unreachable

[pellared]

This would be a bug in the code and would encourage filling bugs in this repo.
But, I will revert it and consider creating a separate PR for it.

Originally posted by @pellared in #8038 (comment)