Could a rogue SSD move things around in your filesystem? If so, couldn't it install a rootkit?

Either way, it's not just about backdoors. A blob is like a car that you cannot perform maintenance on. You want to be able to fix bugs, and also inspect it to check if there aren't any. Maybe customize it.