I'm not saying it isn't physics, I'm saying it doesn't know what the physics is.
We're physics too, but we don't know how it all fits together.
If a sub-part of us that knows less than we do can make a copy of us, despite not knowing how it all works, that's an existence proof that we don't need to understand how it all works to make a copy of us.