It isn't really gradual. Real estate has traditionally allowed for restrictions on property. You can sell your House with a condition that if the person ever builds a fence.
Hell, whole neighborhoods had restrictions on selling to black people.
If you own a condo, there are tons of restrictions on it.
I could go on a Libertarian rant, but I'm sure you've already heard about cars being raided without a reason or private data being exposed.
Sad to live in a world like this.