As someone said in a nested reply: you can. You don't need to be connected to anything via Wifi, but it needs to be on.

This isn't just theory: I use my Mac mini in exactly this configuration. Wired Gbit Ethernet, but with Wifi left on but connected to no network for airdrop/handoff/etc stuff.