Cane toads were introduced to Australia [1] with devastating consequences to the local fauna. I suspect that's one of the species it'd be most happy to be rid of.

Then there's the feral rabbits, camels, horses (brumbies), pigs etc.

[1] http://en.wikipedia.org/wiki/Cane_toads_in_Australia