This 100%! Also, if you shoot down something in airspace, you'll likely be in a lot more trouble than anyone flying the drone.That’s what a lot of people think, but the airspace in the US is free to all, barring restrictions like around airports and military installations, and the FAA controls that airspace. There also are restrictions such as not flying over crowds of people or moving vehicles without proper training and licensing and propeller guards, etc. Otherwise, you can fly a drone up to 400 feet AGL in Class G airspace over just about any piece of land (or water.)
What a landowner can restrict is operating a drone while on his or her property. In other words, they can trespass a drone pilot from their land. But if that pilot goes to the public road and stands on the public easement and flies the drone back over the landowner’s property, not much they can do. Legally.