Depends. Do you burn tons of wood every day as my neighbor for a daily barbeque or 10 hours in a row in your smoker? Does the smoke go into my sleeping room in the summer? I'd rather prefer if you didn't. Once in a while? I have to accept it (and might to a barbeque once in a while, too).
this is the reality here - dozens of wood fires for small groups of people with zero filtering; so easy and common, difficult to see the cumulative effects. I believe open fires have been completely banned in my area due to simple excess by a small number of careless actors.
What about for cooking? Smoking meat requires the use of wood splits being used to build a wood fire in a smoker.