I just voted in this poll ( "no, never") and was surprised to discover what an overwhelming majority that response has gotten.
I don't smoke in my house for these reasons:
1) It would really bother my wife and daughter.
2) It would really bother ME! As much as I enjoy smoking a cigar, I hate that stale tobacco smell that infuses fabric and is so hard to get rid of.
3) I can't stand cigarette smoke, and it would be awkward to ask guests not to smoke cigarettes when they can tell I have been smoking in the house.
So, my wife and I have a strict nonsmoking policy for inside the house. We are on the same page with this.