Yes, this may in fact be a problem. When surveyed, 89% of families state that they would not hire the nanny who smokes. Many non-smoking households will consider a nanny who smokes but agrees never to smoke while on duty or in the presence of the children. Be honest about this...non-smokers can usually detect when someone smokes. Second-hand smoke is unhealthy for children, and families are within their rights to insist that their home be smoke-free.
Creative Commons Source: http://www.4nannies.com/info/NANNYFAQ.cfm