You are permitted to forbid smoking in your units and in fact HUD has forbidden smoking in public housing since February 2017, mandatory since July 2018. HUD specifically forbids marijuana, as even though some states purport to have legalized its use, it is still federally illegal.
The Public Health Law Center has a great Q&A on this that states
Q: Can tenants smoke marijuana in multi-unit apartment buildings if they live in states where the use of medical or recreational marijuana is legal?
A: There is no absolute right to smoke medical or recreational marijuana in any state, especially when smoking impacts others. Secondhand smoke, whether from combustible or aerosolized tobacco or marijuana products, spreads throughout multi-unit dwellings. A recent U.S. study reports that even in multi-unit buildings where smoke-free policies were enforced, 50 percent of residents experienced smoke entering into their units from adjacent units. Multi-unit residential property owners have the legal authority to make their properties smoke- free, which includes prohibiting the smoking or vaping of medically prescribed marijuana in individual units and common areas, even in jurisdictions in which the use of medical marijuana is permitted by state law.
https://publichealthlawcenter.org/sites/default/files/resources/Marijuana-in-Multi-Unit-Residential-Setting-2019-1.pdf
