You can get aqueous cortisone sprays for your nose when it gets REALLY bad. I use 'Beconase'.
The privet around my house is going feral right now, you can smell the heavy, doughy perfume - I hate that smell. Of course there are the grass pollens which are light enough to be wafted around and get everywhere.
If you can, it's a good idea to get rid of anything that traps and holds the dust/mold. Get rid of carpets and drapes, replace them with wood/veneer fixtures.