Hello sticky!
Yes it would generally be considered safe if it’s “just a cold” and/or you are over the hump – in fact the humidity alone is usually considered beneficial in moving it along and facilitating better breathing (asthmatics are recommended to have humid environment for example).
From a yoga studio point of view, it’s probably considered good “yoga etiquette” to stay away in the initial stages of anything viral, since we are all huffing and puffing each other’s air in a closed environment.
Some people also find it dodgy if you come in with tissues and sneeze all over the place, though I’m personally not so bothered by that … unless they are next to me haha!
But in terms of congestion – it’s the bets thing for you IMO (and I went back to yoga as soon as I possibly could after contracting pneumonia in 2008 – very helpful indeed).
Hope that helps!
Robert