I am so sorry to hear of your loss. It must be devastating to have three little guys die and another nearly succumb at about the same time and not know why.
Just my opinion:
It's been my experience that most pet store employees are far from "experts" on the subject of bird ailments. They can't be experts because they haven't had the training to be able to diagnose. Consequently, I hope that you had a necropsy done on one or all of them so that the survivor can be treated, in the event that the deaths were caused by a disease or other ailment instead of "stress", and so the newest additions to your flock can be protected. I assume that you're keeping them in quarantine but perhaps the aviary will need to be disinfected and/or remodeled while you're waiting for the quarantine period to pass.
Perhaps there is some online site that can give you good ideas on how to remodel your aviary so that there is a wonderful, protected area where the birds can escape the trauma of bad weather. Or perhaps you could move the flock indoors so this sad situation won't arise again. Do let us know how this all works out, please. We do care.