Sticking whole fruits, vegetables, and meats is a good rule of thumb. Frozen or fresh can usually fit into any budget as long as you follow some basic rules.
Since many allergies will require that you cook more from scratch because your body can’t tolerate the ingredients in pre-packaged products, ease of preparation will become more important.