What should I put the food/water in?
You should use food grade containers for storing anything you intend to eat. A food grade container is one that will not transfer non-food chemicals into the food and contains no chemicals which would be hazardous to human health. If you are uncertain whether a container is food-grade or not then contact the manufacturer and ask if a particular container is approved for food use. Many manufacturers are beginning to indicate on the container label if it is approved for food use.
Plastic Containers
What makes a bucket or plastic bag "food grade"?
Plastic films and containers of food grade quality are made from polycarbonate, polyester or polyethylene. Their characteristics in terms of density, permeability and strength vary. To limit permeability to moisture and oxygen, films of the above plastics are sometimes laminated together, frequently with a metallic layer. Military food packaged in just such a metallized polyester, polyethylene wrap has a long shelf life (5+ years) if kept cool. High density polyethelene buckets will have HDPE stamped on them, or a recycle symbol with a "2" in the middle.