There are many issues to consider when determining the effects of mold. People respond on an individual basis to mold. It isn't possible to tell until the symptoms appear. You may not show any reaction to the presence of mold in the home, whereas your spouse may have an allergy-type reaction to the mold's presence (itchy, watery eyes, sneezing).
The solution is to avoid areas of high mold concentrations. Take steps to avoid mold growth in and around your home, and if you must be exposed to mold, use personal protection such as an N-95 rated respirator and rubber gloves.
Keep children and the elderly away from areas you know or suspect contain concentrations of mold, because they are more at risk of adverse health effects due to exposure.
North Dakota State University offers some tips (Remove Mold for a Healthy Home) on where to look for mold. http://www.ag.ndsu.edu/pubs/yf/home/ae1202w.htm