It sounds as if your Hayden mango may have the powdery mildew fungus Oidium mangiferae Berthet. This disease is common when the weather is constantly wet. Take a look at the the Univiversity of Hawaii publication on mango powdery mildew and refer to the prevention recommendations. Unfortunately, once you see the flowers turn gray and wither, the damage has already occurred.
