Unfortunately, there is nothing that can be added to remove or tie up the potassium so it is not absorbed. Dilution with a low potassium feed (corn silage, brewers grains, beet pulp, and low potassium hay are examples) or limiting the amount to the dry cows are the only choices. Adding anionic salts to the close-up dry cow program can counterbalance the high DCAD (dietary cation-anion difference) due to the potassium. If your total dietary potassium is below 2 percent, anionic salts can work.
Mike Hutjens, Extension Dairy Specialist, University of Illinois - Illini DairyNET