Read more: How To Keep Your Kitchen Sponges Clean Fortunately, cleaning a water dispenser is pretty easy to do on your own. All you'll need are dish soap or white vinegar, water, a straw cleaner ...