I think you nailed it.
I've had it happen occassionally, and I just scrape it off and go on. As long as you're keeping your brushes (or powder puffs) clean, I don't think sanitation would be a problem, meaning if it's just moisture and not oil or sweat.