Weather, available transportation, political unrest, difficulty with visa, passport, finances.
-
All of the above, plus fashion, the amount of other tourist going there, and which countries the tourists are coming from. (Right now, a lot of Chinese are able to afford tourism and can get visas, so countries and areas (such as Hawaii) close to China are getting more Chinese tourists, thus sometimes more total tourism.