In my worldview, there is one major and significant climate change within well recorded history and that is the transition from the medieval climate optimum to the little ice age and then from that LIA to the last 150 years or so of weather. That, like the present two years without sunspots, is due to the normal behavior of stars like our sun.
If you go back just out of anything you'd call recorded history, you have what is called a late Holocene climate optimum which was much warmer than recent ages and which roughly corresponds to what ancient literature refers to as a "golden" age and, in my worldview, the reason Plato and others referred to that as a golden age instead of as the age when everybody drowned is that the age was prior to the flood and there simply was not as much water on the planet at the time. If an age like that were to recur now, the beach front could be in West Virginia or Kentucky.
Also in my worldview, the real ice ages had cosmic causes related to the nature of the solar system itself, and we are in no danger whatever of any sort of a recurrence of such an age because there is absolutely nothing on the horizon capable of causing such a thing. Same is true of the conditions which brought about that late Holocene optimum.
Thus, again in my worldview, the weather holds nothing for mankind to worry about in the foreseeable future. One thing people really could start to worry about if they want to worry about something which could wipe us out in 500 - 5000 years, would be genetic entropy.