So today, I jumped onto Home Assistant to check the weather stats, and, nope broken for the first time in 2 years. This post is a deep dive into why it became broken.
So checking out the github repo I noticed that there had been an upgrade to the setup.
Also checked on the Weather Underground side to see if the Weather Station had dropped off the radar, but nope its still there. But interestingly you can see when the last attempt to use the API key had worked and then failed.
Next thing to do is to try generating a new key and see if that helps. Still nothing.
Turns out deleteing and readding the files worked.