Blower/AC has a mind of its own in a 2008

I have a 2008 with roughly 35k miles, and yesterday I pulled out of the garage and the blower wasn't working.
I changed the temperature and still no heat or cold air.
I changed the blowing speeds and still nothing. I am not mechanically inclined and so my first attempt to fix it yesterday was to run over a few bumps in the road and still nothing. I even tried parking it and turning it on and off again and still nothing.
This has happened once before, but after a few minutes it kicked on, and switched to bringing in outside air.
Today, my roommate went out to check the fuses and he turned it on and the blower and everything worked.
Any ideas on what it might be?
Thank you.

 

Thanks Bob,
I am not sure if that is causing the problem. We do have cold nights, however, when this happened yesterday it was in the early afternoon and it was roughly 64 outside. Then last night it got quite cold, but when my roommate went out to check the fuse, it kicked on.
I did forget to mention that yesterday I could hear the sound of it clicking but that is all.
I spoke to my dad and while he isn't up on the hybrid technology he seems to think that it is in the electrical system and that I should take it to the dealer on Monday. While I don't mind taking it to the dealer, I was just there last week to get the 30k maintenance done and I was there for 4 hours and of course the blower was working fine.