Outside mirror replacement ? easy?

I have a 2007 Prius, the left side got hit and I'm trying to save some of the $500 deductible by doing the mirror and wheel myself since those were enough on the insurance estimate to cover the deductible. Can someone tell me what I need to do to replace the mirror assembly? It looks like I need to take off the little door speaker on the interior of the car behind the mirror. Any notes on how to do this (or whatever I need to do) would be appreciated.
thanks
Scott