Updated with Python3's version :)
If you have trouble installing matplotlib for Python3, here's a good place to start. What I did was, install distribute first, then pip for Py3K, then numpy, and then other matplotlib's dependencies (as seen in the link above). Finally, clone matplotlib to your local directory, and compile from sources.
If there are multiple versions of pip, don't forget to specify pip-3.2 (or 3.3).