http://flux88.com/blog/load-testing-our-heroku-app/

I think I would do mine in app engine