This article provides good arguments from perspective of both sides:
[2008] Objections to Bayesian statistics (with discussion). {\em Bayesian Analysis}, to appear. (Andrew Gelman)
Rejoinder to discussion. (Andrew Gelman)
It is very nice to see a balanced view on the issue.
Bayesian vs. Frequentist
