I would say it is a project by project choice. Based on the up/down sides you have listed. If you already have a background in hand-coded work I would suggest get used to a framework but use your knowledge of hand coding to try get the best of both worlds on different projects.
Adam