If you are fortunate enough to live in the area you are researching the best places to start are the graveyards (I have found the people in the office exceptionally helpful) and local libraries (many now have a Local History section).  

I also took a trip down to London to the Records Office but most of these can now be found on FreeBMDs excellent website.

Please feel free to add any other places you have found useful.