Do I need to show proof of living expenses for the entire duration of my course?

You do not need to show living costs for the entire duration of your course. You only need to demonstrate funds for up to 9 months of living expenses.

As per UKVI, living cost for London is £1483 per month and outside london £1136 per month.