The ballot didn't ask what your political viewpoint was, so any supposition that Labour == Remain, Tory == Leave etc is just guesswork or based on dubious opinion polls (why anyone takes much notice of them any more is a mystery)
In fact, many of the safest Labour areas in the country voted leave, for example Hull, Doncaster, the South Wales valleys, Lancashire.
Really? Lancashire County Council is under the control of the Conservatives while its' MPs include Conservatives Nigel Evans, Paul Maynard, Ben Wallace, Mark Menzies, David Morris, Andrew Stephenson, Jake Berry and Seema Kennedy. The former Lancashire cities of Liverpool and Manchester (both areas which voted remain) are some of the safest Labour areas in the country* - present day Lancashire is very mixed.
While a presumption that Labour voters voted remain and Conservative voters voted leave is wrong, there are certain groups which are more likely to have voted leave or remain. For example, the older richer Conservative voters are more likely to have voted leave and the same is true of the middle aged Labour voters from some of the less affluent parts of the UK, while younger voters are more likely to have voted remain regardless of which party they support (although Conservative support among under 35s is falling to record lows.)
* One reason why Corbynite Dan Carden ended up being given the Liverpool Walton seat to contest.