I do understand that. If you had begun to see the EU as a single territory to which you could resettle at any time, Brexit will have been a disappointment and Remain would have been the obvious vote.
For most British people, though, I do get the impression that it's a bit like public libraries: people like the idea of them more than they actually use them.
I think most Brits value the ability to travel to other countries more than they really intend to settle there, some retirees excepted.
If it's any consolation, I think you might be pleasantly surprised on where we end up on movement. I doubt the shutters will really come down in either direction. I'd bet it'll be the Ukippers who are more disappointed with the outcome in that area, rather than the remainers.
I've been looking for something from Brexiters to agree/empathise with, and that's probably it!
Hopefully the tourist and would be retiree (and of course those already out there) aren't inconvenienced by Brexit; let's face it, why would any country want to stop one (let along thousands) of us going there spending our cash? It doesn't make sense.
However - the big worry is that we (save for Greenland) are the first to leave, and the EU may well feel if we made a success of it, others would follow - so for that alone they, as a group, will make life very difficult, and may well cut their face to spite their nose regarding visitors.
I think, in the medium term, the "richer" countries (D, NL, B, F, LUX, DK) may well separate, and we (re)join them as a trading block with full FoM, maybe also with CH, FL and the Scandivavian countries.
I think that's how the EU should have progressed in the first place, and have a two-tier system with the south and east being the second tier.
That being said, it's a shame for someone with skills in languages that they can't automatically apply for a job in the EU now, they will be in the queue behind EU citizens.