Yes you can.
What you experienced is common. More often than not from Fleet I get told that I need a Fleet to Surbiton ticket. You can actually buy them from the TVMs (at least the ones SWT) have, but they are filed as "Boundary Zone -" (that's from memory, others will correct it if I'm...