Yeah, it's not the easiest place to get to by train. I've just looked at times and I think it'd just be possible to do in a day, getting the 0554 from Buxton to Malton, bus to Pickering, NYMR to Grosmont with 40ish minutes to look around, and then train to Whitby. Coming back would be via...