The Risk & Safety behavioural questionnaire that I have just completed for a Grade 2 crossing keeper, was utterly bizarre. I was expecting situational judgement, but they were anything but. Some questions were blindingly obvious in terms of my response, such as being a reliable individual, but when it resorted to something such as
'I buy lots of expensive items because I like to show people how successful I am'
OR
'I don't care about those who are less fortunate than me'
And it's not even a question when the only responses available to you for each case are 'Slightly Agree', 'Agree', 'Definitely Agree'. There's no option for 'I don't agree with either'. It also depends on how you perceive the question. In my view agreeing with the former makes you appear bombastic, a chancer/risk taker to show off, and the latter, uncaring. So for someone who doesn't take unnecessary risks but does cares about others, there's no suitable response.
A friend of mine who worked in aviation said he saw a lot of unsuitable individuals get accepted for pilot jobs based upon psychometric test results. Personally I don't think the prove anything, as the questions themselves are ambiguous and assume everyone will interpret them in exactly the same way as the person who wrote them. People can also slip under the suitability radar by simply 'learning' which boxes need ticking in order to pass.
The concentration and reactions tests were easy (I thought), but that's because I have hobbies and a previous job role where those two factors are crucial. However, having seen some NR responses to questions on their facebook page about lower grade roles within signalling, people are recruited mainly upon personality than any previous background/transferrable safety critical skills. In that case, what was the point of the concentration and reaction tests? No point in having a really nice kind cuddly person sat at the desk if they possess the decision making/concentration/reaction skills of a stunned slug. Some things can be taught, but the ability to remain focussed and react fast and in the right way, has to be an inherent skill.