I have it from a reliable source within Downing Street, close to the PM, that they show up in front of No. 10 most nights between 2 and 5 AM. However, I would not recommend you show up with your rifle and try to stalk them, as the police officers on duty may not let you drive through the gate, they will insist you get out of your vehicle and walk through the pedestrian entrance.