The question popped up today and I’m sure I had found another way round this before but I couldn’t remember.
After googling around I finally found the answer and was shocked it was so easy
You just press
Ctrl + Alt + End
this also works even if the screen isn’t full screen