Summoned to a parallel fantasy world many times

Guy’s whole class gets summoned to another word, except he’s the only who one was transferred to a different one. Just when he gets used to his new life, he gets summoned to another world again, and again.