The interim boss takes charge of his final game on Sunday