The Schalke stopper misread a corner from Jeremy Menez and Kaboul was able to head home, unchallenged, at the far post.
France secured a 1-1 first leg draw with Portsmouth defender Kaboul playing solidly at the back.
The two sides meet again in Metz on Wednesday with a berth at next summer's tournament in Sweden at stake for the winners on aggregate.




