A quantum non-Markovian collision model: incoherent swap case