Israeli foreign minister said the exchange of detainees between the two sides will begin on Thursday, Sky News reported on Wednesday.