A clash on Thursday broke out on the border of Tajikistan and Kyrgyzstan between both nation's militaries, according to media reports.