The governor of eastern Ukraine's Kharkiv said Ukrainian forces are in full control of the city, Reuters has reported.