Former U.S. Vice President Mike Pence met with Ukrainian President Volodymyr Zelenskyy in Kyiv, NBC News reported on Thursday.