A Ghanaian man who led a self-styled African tribe in the Scottish Borders has been deported, the Home Office has confirmed.