Go to the contacts list page, follow the delete icon () in the line of the corresponding user and acknowledge the removal.