After all user created data sources have been removed, there is a System data source that appears and can't be deleted.
For more information, please refer to the tech doc Deleting a data source.