The Delete Data Source button is greyed out and not selectable when trying to delete a data source.
All supported releases
The role right "Delete Data Sources" is disabled by default for Administrator.
Now you can delete the data source.
It is advisable once the data source is deleted, then go back and remove the role right Delete Data Sources.