No delete button for site column

Yeah, I ran into this. I found a way to let you get more details as to why.

Assuming you are on the edit column page, put this in the URL Address box

javascript:DoDelete()

You should get an alert with some details.