If a tag is not linked to any asset, you can click the π icon and delete it right away.
If a tag is linked to any asset(s), you will have to remove the tag from the assets first in order to delete the tag. You can also create a playbook to remove tags from your assets at scale.