Could a KPI be deleted?

Yes. A KPI can be deleted by the admin user. Please see this article to understand the permissions connected to the different user roles.