If your WordPress user has the Author role, you may only discard those references you’ve added yourself, but you can not dismiss those suggested by another user with Editor or Administrator role.
Users with Editor and Administrator roles can discard all the suggested references.