One of the annoying aspects of rubrics in Canvas is when first creating the rubric it doesn't allow you to delete criteria rows (this is true even if not using Outcomes).

To delete a criteria row, select Update Rubric to save your rubric, reload the page, then click the pencil icon to edit your rubric. Each criteria row should now have a trash icon present you can use to delete.