Yes, while viewing the Payment details each payment has a Trash Icon that you can click to delete that transaction.