Posting Invoices touches several files. It updates the Customer file and the G/L Transactions Report in Receivables. In Invoices, the Invoice History, the Tax Summary and the Posting journal are updated. Have you verified that these other files are correct?

If you have Inventory, Sales Analysis or JobCost, you should also verify that they have received correct information.

If the information is satisfactory, yes, you can simply delete the error batch. If it is not, you may want to restore your backup instead of proceeding.