...
If you choose to continue an incomplete form, the original incomplete form you saved will remain saved on the phone unless you save it again or complete the form. If a user pressed the back button and chooses to not save their changes, for instance, the original incomplete form remains as it was before form entry. If the user presses Save Form on the menu, however, it will update the existing saved form with the new version.
...
How can I remove an incomplete form?
If an incomplete form is stale and should be removed, this can be done from either of the 2 screens described in the steps to continue the form. To remove an incomplete form from the Incomplete Forms screen, you can long-click a form and then choose Delete Record
...