If you want to interrupt a voice message during recording, e.g. to record it again, click on the trash can icon on the left side of the recording:

Recording will stop and the previously recorded voice memo will be deleted so you can record and send it again.