You are populating the journal incorrectly.
You cannot have multiple lines in the payment journal and use the Bank Export. You should have one line for the vendor, leave the amount blank. Then use the Apply Entries function under Process, set the applies to id for the invoice and credit memo, press OK which returns the amount to be paid to the payment journal line.