Interesting. Typically, the "private feedback" question is tied with a "should I buy from him?" question. Yours is the opposite.
If he paid you with non-cc PayPal, ship him his goods. If he sends you a money order, and it cashes, send him his goods. Anything else, no sale.