Case on Incoterms

Imagine you are a seller of bananas. You sent cargo to the buyer in two shipments: 1 in CFR (Costs and Freight) conditions and 2 in CIF (cost insurance freight).  Before the shipments, you did an inspection and everything was ok. The captain signed a clean Bill of lading (a document issued by a carrier to acknowledge receipt of cargo for shipment). When the cargo arrived at port of destination the buyer concluded that the cargo was wet. The buyer contacted with you to do an inspection but finally he did it without your presence. The inspection concluded that the cargo had not the quality agreed upon. The buyer is trying to not to pay the cargo because of damages. However you believe you are not responsible because in CFR and CIF the risk is transferred to the buyer when the cargo is on board.