Sitting in a top fashion retailer’s office on Tuesday with the air-conditioning turned up to full blast, it wasn’t hard to see why selling clothes is hard at the moment.