Sports Direct’s independent investors are deserting it, as some suspect the retailer may never resolve its corporate governance crisis.