Jack Wills swung to a full-year loss in its latest financial year as it battled to compete in a “highly competitive” clothing market.