Fifa president Sepp Blatter has refused responsibility for allegations of misconduct under his leadership. But the buck must stop at the top.