West Indies have turned against Sri Lanka