I think he realizes two things:

1. Trump duped him also -- Bannon to me seems to be a "true believer"...we all know that Trump is just in it for himself and
2. He sees this ship sinking, so he's trying to put as much distance between himself and the wake caused by the Trumptanic going under

Bannon wants to retain the credibility he has with his followers after this disaster is over.