Yes. You are missing a lot. Don't listen to Goldy. I will post the specific allegations soon (there are two alleged victims). [He got a 16-year-old drunk 10 years ago (he stayed sober), took her to his home, got her into his bedroom, pulled down his pants and... and, yes, sure, he drove her home later. How nice.]
Politicians win and lose based on politics, not some steady, considered process. Political office is a high calling, and we don't have the luxury of waiting years for things to wind through the courts before deciding "Wow! I guess he wasn't suitable for that office he's occupied for years!" I reserve the right to make that choice earlier.
His own staff and caucus abandoned him. It's reasonable to assume they know something. As I will write about soon, members of his own Party have been chasing this stuff down for years.
RE: Me Too Sinks Canadian Politician Accused of Sexual Assault and Harassment, Part 1