While I agree with your logic of the chicken being first, I would interpret the question differently. I think the egg refers to the baby chicken not the the first chicken egg that was laid. And one could argue that while the egg did not come from a chicken, it housed a chicken so it could be considered a chicken egg. So I always say the egg come first because the non-chicken who gave birth to the first chicken, laid an egg which contained the first chicken.