Learning from Past or Present?