Learning When to Speak and When to Stay Silent