It is absolutely true that only people based on the Buddhism cultural background can understand this Haiku well. And we can even say that it should be a religious experience rather than a cultural experience for most of western readers from the Christian world. Yeah, it is said that such kind of temple bell sound can travel far away. The truth is there is a famous ancient Chinese poem which also describes the temple bell sound.

MOORING BY MAPLE BRIDGE AT NIGHT
枫桥夜泊
At moonset cry the crows, streaking the frosty sky,
月落乌啼霜满天，
Dimly lit fishing boats ‘neath maples sadly lie.
江枫渔火对愁眠。
Beyond the city walls, from Temple of Cold Hill,
姑苏城外寒山寺，
Bells break the ship-borne roamer’s dream and midnight still.
夜半钟声到客船。