A few bad apples (forgive the pun) spoil the fun for everyone else.
I love the concept. In America there are these little "libraries" (more like glorified mailboxes) that people can swap books at, unattended. But even those have their critics and are prone to abuse.
RE: Honesty Boxes And The Intrinsic Trust Required Among Strangers