As part of the original conceit that a computer’s workspace was analogous to a physical desktop, papers, pens, and all, the need to remove something permanently was represented by a trash can.
This is intuitive enough that the visual metaphor has persisted for decades, although Microsoft decided to go its own way by by turning it into a “Recycle Bin,” which is a little silly but no less apropos.