In the poem The Rime of the Ancient Mariner, an albatross follows a ship setting out to sea, which is considered a sign of good luck. However, the titular mariner shoots the albatross with a crossbow, an act that will curse the ship and cause it to suffer terrible mishaps. Unable to speak due to lack of water, the ship’s crew let the mariner know through their glances that they blame him for their plight and they tie the bird around his neck as a sign of his guilt. From this arose the image of an albatross around the neck as metaphor for a burden that is difficult to escape.

https://en.wikipedia.org/wiki/Albatross_(metaphor)