Feathers can be found in several shops and dropped from various monsters listed below. It's commonly used for fly-fishing when Fishing, or to attach them to arrows while Fletching.
