Another possibility for consideration is to make fletching create standard 1 damage arrows, and have powerful bane damage arrows be cool quest-able or droppable things that you could pick up once in a while.
For instance, if you kill Empress Pernelia, she has a 1 in 3 chance of dropping a...