when I like to store items of that calibre I like to store them at the adventurer's mart, because no doubt you will go there often and that will make it so you can always remember where your stuff is, I use the barrel at the top of the stairs on the left hand side ( it should have 20 arrows in it)
Like everybody said, find a container that you like and put it there. You don't need quest items later, but you can't sell them. I tend to keep them in a container because I worry that I'll miss out on something if I don't.
as a fighter/thief with the keep I might store my items in the bookshelf as I go there for my money anyway. I think strongholds are a good bet since you usually keep going there for quests/money
Comments