They're all pretty much hidden in the caves of Hobbiton, Barrow Downs and Troll Shaws with the exception of a few that will be given by certain people i.e. the hobbit in the Hobbiton cave will give you a gem for a healing fern...

Check out the walkthrough at www.gamewinners.com/snes/lordRings.htm