I think it works. It seems like a valid nature name to me along the lines of
Ruby or
Opal. The spelling
Jem would make me assume male, so I prefer Gem to
Jem for a female.
It would also work as a middle name! But I really think it's usable as a first.
Gem
AdelaideGem
ElizabethGem
Katrine