I prefer
Emory to Amory. I thing it's relatively gender-neutral, but slightly more masculine.
For a boy:
Amory
CharlesAmory
MichaelAmory
FranklinAmory
ColinAmory
DanielAmory
Thomas
For a girl:
Amory
EloiseAmory
KateAmory
IsobelAmory
LorraineAmory
ElaineAmory
Marguerite