I would definitely go with Noel, especially if you live in Sweden. I do too, and my brother is named Noel, and as you say, pronunciation is not a problem at all. I also like it because it's rarer than the other two, I feel like everyone is named Oliver or August these days.