I'd always assumed your orange blossom explanation was the right one, but things can be strange in
Oz! (Those wonderful people who name their daughters
Kylie = Boomerang .. weird!)
Is it possible that it might be a native Australian name - there are so many aboriginal languages, many dead or dying, but perhaps a South Australian tribe used it and it caught on?