If you have doubts about the size then 40mm is a good compromise, there are many nice 40mm models out there, the 48, 49 and 50 are all 40mm and just like their 44mm counterparts, and the 282 is lovely, there's also my personal favourites, the 72 and 74, which are the chono versions which look lovely.
If you are worried you won't get away with a 44mm then it's always worth trying them in the shop, i had the same thoughts about 44mm but after biting the bullet and buying one i've been wearing them ever since, they feel very comfy on the wrist with the leather straps, and the cases sit nicely, yes it looks a bit big but you get used to it after a while, here's an example of a 40mm and a 44mm on a 6.75" wrist.
40mm
44mm
