I also have a few Rolexes that I have been wearing since my first Submariner in 1979. However, I love my Panerai 104 and I think the advice to go with a 44MM is sound. I have small wrists and it looks great. My Business partner bought a 40 MM and has regreted not buying the 44 since...
Good Luck