Japan has some great secondhand watch shops—check out Jack Road, GMT, or Rasin in Tokyo for solid Panerai options... Since you prefer smaller sizes, consider the Luminor 40mm or 42mm models for a better fit...
Try them on in person if you can, and enjoy the hunt!