My suggestion? Buy some of each size and some prototyping adaptors to practice on. This will give you a feel for the skills involved.
You may find that 0402 (1005 metric) isn’t too bad if your hands are steady and you have decent equipment. Or, you may find that you will need to make the investment in good soldering irons (get two - makes it easier to unsolder a part) and tips.
As it is, most boards are made with 0402 now as the go-to size, with larger sizes used for bigger / higher power values as needed. 0201 (0603 metric) and 01005 are almost beyond what can be done by hand for most people, but show up in compact boards like mobile handsets and other small electronics.
For less-skilled beginners and folks with poor vision or shaky hands, 1206 (3216 metric) and 805 (2012 metric) are a bit easier.
But... bear in mind also that if you’re considering SMT passives, you’ll probably be dealing with SMT ICs as well. There’s different types to consider.
- QFP (gull-wing) packages solder fairly easily
- J-leads are a bit trickier because they’re harder to see (and thankfully are largely obsolete.)
- Leadless chip carriers can be hand soldered by skilled people but should best be applied by reflow
- BGAs require careful reflow technique