I can verify that soldering does produce beads and dusts in the area, even when you're careful. It's quite a bit more than some people make it out to be. If you keep your workstation clean and it is the proper colour, the solder has no grime or camouflage to hide amongst. An iron will mostly produce larger bits like beads and flakes, but solder vacuums are notorious for producing fine dusts.
If you're jumping back and forth between soldering and using the mouse/keyboard, then you should not be jumping back and forth between eating and using the mouse/keyboard.