Just working with grounded wrist-straps, and keeping major ESD generating clutter to a minimum, you shouldn't have much problem down to about 40% relative humidity. However, below 35% or 40%, you should start being extra vigilant.
For example, it's always a good idea to keep styrofoam packing material, wool sweaters, polyester fleeces, and rolls of packing tape away from your ESD-safe work area, but when the humidity is very low, even ordinary paper can start to be a problem. An ordinary laminated surface that might be passable at high humidity can start to cause problems when the air gets very dry. The professionals use grounded mats on the workbench surface all the time. When the air is very dry, ionizing fans become necessary.
So, you can work with almost any R.H., depending on the level of protection measures you have in place.