how to make a solenoid multiple layers winding to produce a desired magnetic field? In that case, the normal solenoid formula(muni) will be valid or not?
The formula still works but the magnetic coupling from the wire-turns to your core will be worse. It is quite normal to have multiple layers of wire-turns on a core.
In the typical transformer equivalent circuit this will present itself as a greater portion of series inductance.