General answer:
If the high voltage is "tracking" across the surface of the circuit board then make physical slots in the PCB to make the surface path much longer. If the problem is induced emf due to currents then try using some ferrite sheet but make sure it's insulated against the AC voltages (ferrite can conduct a little). Small decouplers on the sensitive tracks to ground may also help.
If high AC voltage is capacitively coupling to the sensitive tracks small decouplers on those tracks to ground may alleviate the problem. The problem may also be alleviated by adding series resistance to the sensitive tracks.
However, it sounds to me like you may have to redesign the PCB.