For baud 115200 below 5V, the 30~50MHZ analog switch is enough. FTDI FT232 is up to 8Mbps, or 8MHz. It uses external 16MHz crystal. You can use dual 2-channel SPDT (Vishay DG9415DQ, MPS MP2735), triple SPDT (such as TI 74HC4053/CD74HC4053, Nexperia 74LVC1G53) to include SW1. Or single SPDT + single DPDT as in your schematic. You can check 74HC series MUX IC.