The kind of tip you show is not intended for permanent installation.
If you need to have a scope hooked up to the device under test, with good high frequency performance, the only good solution is to design testing connections into your device.
I like MMCX connectors, because they're very compact, and you can get MMCX->SMA pigtails (and convert that to BNC) for cheap.
You do have to design testing into your project, but it's a good habit to get into anyways. I tend to try to scatter MMCX footprints around my board layouts, so I can get easy probe access to any nets I'm interested in. Plus, they make decent pads for probing with a spring ground clip if you don't want to solder connectors down.
You can also make a homemade alternative, if you have the board-space and patience:
As W5VO points out in the comments, using a test-setup like this for high-speed connections can be somewhat challenging. You would need to either construct a 10:1 probe adapter with a compensation capacitor, and mount it right on the mating MMCX connector, or properly ensure that your connecting cable is 50Ω, and the oscilloscope you're using is set to 50Ω input impedance to prevent reflections and signal distortions.
If you are interested in high-speed logic probing, a simpler solution then dealing with having to terminate the signal run to your scope would be to use a homemade inline termination as close to the MMCX connector as possible.
Basically, you can homebrew a 10:1 or 20:1 probe by simply inserting a series termination as close to the connector (the PCB-end connector) as possible. With a 50Ω scope imput impedance, a series resistance of 450Ω results in 10:1 attenuation, while maintaining proper impedance matching to the oscilloscope, and also loading the circuit under test much less.
A 950Ω resistor would result in 20:1 attenuation.
There are several homemade probes using this technique here and here.
For this sort of setup, I would take a male and female PC-mount connector, and solder the resistor in between the two, with some bare wire connecting the ground pins. It should be quite compact and structurally robust.
You can even add a compensation capacitors if you're interested in very high speed signals. There is a good resource about that here.
You then simply insert the series termination inbetween the scope lead and your board under test, and set your scope to the proper attenuation.