The input in question is "floating" until the button is pressed, due to its inputs being of very high impedance.
You need to add a pull-down resistor to the pushbutton, 10k is commonly used, thus:
That
That way, the PaspberryRaspberry Pi input sees a false
(0 Volts) until the button is pressed, then a true
until released.