Your ISP connector is wired wrong.
Pin 5, the reset pin is not connected to pin one of the ATTiny. This will hinder your ability to program the chip.
The 5 Volt from the header is also not connected to the IC.
I also hope you are not providing anything other than 5V through the screw terminal, as this will destroy the chip.
I would also move your electrolytic cap from the reset line and put the 0.1uf there if you want as the electrolytic will stop immediate resetting. Then move the electrolytic to the VCC of the chip.
Attached are some reference pics.