Would it be possible to remove the case from a ceramic capacitor ? Like the ones surrounding the IC in this picture?
These capacitors do not have an outer case, so there is nothing to remove.
They consist of fine conducting membranes between layers of ceramic; the same ceramic body also forms the outer shell. The electrodes at the ends connect the plates to each other and the outside world.
If you want to see how they work, I'd suggest splitting them in half along the long axis and using a microscope.