It might be a 4A fuse allowing 5.5A at the moment. To understand why/how this can happen, you need to know the working of a fuse. The fuse will have some finite resistance R and a current I through it will start adding heat to the fuse as per the equation - IxIxRxt where t is the time. This heat energy will raise the temperature of the fuse and at one point, it will melt. However this isn't the only thing going on in there. The fuse is also losing some of the heat to its surroundings and hence the surroundings also play a role in deciding the current at which the fuse will blow and the time it will take to blow. Here is an excerpt from a fuse sizing guide:
In your case, one of the following might be the case:
1) Lack of quality control - Maybe the fuse company didn't control the tolerance very well.
2) Fuse is losing too much heat to its surroundings.
3) Fuse is not a fast one and it might blow given enough time.
4) It's not a 4A fuse.