
When you remove the cap you should have two fixing screw holes and one larger hole through which the indicator locates with the shifting mechanism.
Shimano don't provide any plastic blank caps, I just covered the larger hole with a bit of insulation tape (or you could use some MBUK stickers) and re-inserted the two screws.
The lack of alternative cover is a shoddy Shimano oversight, imo.