Usually there is an indicator light, up right, showing it. I have a rather standard keyboard, above the NumPad it shows a capital A, it's lit if in use, off when not in use. Controlled by Caps Lock, left in keyboard = goes off and on by pressing.
If you have a laptop, it may be a bit different. But the principle should be about the same.