Thats a good check you have done.
Try start the car and then remoove the battery, and see if car keep running or get stalled. If it stalls then that mean alternator isnt charging battery constantly and thats why light is shown.
If you dont do this, may be after few days once battery is down your car wont start at all.