Just for the record:
On NVidia I get a report of approx. 250 handles being used when starting an application that opens a GL context. It seems to be an issue with AMD's driver. But as long as all these handles only get allocated once, don't worry. What you should check is if they leak if you try to destroy and recreate the context, provided that you even do such a thing.