The driver cannot know what to optimize out of a vertex & fragment shader until they are linked. The linking & combination of shaders is an area of significant optimization in drivers.

You may be...