Indeed GPUs take advantage of extreme parallelism thanks to having almost no coupling between tasks, which means they are much more efficient (in raw compute power for transistor count) than CPU.

But per-pixel operations results (fragment shaders) are really per pixel, only the inputs are interpolated between vertices.