You are mistaken.

Kindly point out the section in GPLv2 that absolves you of copyright infringement for the copies that you distributed.

It is certainly true that you cannot be forced to open source your code but you nonetheless have no distribution license if you do not comply with the GPL and have thus committed copyright infringement.

(GPLv3 has a grace period where you can come into compliance.)