Continue prying with the spudger to separate the Lightning connector assembly from the rear case.

Be sure to loosen all parts of the assembly, including the Lightning connector, headphone jack and home button cable socket.