When doing push ups, keep your head looking down towards your hands. You want to keep your back straight and lower yourself to the ground and back up in one uniform motion.
Holding your head up and looking forward causes your spine to drop out of alignment(your tummy swoops down closer to the ground while your head is still up higher). This causes stress on the lower back and does not engage the desired muscles.
Form is everything