So much of what you say really points to the main relay, in your diagram, P4 feeds to where your red track goes to the EGR, the black dot, just before it, is a connection to the other 3 units also.
The relay has two sets of contacts, one feeds that pin 4, the other one feeds power to the injectors. For pin 4 to have no power, either, there is no power to the contact or the contact is faulty.
This bit,
.
I then jiggled the fuel pump connector above the fuel tank. The car sputtered and then died. I was then unable to get the car to restart.
You have just been right through this area with fitting the new pump, you would have noticed if there was a bad connection, so did this stop the pump or did the relay contact turn off power to the injectors?
I would try replacing that relay, see if it is the problem.
