Did you ever fix this problem with the lift pump? i have done pretty much all of the above and im still having the same issues, though not quite as severe as what yours sounds.
hi. i'm in turkey.i have the same car and i have the air problem in fuel line.lucas pumps are very bad i think.
when i was starting the engine at morning, the engine start 3 minutes then stops itself. because air comes to the fuel pump and stops.
i cant find where was coming that air all night.
then i have fix that air problem with a little webasto external heater fuel pump and the shut off valve. i put the shut off valve behind the fuel heater.with the shut off valve the fuel cant go back to tank when the air comes into fuel line. little webasto fuel pump is at the exit of the fuel tank. i connect the little pump electric to glow plugs lamp line at the instrument cluster. when i turn the ignition to start the car the little pump starts. when the light turn off the little pump turn off too. and i start the engine. the engine cant runaway. it works perfect and no bubble in the fuel line.
with the little pump the fuel filter loads fully
this system is also used on new cdi engines too!. cdi engine first fuel pump is in the fuel tank. the second one is near the engine.