It certainly does sound like failed glow plugs. The most reliable test is to remove them, inspect them, and bench test them (power them using jumper leads and a battery).
If any have failed it's a good idea to replace them all.
If you have the 6v plugs (will say 6v, maybe 6.2v somewhere on...