Beginning to sound like the graphics card is either not making proper
contact with the slot, is faulty in some way, or is being starved of
power ( this would only show up when the full drivers are installed ).

What's the specification of the PSU they put in this rig ???