Minimal measurements of the gate fidelity of a qudit map