You can't have the one field as Primary part of the time. It is either Primary or it is not.
Suggest that this field not be used as the Primary. I am sure you have some good reasons behind this. Could you please explain where you are wanting to go and why.
If you can't find a different field...