Been said before but could it be sticky steering again, mine had this. it's sorted but still has a sort of pulling different ways as you describe, I think it's a lot to do with the road surface on B roads, it is less obvious on dual carriage ways and M ways.