Note that we use the third conditional in this way when we are expressing regret about something. To emphasise how much we regret something, we can use if only as an alternative to if: I just didn ...

Of course, had we used the more normal if-clause to express this conditional idea ... but is simply an alternative to the present simple in the more normal if-clause: If you don't want to go ...