There are no specific rights that apply to this circumstance, but if the court were to deliberate on this matter, it may give significant weight to the child's opinion about who he wishes to live with.
It would be best to organise a family dispute resolution conference to discuss this with the father before taking action. Taking action without efforts to reach agreement with the other parent tends to go sour fairly quickly and the court frowns upon it, but Relationships Australia offer child-inclusive conferences so that the child's views can be heard and considered by both parties in discussing current arrangements.
Hope this helps.