There's not nearly enough detail here to provide an accurate response, here. It's not advisable to move without the other party's consent because they may apply for a recovery order to have you and the child returned to the town of origin. If you're unable to get the father's agreement, you can apply to the court for parenting orders, but you'll need to show that it's in the child's best interests to move with you, instead of staying at the home town with the father, were he may already be enroled in school, close to family, etc.
Sorry I can't be more help, but as I said, there's not really enough information here, so legal advice might be your best option.