Controlling position with an encoder (AX3500 series)

Can I control position with an encoder instead of potentiometer in AX3500 series?

You can but the digital encoder is incremental so it does not have an absolute reference. This means you need to use a computer board and create and keep track of the zero point.
See the instruction manual (downloadable from www.roboteq.com) for examples.