Yes, you have the right to build a fence directly on the property line. Survey’s may be required to determine the exact boundary.