That would likely depend on the jurisdiction that you are in. In some jurisdictions The agreement covering the easement or right-of-way will specify who, other than the owner of the easement, may enter the easement or right-of-way area and when they are entitled to do so. A notification policy is usually included in the agreement.
Access by the representatives of the holder cannot be prevented although they should carry proper identification. Access
must be provided for excavation, repair or any other activities outlined in the agreement.