The Sheriff of your home county gets the change of address and they can revoke your permit since you are no longer a resident of NC. NC does not issue permits to residents of other states.
http://www.jus.state.nc.us/NCJA/ncfirearmslaws.pdf
The sheriff of the county where the permit was issued or the sheriff of the county where
the individual resides may revoke a permit, subsequent to a hearing, for any of the following
reasons:
1. Fraud, intentional or material misrepresentation in obtaining a permit;
2. Misuse of a permit, including lending or giving a permit to another person,
duplicating a permit, or using a permit with the intent to unlawfully cause
harm to a person or property;
3. The doing of an act or
existence of a condition which would have been grounds
for the denial of the permit by the sheriff;
4. Violation of any terms governing the carrying of concealed handguns; or
5. The applicant is adjudicated guilty, or receives a Prayer for Judgment
Continued for a crime which would have disqualified the applicant from
initially receiving a permit.
N.C. Gen. Stat. § 14-415.18