The ATF paperwork that you have to fill out to buy a handgun also has a space for your social security number. However, you don't have to provide it.