Chief Chuck Hasty said in a statement Randy Pless, 47, faces charges of assault with a deadly weapon inflicting serious injury and possession of a firearm by felon.
Pless was taken into custody on the nearby railroad tracks by Investigator J.K. Davis.
Master Officer A. Salmon, who responded to the shooting call around 2:30 p.m., located Pless and saw him running down the tracks on Hinson Street.
Pless was jailed on $5,000 bond and assigned a May 3 court date.
Investigators at the scene Thursday said the shooting was the result of an argument between two men which led to a fistfight and the alleged suspect pulling out a gun and shooting the victim in the lower extremities.
The victim was transported to the hospital by Halifax County EMS for treatment of non-life threatening injuries.