Sollie said it happened Thursday when his jailers responded to a disturbance in the cell where Talley was being held by himself. They took him out and searched the cell, where they found the gun.
Sollie said there were no bullets found in the cell.
The Meridian Star reports Talley was charged with being a felon in possession of a firearm and possession of contraband.
The investigation continues.