Shevardnadze revoked an earlier decree which had granted Mkhedrioni, or Horsemen, the status of "protection force" and had allowed its members to carry firearms, his press office said.
The group is believed to have several thousand fighters.
"The need for [Mkhedrioni] to carry weapons has expired," Shevardnadze said in a decree issued Thursday. "There have been cases when this has caused harm."
Shevardnadze, the last Soviet foreign minister, came to power in the troubled Transcaucasian state in early 1992, after Mkhedrioni had teamed up with other private militias to overthrow elected President Zviad Gamsakhurdia.
The Georgian Interior Ministry said it arrested 22 Mkhedrioni members in Kakhetia on Thursday and confiscated a significant quantity of arms.
A Message from The Moscow Times:
Dear readers,
We are facing unprecedented challenges. Russia's Prosecutor General's Office has designated The Moscow Times as an "undesirable" organization, criminalizing our work and putting our staff at risk of prosecution. This follows our earlier unjust labeling as a "foreign agent."
These actions are direct attempts to silence independent journalism in Russia. The authorities claim our work "discredits the decisions of the Russian leadership." We see things differently: we strive to provide accurate, unbiased reporting on Russia.
We, the journalists of The Moscow Times, refuse to be silenced. But to continue our work, we need your help.
Your support, no matter how small, makes a world of difference. If you can, please support us monthly starting from just $2. It's quick to set up, and every contribution makes a significant impact.
By supporting The Moscow Times, you're defending open, independent journalism in the face of repression. Thank you for standing with us.
Remind me later.