The heavy fighting is underway as security forces try to beat them back.
Provincial governor spokesman, Arif Noori said that at least one Afghan soldier has been killed and seven others wounded in the fighting in Ghazni.
The attack on Ghazni comes as the Taliban faces growing pressure to agree to peace talks with the Afghan government to end the 17-year war.