TEHRAN, Young Journalists Club (YJC) - President Martin Vizcarra quickly denounced the move, saying it undercuts Peru's drive to purge corruption.
"The head-on fight against corruption and impunity is a priority of this government," Vizcarra said on Twitter.
Two of the five supreme prosecutors called the decision by Attorney General Pedro Chavarry "a death blow" to the anti-corruption fight and urged him to reverse it.
The dismissal came just weeks before the Brazilian construction giant was set to reveal key evidence against powerful former Peruvian officials.
Executives at Odebrecht have acknowledged that it distributed millions in bribes across Latin America, including $29 million in Peru, to obtain lucrative government contracts.
The prosecutor's office is investigating all the Peruvian presidents who governed from 2001 to 2018 for alleged crimes of corruption and money laundering.
Chavarry's action set off demonstrations by hundreds of citizens in the capital of Lima and three other cities. Protesters shouted phrases like "Out with Chavarry" as they waved Peruvian flags.
The attorney general called a news conference to announce his decision but he then took no questions. He said the dismissal was necessary to nullify the appointment of the prosecutor heading the team of investigators.