WASHINGTON (AP) — Former Rep. Matt Gaetz said Friday that he will not return to Congress after withdrawing his name from consideration to become attorney general under President-elect Donald Trump, amid growing allegations of sexual misconduct.

“I will still be in the fight, but it will be from a new seat. I am not going to join the 119th Congress,” Gaetz told conservative commentator Charlie Kirk, adding that he has “some other goals in life that I am eager to pursue with my wife and family.”

The announcement comes a day after Gaetz, a Florida Republican, stepped aside from the administration’s nomination process amid growing fallout from federal and House investigations which cast doubt on his ability to be confirmed as the nation’s head of federal law enforcement officials. The 42-year-old has vehemently denied the accusations against him.

Gaetz’s nomination as attorney general had shocked many career lawyers inside the Justice Department, but reflected Trump’s desire to place a loyalist in a department he has marked for retaliation after the criminal cases against him.

Hours after Gaetz pulled out, Trump nominated Pam Bondi, the former Florida attorney general, who would come to the job with years of legal work under her belt and the other quality that Trump prizes above all: loyalty.

It’s unclear what happens next for Gaetz, who is no longer a member of the House. He surprised colleagues by resigning from Congress the day Trump nominated him for attorney general. Some speculated that he could still be sworn into office for another two-year term on January 3, given that he just won re-election earlier this month.

But Gaetz, who has been in state and national politics for 14 years, said he is done with Congress.

“I think eight years is probably enough time in the United States Congress,” he said.