Photo by Mike Coppola/Getty Images for CMT

Jimmie Allen is countersuing the two women who have accused him of sexual assault.

In the countersuit, he claims that the affair with his day-to-day manager was consensual. He says the accusation from the second woman who came forward claiming that he secretly recorded their encounter and then took his phone, was also consensual and that she knew they were being recorded.

In a statement, Jimmie says, “As the son and brother of rape victims, and the father of daughters, these false claims are extremely hurtful to me and everyone around me. These false allegations have caused me to lose a vast number of business and endorsement opportunities that I worked extremely hard for. These false allegations have also not only harmed me, but have caused severe financial damage to my band, my team, and their families.”

Jimmie was fired from his record label, lost endorsements and dropped from concert appearances.

Amid these accusations, he and his estranged wife, Alexis, are trying to move forward.

He tells People, “The divorce case is still pending, as my wife and I are working to resolve things together as a family.” Jimmie and Alexis both filed divorce papers citing irreconcilable differences before the news of the sexual abuse allegations was made public.