Aiden, an early bookie’s favourite, left the show on Sunday after Simon Cowell failed to save him when he appeared in the bottom two alongside Katie Waissel.
It was the fourth time that unpopular Katie, 24, had appeared in the bottom two.
Matt, 27, told The Daily Mail: “In terms of the television show, Aiden is expendable. I was shocked when Simon sent him home, but then Katie is better for the show than Aiden is.
“She gets the coverage – she gets the show attention. He just isn’t like that but he is a much better singer.
“It is like losing a brother. When it went to Katie and Aiden in the bottom two, I didn’t think he would go.”
Aiden, 18, added: “It is an entertainment show, but I can’t see where the entertainment is coming from [with Katie] as she is not doing that well.
“I think it should be more about singing from now on.”
Katie’s lacklustre performance of Elton John’s Saturday Night’s Alright (For Fighting) received a mixed reaction from the judges in Saturday’s live show.
Louis Walsh was particularly critical, saying to her mentor Cheryl Cole: “Elton has 44 albums and you give her this silly song. It was a throwaway performance. It was awful. It was wrong.”
However Aiden’s rendition of Rocket Man was praised by the judges, with Simon prematurely stating: “I think you’re going to be fine for next week.”
Meanwhile, The Sun claimed that X Factor bosses have called in police after Katie received death threats on social networking sites.
More than 150,000 people joined a revolting Facebook group claiming that Katie is harder to get rid of than a sexually transmitted disease.
Messages such as “Katie Waissel deserves to die right this minute,” were posted.
An X Factor Spokesperson told The Sun: “These threats are disgusting and outrageous. This is cyber bullying and we will not put up with it.
“We are doing what we can to stop it and are contacting the police.”