Stars including Dawn French, Jennifer Saunders, Davina McCall and Jamie Oliver all turned down 'Great British Bake Off'.
Noel Fielding and Sandi Toksvig have been lined up to replace presenters Mel Giedroyc and Sue Perkins but it has been claimed that they were chosen after a host of big names said no.
A source told The Sun: "A lot of people at Love Productions are worried about what Channel 4 is going to do with their show.
"Noel is going to turn off a lot of the family viewing that made Bake Off such a favourite.
"Noel and Sandi are an odd combination and they certainly weren't top of the list -- or even tenth on the list.
"Channel 4's most loyal presenters were not interested. There was talk that replacing Mel and Sue was a toxic proposition."
However, Love Productions - which makes the show - has insisted that Noel and Sandi were the only people they offered the job to.
A spokesperson said: "Love Productions and Channel 4 jointly chose Sandi and Noel as presenters and they were the only pair an offer was made to."
Previously, the 'Mighty Boosh' star Noel hailed his new role as a "dream come true", and said he's looking forward to working alongside the 'Q.I.' host when the popular culinary contest moves to Channel 4.
He said in a statement: "'GBBO' is one of my favourite shows. I've always loved brightly coloured cakes and Sandi Toksvig so this is a dream come true for me! It's basically the double."
And Sandi hailed the chance to take over from departed hosts Mel & Sue an "extraordinary honour" - though she's worried about matching flamboyant Noel in the sartorial stakes.
She said: "It is an extraordinary honour to part of this national treasure of a show.
"Noel Fielding is one of the nicest guys in show business. The first time I met him I felt like I had met a rather wayward cousin whose take on the world made me laugh.
"The only down side is that he has much better dress sense that I do. I spend my daytimes on Channel 4 already so it will be a treat to be there in the evenings.
"I am so delighted to be working with Love Productions and Channel 4 on this best of British show."