After knocking out Dillian Whyte in front of 94,000 at Wembley, Fury, 33, brought Ngannou, 35, into the ring during his postfight interview to tease a blockbuster mega-fight.
But White doesn’t like the idea of the two biggest stars in their respective sports colliding in a crossover bout.
He told TMZ: “Nobody is beating my door down for this fight.
“And I love Tyson Fury, I’m friends with Tyson. He’s one of the greatest boxers of all time.
“One of the greatest heavyweight boxers of all time going in against one of my MMA guys. We saw this movie before. We know how this story ends.
“Boxing is a massive advantage for Tyson Fury. Ngannou just fought Ciryl Gane and wrestled him. If you know anything about fighting, it’s a silly conversation.
“The thing was, the Conor-Floyd thing took on a life of its own. I mean, everywhere I went that’s all people were asking me about.
“All the media was talking about it, fans wanted to see it. It got to a point where fans wanted to see that fight and the media wanted to see that fight, and you know me. People aren’t knocking our door down for this fight.”
Ngannou’s current deal with the UFC is reportedly set to expire at the end of the year.
However, he insists that he will not sign a new contract unless Fury is also mentioned in the conversation.
He said on The MMA Hour podcast: “The Tyson Fury fight has to be part of the discussion.
That’s not an option. It has to be part of the discussion because if that’s not part of the discussion, it will never be. If I sign another contract now, basically the same model of the contract, I’m screwed.
“That’s not happening ever. So we have to figure out a way to implement this into a contract.
“I think the UFC is a good promotion, and I want to keep fighting. The Tyson Fury is not my last fight. I want to keep fighting.
“After Tyson Fury there’s still a lot of fights. There’s the Jon Jones, there’s the Stipe trilogy. There’s big fights I can do in the UFC, and I would really like that to happen.
“I would really like us to get to a common point. Yes, I can do the Tyson Fury fight on my own, but what’s next? I would like to keep fighting.
“I would like for us to come to an agreement.”