The Body Snatcher, 32, slammed suggestions that he is feigning injury to avoid fighting Otto Wallin in their scheduled bout this weekend.
Whyte's withdrawal with a shoulder injury a few weeks before the fight has given rise to talk that he didn't want to fight him in the first place, but he has since refuted those claims.
"These things happen unfortunately, we're big heavyweights, I've been sparring some big guys.
"It was going to be a big fight, I'd trained hard, I didn't want to make the same mistake Tyson Fury made by underestimating Otto Wallin.
"So I was training very hard, I was putting in extra hours and extra shifts, and the injury just happened."
Wallin has accused Whyte of fabricating the injury, but Whyte has intimated that he could have saved a lot of money if he had 'pulled out like three or four weeks ago'.
He added: "A lot of people have been saying, 'You pulled out because of Tyson Fury', but if that was the case I would have pulled out like three or four weeks ago when I knew that obviously the mandatory position was going to be in place.
"Obviously, my camps cost a lot of money, my training camps cost me a lot of money, so I would've just pulled out early to save all of this and money and stuff.
"I've got a lot of people in camp that work for me and look after me so I would've pulled out weeks ago if I was going to pull out."
Whyte (28-2, 19 KOs) also revealed he has fought through the pain plenty of times during his 30-fight professional career.
However, he didn't feel like it was worth the risk, especially considering the fact he is on the brink of a world title shot.
"I've fought many times with injuries as you know, I've fought with an injured shoulder before, broken hand, broken ribs, but I'm at that stage of my career where I've got to use a bit more brain instead of brawn," he explained.
"I wanted to fight. I said to my guy, 'Listen, can't I just put some f------ morphine in it or something and just go and have a go?' But they were like, 'You're not a caveman, you need to be smart, there's not just one fight left in your career'.
"Disappointed, heartbroken, but it is what it is. I really wanted to smash Otto Wallin up. I think I could've knocked him out in the first six, seven rounds... Bit annoying, bit p----- off, but this is boxing."News Now - Sport News