Joe said that his son rang him up earlier in the week and went "ballistic" over the accusations he made against the Kardashians in a recent interview, reported TMZ online.
Lamar, who has been paying for Joe's rent for four years, said during the phone call that he would no longer pay for the rent.
Joe said that he would not be able to pay the rent which costs USD 2,900 per month and he would move out next month.
"He would be better off without them. Let him go and get his life together. I think the best thing for him would be to have a clean break, divorce Khloe and as a single man try and get his life back together," the army veteran said of his son.
He also made a comment on Lamar's mother-in-law Kris Jenner, who "doesn't care about Lamar, she just cares about their image and money."
Joe later stated that he was sorry for his action. Joe explained that he did it because he was "frustrated" over people's comments about his son's alleged drug problems, adding that the Kardashians was a "wonderful family.
