How many will hear “I never knew you”?

I can imagine a huge number of people from this era getting to heaven and pleading with the Lord “I was speaking for you, I was teaching the scriptures, I was declaring your name,” only to have Him respond “you used My words but you ignored My children and taught others to value things of the world over things of eternity.”