Not the sermon on the mount
Luke 16:14 And the Pharisees also, who were covetous, heard all these things: and they derided him.
:15 And he said unto them, -(the rest of the chapter). (rich man and Lazarus)
Jesus was talking to,
Luke 11:52 Woe unto you, lawyers! for ye have taken away the key of knowlege: ye entered not in yourselves, and them that were entering in ye hinderd.
See how it fits? The rich man is the one who had the knowlege.
Jesus spoke to them this way more than once.
Mat. 23:31 Wherefore ye be witnesses unto yourselves, that ye are the children of them which killed the prophets.
:32 Ye serpents, ye generation of vipers, how can ye escape the damnation of hell?