Rebuke: Who does it, to whom?

The halacha is pretty straightforward: everyone is obligated to rebuke anyone who does something wrong. But alongside the halacha we find very early sources from very big rabbis saying that even in their generation it would be amazing if there is anyone who is qualified to rebuke, or is able to receive rebuke, or knows how to rebuke. So, we're obligated, but duly warned.