Selfishness

Usually when someone talks negatively about selfishness, he means selfishness of/in others towards him (excluding his own, which he cannot/does not observe/perceive of course, as being acts of selfishness towards others).