One of the ways to know whether it is ‘a karmic relationship or not’ is the sense of defeat in being a righteous person. 

It is right but at the wrong place.  
It is karmic.