Our feelings towards others are largely based upon how we think about and how we treat others, and not as much upon how they treat us. Much of our thinking about others is based upon our own misconceptions and prejudices. Our own erroneous thinking causes us to act poorly towards others. This causes them to look upon us as enemies and for them not to trust us.
This is why Jesus said to "Love your enemies and pray for those who persecute you, that you may be sons of your Father in heaven." Matt 5:44-45. Whether it is towards our enemies or our brothers, the standard is love. (1 Cor 13:4-5 ff "Love is patient, love is kind. It does not envy, it does not boast, it is not proud. It is not rude, it is not self-seeking, it is not easily angered, it keeps no record of wrongs.")
Our actions towards others should not be based upon their behavior or about our thoughts or feelings about others. Instead, our thoughts, attitudes, and actions towards others are to be based upon who God is and who was are as his children. We are to love both our brothers (John 13:34) and our enemies (Matt 5:44).