You can justify a lot of things, but justifications only make things seem right; they don't make them right.
I picked this from one of the episodes of Seventh Heaven. It seemed very true to me. However, a question comes up in my mind: do we need to justify even when we are right? I don't have an answer to it right now. Maybe some day.