The 'Just World' Fallacy is a known psychological bias.  See this post:

The-Just-World-Fallacy

"There are anecdotal accounts of people seeing the prisoners of concentration camps for the first time and assuming they must have been terrible criminals. The first place the mind goes is the place where the world is just."