Report says it was a turning point in the young royal's relationship with his family to be widely chastised while his brother suffered no consequences