The Targaryens really just weren't worth the trouble. At the rate they were insane, there's no reason people shouldn't have rebelled and put someone else on the throne. On top of that, the Targaryens had no 'right' to rule the Seven Kingdoms, that concept didn't exist, they took it by force; exactly what Robert did.