How Do I Handle Security Alert Fatigue?

Adding more security tools might add more security - or just more headaches (and risk).