A Pragmatic Approach to Automating Your Defenses