Jenkins should have a kill switch for notifications to contributors

Sometimes there are changes in the build system, or during infrastructure or upstream transitions that would benefit from having some easy turn off of the notifications, so that contributors don’t get too much spam while things stabilize, and get time to fix their branches.

Parent Task: #10153 (closed)

Original created by @bertagaz on 10399 (Redmine)