We do not plan to add alerting based on performance. The reason is that the alerting configuration would be very complicated and would lead to confusion only.
Eng recommends a workaround for that: you can duplicate the monitor and change the timeout to the threshold when you want to be alerted. This monitor will fail if the threshold is reached and alert will be sent. There is a possibility to setup alerting after N consecutive errors to avoid false alarms