url_response profile gets error 403

Products

• DX Unified Infrastructure Management (Nimsoft / UIM)
• CA Unified Infrastructure Management On-Premise (Nimsoft / UIM)
• CA Unified Infrastructure Management SaaS (Nimsoft / UIM)

Issue/Introduction

When we test the profile we get this response. 
Profile Test results for <URL>
Result: 403 The server understood the request, but is refusing to fulfill it.

We have already added Mozilla/5.0 to the settings tab agent and it still gives this error.

We tried to connect to the url on the robot using the local browser and got just the words "Forbidden".

Environment

• UIM 20.4 and above
• url_response 4.50 and above

Cause

• Web site does not allow direct access

Resolution

The web server admins have a whitelist to allow for monitoring. Provide the web server administrator the ip of the robot that is monitoring the url.