The symptoms of Task Server overload are usually
Increasing the number of allowed clients per Task Server may lead to all of these things, although it depends on many other things like Task Server hardware, frequency of task execution, etc.
You can increase the limit and monitor perf counters for Task Server services.
Task Server limit is a good recommendation but many factors affect the actual number of clients that can connect. Monitor performance on a case by case basis.