Unless the server is experiencing performance issues, this should not be a concern.
However, If you are seeing kswap process in contention for using the most CPU, this would indicate the server does not have physical memory to handle what is being performed on the box.
ps -aef | grep kswap