The Pass through authentication invokes the loginBySSPI method in vpxd. The workflow for loginBySSPI is different from the one for loginByToken. The problem here is that in the loginBySSPI we don't have a refresh callback, meaning that the session lives as long as does the token. In the case of loginBySSPI we have hardcoded this value to 10 minutes.
Resolution
Engineering is still investigating this issue.
In the meantime there is a workaround available: Instead of using pass through authentication provide username and password directly with the PowerCLI ConnectVIServer command