Authentication from webapp to Geneva fails continuosusly, Appservice restart temporarily fixes the problem but issues reappears after a while.

[nishamishra2000]

Executed 'GetUtilizationJob.GetUtilization' (Failed, Id=9472d45a-c9a6-4dc7-bef5-844814783a4f, Duration=1546ms)Microsoft.Azure.WebJobs.Host.FunctionInvocationException: Exception while executing function: GetUtilizationJob.GetUtilization ---> System.AggregateException: One or more errors occurred. ---> Microsoft.WindowsAzure.Security.Authentication.SecurityTokenIssuanceException: Unable to get security token from any specified endpoint. Returning error from endpoint chi21prdapp01-t1-dsts.dsts.core.windows.net. ---> System.Security.Cryptography.CryptographicException: Keyset does not exist

Server stack trace:
at System.Security.Cryptography.Utils.CreateProvHandle(CspParameters parameters, Boolean randomKeyContainer)
at System.Security.Cryptography.Utils.GetKeyPairHelper(CspAlgorithmType keyType, CspParameters parameters, Boolean randomKeyContainer, Int32 dwKeySize, SafeProvHandle& safeProvHandle, SafeKeyHandle& safeKeyHandle)
at System.Security.Cryptography.RSACryptoServiceProvider.GetKeyPair()
at System.Security.Cryptography.RSACryptoServiceProvider..ctor(Int32 dwKeySize, CspParameters parameters, Boolean useDefaultKeySize)
at System.Security.Cryptography.X509Certificates.X509Certificate2.get_PrivateKey()
at System.Security.Cryptography.X509Certificates.RSACertificateExtensions.GetRSAPrivateKey(X509Certificate2 certificate)
at System.IdentityModel.Tokens.X509AsymmetricSecurityKey.get_PrivateKey()
at System.IdentityModel.Tokens.X509AsymmetricSecurityKey.GetSignatureFormatter(String algorithm)
at System.IdentityModel.SignedXml.ComputeSignature(SecurityKey signingKey)
at System.ServiceModel.Security.WSSecurityOneDotZeroSendSecurityHeader.CompletePrimarySignatureCore(SendSecurityHeaderElement[] signatureConfirmations, SecurityToken[] signedEndorsingTokens, SecurityToken[] signedTokens, SendSecurityHeaderElement[] basicTokens, Boolean isPrimarySignature)
at System.ServiceModel.Security.WSSecurityOneDotZeroSendSecurityHeader.CreateSupportingSignature(SecurityToken token, SecurityKeyIdentifier identifier)
at System.ServiceModel.Security.SendSecurityHeader.SignWithSupportingToken(SecurityToken token, SecurityKeyIdentifierClause identifierClause)
at System.ServiceModel.Security.SendSecurityHeader.SignWithSupportingTokens()
at System.ServiceModel.Security.SendSecurityHeader.CompleteSecurityApplication()
at System.ServiceModel.Security.SecurityAppliedMessage.OnWriteMessage(XmlDictionaryWriter writer)
at System.ServiceModel.Channels.BufferedMessageWriter.WriteMessage(Message message, BufferManager bufferManager, Int32 initialOffset, Int32 maxSizeQuota)
at System.ServiceModel.Channels.TextMessageEncoderFactory.TextMessageEncoder.WriteMessage(Message message, Int32 maxMessageSize, BufferManager bufferManager, Int32 messageOffset)
at System.ServiceModel.Channels.HttpOutput.SerializeBufferedMessage(Message message, Boolean shouldRecycleBuffer)
at System.ServiceModel.Channels.HttpOutput.Send(TimeSpan timeout)
at System.ServiceModel.Channels.HttpChannelFactory1.HttpRequestChannel.HttpChannelRequest.SendRequest(Message message, TimeSpan timeout) at System.ServiceModel.Channels.RequestChannel.Request(Message message, TimeSpan timeout) at System.ServiceModel.Channels.SecurityChannelFactory1.SecurityRequestChannel.Request(Message message, TimeSpan timeout)
at System.ServiceModel.Dispatcher.RequestChannelBinder.Request(Message message, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]:
at Microsoft.WindowsAzure.Security.Authentication.StsHighAvailibilityExecutor3.<>c__DisplayClass8_0.<CreateWorkItemAsync>b__0() in X:\bt\1127519\repo\src\services\dsts\Security\Authentication\StsHighAvailibilityExecutor.cs:line 207 at System.Threading.Tasks.Task.Execute() --- End of inner exception stack trace --- at Microsoft.WindowsAzure.Security.Authentication.AuthenticationClient.ExecuteGetSecurityToken(IEnumerable1 proxyList, SecurityTokenIssuanceRequest request) in X:\bt\1127519\repo\src\services\dsts\Security\Authentication\AuthenticationClient.cs:line 450
at Microsoft.WindowsAzure.Security.Authentication.AuthenticationClient.GetSecurityToken(Uri serviceRealmUri, String dnsHostName, AuthenticationMetadata authenticationMetadata, ICertificateSelector certificateSelector, SecurityToken actAsToken) in X:\bt\1127519\repo\src\services\dsts\Security\Authentication\AuthenticationClient.cs:line 388
at Microsoft.WindowsAzure.Security.Authentication.WebAuthenticationClient.CreateContextInternal(String serviceName, String serviceDnsName, AuthenticationMetadata authenticationMetadata, ICertificateSelector certificateSelector, SecurityToken actAsToken) in X:\bt\1127519\repo\src\services\dsts\Security\Authentication\WebAuthenticationClient.cs:line 387
at Microsoft.WindowsAzure.Wapd.AuthenticationLibraries.DstsAuthentication.DstsWebAuthenticationClient.get_CurrentContext()
at Microsoft.WindowsAzure.Wapd.AuthenticationLibraries.DstsAuthentication.DstsAuthenticationClientBase.ConfigureRequest(HttpRequestMessage request)
at Microsoft.Azure.Geneva.Actions.Client.Credentials.AzureClientCredentials.d__11.MoveNext() in X:\bt\1021790\repo\src\GenevaActionsLibrary\GenevaActionsLibrary\Credentials\AzureClientCredentials.cs:line 113
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Azure.Geneva.Actions.Client.ExtensionOperations.d__9.MoveNext() in X:\bt\1021790\repo\src\GenevaActionsLibrary\GenevaActionsLibrary\generated\AcisRestAPI\ExtensionOperations.cs:line 835
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Azure.Geneva.Actions.Client.ExtensionOperationsExtensions.d__9.MoveNext() in X:\bt\1021790\repo\src\GenevaActionsLibrary\GenevaActionsLibrary\generated\AcisRestAPI\ExtensionOperationsExtensions.cs:line 180
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Azure.Geneva.Actions.Client.ExtensionOperationsExtensions.GetOperationDetails(IExtensionOperations operations, String extension, String operation, String flags) in X:\bt\1021790\repo\src\GenevaActionsLibrary\GenevaActionsLibrary\generated\AcisRestAPI\ExtensionOperationsExtensions.cs:line 160
at Microsoft.Networking.Tycoon.BootstrapRP.Models.Repositories.AcisRepository.d__8.MoveNext() in C:__w\1\s\src\BootstrapRP\BootstrapRP.Models\Repositories\AcisRepository.cs:line 264
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Networking.Tycoon.BootstrapRP.Models.Repositories.AcisRepository.d__6.MoveNext() in C:__w\1\s\src\BootstrapRP\BootstrapRP.Models\Repositories\AcisRepository.cs:line 143
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Networking.Tycoon.BootstrapRPCapacityApi.Repositories.CapacityRepository.d__9.MoveNext() in C:__w\1\s\src\BootstrapRP\BootstrapRPCapacityApi\Repositories\CapacityRepository.cs:line 118
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Networking.Tycoon.BootstrapRPCapacityApi.Jobs.GetUtilizationJob.d__10.MoveNext() in C:__w\1\s\src\BootstrapRP\BootstrapRPCapacityApi\Jobs\GetUtilizationJob.cs:line 100
--- End of inner exception stack trace ---
at System.Threading.Tasks.Task.WaitAll(Task[] tasks, Int32 millisecondsTimeout, CancellationToken cancellationToken)
at Microsoft.Networking.Tycoon.BootstrapRPCapacityApi.Jobs.GetUtilizationJob.TriggerTask(List1 switches) in C:\__w\1\s\src\BootstrapRP\BootstrapRPCapacityApi\Jobs\GetUtilizationJob.cs:line 94 at Microsoft.Networking.Tycoon.BootstrapRPCapacityApi.Jobs.GetUtilizationJob.GetUtilization(TimerInfo timerInfo) in C:\__w\1\s\src\BootstrapRP\BootstrapRPCapacityApi\Jobs\GetUtilizationJob.cs:line 56 at lambda_method(Closure , GetUtilizationJob , Object[] ) at Microsoft.Azure.WebJobs.Host.Executors.VoidMethodInvoker2.InvokeAsync(TReflected instance, Object[] arguments)
at Microsoft.Azure.WebJobs.Host.Executors.FunctionInvoker`2.d__10.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.d__26.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.d__20.MoveNext()
--- End of inner exception stack trace ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.d__20.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.d__15.MoveNext()