Using Apple Network Framework and WebSockets

[lilleyd]

Apple platform

iOS

Framework version

net10.0-*

Affected platform version

.Net 10.0.101

Description

We are connecting to Trade Republic with an web socket and we experience ssl failure when we connect with Apple Network Framework and WebSockets, when not using Apple Network Framework, the WebSockets work fine.

net_webstatus_ConnectFailure
net_http_ssl_connection_failed
Arg_NullReferenceException
 

System.Net.WebSockets.WebSocketException (0x80004005): net_webstatus_ConnectFailure
---> System.Net.Http.HttpRequestException: net_http_ssl_connection_failed
---> System.NullReferenceException: Arg_NullReferenceException
   at System.Runtime.InteropServices.Marshalling.SafeHandleMarshaller`1.ManagedToUnmanagedIn[[Microsoft.Win32.SafeHandles.SafeX509ChainHandle, System.Security.Cryptography, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]].FromManaged(SafeX509ChainHandle )
   at Interop.AppleCrypto.X509ChainGetChainSize(SafeX509ChainHandle )
   at System.Net.CertificateValidationPal.GetRemoteCertificate(SafeDeleteContext , Boolean , X509Chain& , X509ChainPolicy )
   at System.Net.CertificateValidationPal.GetRemoteCertificate(SafeDeleteContext , X509Chain& , X509ChainPolicy )
   at System.Net.Security.SslStream.VerifyRemoteCertificate(RemoteCertificateValidationCallback , SslCertificateTrust , ProtocolToken& , SslPolicyErrors& , X509ChainStatusFlags& )
   at System.Net.Security.SslStream.CompleteHandshake(ProtocolToken& , SslPolicyErrors& , X509ChainStatusFlags& )
   at System.Net.Security.SslStream.CompleteHandshake(SslAuthenticationOptions )
   at System.Net.Security.SslStream.<ForceAuthenticationAsync>d__159`1[[System.Net.AsyncReadWriteAdapter, System.Net.Security, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]].MoveNext()
   at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptions , HttpRequestMessage , Boolean , Stream , CancellationToken )
   Exception_EndOfInnerExceptionStack
   at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptions , HttpRequestMessage , Boolean , Stream , CancellationToken )
   at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage , Boolean , CancellationToken )
   at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage , Boolean , CancellationToken )
   at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem )
   at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.<WaitWithCancellationAsync>d__1[[System.Net.Http.HttpConnection, System.Net.Http, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]].MoveNext()
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage , Boolean , Boolean , CancellationToken )
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage , Boolean , CancellationToken )
   at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync|115_0(HttpRequestMessage , CancellationToken )
   at System.Net.WebSockets.WebSocketHandle.ConnectAsync(Uri , HttpMessageInvoker , CancellationToken , ClientWebSocketOptions )
   at System.Net.WebSockets.WebSocketHandle.ConnectAsync(Uri , HttpMessageInvoker , CancellationToken , ClientWebSocketOptions )
   at System.Net.WebSockets.ClientWebSocket.ConnectAsyncCore(Uri , HttpMessageInvoker , CancellationToken )
   at Subsembly.Scraper.ScraperSessionTradeRepublic.EmbeddedWebSocketClient.Connect()
   at Subsembly.Scraper.ScraperSessionTradeRepublic.OnContinueLogin(SepaAccount[]& vAccts, JsonObject jsCredential)
   at Subsembly.Scraper.ScraperSession.ContinueLogin(JsonObject jsCredential)
 
#### Fehler: net_webstatus_ConnectFailure
net_http_ssl_connection_failed
Arg_NullReferenceException

Steps to Reproduce

Unfortunately I cannot provide an example for you to test as it is behind credentials of a bank.

Did you find any workaround?

No response

Relevant log output

No response

[rolfbjarne]

Just to be clear, your app works when you set this project in the csproj:

<UseNativeHttpHandler>false</UseNativeHttpHandler>

and then doesn't when doing this:

<UseNativeHttpHandler>true</UseNativeHttpHandler>

?

[lilleyd]

<UseNativeHttpHandler>false</UseNativeHttpHandler> Works Correctly
<UseNativeHttpHandler>True</UseNativeHttpHandler> Works Correctly

<UseNativeHttpHandler>True</UseNativeHttpHandler> and AppContext.SetSwitch("System.Net.Security.UseNetworkFramework", true); Fails With

Unable to connect to the remote server
The SSL connection could not be established, see inner exception.
Object reference not set to an instance of an object
System.Net.WebSockets.WebSocketException (2): Unable to connect to the remote server ---> System.Net.Http.HttpRequestException: The SSL connection could not be established, see inner exception.
 ---> System.NullReferenceException: Object reference not set to an instance of an object
   at System.Runtime.InteropServices.Marshalling.SafeHandleMarshaller`1.ManagedToUnmanagedIn[[Microsoft.Win32.SafeHandles.SafeX509ChainHandle, System.Security.Cryptography, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]].FromManaged(SafeX509ChainHandle handle)
   at Interop.AppleCrypto.X509ChainGetChainSize(SafeX509ChainHandle chain)
   at System.Net.CertificateValidationPal.GetRemoteCertificate(SafeDeleteContext securityContext, Boolean retrieveChainCertificates, X509Chain& chain, X509ChainPolicy chainPolicy)
   at System.Net.CertificateValidationPal.GetRemoteCertificate(SafeDeleteContext securityContext, X509Chain& chain, X509ChainPolicy chainPolicy)
   at System.Net.Security.SslStream.VerifyRemoteCertificate(RemoteCertificateValidationCallback remoteCertValidationCallback, SslCertificateTrust trust, ProtocolToken& alertToken, SslPolicyErrors& sslPolicyErrors, X509ChainStatusFlags& chainStatus)
   at System.Net.Security.SslStream.CompleteHandshake(ProtocolToken& alertToken, SslPolicyErrors& sslPolicyErrors, X509ChainStatusFlags& chainStatus)
   at System.Net.Security.SslStream.CompleteHandshake(SslAuthenticationOptions sslAuthenticationOptions)
   at System.Net.Security.SslStream.<ForceAuthenticationAsync>d__159`1[[System.Net.AsyncReadWriteAdapter, System.Net.Security, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]].MoveNext()
   at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptions sslOptions, HttpRequestMessage request, Boolean async, Stream stream, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptions sslOptions, HttpRequestMessage request, Boolean async, Stream stream, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem)
   at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.<WaitWithCancellationAsync>d__1[[System.Net.Http.HttpConnection, System.Net.Http, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]].MoveNext()
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
   at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync|115_0(HttpRequestMessage request, CancellationToken cancellationToken)
   at System.Net.WebSockets.WebSocketHandle.ConnectAsync(Uri uri, HttpMessageInvoker invoker, CancellationToken cancellationToken, ClientWebSocketOptions options)
   at System.Net.WebSockets.WebSocketHandle.ConnectAsync(Uri uri, HttpMessageInvoker invoker, CancellationToken cancellationToken, ClientWebSocketOptions options)
   at System.Net.WebSockets.ClientWebSocket.ConnectAsyncCore(Uri uri, HttpMessageInvoker invoker, CancellationToken cancellationToken)
   at Subsembly.Scraper.ScraperSessionTradeRepublic.EmbeddedWebSocketClient.Connect() in /Users/davidlilley/code/Subsembly.Scraper/Subsembly.Scraper/ScraperSessionTradeRepublic.cs:line 1092
   at Subsembly.Scraper.ScraperSessionTradeRepublic.AccountContext.BuildStatement(DateTime from) in /Users/davidlilley/code/Subsembly.Scraper/Subsembly.Scraper/ScraperSessionTradeRepublic.cs:line 636
   at Subsembly.Scraper.ScraperSessionTradeRepublic.OnDownloadStatement(SepaStatement& aSepaStatement, SepaAccount aAcct, DateTime from) in /Users/davidlilley/code/Subsembly.Scraper/Subsembly.Scraper/ScraperSessionTradeRepublic.cs:line 393
   at Subsembly.Scraper.ScraperSession.DownloadStatement(SepaDocument& aCamtDoc, JsonObject jsAcct, DateTime tFromDate) in /Users/davidlilley/code/Subsembly.Scraper/Subsembly.Scraper/ScraperSession.cs:line 826

<UseNativeHttpHandler>False</UseNativeHttpHandler> and AppContext.SetSwitch("System.Net.Security.UseNetworkFramework", true);

net_webstatus_ConnectFailure
net_http_ssl_connection_failed
Arg_NullReferenceException
System.Net.WebSockets.WebSocketException (0x80004005): net_webstatus_ConnectFailure
 ---> System.Net.Http.HttpRequestException: net_http_ssl_connection_failed
 ---> System.NullReferenceException: Arg_NullReferenceException
   at System.Runtime.InteropServices.Marshalling.SafeHandleMarshaller`1.ManagedToUnmanagedIn[[Microsoft.Win32.SafeHandles.SafeX509ChainHandle, System.Security.Cryptography, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]].FromManaged(SafeX509ChainHandle )
   at Interop.AppleCrypto.X509ChainGetChainSize(SafeX509ChainHandle )
   at System.Net.CertificateValidationPal.GetRemoteCertificate(SafeDeleteContext , Boolean , X509Chain& , X509ChainPolicy )
   at System.Net.CertificateValidationPal.GetRemoteCertificate(SafeDeleteContext , X509Chain& , X509ChainPolicy )
   at System.Net.Security.SslStream.VerifyRemoteCertificate(RemoteCertificateValidationCallback , SslCertificateTrust , ProtocolToken& , SslPolicyErrors& , X509ChainStatusFlags& )
   at System.Net.Security.SslStream.CompleteHandshake(ProtocolToken& , SslPolicyErrors& , X509ChainStatusFlags& )
   at System.Net.Security.SslStream.CompleteHandshake(SslAuthenticationOptions )
   at System.Net.Security.SslStream.<ForceAuthenticationAsync>d__159`1[[System.Net.AsyncReadWriteAdapter, System.Net.Security, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]].MoveNext()
   at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptions , HttpRequestMessage , Boolean , Stream , CancellationToken )
   Exception_EndOfInnerExceptionStack
   at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptions , HttpRequestMessage , Boolean , Stream , CancellationToken )
   at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage , Boolean , CancellationToken )
   at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage , Boolean , CancellationToken )
   at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem )
   at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.<WaitWithCancellationAsync>d__1[[System.Net.Http.HttpConnection, System.Net.Http, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]].MoveNext()
   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage , Boolean , Boolean , CancellationToken )
   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage , Boolean , CancellationToken )
   at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync|115_0(HttpRequestMessage , CancellationToken )
   at System.Net.WebSockets.WebSocketHandle.ConnectAsync(Uri , HttpMessageInvoker , CancellationToken , ClientWebSocketOptions )
   at System.Net.WebSockets.WebSocketHandle.ConnectAsync(Uri , HttpMessageInvoker , CancellationToken , ClientWebSocketOptions )
   at System.Net.WebSockets.ClientWebSocket.ConnectAsyncCore(Uri , HttpMessageInvoker , CancellationToken )
   at Subsembly.Scraper.ScraperSessionTradeRepublic.EmbeddedWebSocketClient.Connect()
   at Subsembly.Scraper.ScraperSessionTradeRepublic.OnContinueLogin(SepaAccount[]& vAccts, JsonObject jsCredential)
   at Subsembly.Scraper.ScraperSession.ContinueLogin(JsonObject jsCredential)
#### Error: net_webstatus_ConnectFailure
net_http_ssl_connection_failed
Arg_NullReferenceException

[rolfbjarne]

Ah, I see, this is only a problem when System.Net.Security.UseNetworkFramework is enabled, irrespective of whether UseNativeHttpHandler is enabled or disabled.

In that case, this is probably a problem in the dotnet/runtime repository, where the corresponding code for System.Net.Security.UseNetworkFramework is, so I'm moving this issue there.

[dotnet-policy-service]

Tagging subscribers to this area: @karelz, @dotnet/ncl
See info in area-owners.md if you want to be subscribed.

[dotnet-policy-service]

Tagging subscribers to this area: @dotnet/ncl, @bartonjs, @vcsjones
See info in area-owners.md if you want to be subscribed.