Test Discovery not working in JetBrains Rider macOS + Linux

[hquinn]

JetBrains Rider About

JetBrains Rider 2024.2.5
Build #RD-242.22855.90, built on September 19, 2024
Licensed to <redacted>
Subscription is active until <redacted>.
Runtime version: 21.0.3+13-b509.15 aarch64 (JCEF 122.1.9)
VM: OpenJDK 64-Bit Server VM by JetBrains s.r.o.
Toolkit: sun.lwawt.macosx.LWCToolkit
macOS 14.6.1
.NET Core v8.0.4 ARM64 (Server GC)
GC: G1 Young Generation, G1 Concurrent GC, G1 Old Generation
Memory: 2048M
Cores: 8
Metal Rendering is ON
Registry:
  ide.experimental.ui=true
  i18n.locale=
Non-Bundled Plugins:
  lermitage.intellij.extratci (2024.5.1)
  com.intellij.resharper.HeapAllocationsViewer (2024.2.0)
  com.thvardhan.gradianto (5.5)
  nsubstitutecomplete-rider (2024.2.0)
  com.intellij.ideolog (242.22855.37)
  com.markskelton.one-dark-theme (5.12.0)
  cognitivecomplexity-rider (2024.2.0)
  Key Promoter X (2024.2.0)
  Abc.MoqComplete.Rider (2024.1.1.1)
  com.intellij.resharper.StructuredLogging (2024.2.0.339)
  com.settler.rider.specflow (1.23.6)
  com.intellij.ml.llm (242.22855.75)
  com.github.dinbtechit.vscodetheme (1.10.11)
  com.github.copilot (1.5.23.6819)
  com.brandiico.jetbrains-nightfall-theme (2.0.2)

Project setup

I created a new solution with a class library (using .NET 8.0.401) using TUnit 0.1.783 (but have also tried on 0.1.752):

<Project Sdk="Microsoft.NET.Sdk">

    <PropertyGroup>
        <TargetFramework>net8.0</TargetFramework>
        <ImplicitUsings>enable</ImplicitUsings>
        <Nullable>enable</Nullable>
    </PropertyGroup>

    <ItemGroup>
      <PackageReference Include="TUnit" Version="0.1.783" />
    </ItemGroup>

</Project>

Then I created the following class:

public class ExampleTests
{
    [Test]
    public async Task Sample()
    {
        bool actual = true;
        await Assert.That(actual).IsTrue();
    }
}

Running it via dotnet test appears to work:

  Determining projects to restore...
  All projects are up-to-date for restore.
  Example.UnitTests -> /Users/hquinn/Documents/Code/Example/tests/Example.UnitTests/bin/Debug/net8.0/Example.UnitTests.dll
  Run tests: '/Users/hquinn/Documents/Code/Example/tests/Example.UnitTests/bin/Debug/net8.0/Example.UnitTests.dll' [net8.0|arm64]
  
  
  ████████╗██╗   ██╗███╗   ██╗██╗████████╗
  ╚══██╔══╝██║   ██║████╗  ██║██║╚══██╔══╝
     ██║   ██║   ██║██╔██╗ ██║██║   ██║   
     ██║   ██║   ██║██║╚██╗██║██║   ██║   
     ██║   ╚██████╔╝██║ ╚████║██║   ██║   
     ╚═╝    ╚═════╝ ╚═╝  ╚═══╝╚═╝   ╚═╝   
     
     v0.1.783.0 | 64-bit | Darwin 23.6.0 Darwin Kernel Version 23.6.0: Mon Jul 29 21:14:30 PDT 2024; root:xnu-10063.141.2~1/RELEASE_ARM64_T6000 | osx-arm64 | .NET 8.0.8 | Microsoft Testing Platform v1.4.0
     
  Passed! - Failed: 0, Passed: 1, Skipped: 0, Total: 1, Duration: 78ms
  
  Test run summary: Passed! - /Users/hquinn/Documents/Code/Example/tests/Example.UnitTests/bin/Debug/net8.0/Example.UnitTests.dll (net8.0|arm64)
    total: 1
    failed: 0
    succeeded: 1
    skipped: 0
    duration: 112ms
  Tests succeeded: '/Users/hquinn/Documents/Code/Example/tests/Example.UnitTests/bin/Debug/net8.0/Example.UnitTests.dll' [net8.0|arm64]

But the tests are not being discovered. I've already checked "Enable Testing Platform", and I've downgraded Rider to 2024.2.4, but hasn't worked.

[thomhurst]

Sorry to hear @hquinn . Unfortunately this isn't something I can solve and sounds like a Rider issue for mac.

Rider is built to pick up tests using the new Microsoft testing platform protocol. I simply send messages with test statuses and it's up to the IDE after that point.

And just to check, you've built your project? As tests are discovered after a build.

If it's still not working after that I recommend creating an issue with Jetbrains

[hquinn]

Hi @thomhurst , I did build the project but didn't show anything in the Test Explorer.

I've logged an issue on YouTrack, so hopefully they will look into this issue.

Link: https://youtrack.jetbrains.com/issue/RIDER-117732/Enable-Testing-Platform-support-doesnt-display-any-unit-tests-from-TUnit.

[devtekve]

I am also experiencing this exact same issue on 2024.2.5

[Mrxx99]

In this video it works when enabling testing platform:

https://youtu.be/dtdgm8lKJZU?t=3m35s

[devtekve]

In this video it works when enabling testing platform:

https://youtu.be/dtdgm8lKJZU?t=3m35s

We know, we tried, in macOS it is not working even with that enabled. Nick is on windows

[DragoQCC]

I ran into a similar issue in Rider when I made a new unit test project; since the template adds a reference to the Microsoft.NET.Test.Sdk package, it was also trying to generate an entry point for the tests, so TUnit wasn't showing up. It worked great once I removed that package reference and just had the TUnit reference.

[thomhurst]

Ah yes the Microsoft.NET.Test.Sdk package is problematic. It basically tells the project to run in the old VSTest mode. I need to update the docs to tell people to remove it!

[thomhurst]

However the project setup on the original post doesn't include that 😞

[wshaddix]

The same problem exists on Linux as well. I also filed an issue with Jetbrains for that. I did confirm it works as advertised on windows

[devtekve]

Ah yes the Microsoft.NET.Test.Sdk package is problematic. It basically tells the project to run in the old VSTest mode. I need to update the docs to tell people to remove it!

Oh! I thought this was something specific to me and I didn’t mention it, but yeah, I also had that issue. However, it is unrelated to the not showing up on rider for Mac and Linux

[danielmackay]

I have the same issue on Rider 2024.2.5, MacOS Sequoia and .NET 9 RC1

[thomhurst]

Anyone that has this issue i recommend upvoting this issue so that Rider prioritise the fix:
https://youtrack.jetbrains.com/issue/RIDER-117732/Enable-Testing-Platform-support-doesnt-display-any-unit-tests-from-TUnit.

[danielmackay]

Anyone that has this issue i recommend upvoting this issue so that Rider prioritise the fix: https://youtrack.jetbrains.com/issue/RIDER-117732/Enable-Testing-Platform-support-doesnt-display-any-unit-tests-from-TUnit.

Done - I've asked my colleagues who use Rider + MacOS to do the same. 😄

[thomhurst]

Jetbrains have marked the issue as fixed.

Says it'll be available in the Next 2024.3 public build. 🤞