Integration test: Automatically run all commands in tests

[CsCherrYY]

• Debugger for Java
• Java Test Runner
• Maven for Java
• Project Manager for Java Check the correctness of all commands in tests vscode-java-dependency#512
• Spring Initializr Java Support

[Eskibear]

@CsCherrYY can you provide more context/details about htis issue?

[github-actions]

Hi @CsCherrYY, I'm an AI Support assistant here to help with your issue. While the team reviews your request, I wanted to provide some possible tips and documentation that might help you in the meantime.

Suggestions for running all Java extension commands in integration tests:

• Discover and execute commands at runtime:

  • In your test setup, use vscode.commands.getCommands(true) to list all available commands (including those from Java extensions).
  • Filter commands by prefix (e.g. java., maven., spring., etc.) and call vscode.commands.executeCommand for each.
  • Example:

    import * as vscode from 'vscode';
    
    suite('Run all Java commands', () => {
      test('execute all commands', async () => {
        const allCommands = await vscode.commands.getCommands(true);
        const javaCommands = allCommands.filter(cmd => /^(java|maven|spring)\./.test(cmd));
        for (const cmd of javaCommands) {
          await vscode.commands.executeCommand(cmd);
        }
      });
    });

• Use the vscode-test library to launch your extension host for integration tests:

  • Docs: https://code.visualstudio.com/api/working-with-extensions/testing-extension
  • Sample tests: https://github.com/microsoft/vscode-extension-samples/tree/main/test-sample

• Identify contributed commands in each extension’s package.json:

  • Debugger for Java: see contributes.commands in https://github.com/microsoft/vscode-java-debug/blob/main/package.json
  • Java Test Runner: https://github.com/microsoft/vscode-java-test/blob/main/package.json
  • Maven for Java: https://github.com/microsoft/vscode-maven/blob/main/package.json
  • Spring Initializr Java Support: https://github.com/microsoft/vscode-spring-initializr/blob/main/package.json

Other references with low confidence:

java.test.config setting is ignored

• Discusses how "Run all tests" behaves with unit vs integration tests. Might help if you want to filter tests rather than all commands.
• The "java.test.config" setting is ignored vscode-java-test#1108

The team will respond to your issue shortly. I hope these suggestions are helpful in the meantime. If this comment helped you, please give it a 👍. If the suggestion was not helpful or incorrect, please give it a 👎. Your feedback helps us improve!