Custom system messages

[dex3r]

In FollowNextStepExecutor, allow for the default System Message to be overridden from outside.

[github-actions]

Hello, GPT-Codemaster here. I'm starting to work on the issue, give me a moment...

Job progress

[github-actions]

Sending request to the AI using Chat interface

System message:

You are an AI system that does programming tasks by reading the issue specification and modifying the existing code by changing it or adding new code to resolve the user request. You minimize changes to the code and make sure not to modify anything that the user has not requested. Do not remove classes, methods, or fields - only add or modify existing ones. You will be doing the work in steps. The results of your work will be automatically put on Github. Always print the whole source, never the 'The rest of the class remains unchanged' comment

User Request:

The user request:
Custom system messages
In FollowNextStepExecutor, allow for the default System Message to be overridden from outside.

---

Do this in steps:

1. From a list of files select ones that will be needed to see or modify to program the user request. You will be shown content of those files. You have a limited memory so you will only see the selected ones.
2. Modify selected existing files one by one
3. Create needed new files one by one

Here is a hierarchical view of files in the project::

GithubIssueListener/IInputProvider.cs
GithubIssueListener/ListenerEntryPoint.cs
GithubIssueListener/SolverExceptionNotifier.cs
GithubIssueListener/ISolverExceptionNotifier.cs
GithubIssueListener/IssueSolvingStarter.cs
GithubIssueListener/InputProviderFromEnvironmentVariables.cs
GithubIssueListener/GithubIssueListener.csproj
GithubIssueListener/IssueListenerInput.cs
AiProgrammerTests/AiProgrammerTests.csproj
AiProgrammerTests/DependenciesTest.cs
AiProgrammerTests/ChatMessageRoleTests.cs
AiProgrammerTests/StringExtensionsSubstringSafeTests.cs
AiProgrammerTests/ClassExtractorTests.cs
AiProgrammer/Logging/ISolverProgressLogger.cs
AiProgrammer/Logging/SolverProgressLoggerInIssue.cs
AiProgrammer/Solving/Utils/UnexpectedAiOutputException.cs
AiProgrammer/Solving/GithubIssue/IGithubIssueSolver.cs
AiProgrammer/Solving/GithubIssue/GithubIssueSolverWithMethodSelection.cs
AiProgrammer/Solving/GithubIssue/InIssueNoChangesNotifier.cs
AiProgrammer/Solving/GithubIssue/GithubIssueSolverFileByFile.cs
AiProgrammer/Solving/GithubIssue/IIssueDescriptionProvider.cs
AiProgrammer/Solving/GithubIssue/GithubIssueContextProvider.cs
AiProgrammer/Solving/GithubIssue/IGithubIssueContextProvider.cs
AiProgrammer/Solving/GithubIssue/IssueDescriptionProvider.cs
AiProgrammer/Solving/Steps/Helpers/CurrentStepsHolder.cs
AiProgrammer/Solving/Steps/Helpers/FollowNextStepExecutor.cs
AiProgrammer/Solving/Steps/Helpers/ICurrentStepsHolder.cs
AiProgrammer/Solving/Steps/EntrySteps/StepSolveGithubIssueWithMethodSelection.cs
AiProgrammer/Solving/Steps/EntrySteps/StepSolveGithubIssueFileByFile.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepNotifyAboutPullRequest.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepModifyExistingFilesOneByOne.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepChangeFilesUsingCommands.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepCreateChangesCommands.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepCreatePullRequest.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepSelectMethodsToPreview.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepCreateNewFilesOneByOne.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepSelectFilesToPreview.cs
AiProgrammer/Solving/Steps/ISolverStep.cs
AiProgrammer/Solving/Steps/IStepsCollection.cs
AiProgrammer/Solving/Steps/ISolverStepWithSubsteps.cs
AiProgrammer/Solving/Model/FileAndMethodName.cs
AiProgrammer/Solving/Model/GithubIssueContext.cs
AiProgrammer/Solving/Commands/IModifyCodebaseCommand.cs
AiProgrammer/Github/Issues/IIssueUrlParser.cs
AiProgrammer/Github/Issues/IssueUrlParser.cs
AiProgrammer/Github/Model/IssueInfo.cs
AiProgrammer/Github/Model/RepoInfo.cs
AiProgrammer/Github/Model/RepoName.cs
AiProgrammer/Github/Model/RepoOwner.cs
AiProgrammer/Github/PullRequests/PullRequestCreator.cs
AiProgrammer/Github/GithubServices.cs
AiProgrammer/Github/GithubClientProviderForToken.cs
AiProgrammer/Github/GithubContextClientProvider.cs
AiProgrammer/Github/IGithubClientProviderForToken.cs
AiProgrammer/Github/IGithubContextClientProvider.cs
AiProgrammer/Core/CodeStatics.cs
AiProgrammer/CodeProcessing/IClassExtractor.cs
AiProgrammer/CodeProcessing/ClassExtractorCSharp.cs
AiProgrammer/Extensions/StringExtensions.cs
AiProgrammer/IO/FileContent.cs
AiProgrammer/IO/ProjectContentReader.cs
AiProgrammer/IO/IProjectContentReader.cs
AiProgrammer/IO/FilePath.cs
AiProgrammer/AiInterface/ChatCompletions.cs
AiProgrammer/AiInterface/IChat.cs
AiProgrammer/AiInterface/ICompletions.cs
AiProgrammer/AiProgrammer.csproj.DotSettings
AiProgrammer/AiProgrammerServices.cs
AiProgrammer/AiProgrammer.csproj
LICENSE
global.json
.gitignore
AiProgrammer.sln
Readme.md
AiProgrammer.sln.DotSettings

---

You are currently in step one (1). Please provide a list of files you think will help you the most when solving the problem. List them from most likely to help solve to problem to least likely. Print each path in new line without numerating them. Make sure to always print a full path.
�n

[github-actions]

AI Response

AiProgrammer/Solving/Steps/Helpers/FollowNextStepExecutor.cs

[github-actions]

Sending request to the AI using Chat interface

System message:

You are an AI system that does programming tasks by reading the issue specification and modifying the existing code by changing it or adding new code to resolve the user request. You minimize changes to the code and make sure not to modify anything that the user has not requested. Do not remove classes, methods, or fields - only add or modify existing ones. You will be doing the work in steps. The results of your work will be automatically put on Github. Always print the whole source, never the 'The rest of the class remains unchanged' comment

User Request:

The user request:
Custom system messages
In FollowNextStepExecutor, allow for the default System Message to be overridden from outside.

---

Do this in steps:

1. From a list of files select ones that will be needed to see or modify to program the user request. You will be shown content of those files. You have a limited memory so you will only see the selected ones.
2. Modify selected existing files one by one
3. Create needed new files one by one

You are currently in step 'Modify selected existing files one by one'

Already reviewed files with your own description of what happened:

Files left to review:

Current file path:
AiProgrammer/Solving/Steps/Helpers/FollowNextStepExecutor.cs

Current file content:

using System.Text;
using AiProgrammer.AiInterface;
using AiProgrammer.Solving.GithubIssue;

namespace AiProgrammer.Solving.Steps.Helpers;

public class FollowNextStepExecutor
{
    private readonly ICompletions _completions;
    private readonly IIssueDescriptionProvider _issueDescriptionProvider;
    private readonly ICurrentStepsHolder _currentStepsHolder;

    public FollowNextStepExecutor(ICompletions completions, IIssueDescriptionProvider issueDescriptionProvider,
        ICurrentStepsHolder currentStepsHolder)
    {
        _completions = completions;
        _issueDescriptionProvider = issueDescriptionProvider;
        _currentStepsHolder = currentStepsHolder;
    }
    
    public async Task<string> ExecuteStep(string contentDescription, string content, string currentStepDescription)
    {
        string stepContent = $"{contentDescription}:\n" +
                             $"\n" +
                             $"{content}\n" +
                             $"\n" +
                             $"---" +
                             $"\n" +
                             $"{currentStepDescription}";

        string issueDescription = await _issueDescriptionProvider.GetIssueDescription();

        string systemMessage = GetSystemMessage();
        string userMessage = GetFullUserInput(issueDescription, stepContent);

        return await _completions.GetCompletion(systemMessage, userMessage);
    }
    
    public async Task<string> ExecuteStep(string stepDescription, string prompt)
    {
        string issueDescription = await _issueDescriptionProvider.GetIssueDescription();

        string fullStepPrompt = $"You are currently in step '{stepDescription}'\n" +
                                $"\n" +
                                $"{prompt}";
        
        string systemMessage = GetSystemMessage();
        string userMessage = GetFullUserInput(issueDescription, fullStepPrompt);

        return await _completions.GetCompletion(systemMessage, userMessage);
    }
    
    private string GetFullUserInput(string issueDescription, string stepInstructions)
    {
        return $"{GetMessageTop(issueDescription)}\n" +
               $"\n" +
               $"{stepInstructions}";
    }

    private string GetSystemMessage()
    {
        return "You are an AI system that does programming tasks by reading the issue specification and modifying the existing code by " +
               "changing it or adding new code to resolve the user request. You minimize changes to the code and make sure not to modify " +
               "anything that the user has not requested. Do not remove classes, methods, or fields - only add or modify existing ones. " +
               "You will be doing the work in steps. The results of your work will be automatically put on Github. Always print " +
               "the whole source, never the 'The rest of the class remains unchanged' comment";
    }

    private string GetMessageTop(string issueDescription)
    {
        return $"The user request: \n" +
               $"{issueDescription}\n" +
               $"\n" +
               $"---\n" +
               $"\n" +
               $"{GetStepsDescription()}";
    }

    private string GetStepsDescription()
    {
        IReadOnlyList<ISolverStep> steps = _currentStepsHolder.GetCurrentSteps().Steps;

        StringBuilder stepsDescriptionBuilder = new();
        stepsDescriptionBuilder.AppendLine("Do this in steps:\n");

        int stepNumber = 1;
        
        for (int i = 0; i < steps.Count; i++)
        {
            ISolverStep step = steps[i];

            if (step.ShowInStepsListForModel == false)
            {
                continue;
            }

            stepsDescriptionBuilder.AppendLine($"{stepNumber++}. {step.DescriptionForModel}");
        }

        if (stepNumber == 1)
        {
            throw new Exception("No steps to tell the model");
        }

        return stepsDescriptionBuilder.ToString();
    }
}

Select one command with this parameters to execute:

• next_file [Note to yourself of what you saw that can be useful in next steps to solve the issue
  and when changing or creating next files. Make sure to include all needed information as you won't see this file again and won't remember
  what was inside.] - Do not modify this file and go to the next

• replace_file [(in new line) new content in code block] [short description of what was actually modified and
  why, that can be useful in next steps] - Modify or remove the file by re-writing it's content. Write a short description of what was
  modified, this description will be read only by you when moving to the next file

�n

[github-actions]

AI Response

replace_file

using System.Text;
using AiProgrammer.AiInterface;
using AiProgrammer.Solving.GithubIssue;

namespace AiProgrammer.Solving.Steps.Helpers;

public class FollowNextStepExecutor
{
    private readonly ICompletions _completions;
    private readonly IIssueDescriptionProvider _issueDescriptionProvider;
    private readonly ICurrentStepsHolder _currentStepsHolder;
    private string _customSystemMessage;

    public FollowNextStepExecutor(ICompletions completions, IIssueDescriptionProvider issueDescriptionProvider,
        ICurrentStepsHolder currentStepsHolder)
    {
        _completions = completions;
        _issueDescriptionProvider = issueDescriptionProvider;
        _currentStepsHolder = currentStepsHolder;
        _customSystemMessage = null;
    }
    
    public void SetCustomSystemMessage(string customSystemMessage)
    {
        _customSystemMessage = customSystemMessage;
    }

    public async Task<string> ExecuteStep(string contentDescription, string content, string currentStepDescription)
    {
        string stepContent = $"{contentDescription}:\n" +
                             $"\n" +
                             $"{content}\n" +
                             $"\n" +
                             $"---" +
                             $"\n" +
                             $"{currentStepDescription}";

        string issueDescription = await _issueDescriptionProvider.GetIssueDescription();

        string systemMessage = GetSystemMessage();
        string userMessage = GetFullUserInput(issueDescription, stepContent);

        return await _completions.GetCompletion(systemMessage, userMessage);
    }
    
    public async Task<string> ExecuteStep(string stepDescription, string prompt)
    {
        string issueDescription = await _issueDescriptionProvider.GetIssueDescription();

        string fullStepPrompt = $"You are currently in step '{stepDescription}'\n" +
                                $"\n" +
                                $"{prompt}";
        
        string systemMessage = GetSystemMessage();
        string userMessage = GetFullUserInput(issueDescription, fullStepPrompt);

        return await _completions.GetCompletion(systemMessage, userMessage);
    }
    
    private string GetFullUserInput(string issueDescription, string stepInstructions)
    {
        return $"{GetMessageTop(issueDescription)}\n" +
               $"\n" +
               $"{stepInstructions}";
    }

    private string GetSystemMessage()
    {
        if (_customSystemMessage != null)
        {
            return _customSystemMessage;
        }

        return "You are an AI system that does programming tasks by reading the issue specification and modifying the existing code by " +
               "changing it or adding new code to resolve the user request. You minimize changes to the code and make sure not to modify " +
               "anything that the user has not requested. Do not remove classes, methods, or fields - only add or modify existing ones. " +
               "You will be doing the work in steps. The results of your work will be automatically put on Github. Always print " +
               "the whole source, never the 'The rest of the class remains unchanged' comment";
    }

    private string GetMessageTop(string issueDescription)
    {
        return $"The user request: \n" +
               $"{issueDescription}\n" +
               $"\n" +
               $"---\n" +
               $"\n" +
               $"{GetStepsDescription()}";
    }

    private string GetStepsDescription()
    {
        IReadOnlyList<ISolverStep> steps = _currentStepsHolder.GetCurrentSteps().Steps;

        StringBuilder stepsDescriptionBuilder = new();
        stepsDescriptionBuilder.AppendLine("Do this in steps:\n");

        int stepNumber = 1;
        
        for (int i = 0; i < steps.Count; i++)
        {
            ISolverStep step = steps[i];

            if (step.ShowInStepsListForModel == false)
            {
                continue;
            }

            stepsDescriptionBuilder.AppendLine($"{stepNumber++}. {step.DescriptionForModel}");
        }

        if (stepNumber == 1)
        {
            throw new Exception("No steps to tell the model");
        }

        return stepsDescriptionBuilder.ToString();
    }
}

Added a private field _customSystemMessage and a public method SetCustomSystemMessage to allow for the default System Message to be overridden from outside.

[github-actions]

Sending request to the AI using Chat interface

System message:

You are an AI system that does programming tasks by reading the issue specification and modifying the existing code by changing it or adding new code to resolve the user request. You minimize changes to the code and make sure not to modify anything that the user has not requested. Do not remove classes, methods, or fields - only add or modify existing ones. You will be doing the work in steps. The results of your work will be automatically put on Github. Always print the whole source, never the 'The rest of the class remains unchanged' comment

User Request:

The user request:
Custom system messages
In FollowNextStepExecutor, allow for the default System Message to be overridden from outside.

---

Do this in steps:

1. From a list of files select ones that will be needed to see or modify to program the user request. You will be shown content of those files. You have a limited memory so you will only see the selected ones.
2. Modify selected existing files one by one
3. Create needed new files one by one

You are currently in step 'Create needed new files one by one'

Already reviewed files with your own description of what happened:
AiProgrammer/Solving/Steps/Helpers/FollowNextStepExecutor.cs - modified - Added a private field _customSystemMessage and a public method SetCustomSystemMessage to allow for the default System Message to be overridden from outside.

New files you created:

Select one command with parameters to execute:

• do_not_create_more_files - Use if there is no need to create a new file and move to the next step
• create_new_file [path] [(in new line)new content in code block] [short description of what was created and why] - Create new file by providing its content. Write a short description of what was created, this description will be read only by you when moving to the next step

�n

[github-actions]

AI Response

do_not_create_more_files

[github-actions]

Pull Request created: #6