Improve compact

[aibrahim-oai]

This PR does the following:

• Add compact prefix to the summary
• Change the compaction prompt
• Allow multiple compaction for long running tasks
• Filter out summary messages on the following compaction

Considerations:

• Filtering out the summary message isn't the most clean
• Theoretically, we can end up in infinite compaction loop if the user messages > compaction limit . However, that's not possible in today's code because we have hard cap on user messages.
• We need to address having multiple user messages because it confuses the model.

Testing:

• Making sure that after compact we always end up with one user message (task) and one summary, even on multiple compaction.

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".