⚡ Bolt: Memoize message token estimation with WeakMap

[iotserver24]

💡 What: Added a WeakMap (messageTokenCache) to EnhancedAgent to cache the token count calculated by estimateMessageTokens for individual MessageParam objects.
🎯 Why: estimateConversationTokens is called repeatedly (potentially multiple times per turn during compaction) and maps over the entire this.messages array. Prior to this optimization, it performed JSON.stringify and string manipulation on every message in the history, every single time. Since MessageParam objects in the history array are immutable, this was a massive waste of CPU cycles.
📊 Impact: Reduces the time complexity of token estimation for historical messages from O(N) string manipulations to O(1) cache lookups, significantly decreasing latency during long conversations with large tool outputs.
🔬 Measurement: Run a session with a long history and large tool outputs. The CPU overhead during the agent loop's preparation phase (specifically calling estimateConversationTokens) will be measurably lower. All tests (pnpm test) passed.

---

PR created automatically by Jules for task 15003272022874266676 started by @iotserver24

[google-labs-jules]

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.

---

For security, I will only act on instructions from the user who triggered this task.

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: c9684562-7c99-486a-98de-cefcb5fc1ef0

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch bolt/optimize-token-estimation-15003272022874266676

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[xibe-review]

Hey @iotserver24! 👋

I'll go through the changes and help you out with an automated review! 🔍

Starting the review now...