Skip to content

[bot] Letta (agent execution SDK) not instrumented #569

Description

@braintrust-bot

Summary

Letta (formerly MemGPT) is a stateful agent execution framework with an official Python client SDK, maintained at https://github.com/letta-ai/letta with docs at https://docs.letta.com. Sending a message to a running Letta agent triggers multi-step reasoning, tool calls, and memory operations — an agent-run execution surface comparable in scope to other agent frameworks this repo already instruments (crewai, autogen, agno, strands, agentscope).

This repo does not instrument Letta anywhere: no py/src/braintrust/integrations/letta* directory, no wrapper, no nox session, no cassette, no README entry, and no mention in py/pyproject.toml's [tool.braintrust.matrix].

Braintrust docs status: not_found. https://www.braintrust.dev/docs/guides/tracing does not mention Letta or MemGPT among its supported frameworks list.

What needs to be instrumented

The primary execution entrypoint is sending a message to an agent:

  • client.agents.messages.create(agent_id, input=..., messages=[...]) — synchronous, POST /v1/agents/{agent_id}/messages
  • streaming variant (streaming=True, SSE) for token/step streaming

The response is a LettaResponse containing a messages array of typed steps (ReasoningMessage, ToolCallMessage, ToolReturnMessage, AssistantMessage, etc.), usage (LettaUsageStatistics), and stop_reason — a rich multi-step agent trace analogous to what other agent-framework integrations in this repo already capture as nested spans.

Upstream sources

Local repo files inspected

  • py/src/braintrust/integrations/ — no letta directory
  • Repo-wide grep for letta (case-insensitive) under py/src/braintrust/ — zero matches
  • README.md integrations table — no Letta/MemGPT entry
  • py/pyproject.toml [tool.braintrust.matrix] — no letta key

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions