LLM tracing in Elastic APM: prompts, responses, and token counts in the span view
Observability Labs
LLM tracing in Elastic APM: prompts, responses, and token counts in the span view
In a twenty-call agentic trace, you can see which span is using the most tokens and read the prompt that caused it. Both live in Elastic APM, so there is no second tool to run.