How to print more logs when agent running?

[Guanwei1989]

The default log is too less, I want to see more detail logs, such as prompt, completions, etc. is there any way can do it?

[ekzhu]

Use the EVENT_LOGGER_NAME and TRACE_LOGGER_NAME in the Core. It contains all the model client call events.

https://microsoft.github.io/autogen/stable/user-guide/core-user-guide/framework/logging.html

[Guanwei1989]

I tried use TRACE_LOGGER_NAME and EVENT_LOGGER_NAME according to guideline, but it doesn't work.

import logging

from autogen_core import TRACE_LOGGER_NAME

logging.basicConfig(level=logging.WARNING)
logger = logging.getLogger(TRACE_LOGGER_NAME)
logger.setLevel(logging.DEBUG)

import logging
from dataclasses import dataclass

@dataclass
class MyEvent:
    timestamp: str
    message: str

class MyHandler(logging.Handler):
    def __init__(self) -> None:
        super().__init__()

    def emit(self, record: logging.LogRecord) -> None:
        try:
            # Use the StructuredMessage if the message is an instance of it
            if isinstance(record.msg, MyEvent):
                print(f"Timestamp: {record.msg.timestamp}, Message: {record.msg.message}")
        except Exception:
            self.handleError(record)

logger = logging.getLogger(EVENT_LOGGER_NAME)
logger.setLevel(logging.INFO)
my_handler = MyHandler()
logger.handlers = [my_handler]

The output still as following:

Enter a message (type 'exit' to leave): What is the capital of France
---------- user ----------
What is the capital of France
---------- weather_agent ----------
The capital of France is Paris.

I want to see more detail to understand what happening in the running process, such as the prompt and GAI completion, and how to make decision for handoff in multi-agents?

[ekzhu]

You didn't register a handler.

import asyncio
import logging
from autogen_core import EVENT_LOGGER_NAME
from autogen_agentchat.agents import AssistantAgent
from autogen_agentchat.messages import TextMessage
from autogen_core import CancellationToken
from autogen_core.memory import ListMemory, MemoryContent
from autogen_ext.models.openai import OpenAIChatCompletionClient

logger = logging.getLogger(EVENT_LOGGER_NAME)
logger.addHandler(logging.StreamHandler())
logger.setLevel(logging.DEBUG)

async def main() -> None:
    # Create a model client.
    model_client = OpenAIChatCompletionClient(
        model="gpt-4o-mini",
        # api_key = "your_openai_api_key"
    )

    # Create a list-based memory with some initial content.
    memory = ListMemory()
    await memory.add(MemoryContent(content="User likes pizza.", mime_type="text/plain"))
    await memory.add(MemoryContent(content="User dislikes cheese.", mime_type="text/plain"))

    # Create an AssistantAgent instance with the model client and memory.
    agent = AssistantAgent(
        name="assistant",
        model_client=model_client,
        memory=[memory],
        system_message="You are a helpful assistant.",
    )

    response = await agent.on_messages(
        [TextMessage(content="One idea for a dinner.", source="user")], CancellationToken()
    )
    print(response.chat_message.content)  # type: ignore


asyncio.run(main())

{"type": "LLMCall", "messages": [{"content": "You are a helpful assistant.", "role": "system"}, {"content": "One idea for a dinner.", "role": "user", "name": "user"}, {"content": "\nRelevant memory content (in chronological order):\n1. User likes pizza.\n2. User dislikes cheese.\n", "role": "system"}], "response": {"id": "chatcmpl-B3a0ZJ4WwrLmgPk2PWNH5KJyaD2jt", "choices": [{"finish_reason": "stop", "index": 0, "logprobs": null, "message": {"content": "How about a delicious pizza with a twist? You can make a cheese-less pizza topped with your favorite veggies and a flavorful sauce. \n\nFor the base, you can use a premade crust or make your own using flour and water. Top it with tomato sauce (or a pesto if you like), and then load it up with toppings like bell peppers, mushrooms, olives, spinach, and any other veggies you enjoy. You can also add some protein like grilled chicken or pepperoni for extra flavor. \n\nFinish it off with some herbs like basil or oregano for added depth. Bake it until the crust is crispy, and you have a delightful cheese-less dinner that you\u2019ll love!", "refusal": null, "role": "assistant", "audio": null, "function_call": null, "tool_calls": null}}], "created": 1740193099, "model": "gpt-4o-mini-2024-07-18", "object": "chat.completion", "service_tier": "default", "system_fingerprint": "fp_06737a9306", "usage": {"completion_tokens": 137, "prompt_tokens": 49, "total_tokens": 186, "completion_tokens_details": {"accepted_prediction_tokens": 0, "audio_tokens": 0, "reasoning_tokens": 0, "rejected_prediction_tokens": 0}, "prompt_tokens_details": {"audio_tokens": 0, "cached_tokens": 0}}}, "prompt_tokens": 49, "completion_tokens": 137, "agent_id": null}
How about a delicious pizza with a twist? You can make a cheese-less pizza topped with your favorite veggies and a flavorful sauce. 

For the base, you can use a premade crust or make your own using flour and water. Top it with tomato sauce (or a pesto if you like), and then load it up with toppings like bell peppers, mushrooms, olives, spinach, and any other veggies you enjoy. You can also add some protein like grilled chicken or pepperoni for extra flavor. 

Finish it off with some herbs like basil or oregano for added depth. Bake it until the crust is crispy, and you have a delightful cheese-less dinner that you’ll love!

[ekzhu]

Updated logging docs for AgentChat #5655

[Guanwei1989]

It works now, thank you very much