docs/how_to/trim_messages/

[giscus[bot]]

docs/how_to/trim_messages/

This guide assumes familiarity with the following concepts:

https://python.langchain.com/docs/how_to/trim_messages/

[antoremin]

Any advice on how to use token counter = llm when trimming messages with tools calls? Getting this

BadRequestError: Error code: 400 - {'type': 'error', 'error': {'type': 'invalid_request_error', 'message': 'prompt is too long: 203961 tokens > 200000 maximum'}}

[yuchuxiang]

Hello, I try to trim the SQLChatMessageHistory, as you can see the code in the below:

def get_session_history(user_id: str, conversation_id: str) -> BaseChatMessageHistory:
target_session_id = f"{user_id}_{conversation_id}"
db_name = f"sqlite:///{user_id}.db"
chat_history = SQLChatMessageHistory(
session_id=target_session_id, connection=db_name
)
return chat_history

    with_message_history = RunnableWithMessageHistory(
        rag_chain,
        get_session_history,
        input_messages_key="question",
        history_messages_key="history",
        history_factory_config=[
            ConfigurableFieldSpec(
                id="user_id",
                annotation=str,
                name="User ID",
                description="Unique identifier for the user.",
                default="",
                is_shared=True,
            ),
            ConfigurableFieldSpec(
                id="conversation_id",
                annotation=str,
                name="Conversation ID",
                description="Unique identifier for the conversation.",
                default="",
                is_shared=True,
            ),
        ],
    )

the return chat_history is a SQLChatMessageHistory class variable, and is there a way to trim it?