Agentic memory #5227

rickyloynd-microsoft · 2025-01-28T01:47:21Z

Adds a baseline implementation of agentic memory to the autogen-ext package.

For technical details, see the Agentic Memory README.

To see it in action, view the page logs generated while running the code samples.

This PR is a draft pending a few remaining items in-progress:

Unit tests
Full documentation
Lint & format fixes
Potential usage of autogen-core/memory

Make memory optional. Filter out insights with negative scores.

Refactor memory paths. Enrich page logging.

Seed messages with random int for variability.

Save sessions as yaml for readability.

Eval simplifications.

…ions.

…ified in settings.

python/packages/autogen-ext/imgs/agentic_memory.png

python/packages/autogen-ext/src/autogen_ext/agentic_memory/README.md

python/packages/autogen-ext/pyproject.toml

python/packages/autogen-ext/src/autogen_ext/agentic_memory/agent_wrapper.py

python/packages/autogen-ext/src/autogen_ext/agentic_memory/agentic_memory_controller.py

python/packages/autogen-ext/src/autogen_ext/agentic_memory/apprentice.py

python/packages/autogen-ext/src/autogen_ext/agentic_memory/page_logger.py

python/packages/autogen-ext/src/autogen_ext/agentic_memory/_agentic_memory_bank.py

python/samples/agentic_memory/settings/self_teaching.yaml

ekzhu · 2025-01-29T08:44:57Z

I haven't gone deep into the implementation logics, but I believe from just API level, we need to work on it to make sure it aligns with the rest of the framework. E.g., serializable configuration is already supported, and we should be using that. TaskRunner protocol is already there, and we should be using that. BaseChatAgent already provides an agent abstraction, and we should be using that as well.

jackgerrits

This PR is simply too large. Please propose your changes progressively and iteratively using a separate sequence of PRs. We cannot effectively review these changes as is.

…entic_memory

ekzhu · 2025-01-30T04:26:05Z

@jackgerrits we will be refactoring this in the current branch first

…er agent.

rickyloynd-microsoft added 30 commits November 29, 2024 12:31

initial checkin

442a9d8

support for extensive evaluations

f8584cd

Enhance retrieval with task generalization and insight validation

607e7ff

Support TRAPI client.

b045636

Make memory optional. Filter out insights with negative scores.

Restoring earlier results, and general cleanup.

63b28d7

Merge branch 'refs/heads/main' into agentic_memory

b921d83

Modify imports after merge from main.

9dfb074

Log model and token counts.

93a5ca4

Only instantiate the client once.

2cb9344

Fix bug that was duplicating insights across trials.

878f458

Add the Grader class.

21562f1

Refactor memory paths. Enrich page logging.

Adjustments for comparison tests.

3a40b30

Test generalization over multiple tasks.

8622c5e

Add teachability and a test for it.

20b26c1

Learning from demonstration, in-progress.

9d47227

In memory retrieval, validate insights separately rather than together.

52d4e00

Finish learning from demonstration.

6b15777

Seed messages with random int for variability.

Added RecordableChatCompletionClient as a guardrail during refactoring.

a18674c

Ran 3 evals with session recording and replay.

52e213e

Add results to recorded sessions, including session length.

a440b0a

Save sessions as yaml for readability.

Use yaml file for eval settings.

cab51f1

Simplify paths and other settings.

d91e58c

Renamed the memory classes.

f1d7a2f

Apprentice.

17d4c42

Eval simplifications.

Moved test into the evaluator, and removed eval.py's other util funct…

19654e8

…ions.

renaming

7aa20c1

Rerouted calls to AgenticMemoryController through FastLearner.

83a7ddc

Replace task_assignment_callback with AgentWrapper.

3047c1c

Segregate files into subfolders, eval framework vs. implementation, etc.

1f20b79

Rename FastLearner subclass to Apprentice, and import it only as spec…

de4c12b

…ified in settings.

rickyloynd-microsoft added 3 commits January 27, 2025 16:55

readme files

87ee27b

readme files

b21d140

remove ame

1e88eb6

rickyloynd-microsoft requested review from ekzhu, victordibia, rysweet and husseinmozannar January 28, 2025 01:47

rickyloynd-microsoft added 5 commits January 28, 2025 09:57

readme

a3addc1

comment out api_key lines

c6ffa43

Optional disabling of prefix caching (to decorrelate repeated runs)

8f66612

Merge branch 'refs/heads/main' into agentic_memory

491964f

Remove unnecessary instantiation of Grader

2ed08ae