Skip to content

Update incontext to latest #48

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
cfunk1210 wants to merge 644 commits into
base: dev/incontext
Choose a base branch
from
Open

Update incontext to latest #48

cfunk1210 wants to merge 644 commits into from

Conversation

@cfunk1210
Copy link

@cfunk1210 cfunk1210 commented Apr 24, 2024

No description provided.

jadie1 and others added 30 commits December 6, 2024 14:31
@jadie1
Adding relevance oracle for scalar targets
3e8500f
@jadie1
Adding eps to avoid zero division
7ad9c83
@jadie1
Adding zero-shot relevance comp. reg. ADM
9ad7d23
@jadie1
Adding optional zero-shot relevance prediction to comp. reg. ADM
8aa1110
@jadie1
Adding binary ICL for relevance
2b79246
@jadie1
Switching relevance prediciton to be yes/no
5db72cc
@jadie1
Expanding relevance ICL and adding relevance reasoning to justification
c0fb371
@eveenhuis @dmjoy
Add multi-KDMA targets for testing
1952bab
@jadie1
Adding relevance oracle for scalar targets
7a1a043
@jadie1
Adding eps to avoid zero division
5fc47c9
@jadie1
Adding zero-shot relevance comp. reg. ADM
906c965
@jadie1
Adding optional zero-shot relevance prediction to comp. reg. ADM
6904bf2
@jadie1
Adding binary ICL for relevance
0e09ae1
@jadie1
Switching relevance prediciton to be yes/no
32743e1
@jadie1
Expanding relevance ICL and adding relevance reasoning to justification
a0ae246
@jadie1
Merge branch 'dev/relevance' of https://github.com/ITM-Kitware/align-…
d7dbf15 
…system into dev/relevance
@jadie1
Removing one-step relevance prediction
658c925
@jadie1
Adding relevance alingment function to hybrid kaleido ADM
e033dbc
@dmjoy
Initial working version of outlines based personas ADM
f3bdbe7
@dmjoy
Add configs for outlines based personas ADM
a86c507
@dmjoy
Quickfix for ingroup bias in KDMA_TO_PROBE_MAPPING
c9cefb1
@dmjoy
Add basic support for backstory selection from distribution target
bc46184
@dmjoy
Fix issue with scalar alignment target backstory selection
d4abcf5 
Were considering KDMAs (probes) outside of the KDMAs of interest for
the target (by defaulting to a value of 0)
@dmjoy
Raise an error if we get an unexpected alignment target type
6521bf4
@dmjoy
Update CHANGELOG wrt added outlines based persona ADM
e92eac0
@jadie1
Adding phase1 train files
bfec733
@jadie1
Small fixes
f033a10
@jadie1
Merging with main
0760e21
@jadie1
Updating ST ICL files
c3b443d
@jadie1
Adding distribution alignment with relevance
ff4bc14
dmjoy and others added 30 commits September 10, 2025 16:42
@dmjoy
Update old alignment target files to point at backward compatible dat…
a81c572 
…a model
@dmjoy
Update integration test expected output for relevance representation …
16e234a 
…update
@dmjoy
Update prompt-based integration test
2b1b975
@dmjoy
Use local backward compatible TA3 models with random_adm
f8cb75f
@dmjoy
Update dict check to cover omegaconf's DictConfig
2a10274
@eveenhuis
Add alignment info to choice_info
7228bd7
@eveenhuis
Add source to alignment info
fd02003
@eveenhuis
Merge pull request #247 from ITM-Kitware/dev/alignment_info
331e594 
Add alignment info to choice_info
@barry-ravichandran
DecisionFlow integration (#223)
b742fe9 
* Initial commit for DecisionFlow integration

* VariablesExtractionComponent integration

* Extraction Stage Component

* Attribute Stage Component

* Filter Stage Component

* Objective Stage Component

* Final Express Stage Component

* Final Math Reason and action choice components

* Refactor DecisionFlow stages to support both Ph1 and Ph2 alignment tgt APIs

* Switch to low-temp multinomial sampler and constrain generator tokens

* Add attribute config files for NAACL24 MTA dataset

* Update exp and inference configs and clean-up redundant files

* Add default value for max_generator_tokens in outlines_inference_engine
@dmjoy
Initial cut at "driver" component refactor
3256414
@dmjoy
Quick fixes for driver script refactor
079efaa
@dmjoy
Updated expected outputs for some test (random choice answers changing)
0b3210c
@dmjoy
Remove cli_parser methods from interfaces (very deprecated)
30a0ad3
@dmjoy
Remove lots of old code from before hydra/outlines (NAACL paper era)
a87c6ed
@dmjoy
Remove the 'tags' property from Dialog (was unused)
bcf7511
@dmjoy
Remove deprecated Dialog "tags" from decisionflow components
6b4d972
@dmjoy
Remove older (hybrid) kaleido implementation and integration test
e51e75d
@dmjoy
Add direct medical regression component and pipeline
5b78a2e
@dmjoy
Add direct regression ADM component (not just medical)
0e6f01f
@dmjoy
Remove medical only direct regression adm component
bc00c15
@dmjoy
Config refactoring for direct regression
d9cce0e
@dmjoy
Add some direct regression support for search and personal safety
8b1483a
@dmjoy
Update direct regression medical system prompt
82a528c
@dmjoy
Misc tweaks / fixes wrt cleanup and driver refactor
31e8073
@dmjoy
Fix driver.apply_action_filtering setting wrt driver refactor
871e6a8
@barry-ravichandran @dmjoy
DecisionFlow: Added unstructured objective function json parsing and …
cfba663 
…json retry util functions
@dmjoy
Simple update to add per-step timing info for pipeline ADM
7705074
@barry-ravichandran @dmjoy
Add SceneSkipException for DecisionFlow implementation
09564ee
@dmjoy
Support str system prompt for baseline; add baseline sys prompt exper…
913d54c 
…iments
@dmjoy
Update alternate baseline run configs for live eval
a1a255b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

8 participants

@cfunk1210 @jadie1 @eveenhuis @dmjoy @barry-ravichandran @PaulHax @DennisMelamedKitware