modifications/additions to llm_qa_direct_only and parse_scenario_womd. also incorporating grade files and corresponding generated graphs - #6

Open

dataei wants to merge 49 commits into

mainfrom

Commits on Feb 26, 2025

first

dataei
authored and
Denise Ataei
committed
78c94b1
k

dataei
authored and
Denise Ataei
committed
e14c62d
merge conflicts
Denise Ataei
committed
6810c58
merge conflicts
Denise Ataei
committed
7035d96

Commits on Feb 27, 2025

comment test
Denise Ataei
committed
c962628

Commits on Feb 28, 2025

first

dataei
authored and
Denise Ataei
committed
9d54926
k

dataei
authored and
Denise Ataei
committed
0792497
merge conflicts
Denise Ataei
committed
bdd9789
merge conflicts
Denise Ataei
committed
e6735bb
comment test
Denise Ataei
committed
cea730b
first

dataei
authored and
Denise Ataei
committed
b963219
modifying to deepinfra instead of deepseek and changed file path to training
Denise Ataei
committed
cea0646
debugging with print statements, planning direct prompting variables 2,4,6shot
Denise Ataei
committed
97bbf86
added 2,4,6,8 shot direct prompting and moved writing script out of for loop to prevent repeated output in llm_qa_direct_only.py. changed index in run_experiments.py to work with 8 interaction scen…
Denise Ataei
committed
9f1cefe
Merge branch 'dev_denise' of https://github.com/AugmentedDesignLab/CarPlanningProblemGen into dev_denise
Denise Ataei
committed
a60c014

Commits on Mar 8, 2025

Modifications to model names and corresponding evals can now be completed easily.

ishaan95
authored and
Denise Ataei
committed
f893f7e
added 2,4,6,8 shot direct prompting and moved writing script out of for loop to prevent repeated output in llm_qa_direct_only.py. changed index in run_experiments.py to work with 8 interaction scen…
Denise Ataei
committed
fca4c75
syntax conflict
Denise Ataei
committed
faf4d9b
llm_qa_direct_only: added to model dictionary, incorporated CoT prompting 2,4,6shot under generate_qa_prompt, and modified graph titles within main. parse_scenario_womd: called obtain_andwrite_mcq_…
Denise Ataei
committed
70e49e9

Commits on Mar 23, 2025

ran more experiments to find pattern in small, medium, large file sizes with gpt4o-mini in addition to creating draft of script comparing experiment results in bar chart
Denise Ataei
committed
6cab612

Commits on Mar 25, 2025

Commits on Mar 26, 2025

latest
ishaan95
committed
5e5df63
merge dev_denise with dev_Ishaan
ishaan95
committed
e4bc684
Removing planner import
ishaan95
committed
a28cb92

Commits on Mar 27, 2025

Commits on Apr 8, 2025

add grades folder to gitignore
ishaan95
committed
19717bc
merge conflict resolution
ishaan95
committed
1626387
merge conflict resolution
ishaan95
committed
4e1e3ac

Commits on Apr 9, 2025

Commits on Apr 10, 2025

reorganizing files and adding boxplots + creation script. fixed sizing parameters in parse scenario womd.
Denise Ataei
committed
857da20

Commits on Apr 22, 2025

embedding space analysis, parallel experiments
ishaan95
committed
7f28e5b

Commits on Apr 23, 2025

Modifications to model names and corresponding evals can now be completed easily.

ishaan95
authored and
Denise Ataei
committed
fb99033
latest

ishaan95
authored and
Denise Ataei
committed
28845b5
Removing planner import

ishaan95
authored and
Denise Ataei
committed
a8986fa
add grades folder to gitignore

ishaan95
authored and
Denise Ataei
committed
442fea4
Calculate the most similar scenarios to a given index

ishaan95
authored and
Denise Ataei
committed
c46ae04
Search similar scenarios to a specific index and with respect to a given range

ishaan95
authored and
Denise Ataei
committed
96c7cf7
embedding space analysis, parallel experiments

ishaan95
authored and
Denise Ataei
committed
d4f00ef
experimenting w/ llm as a judge prompting
Denise Ataei
committed
92e1495
placed data collection outside of project folder
Denise Ataei
committed
ccab94d
renamed box plotting script, added negative prompting (concise) to run 60 experiments
Denise Ataei
committed
b1c953c
modifications to negative prompting
Denise Ataei
committed
9d8a5de
merge commit
ishaan95
committed
3ae34b1

Commits on Apr 24, 2025

Reorganized the llm evaluation script
ishaan95
committed
38abeb5

Commits on Apr 30, 2025

modified parse scenario to my file path
Denise Ataei
committed
7cd3f39
lecturing prompting has been added. PDDL testing for the latest version of the code has been done.

ishaan95
authored and
Denise Ataei
committed
38e7009