Code

Adding new benchmark - BA-Calendar#58

Code

Open

vidhishanair wants to merge 14 commits intomainmicrosoft/eureka-ml-insights:mainfrom vidhisha/ba_benchmarksmicrosoft/eureka-ml-insights:vidhisha/ba_benchmarksCopy head branch name to clipboard

+875-4

Commits

Commits on Nov 12, 2024

• onboarding calendar planning - pipeline+metrics

  

  Vidhisha Balachandran

  committed
  3a1fd02

  Copy full SHA for 3a1fd02

• Merge branch 'main' into vidhisha/ba_benchmarks

  

  Vidhisha Balachandran

  committed
  26e98d9

  Copy full SHA for 26e98d9

Commits on Dec 1, 2024

• ba-calendar - removing unused imports, needs metric review

  

  Vidhisha Balachandran

  committed
  26f980b

  Copy full SHA for 26f980b

Commits on Dec 9, 2024

• Added HFReader for dataset reading, pipeline tests

  

  Vidhisha Balachandran

  committed
  858bfa4

  Copy full SHA for 858bfa4

• refactor, addressing merge conflicts

  

  Vidhisha Balachandran

  committed
  4e2074a

  Copy full SHA for 4e2074a

• Added comment on ba_calendar_metrics

  

  Vidhisha Balachandran

  committed
  1595e98

  Copy full SHA for 1595e98

Commits on Jan 6, 2025

• Merge branch 'main' into vidhisha/ba_benchmarks

  vidhishanair

  authored
  0d90d78

  Copy full SHA for 0d90d78

• addressed import issue

  

  Vidhisha Balachandran

  committed
  76567ea

  Copy full SHA for 76567ea

• added ba_cal config

  

  Vidhisha Balachandran

  committed
  f333868

  Copy full SHA for f333868

Commits on Jan 15, 2025

• PR Comments, Majority Vote + Best of N Evals

  

  Vidhisha Balachandran

  committed
  36c8a87

  Copy full SHA for 36c8a87

• renamed prompt templates

  

  Vidhisha Balachandran

  committed
  2992d0a

  Copy full SHA for 2992d0a

• Merge branch 'main' into vidhisha/ba_benchmarks

  

  Vidhisha Balachandran

  committed
  82ee932

  Copy full SHA for 82ee932

• refactor configs, add answer extraction for cot setting

  

  Vidhisha Balachandran

  committed
  b1cab65

  Copy full SHA for b1cab65

Commits on Jan 17, 2025

• change NA to none, test fixes

  

  Vidhisha Balachandran

  committed
  b17aefd

  Copy full SHA for b17aefd