Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: bigcode-project/bigcodebench
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.2.1.post3
Choose a base ref
...
head repository: bigcode-project/bigcodebench
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v0.2.1.post7
Choose a head ref
  • 10 commits
  • 10 files changed
  • 1 contributor

Commits on Dec 12, 2024

  1. fix: pass calibrated into gradio api

    @terryyz
    terryyz authored Dec 12, 2024
    Configuration menu
    Copy the full SHA
    992fc34 View commit details
    Browse the repository at this point in the history

  2. update docker files

    @terryyz
    terryyz committed Dec 12, 2024
    Configuration menu
    Copy the full SHA
    d92b012 View commit details
    Browse the repository at this point in the history

  3. update running example

    @terryyz
    terryyz committed Dec 12, 2024
    Configuration menu
    Copy the full SHA
    201c236 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2024

  1. fix: add transformers req

    @terryyz
    terryyz committed Dec 20, 2024
    Configuration menu
    Copy the full SHA
    86c05cf View commit details
    Browse the repository at this point in the history

  2. update docker

    @terryyz
    terryyz committed Dec 20, 2024
    Configuration menu
    Copy the full SHA
    90adab8 View commit details
    Browse the repository at this point in the history

  3. fix (evaluate): update gt checking

    @terryyz
    terryyz committed Dec 20, 2024
    Configuration menu
    Copy the full SHA
    66d9499 View commit details
    Browse the repository at this point in the history

  4. fix(generate): rm temperature for o1

    @terryyz
    terryyz committed Dec 20, 2024
    Configuration menu
    Copy the full SHA
    e264513 View commit details
    Browse the repository at this point in the history

  5. fix(generate): rm max output tokens

    @terryyz
    terryyz committed Dec 20, 2024
    Configuration menu
    Copy the full SHA
    e380adf View commit details
    Browse the repository at this point in the history

  6. fix(evaluate): postprocess the concurrent outputs for o1

    @terryyz
    terryyz committed Dec 20, 2024
    Configuration menu
    Copy the full SHA
    ba18aaf View commit details
    Browse the repository at this point in the history

  7. fix(generate): use 2nd part for gemini thinking models

    @terryyz
    terryyz committed Dec 20, 2024
    Configuration menu
    Copy the full SHA
    fd3cbc8 View commit details
    Browse the repository at this point in the history
Loading