Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: stephenleo/llm-structured-output-benchmarks
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.0.2
Choose a base ref
...
head repository: stephenleo/llm-structured-output-benchmarks
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Choose a head ref
  • 19 commits
  • 43 files changed
  • 3 contributors

Commits on Jul 20, 2024

  1. update LMFE to 0.10.4

    @stephenleo
    stephenleo committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    9bc2b34 View commit details
    Browse the repository at this point in the history

  2. updating to gpt-40-mini and adding modelsmith

    @stephenleo
    stephenleo committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    e8e6617 View commit details
    Browse the repository at this point in the history

  3. moving multilabel_classification results

    @stephenleo
    stephenleo committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    f5ad39c View commit details
    Browse the repository at this point in the history

  4. adding NER

    @stephenleo
    stephenleo committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    31eb63f View commit details
    Browse the repository at this point in the history

  5. minor bug fix

    @stephenleo
    stephenleo committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    e76e6d7 View commit details
    Browse the repository at this point in the history

  6. minor formatting fix

    @stephenleo
    stephenleo committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    221ea35 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. NER bug fix, updating NER frameworks

    @stephenleo
    stephenleo committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    5d9c85f View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2024

  1. adding vanilla openai with structured outputs

    @stephenleo
    stephenleo committed Aug 24, 2024
    Configuration menu
    Copy the full SHA
    9ad6673 View commit details
    Browse the repository at this point in the history

  2. adding synthetic data generation

    @stephenleo
    stephenleo committed Aug 24, 2024
    Configuration menu
    Copy the full SHA
    a6cd3ae View commit details
    Browse the repository at this point in the history

  3. correcting metrics

    @stephenleo
    stephenleo committed Aug 24, 2024
    Configuration menu
    Copy the full SHA
    4960aaa View commit details
    Browse the repository at this point in the history

  4. minor bug fix

    @stephenleo
    stephenleo committed Aug 24, 2024
    Configuration menu
    Copy the full SHA
    595ddf8 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2024

  1. updating mirascope to v1

    @stephenleo
    stephenleo committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    de14792 View commit details
    Browse the repository at this point in the history

  2. metrics update 2024-08-25

    @stephenleo
    stephenleo committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    25549cc View commit details
    Browse the repository at this point in the history

  3. minor readme update

    @stephenleo
    stephenleo committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    2576774 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2024

  1. Outlines: add json_schema and max_length 

    Following LMFormatEnforcer, add for Outlines:

- `json_schema` to prompts
- `max_length` to model settings
    @adrianeboyd
    adrianeboyd committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    d9fdba8 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. updating metrics for Outlines

    @stephenleo
    stephenleo committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    93c0e9f View commit details
    Browse the repository at this point in the history

  2. Merge pull request #3 from adrianeboyd/outlines-add-json-schema-max-l… 

    …ength

Outlines: add json_schema and max_length
    @stephenleo
    stephenleo authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    6fefff2 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #6 from stephenleo/outlines-add-json-schema-max-le… 

    …ngth

updating metrics for Outlines
    @stephenleo
    stephenleo authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    19eb2db View commit details
    Browse the repository at this point in the history

  4. updating requirements

    @stephenleo
    stephenleo committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    8090959 View commit details
    Browse the repository at this point in the history
Loading