Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add faithfulness metric based on Bespoke Labs MiniCheck model #1269

Open
wants to merge 25 commits into
base: main
Choose a base branch
from
Open

feat: add faithfulness metric based on Bespoke Labs MiniCheck model #1269

wants to merge 25 commits into from

Commits on Sep 10, 2024

  1. first draft for ragas minicheck faithfulness

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    1308b3f View commit details
    Browse the repository at this point in the history

  2. fix deps

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    2d99947 View commit details
    Browse the repository at this point in the history

  3. more fixes

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    38bd165 View commit details
    Browse the repository at this point in the history

  4. faithfulness fix

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    27b050d View commit details
    Browse the repository at this point in the history

  5. more faithfulness fix

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    b6d752f View commit details
    Browse the repository at this point in the history

  6. add api support

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    8b75541 View commit details
    Browse the repository at this point in the history

  7. fix formatting

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    3b03d38 View commit details
    Browse the repository at this point in the history

  8. more fixes

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    09e6f63 View commit details
    Browse the repository at this point in the history

  9. fix ci line

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    a8329fa View commit details
    Browse the repository at this point in the history

  10. fix

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    040162b View commit details
    Browse the repository at this point in the history

  11. local import

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    71e3794 View commit details
    Browse the repository at this point in the history

  12. docs

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    424496c View commit details
    Browse the repository at this point in the history

  13. fix formatting

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    67bf5d4 View commit details
    Browse the repository at this point in the history

  14. fix deletion

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    22162a7 View commit details
    Browse the repository at this point in the history

  15. Merge branch 'main' into main

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    895405f View commit details
    Browse the repository at this point in the history

  16. fix optional dep

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    d4d3185 View commit details
    Browse the repository at this point in the history

  17. add trust_remote_code to tokenizer

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    8084c06 View commit details
    Browse the repository at this point in the history

  18. correct variable naming in minicheck example

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    1cecb3e View commit details
    Browse the repository at this point in the history

  19. fix docs to include grouth truth from new api

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    98bd803 View commit details
    Browse the repository at this point in the history

  20. remove yes_token

    @vutrung96
    vutrung96 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    41b3691 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. fix lint

    @vutrung96
    vutrung96 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    5b169cf View commit details
    Browse the repository at this point in the history

  2. fix type

    @vutrung96
    vutrung96 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    1a11d01 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. add requirements to dev

    @vutrung96
    vutrung96 committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    0b194ff View commit details
    Browse the repository at this point in the history

  2. add sentence piece

    @vutrung96
    vutrung96 committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    e865c00 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Merge branch 'main' into main

    @jjmachan
    jjmachan committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f377620 View commit details
    Browse the repository at this point in the history