Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: mongodb-js/mongodb-mcp-server
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: aad10be
Choose a base ref
...
head repository: mongodb-js/mongodb-mcp-server
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: eec80eb
Choose a head ref
  • 16 commits
  • 23 files changed
  • 1 contributor

Commits on Jul 3, 2025

  1. chore: LangChain based accuracy tests

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    7ed01ed View commit details
    Browse the repository at this point in the history

  2. chore: use vercel AI SDK instead of langchain 

    LangChain's ToolCalling agent was not providing a structured tool call
response and different model providers were providing entirely different
tool calls for the same tool definition which was too turbulent for us
to have any accuracy baseline at all.

Vercel's AI SDK pushes us forward on that problem and the tool call
responses so far have always been well structured.

This commit replaces LangChain based implementation with Vercel's AI SDK
based implementation.
    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    19a881e View commit details
    Browse the repository at this point in the history

  3. chore: integrate capturing accuracy snapshots

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    074c3cc View commit details
    Browse the repository at this point in the history

  4. chore: correct env names

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    be684e6 View commit details
    Browse the repository at this point in the history

  5. chore: more consolidated prompt tests

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    e8f6ad3 View commit details
    Browse the repository at this point in the history

  6. chore: add a few more tests and some more models

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    8864134 View commit details
    Browse the repository at this point in the history

  7. chore: add AzureOpenAI model in the model list

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    96dc0ce View commit details
    Browse the repository at this point in the history

  8. chore: use ListDatabasesTool response creator for tests

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    9c23e95 View commit details
    Browse the repository at this point in the history

  9. chore: use ListCollectionsTool response creators in tests

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    532c175 View commit details
    Browse the repository at this point in the history

  10. chore: tests for collection-indexes tool

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    a8f1a0c View commit details
    Browse the repository at this point in the history

  11. modify prompt for list-collections prompt and log tools provided

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    a1c0a49 View commit details
    Browse the repository at this point in the history

  12. chore: have mock generators return Promise of ToolResult as well

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    c416990 View commit details
    Browse the repository at this point in the history

  13. chore: tests for collection-schema tool

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    19da4f9 View commit details
    Browse the repository at this point in the history

  14. chore: do not fail tests on dropped accuracy

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    c753e2c View commit details
    Browse the repository at this point in the history

  15. chore: added tests for find tool

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    323ba95 View commit details
    Browse the repository at this point in the history

  16. chore: quick integration with braintrust sdk

    @himanshusinghs
    himanshusinghs committed Jul 3, 2025
    Configuration menu
    Copy the full SHA
    eec80eb View commit details
    Browse the repository at this point in the history
Loading