-
Notifications
You must be signed in to change notification settings - Fork 928
Add Server Instructions content #1334
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Add Server Instructions content #1334
Conversation
… and adding a specific example for implementing server instructions
docs/clients.mdx
Outdated
| [TheiaAI/TheiaIDE][TheiaAI/TheiaIDE] | ❌ | ❌ | ✅ | ❓ | ❌ | ❌ | ❓ | ❌ | | ||
| [Tome][Tome] | ❌ | ❌ | ✅ | ❓ | ❌ | ❌ | ❓ | ❌ | | ||
| [TypingMind App][TypingMind App] | ❌ | ❌ | ✅ | ❓ | ❌ | ❌ | ❓ | ❌ | | ||
| [VS Code GitHub Copilot][VS Code] | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we support it :) microsoft/vscode-copilot-chat#491
| [VS Code GitHub Copilot][VS Code] | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | | |
| [VS Code GitHub Copilot][VS Code] | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | |
- [ ] Add edit/disable capabilities | ||
- [ ] Log instruction usage | ||
- [ ] Set reasonable length limits | ||
- [ ] Sanitize before prompt injection |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm not necessarily sure if server instructions need special treatment here. Prompt injection is also possible and demonstrated using tool descriptions themselves, so as a client developer do instructions need to be treated any different than tools?
|
||
- 'Tool C should always be used after tool A and B' | ||
- 'This Prompt or Tool works best if specialized tools from other servers X and Y are available' | ||
- 'All Tools are rate limited to 10 requests per minute' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's up to the client how to present the instructions, but I could see cases where the LM could get confused about the context of "all tools", perhaps we should recommend that instead the statement is something like "Server A tools are rate limited to 10 requests per minute"
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Some edits.
Co-authored-by: Den Delimarsky <hi@den.dev>
Co-authored-by: Den Delimarsky <hi@den.dev>
Co-authored-by: Den Delimarsky <hi@den.dev>
Co-authored-by: Den Delimarsky <hi@den.dev>
Co-authored-by: Den Delimarsky <hi@den.dev>
Co-authored-by: Den Delimarsky <hi@den.dev>
Co-authored-by: Den Delimarsky <hi@den.dev>
Co-authored-by: Den Delimarsky <hi@den.dev>
Co-authored-by: Den Delimarsky <hi@den.dev>
Co-authored-by: Den Delimarsky <hi@den.dev>
Co-authored-by: Den Delimarsky <hi@den.dev>
Co-authored-by: Den Delimarsky <hi@den.dev>
…/modelcontextprotocol into add-server-instructions
Co-authored-by: Den Delimarsky <hi@den.dev>
I was originally going to post a personal blog and make some tweaks to docs related to Server Instructions, but thought it could be better to add an official blog post as a followup from the Prompts post.
Some of this could go into other parts of the documentation instead. Sharing what I have so far here to get feedback and suggestions.
Motivation and Context
More clients are starting to add support for this feature, and it relates to a lot of use cases I've seen discussed. A few of them are here, but its not totally exhaustive.
How Has This Been Tested?
N/A
Breaking Changes
N/A
Types of changes
Checklist
Additional context
VSCode is going to release this feature soon, so @dend maybe something like this could be coordinated for when that release happens? (I believe its only in Insiders so far?)