Skip to content

Added script to invoke alpaca model #273

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 2 commits into from
Closed

Added script to invoke alpaca model #273

wants to merge 2 commits into from

Conversation

nullhook
Copy link

@nullhook nullhook commented Mar 18, 2023 •
edited
Loading

Resolves #240

WIP

This needs to be able to:

  1. Configure custom model folders.
  2. Adjust settings for running variants of the Alpaca model and make corresponding changes in the C++ side.
  3. Provide the ability to configure parameters.
  4. Possibly hide the extraneous template it returns.
  5. Ability to run interactive mode

@ggerganov
Copy link
Member

I made some changes to on master already to support the interactive mode where we inject ### Instruction: prefix and ### Response: suffix in the input. I don't know if this is really needed, but this is what the alpaca.cpp guys are using, so I added it.

I think our original --interactive mode actually works better, but don't have too much evidence.

If you adapt this python script to the new changes and update the README with usage instruction - we can merge.

@gjmulder gjmulder added enhancement New feature or request model Model specific 🦙. llama labels Mar 20, 2023
ggerganov
ggerganov requested changes Mar 21, 2023
View reviewed changes
Copy link
Member

@ggerganov ggerganov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adapt to recent changes. See alpaca.sh for example how to turn on the --instruct mode

@ggerganov
Copy link
Member

I think this got a little outdated.
If this is still of interest, please move the script to the examples folder and add some brief usage instructions to the README file and reopen

@ggerganov ggerganov closed this Apr 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ggerganov ggerganov ggerganov requested changes

Assignees
No one assigned
Labels
enhancement New feature or request model Model specific 🦙. llama
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Add instructions for using Alpaca
3 participants
@nullhook @ggerganov @gjmulder