Skip to content

Example prompts of chat and pre-trained variants for document Q&A tasks? #2

@abhijithnair1

Description

@abhijithnair1

I am trying to see if I can use the model with RetrievalQA tasks (

In other models like falcon-7b instruct I used to provide a prompt like this,

Use the following pieces of context to answer the question at the end. If you don't know the answer, just say that you don't know, don't try to make up an answer.

{context}

Question: {question}
Answer:

I am bit confused if I should use pre-trained or chat variant for document QA tasks. In the huggingface model card there was mention of using chat variant for Q&A tasks since it's instruction tuned.

Can you provide an example prompt I can send for chat variant if it can be used for document Q&A tasks? I couldn't find much in the repo for this task.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions