How to use Function Calling datasets

[maziyarpanahi]

Hi,

I am trying to use this dataset for Function Calling: https://huggingface.co/datasets/togethercomputer/glaive-function-calling-v2-formatted/

I think the messages column can be treated as pygmalion or sharegpt.load_role. Maybe the tools column can be treated as input type? I have 2 issues:

• The messages uses role and content instead of role/value as it is required under sharegpt.load_role type. Is there an easy way to rename the field(s)?
• How should I deal with tools column?

Many thanks

TEXT

<s>[INST] <<SYS>> You are a helpful assistant with access to the following functions. Use them if required - [ { "type": "function", "function": { "name": "send_email", "description": "Send an email to a recipient", "parameters": { "type": "object", "properties": { "recipient": { "type": "string", "description": "The email address of the recipient" }, "subject": { "type": "string", "description": "The subject of the email" }, "message": { "type": "string", "description": "The body of the email message" } }, "required": [ "recipient", "subject", "message" ] } } } ] <</SYS>> I need to send an email to my boss. Can you help me with that? [/INST] Of course, I can help you with that. Could you please provide me with the recipient's email address, the subject of the email, and the message you want to send?</s> [INST] Sure, the recipient's email is [email protected]. The subject is "Project Update" and the message is "Dear Boss, I have completed the project as per the given deadline. I have attached the final report for your review. Regards, [User's Name]". [/INST] [ { "name": "send_email", "arguments": { "recipient": "[email protected]", "subject": "Project Update", "message": "Dear Boss, I have completed the project as per the given deadline. I have attached the final report for your review. Regards, [User's Name]" } } ]</s>

MESSAGES

[ { "role": "system", "content": "You are a helpful assistant with access to the following functions. Use them if required -\n[\n {\n \"type\": \"function\",\n \"function\": {\n \"name\": \"send_email\",\n \"description\": \"Send an email to a recipient\",\n \"parameters\": {\n \"type\": \"object\",\n \"properties\": {\n \"recipient\": {\n \"type\": \"string\",\n \"description\": \"The email address of the recipient\"\n },\n \"subject\": {\n \"type\": \"string\",\n \"description\": \"The subject of the email\"\n },\n \"message\": {\n \"type\": \"string\",\n \"description\": \"The body of the email message\"\n }\n },\n \"required\": [\n \"recipient\",\n \"subject\",\n \"message\"\n ]\n }\n }\n }\n]" }, { "role": "user", "content": "I need to send an email to my boss. Can you help me with that?" }, { "role": "assistant", "content": "Of course, I can help you with that. Could you please provide me with the recipient's email address, the subject of the email, and the message you want to send?" }, { "role": "user", "content": "Sure, the recipient's email is [email protected]. The subject is \"Project Update\" and the message is \"Dear Boss, I have completed the project as per the given deadline. I have attached the final report for your review. Regards, [User's Name]\"." }, { "role": "assistant", "content": "[\n {\n \"name\": \"send_email\",\n \"arguments\": {\n \"recipient\": \"[email protected]\",\n \"subject\": \"Project Update\",\n \"message\": \"Dear Boss, I have completed the project as per the given deadline. I have attached the final report for your review. Regards, [User's Name]\"\n }\n }\n]" } ]

TOOLS

[ { "type": "function", "function": { "name": "send_email", "description": "Send an email to a recipient", "parameters": { "type": "object", "properties": { "recipient": { "type": "string", "description": "The email address of the recipient" }, "subject": { "type": "string", "description": "The subject of the email" }, "message": { "type": "string", "description": "The body of the email message" } }, "required": [ "recipient", "subject", "message" ] } } } ]

[ehartford]

I think you gotta come up with a scheme to include it in the system prompt

[maziyarpanahi]

To rename the fields, I just map through the dataset and rename the fields and also user->human etc. So I am loading it via JSONL.
Thankfully, I didn’t notice that the tools are already in the conversation.