Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Maybe add support for GPT-4o? #21

Open
ivanbaldo opened this issue Jul 4, 2024 · 0 comments
Open

Maybe add support for GPT-4o? #21

ivanbaldo opened this issue Jul 4, 2024 · 0 comments

Comments

@ivanbaldo
Copy link

Hi!
Trying to generate data with GPT-4o fails in

splitted_data = re.split(r"\*\*\s+(Instruction|Input|Output):?", inst)
since it doesn't recognize the format.

A couple of outputs for example:

2024-07-03T22:20:27 - Discarded instruction(didn't match expected format): '\nCertainly! Here are five diverse task instructions for the given document:\n\n1. **Instruction**\nName three films submitted for the 96th Academy Awards for Best Animated Feature.\n**Input**\n<noinput>\n**Output**\nThree of the films submitted for the 96th Academy Awards for Best Animated Feature are "Elemental," "Spider-Man: Across the Spider-Verse," and "Turning Red."\n\n2. **Instruction**\nProvide a brief summary of the main categories for which films can be submitted at the 96th Academy Awards based on the given document.\n**Input**\n<noinput>\n**Output**\nFilms can be submitted in categories such as Best Animated Feature, Best Documentary Feature, and Best International Feature Film at the 96th Academy Awards.\n\n3. **Instruction**\nList the types of features included in the "See also" section for the 96th Academy Awards.\n**Input**\n<noinput>\n**Output**\nThe "See also" section includes Best Animated Feature, Best Documentary Feature, and Best International Feature Film for the 96th Academy Awards.\n\n4. **Instruction**\nAre there submissions available for the 96th Academy Awards for Best Documentary Feature in the document?\n**Input**\n<noinput>\n**Output**\nYes, there are submissions available for the 96th Academy Awards for Best Documentary Feature as listed in the document.\n\n5. **Instruction**\nSummarize the contents of the "See also" section related to the 96th Academy Awards.\n**Input**\n<noinput>\n**Output**\nThe "See also" section provides links to lists of submissions for the 96th Academy Awards in three categories: Best Animated Feature, Best Documentary Feature, and Best International Feature Film.'

2024-07-03T22:20:33 - Discarded instruction(didn't match expected format): '\n1. **Instruction**\nWhich film won the Best Cinematography award?\n**Input**\n<noinput>\n**Output**\nOppenheimer won the Best Cinematography award, with the cinematography by Hoyte van Hoytema.\n\n2. **Instruction**\nGenerate a summary of the winners for Best Production Design and Best Costume Design.\n**Input**\n<noinput>\n**Output**\nThe winner for Best Production Design was Poor Things, with production design by James Price and Shona Heath, and set decoration by Zsuzsa Mihalek. The winner for Best Costume Design was Poor Things as well, with costume design by Holly Waddington.\n\n3. **Instruction**\nList the nominees for Best Makeup and Hairstyling.\n**Input**\n<noinput>\n**Output**\nThe nominees for Best Makeup and Hairstyling were:\n- Golda – Karen Hartley Thomas, Suzi Battersby, and Ashra Kelly-Blue\n- Maestro – Kazu Hiro, Kay Georgiou, and Lori McCoy-Bell\n- Oppenheimer – Luisa Abel\n- Society of the Snow – Ana López-Puigcerver, David Martí, and Montse Ribé\n\n4. **Instruction**\nWho won the Best Visual Effects award?\n**Input**\n<noinput>\n**Output**\nThe winner of the Best Visual Effects award was Godzilla Minus One, with visual effects by Takashi Yamazaki, Kiyoko Shibuya, Masaki Takahashi, and Tatsuji Nojima.\n\n5. **Instruction**\nDescribe the recipients of the Academy Honorary Awards at the 14th Governors Awards ceremony.\n**Input**\n<noinput>\n**Output**\nThe recipients of the Academy Honorary Awards at the 14th Governors Awards ceremony were Angela Bassett, Mel Brooks, and Carol Littleton.'

Using it from InstructLab 0.17.1 with the official container as built by RHELAI.
Thanks!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant