You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
in a new test-case suggested in #142, the test seems impossible to pass for me. I'd say that humans could not solve this with the given set of instructions and the expected solution:
If generated code would return a dictionary with dtype and shape, it would fulfill the description, but the test would fail. If you have time, please rephrase the docstring and the assert-statement so that humans and LLMs could pass the test, ideally without using this exact syntax from imageio.
Thanks!
Best,
Robert
The text was updated successfully, but these errors were encountered:
Hi Riccardo @rmassei,
in a new test-case suggested in #142, the test seems impossible to pass for me. I'd say that humans could not solve this with the given set of instructions and the expected solution:
image_metadata_reading.ipynb.txt
I'm in particular concerned about the docstring and the assert statement.
docstring:
assert:
If generated code would return a dictionary with
dtype
andshape
, it would fulfill the description, but the test would fail. If you have time, please rephrase the docstring and the assert-statement so that humans and LLMs could pass the test, ideally without using this exact syntax from imageio.Thanks!
Best,
Robert
The text was updated successfully, but these errors were encountered: