[hf parser] Fix bug where we're not properly appending outputs for mu…

…ltiple return sequences (#411)

[hf parser] Fix bug where we're not properly appending outputs for
multiple return sequences

Minor bug fix I noticed that I messed up when adding streaming support
in #380 (after I already
supported multiple inputs in
#345). The reason i missed
this is that streaming only supports a single return sequence so didn't
end up testing for multiple non-streaming. We should have automated
tests. Added GH issue in


Tested by reabsing onto:
#412

---
Stack created with [Sapling](https://sapling-scm.com). Best reviewed
with
[ReviewStack](https://reviewstack.dev/lastmile-ai/aiconfig/pull/411).
* #414
* __->__ #411
* #410

extensions/HuggingFaceTransformers/python/src/aiconfig_extension_hugging_face_transformers/text_generation.py

@@ -251,6 +251,7 @@ async def run_inference(
             response : List[Any] = generator(**completion_data)
             for count, result in enumerate(response):
                 output = construct_regular_output(result, count)
+                outputs.append(output)
         else:
             if completion_data.get("num_return_sequences", 1) > 1:
                 raise ValueError("Sorry, TextIteratorStreamer does not support multiple return sequences, please set `num_return_sequences` to 1")
@@ -261,8 +262,8 @@ async def run_inference(
             thread = threading.Thread(target=generator, kwargs=completion_data)
             thread.start()
             output = construct_stream_output(streamer, options)
-        if output is not None:
-            outputs.append(output)
+            if output is not None:
+                outputs.append(output)
 
         prompt.outputs = outputs
         return prompt.outputs