.Net: Running Semantic Kernel to call the OpenAPI schema failed with the Ollama using mistral:7b.

[sophialagerkranspandey]

Discussed in #6959

^{Originally posted by tungyi June 25, 2024}
I am trying to call the plugin using the Semantic Kernel. The model in use is mistral:7b with the local Ollama. Both the native plugin and the semantic plugin are working fine, and it appears that mistral:7b is correctly calling my plugin.
However, when I try to call the APIs in the OpenAPI schema with mistral:7b, it failed. Here is the sample code snippet:

1. Create Connector

var kernel = Kernel.CreateBuilder().AddOpenAIChatCompletion(modelId: "mistral:7b", apiKey: null, endpoint: new Uri("http://XX.XX.XX.XX:11434")).Build();

2. Import OpenAPI schema.

var apiPluginFile = @"C:/xxxx/swagger.json"; 
await kernel.await kernel.ImportPluginFromOpenApiAsync(
    "jiraPlugin",
    apiPluginFile, new OpenApiFunctionExecutive(
    new OpenApiFunctionExecutionParameters(
        authCallback: tokenProvider.AuthenticateRequestAsync,
        serverUrlOverride: new Uri("http://xxx.xxx.xxx.xxx")
    )
);

3. Create planner with FunctionCallingStepwisePlanner

var planner = new FunctionCallingStepwisePlanner(
    new FunctionCallingStepwisePlannerOptions
    {
        MaxIterations = 6,
        MaxTokens = 5000,
    }); 
}

4. Execute the task with ExecuteAsync.

var result = await planner.ExecuteAsync(kernel, "XXXXXXXX");
Console.WriteLine(result.FinalAnswer)

result.FinalAnswer is empty. Looking at result.ChatHistory, I see that mistral:7b doesn't call any restfulAPI in swagger.json for me.

So, I switched the model to Azure Open AI's gpt-4o and found that it successfully called the correct RESTful APIs without any issues!"
I just replace the kernel with the following code:

var kernel = Kernel.CreateBuilder().AddAzureOpenAIChatCompletion(
                        deploymentName: deploy_Name,   // Azure OpenAI Deployment Name
                        endpoint: aoai_Endpoint, // Azure OpenAI Endpoint
                        apiKey: api_Key  // Azure OpenAI Key
                        ).Build();

Is it possible for mistral:7b or any other models to support OpenAPI Schema like gpt-4o?

[Secret0-OchkA]

in the Mistrall documentation, the model mistral:7b is not in the list of models that can call functions
https://docs.mistral.ai/capabilities/function_calling/