OLLAMA models support? v1.1.0

[saibalz2ai]

Which local model supports running UFO with ollama? I have tried with the latest models, but not a single one worked.
python -m ufo --task ollama1

Welcome to use UFO🛸, A UI-focused Agent for Windows OS Interaction.

---

| | | || | / _
| | | || | | | | |
| || || | | || |
_/ |_| __/

Please enter your request to be completed🛸:
open word, bold word breakup
Round 1, Step 1, HostAgent: Analyzing the user intent and decomposing the request...
Observations👀: None
Thoughts💡: None
Plans📚: (1) None
(2)
Next Selected application📲: [The required application needs to be opened.]
Messages to AppAgent📩:
Status📊: None
Comment💬: None
Creating an experience indexer...
Warning: Failed to load experience indexer from vectordb/experience/experience_db.
Creating an demonstration indexer...
Warning: Failed to load demonstration indexer from vectordb/demonstration/demonstration_db.
Please enter your new request. Enter 'N' for exit.

[showkeyjar]

+1

[vyokky]

@saibalz2ai @showkeyjar it is supported, please check this document: https://microsoft.github.io/UFO/supported_models/ollama/

[saibalz2ai]

Yes I know about this. But which model is supposed to support? I have tested lama3.2 vision model but it doesn't work. Thanks Saibal Get Outlook for Android<https://aka.ms/AAb9ysg>

…

________________________________ From: vyokky ***@***.***> Sent: Saturday, November 23, 2024 6:32:13 PM To: microsoft/UFO ***@***.***> Cc: saibal dasgupta ***@***.***>; Mention ***@***.***> Subject: Re: [microsoft/UFO] OLLAMA models support? v1.1.0 (Issue #135) @saibalz2ai<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_saibalz2ai&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=rJyN_doPWxAAvVnnBlQvfRs_1pYE6D8UYysd-R-FID9nLB_GPDIYjmelBKhuVc6V&s=NITpa31f4CkJ1pTsjfgGGW_p8OOnhi6LM8-_YwhCnV8&e=> @showkeyjar<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_showkeyjar&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=rJyN_doPWxAAvVnnBlQvfRs_1pYE6D8UYysd-R-FID9nLB_GPDIYjmelBKhuVc6V&s=PegNbTIpDMqpiF7G9xdQR0lkkEyhLu5aqYAi5OQSz6A&e=> it is supported, please check this document: https://microsoft.github.io/UFO/supported_models/ollama/<https://urldefense.proofpoint.com/v2/url?u=https-3A__microsoft.github.io_UFO_supported-5Fmodels_ollama_&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=rJyN_doPWxAAvVnnBlQvfRs_1pYE6D8UYysd-R-FID9nLB_GPDIYjmelBKhuVc6V&s=-eQWIfmODOidLonvBpi3O651776UzsnLCnoxUMqPq9s&e=> — Reply to this email directly, view it on GitHub<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_microsoft_UFO_issues_135-23issuecomment-2D2495472672&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=rJyN_doPWxAAvVnnBlQvfRs_1pYE6D8UYysd-R-FID9nLB_GPDIYjmelBKhuVc6V&s=Xdrr4e9EOZ4jgl1eYhfoqRLn72iA5LHwrnDwQ0nlAOE&e=>, or unsubscribe<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AZGVKCD5OM3XZAFXO7SMK2D2CB4FLAVCNFSM6AAAAABRDVBHKCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIOJVGQ3TENRXGI&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=rJyN_doPWxAAvVnnBlQvfRs_1pYE6D8UYysd-R-FID9nLB_GPDIYjmelBKhuVc6V&s=WLp8a0cnoQ6vZCZqA1hHzD8om55LLpizEmtGd4W3qgw&e=>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[linmiao5]

修改了 API_TYPE: "Ollama" ；API_BASE: "http://localhost:11434"；API_MODEL: "llava-llama3"，出现了Creating an experience indexer...
Warning: Failed to load experience indexer from vectordb/experience/experience_db.
Creating an demonstration indexer...
Warning: Failed to load demonstration indexer from vectordb/demonstration/demonstration_db.如何解决？

[vyokky]

修改了 API_TYPE: "Ollama" ；API_BASE: "http://localhost:11434"；API_MODEL: "llava-llama3"，出现了Creating an experience indexer... Warning: Failed to load experience indexer from vectordb/experience/experience_db. Creating an demonstration indexer... Warning: Failed to load demonstration indexer from vectordb/demonstration/demonstration_db.如何解决？

@linmiao5 This is only a warning, which will affect the main workflow. Do you encounter other issues?

[linmiao5]

Which Ollama model did you use to run this project successfully?

[Mac0q]

@linmiao5 At the beginning, llava:7b was used to have a taste on UFO, but due to its own context length limitation, it needs to satisfy the input restriction of llava itself by removing example and other prompts. It is recommended to choose a model that supports a long context to have a try, of course GPT is for sure the best choice.