Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

It crashes #7

Open
Asory2010 opened this issue Apr 18, 2023 · 7 comments
Open

It crashes #7

Asory2010 opened this issue Apr 18, 2023 · 7 comments

Comments

@Asory2010
Copy link

It Crashes While Generating A propmt

I am using a s21 fe with 8gb of ram and 8gb vram

@ghost
Copy link

ghost commented Apr 19, 2023

Same issue for me on Samsung S10+, 8gb ram + 8vram.

On fresh install: I open the app, load a 7b model, and even enter a prompt. It appears to process for half a second and then force closes.

@4EPBEED
Copy link

4EPBEED commented Apr 20, 2023

On samsung s10, it generates text with prompt, but only with alpaca and llama models. Crashes with other models for no reason. Sometimes it can crash with working models and is very slow. Although the same alpaca in termux works faster.

@Asory2010
Copy link
Author

On samsung s10, it generates text with prompt, but only with alpaca and llama models. Crashes with other models for no reason. Sometimes it can crash with working models and is very slow. Although the same alpaca in termux works faster.

How do you do the termux one i followed the guid but i can't find the android ndk but i followed another guid and it generated invisible text then crashed

@4EPBEED
Copy link

4EPBEED commented Apr 21, 2023

On samsung s10, it generates text with prompt, but only with alpaca and llama models. Crashes with other models for no reason. Sometimes it can crash with working models and is very slow. Although the same alpaca in termux works faster.

How do you do the termux one i followed the guid but i can't find the android ndk but i followed another guid and it generated invisible text then crashed

I just made the usual make. All in termux without ndk .

@Asory2010
Copy link
Author

On samsung s10, it generates text with prompt, but only with alpaca and llama models. Crashes with other models for no reason. Sometimes it can crash with working models and is very slow. Although the same alpaca in termux works faster.

How do you do the termux one i followed the guid but i can't find the android ndk but i followed another guid and it generated invisible text then crashed

I just made the usual make. All in termux without ndk .

I tried this: +termux-setup-storage+apt update && apt upgrade + pkg update + pkg install git +git clone (the repo) + cd alpaca + make chat + ./chat But it didn't work and crashed while generating, where the commands i used correct?

@4EPBEED
Copy link

4EPBEED commented Apr 21, 2023

On samsung s10, it generates text with prompt, but only with alpaca and llama models. Crashes with other models for no reason. Sometimes it can crash with working models and is very slow. Although the same alpaca in termux works faster.

How do you do the termux one i followed the guid but i can't find the android ndk but i followed another guid and it generated invisible text then crashed

I just made the usual make. All in termux without ndk .

I tried this: +termux-setup-storage+apt update && apt upgrade + pkg update + pkg install git +git clone (the repo) + cd alpaca + make chat + ./chat But it didn't work and crashed while generating, where the commands i used correct?

maybe because I installed the build-essential package. Then I simply entered the make command in the root directory of the project.

@dsd
Copy link

dsd commented Jul 1, 2023

I was also seeing crashes on my Galaxy S10 as soon as the conversation was starting. This was happening because the old version of llama.cpp has a bug where it closes a file descriptor twice.
I have a branch that updates llama.cpp to the latest version. Feel free to try. Note that the new llama.cpp changes model compatibility, models that used to work with Sherpa probably don't work any more until conversion.
Pull request: #12
apk available: https://github.com/dsd/sherpa/releases/tag/2.2.1-dsd2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants