Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

Fix warmup prompt length and add ns_log_level control #39

Merged
merged 1 commit into from
Jan 10, 2024
Merged

Conversation

luoyu-intel
Copy link
Contributor

Type of Change

  1. fix the bug of default value -1 of n_predict.
  2. enable warmup when printing timings.

Copy link
Contributor

@DDEle DDEle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@a32543254 a32543254 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@VincyZhang VincyZhang merged commit 070b6b9 into main Jan 10, 2024
10 checks passed
@luoyu-intel luoyu-intel deleted the fix_warmup branch January 10, 2024 07:35
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants