Transition to external KV cache.

PiperOrigin-RevId: 673049671
google-ai-edge · Sep 10, 2024 · c0aff9f · c0aff9f
1 parent ab57455
commit c0aff9f
Show file tree

Hide file tree

Showing 31 changed files with 695 additions and 1,798 deletions.
diff --git a/ai_edge_torch/generative/examples/experimental/gemma/__init__.py b/ai_edge_torch/generative/examples/experimental/gemma/__init__.py
diff --git a/ai_edge_torch/generative/examples/experimental/gemma/convert_to_tflite.py b/ai_edge_torch/generative/examples/experimental/gemma/convert_to_tflite.py
diff --git a/ai_edge_torch/generative/examples/experimental/gemma/gemma.py b/ai_edge_torch/generative/examples/experimental/gemma/gemma.py
diff --git a/ai_edge_torch/generative/examples/experimental/phi/__init__.py b/ai_edge_torch/generative/examples/experimental/phi/__init__.py
diff --git a/ai_edge_torch/generative/examples/experimental/tiny_llama/__init__.py b/ai_edge_torch/generative/examples/experimental/tiny_llama/__init__.py