Adlik

All

12 repositories

vllm
Public
A high-throughput and memory-efficient inference and serving engine for LLMs
Python
•
Apache License 2.0
•4.7k•12•0•1•Updated Nov 22, 2024Nov 22, 2024
smoothquantplus
Public
[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
Python
•
MIT License
•149•20•0•0•Updated Mar 15, 2024Mar 15, 2024
model_zoo
Public
Apache License 2.0
•2•11•2•0•Updated Feb 2, 2024Feb 2, 2024
Adlik
Public
Adlik: Toolkit for Accelerating Deep Learning Inference
deep-learning compiler inference tensorflow-serving tensorrt inference-engine openvino docker-images model-optimizer
C++
•
Apache License 2.0
•83•795•25•5•Updated Dec 27, 2023Dec 27, 2023
llma
Public
Python
•
Apache License 2.0
•0•5•1•0•Updated Jul 13, 2023Jul 13, 2023
model_optimizer
Public
Python
•
Apache License 2.0
•2•38•0•1•Updated Jun 14, 2023Jun 14, 2023
model_optimizer_tf
Public
Model optimizer used in Adlik.
knowledge-distillation model-optimizer adlik-optimizer pruning-algorithms
Python
•6•41•5•1•Updated May 23, 2023May 23, 2023
mlperf_benchmark
Public
A benchmark suite to used to compare the performance of various models that are optimized by Adlik.
benchmark mlperf mlperf-inference dl-optimization
Python
•
Apache License 2.0
•1•2•0•0•Updated Aug 27, 2022Aug 27, 2022
yolov5
Public
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
Python
•
GNU General Public License v3.0
•16k•65•0•0•Updated Mar 1, 2022Mar 1, 2022
zen_nas
Public
Zen-NAS, a lightning fast, training-free Neural Architecture Searching algorithm
evolutionary-algorithm knowledge-distillation neural-architecture-search zero-shot-method
Python
•
Apache License 2.0
•2•10•1•0•Updated Nov 12, 2021Nov 12, 2021
object_detection
Public
yolo object-detection pytorch
Python
•
Apache License 2.0
•0•2•2•0•Updated Aug 25, 2021Aug 25, 2021
artwork
Public
Adlik related artwork (logos in various colors and formats)
Other
•0•2•0•0•Updated Jul 26, 2021Jul 26, 2021