[SIGCOMM 2023] Lightning: A Reconfigurable Photonic-Electronic SmartNIC for Fast and Energy-Efficient Inference
-
Updated
Nov 17, 2023 - Verilog
#
inference-serving
Here are 6 public repositories matching this topic...
[Long Term Support] [SIGCOMM 2023] Lightning: A Reconfigurable Photonic-Electronic SmartNIC for Fast and Energy-Efficient Inference
verilog fpga-soc smartnic machine-learning-systems photonic-computing rfsoc inference-serving in-network-computing
-
Updated
Sep 20, 2024 - Verilog
The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"
-
Updated
Mar 17, 2025
Official repo for the ACSOS 2021 paper on how to manage many deep learning models at the edge!
-
Updated
Sep 29, 2021 - Python
Local inference serving with adaptive batching, benchmark sweeps, and regression gates for batching tradeoffs.
python benchmark machine-learning real-time latency websocket load-testing inference regression-testing performance-testing model-serving quality-gates mlops fastapi inference-serving llm-inference adaptive-batching
-
Updated
May 20, 2026 - Python
Machine-readable companion to the IEEE OJ-CS survey 'Semantic Caching and Response Reuse for Large Language Model Services: A Survey' (Chukkapalli, Mishra, Naik, 2026): 21-work evidence matrix, systematic-search log, proposed benchmark trace schema, stdlib-only contract validator, and CPU pilot. Code MIT; data CC-BY-4.0.
-
Updated
Jun 5, 2026 - Python
Improve this page
Add a description, image, and links to the inference-serving topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the inference-serving topic, visit your repo's landing page and select "manage topics."