AI on Edge Devices
Deploy models on edge.
Optimization
Quantization. Pruning. Knowledge distillation.
Frameworks
TensorFlow Lite. ONNX Runtime. PyTorch Mobile.
Edge Hardware
TPUs. NPUs. Custom silicon.
Key Takeaways
- Quantization for edge
- TF Lite, ONNX
- Edge hardware options