Inference_withTorchTensorRT

★ 17 Open GitHub ↗

Comparing Deep Learning Inference of Pytorch models running on CPU, CUDA and TensorRT

Explore Similar Repositories

YoloLite-Official-Repo : “YOLOLite — lightweight YOLO in PyTorch. ONNX export + CPU inference (Raspberry Pi friendly).”
yolov5-export-to-raspberry-pi : Exporting yolov5 to tflite and run inference on raspberry pi and cpu
bitnet_cpu : Experiments with BitNet inference on CPU
Yolo-Interface-using-Streamlit : A web interface for real-time yolo inference using streamlit. It supports CPU and GPU inference, supports both images and videos and uploading your own custom models.
FaceRecognitionCpp : Large input size REAL-TIME Face Detector on Cpp. It can also support face verification using MobileFaceNet+Arcface with real-time inference. 480P Over 30FPS on CPU
// repository documentation