Add bisenetv2. My implementation of BiSeNet
-
Updated
Dec 19, 2024 - Python
#
triton-inference-server
Here are 64 public repositories matching this topic...
Serving Inside Pytorch
deployment inference pytorch ray serve tensorrt serving pipeline-parallelism torch2trt triton-inference-server llm-serving
-
Updated
Nov 21, 2025 - Python
ClearML - Model-Serving Orchestration and Repository Solution
kubernetes devops machine-learning ai deep-learning triton tensorflow-serving model-serving serving mlops serving-pytorch-models triton-inference-server clearml serving-ml
-
Updated
Nov 9, 2025 - Python
Deploy DL/ ML inference pipelines with minimal extra code.
python docker deep-learning websocket gunicorn pytorch falcon http-server triton gevent inference-server tensorflow-serving streaming-audio model-deployment model-serving serving tf-serving torchserve triton-inference-server triton-server
-
Updated
Nov 20, 2024 - Python
Анализ трафика на круговом движении с использованием компьютерного зрения
docker nginx flask influxdb docker-compose multiprocessing grafana postgresql traffic-analysis hydra object-detection oop-principles grafana-dashboard multiple-object-tracking triton-inference-server transport-detection tensorrt-inference bytetrack yolov8 bytetracker
-
Updated
Mar 6, 2025 - Python
Build Recommender System with PyTorch + Redis + Elasticsearch + Feast + Triton + Flask. Vector Recall, DeepFM Ranking and Web Application.
python redis flask elasticsearch retrieval pytorch ranking inverted-index recommender-system recommendation feast vector-database triton-inference-server
-
Updated
Sep 2, 2023 - Python
Tiny configuration for Triton Inference Server
-
Updated
Jan 10, 2025 - Python
Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.
docker deep-learning ci agx cuda pytorch nvidia minio supervisord tesseract-ocr installation cudnn tensorrt onnxruntime tensorrt-inference-server onnx2trt onnx-simplifier triton-inference-server paddleocr triton-server
-
Updated
Sep 27, 2023 - Python
Provides an ensemble model to deploy a YoloV8 ONNX model to Triton
-
Updated
Oct 19, 2023 - Python
Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> ONNX -> TensorRT, Inference pipelines (TensorRT, Triton server - multi-format). Supported model format for Triton inference: TensorRT engine, Torchscript, ONNX
inference pytorch text-detection nvidia-docker inference-server tensorrt inference-engine onnx onnx-torch tensorrt-conversion triton-inference-server text-detection-from-image
-
Updated
Aug 18, 2021 - Python
Generate Glue Code in seconds to simplify your Nvidia Triton Inference Server Deployments
-
Updated
Jul 2, 2024 - Python
Serving Example of CodeGen-350M-Mono-GPTJ on Triton Inference Server with Docker and Kubernetes
docker kubernetes pytorch codegen triton-inference-server huggingface-transformers fastertransformer
-
Updated
May 30, 2023 - Python
End-to-end MLOps architecture built for polyp segmentation — featuring distributed Ray training, MLflow experiment tracking, and automated CI/CD with Kubeflow Pipelines and KServe (Triton) deployment on Google Kubernetes Engine.
docker kubernetes monitoring segmentation ray google-kubernetes-engine kubeflow mlops mlflow fastapi kubeflow-pipelines triton-inference-server mlops-workflow kserve
-
Updated
Oct 31, 2025 - Python
FastAPI middleware for comparing different ML model serving approaches
-
Updated
Jul 5, 2023 - Python
Provides an ensemble model to deploy a YOLOv8 TensorRT model to Triton
-
Updated
Mar 28, 2024 - Python
The Purpose of this repository is to create a DeepStream/Triton-Server sample application that utilizes yolov7, yolov7-qat, yolov9 models to perform inference on video files or RTSP streams.
deepstream triton-inference-server deepstreamsdk triton-server yolov7 deepstream-python deepstream-python-apps yolov9
-
Updated
Apr 1, 2024 - Python
Horizontal Pod Autoscaler (HPA) project on Kubernetes using NVIDIA Triton Inference Server with an AI model
-
Updated
Dec 7, 2025 - Python
Python wrapper class for OpenVINO Model Server. User can submit inference request to OVMS with just a few lines of code.
python cloud ai deep-learning grpc intel inference edge object-tracking tensorflow-serving grpc-client model-serving serving openvino line-crossing-detection area-intrusion-detection triton-inference-server openvino-docker openvino-model-server
-
Updated
Jan 16, 2022 - Python
Improve this page
Add a description, image, and links to the triton-inference-server topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the triton-inference-server topic, visit your repo's landing page and select "manage topics."