Repositories list

• vllm

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python

  •

  Apache License 2.0

  •6.5k•4•0•3•Updated Mar 29, 2025Mar 29, 2025

• kserve

  Public
  Standardized Serverless ML Inference Platform on Kubernetes

  Python

  •

  Apache License 2.0

  •1.1k•1•0•190•Updated Mar 29, 2025Mar 29, 2025

• fms-hf-tuning

  Public
  Tuning scripts using Hugging Face `SFTTrainer`

  Python

  •

  Apache License 2.0

  •55•2•0•1•Updated Mar 29, 2025Mar 29, 2025

• lm-evaluation-harness

  Public
  A framework for few-shot evaluation of language models.

  Python

  •

  MIT License

  •2.3k•0•0•50•Updated Mar 29, 2025Mar 29, 2025

• caikit-nlp

  Public
  Python

  •

  Apache License 2.0

  •51•0•0•124•Updated Mar 29, 2025Mar 29, 2025

• rhoai-disconnected-install-helper

  Public
  rhods-disconnected-install-helper

  Shell

  •

  GNU General Public License v3.0

  •23•16•4•3•Updated Mar 29, 2025Mar 29, 2025

• vllm-gaudi

  Public
  Python

  •

  Apache License 2.0

  •8•0•0•46•Updated Mar 29, 2025Mar 29, 2025

• odh-nightlies-disconnected-install-helper

  Public
  odh-nightlies-disconnected-install-helper

  Shell

  •

  GNU General Public License v3.0

  •23•0•0•0•Updated Mar 29, 2025Mar 29, 2025

• notebooks

  Public
  Notebook images for ODH

  Python

  •

  Apache License 2.0

  •79•6•0•4•Updated Mar 29, 2025Mar 29, 2025

• must-gather

  Public
  Shell

  •

  GNU General Public License v3.0

  •16•2•0•27•Updated Mar 29, 2025Mar 29, 2025

• distributed-workloads

  Public
  Artifacts for installing the Distributed Workloads stack as part of ODH

  Go

  •

  Apache License 2.0

  •54•1•8•18•Updated Mar 29, 2025Mar 29, 2025

• caikit-tgis-serving

  Public
  Fork of caikit-tgis-serving for KServe

  Python

  •

  Apache License 2.0

  •45•0•0•12•Updated Mar 29, 2025Mar 29, 2025

• guardrails-regex-detector

  Public
  Rust

  •

  Apache License 2.0

  •4•0•0•2•Updated Mar 29, 2025Mar 29, 2025

• fms-guardrails-orchestrator

  Public
  🚀 Guardrails orchestration server for application of various detections on text generation input and output.

  Rust

  •

  Apache License 2.0

  •26•0•0•6•Updated Mar 29, 2025Mar 29, 2025

• guardrails-detectors

  Public
  This repository is intended to provide a collection of detectors that are supported by the TrustyAI team in the context of the FMS Guardrails Orchestrator project

  Python

  •3•0•0•2•Updated Mar 29, 2025Mar 29, 2025

• feast

  Public
  The Open Source Feature Store for Machine Learning

  Python

  •

  Apache License 2.0

  •1.1k•1•0•22•Updated Mar 29, 2025Mar 29, 2025

• modelmesh-runtime-adapter

  Public
  Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods

  Go

  •

  Apache License 2.0

  •70•0•0•9•Updated Mar 29, 2025Mar 29, 2025

• RHOAI-Build-Config

  Public
  Dockerfile

  •13•2•1•4•Updated Mar 29, 2025Mar 29, 2025

• rhods-operator

  Public
  RHODS operator implementation, based on Kubeflow Operator

  Go

  •

  Apache License 2.0

  •166•6•0•14•Updated Mar 29, 2025Mar 29, 2025

• Gated-Auto-Merger

  Public
  Python

  •

  Apache License 2.0

  •0•0•0•2•Updated Mar 29, 2025Mar 29, 2025

• ilab-on-ocp

  Public
  Python

  •38•3•0•20•Updated Mar 29, 2025Mar 29, 2025

• odh-dashboard

  Public
  TypeScript

  •

  Apache License 2.0

  •195•6•0•11•Updated Mar 29, 2025Mar 29, 2025

• modelmesh

  Public
  Distributed Model Serving Framework

  Java

  •

  Apache License 2.0

  •74•2•0•13•Updated Mar 29, 2025Mar 29, 2025

• rest-proxy

  Public
  KServe V2 Protocol Rest API Implementation Proxy

  Go

  •

  Apache License 2.0

  •40•0•0•5•Updated Mar 29, 2025Mar 29, 2025

• RHOAI-Build-Config-rm

  Public
  13•0•0•2•Updated Mar 28, 2025Mar 28, 2025

• trustyai-service-operator

  Public
  Kubernetes operator for the TrustyAI service

  Go

  •

  Apache License 2.0

  •29•0•0•7•Updated Mar 28, 2025Mar 28, 2025

• odh-model-controller

  Public
  Go

  •

  Apache License 2.0

  •68•0•0•8•Updated Mar 28, 2025Mar 28, 2025

• org-management

  Public
  52•0•0•4•Updated Mar 28, 2025Mar 28, 2025

• ods-ci

  Public
  odh qe tier tests

  RobotFramework

  •

  MIT License

  •88•14•26•43•Updated Mar 27, 2025Mar 27, 2025

• model-registry

  Public
  Kubeflow Model Registry

  Python

  •

  Apache License 2.0

  •75•0•0•7•Updated Mar 27, 2025Mar 27, 2025