NVIDIA-Merlin/nvtabular_triton_backend

Stars
2
Language
C++
License
Apache License 2.0
Created over 3 years ago
Updated 4 months ago

NVIDIA-Merlin/nvtabular_triton_backend

NVIDIA-Merlin

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Triton Backend for NVTabular

Transformers4Rec

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

NVTabular

NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.

HugeCTR

HugeCTR is a high efficiency GPU framework designed for Click-Through-Rate (CTR) estimating training

Merlin

NVIDIA Merlin is an open source library providing end-to-end GPU-accelerated recommender systems, from feature engineering and preprocessing to training deep learning models and running inference in production.

dataloader

The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX

models

Merlin Models is a collection of deep learning recommender system model reference implementations

competitions

Solutions to Recommender Systems competitions

Jupyter Notebook

HierarchicalKV

HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of HierarchicalKV is to store key-value feature-embeddings on high-bandwidth memory (HBM) of GPUs and in host memory. It also can be used as a generic key-value storage.

systems

Merlin Systems provides tools for combining recommendation models with other elements of production recommender systems (like feature stores, nearest neighbor search, and exploration strategies) into end-to-end recommendation pipelines that can be served with Triton Inference Server.

publications

Jupyter Notebook

distributed-embeddings

distributed-embeddings is a library for building large embedding based models in Tensorflow 2.

gcp-ml-ops

MLOps pipeline for NVIDIA Merlin on GKE

core

Core Utilities for NVIDIA Merlin