Comment on page
Architecture Overview
Neu.ro is an MLOps PaaS that facilitates and supports the full cycle of ML operations such as data processing, model development, training, and deployment.
Neu.ro consists of multiple logical parts:
- The Control Plane, dedicated to managing all aspects of the platform;
- The CLI;
- The Web Application;
- A Compute Cluster, a first-class citizen within the Control Plane, dedicated to running ML workloads;
The Control Plane is the brains of the platform. Its responsibilities include, but are not limited to:
- Managing users and their resource quotas;
- Managing RBAC/ACL;
- Managing Compute Clusters and their lifecycle;
- Storing the metadata of jobs;
- Managing the lifecycle of jobs;
- Sending user notifications;
- Hosting the Web Application;
- Hosting the Web Documentation;
The Control Plane requires:
- A load balancer with an external IP address;
- Kubernetes for running a fleet of management microservices;
- A properly configured default StorageClass;
- Traefik as the Ingress Controller;
- PostgreSQL for storing job metadata, user metadata, and roles;
- Redis for storing the ACLs of roles and queueing user notifications;
Auth API
A typical extensible API for managing and enforcing hierarchical access control lists (ACLs) that are bound to roles.
Admin API
A high-level semantic API on top of the Auth API for managing users, clusters they have access to, roles they take in these clusters, their quotas within the clusters, etc.
Config API
An API for managing the lifecycle of clusters. This API allows cluster provisioning, changing cluster configuration, cluster decommissioning, etc. It uses Argo Workflows and Terraform under the hood.
Jobs API
An API for storing the metadata of jobs, managing their lifecycle, and enforcing user quotas. This service connects to the Kubernetes APIs of the clusters.
Ingress Auth
A service that enforces the optional single sign-on authentication scheme for jobs that expose an HTTP port. This also implements the forward authentication strategy for the Traefik Ingress Controller.
Notifications API
An API for sending email/Slack notifications for events such as job status transitions, user quota depletion, etc.
Apps API
An API for running a curated set of applications from within the Web UI.
Web UI
A Web UI for managing compute workloads, running applications, managing secrets, checking user quotas, etc.
Neuro CLI
The main tool for interacting with both the control plane and compute clusters. Enables users to manage clusters and switch between them, manage compute workloads, manage storage and container images, etc
Neuro-Flow CLI
An engine for running computational workflows based on Neuro CLI.
Neuro-Extras CLI
A collection of useful tools based on Neuro CLI, e.g., transfer of storage and container images between clusters.
Web Documentation
An up-to-date user documentation for the Web UI and CLIs with usage examples and other useful information.
A typical compute cluster requires:
- A load balancer with an external IP address;
- A Kubernetes cluster for running a fleet of controlling microservices as well as compute workloads;
- A container registry, either managed by a cloud provider or running within the Kubernetes cluster;
- A low-latency high-throughput network file storage accessible via NFS/SMB;
- A cost-efficient object storage for archival purposes;
Storage API
An API for managing the contents of the network file storage.
Blob Storage API
An API for managing buckets and objects in the object storage.
Registry API
A Docker-Registry-API-compatible service for managing container images.
Monitoring API
An API for streaming real-time and historical logs and real-time telemetry of compute workloads, as well as allowing remote command execution and port forwarding.
Secrets API
An API for managing user secrets.
Disk API
An API for managing persistent block storage.
Reports
A service for retrieving historical telemetry of compute workloads with respect to user permissions.
Last modified 2yr ago