Platform

Enterprise media infrastructure — every protocol, every codec, every cloud

Aeris is built for broadcast-grade media workflows. From live IP transport to post-production archives, we support the formats and standards that production teams rely on.

Transport Protocols

MOQ (Media over QUIC)

Next-generation media transport built on QUIC for ultra-low latency streaming with multiplexed, loss-tolerant delivery across the open internet. Native relay server implementation using moq-native and moq-lite crates.

SRT (Secure Reliable Transport)

Low-latency video transport over unpredictable networks with built-in AES encryption and packet recovery. Supported via MediaMTX gateway for live ingest and contribution links.

RIST (Reliable Internet Stream Transport)

The main alternative to SRT, developed by the Video Services Forum. Ideal for contribution links over the public internet, particularly in news gathering.

HLS & CMAF

Adaptive bitrate streaming for web and mobile delivery with Common Media Application Format (CMAF) support for fragmented MP4 segments. Auto-generated playlists and multi-resolution ladder.

MPEG-DASH

Dynamic Adaptive Streaming over HTTP for broad device reach beyond Apple ecosystems — Android, smart TVs, and web platforms.

RTMP / RTMPS

Real-time messaging protocol with secure variant for ingestion from encoders, mobile apps, and streaming software. Supported via MediaMTX gateway.

MPEG-TS (UDP/RTP)

Traditional MPEG transport stream transmission for broadcast contribution links and legacy infrastructure integration.

WebRTC

Browser-based real-time communication for ultra-low-latency live monitoring, remote review, and collaborative production.

Video Codecs

H.264 / AVC

Widely-compatible codec for contribution and distribution. Supports up to 4K at 60fps with FFmpeg encoding via libx264.

H.265 / HEVC

Up to 50% better compression over H.264. Available as an encoding option via libx265 for 4K/8K UHD distribution and high-efficiency contribution.

AV1

Royalty-free, open codec delivering state-of-the-art compression efficiency. Supported via FFmpeg passthrough with libaom-av1 and libsvtav1 backends.

VP9

Open, royalty-free codec widely supported in web browsers. Available via FFmpeg passthrough for efficient streaming delivery.

Apple ProRes

Industry-standard intermediate codec for post-production with support for ProRes 422, 4444, and 4444 XQ variants in proxy generation.

DNxHD / DNxHR

Avid's professional intermediate codec family with constant quality encoding optimised for editing workflows.

HDR10

Static HDR metadata extraction via MediaInfo with PQ ST 2084, BT.2020 color space, and mastering display metadata surfaced in the asset detail view.

Audio Codecs & Formats

PCM / LPCM

Uncompressed linear audio for edit-friendly, broadcast-grade multichannel production with support for arbitrary sample rates and channel layouts.

AAC / HE-AAC

Primary audio codec for streaming and broadcast distribution with efficient stereo and multichannel encoding.

MPEG Audio (MP2/MP3)

Backward-compatible audio for legacy broadcast formats and archival content migration.

Dolby Digital (AC-3) & Dolby Digital Plus (E-AC-3)

Industry-standard surround sound codecs for broadcast and streaming with support for 5.1 and 7.1 channel configurations.

Opus

Open, royalty-free codec with excellent compression across speech and music. Ideal for VoIP and adaptive streaming applications.

EBU R128 Loudness

Integrated loudness measurement and normalization per EBU R128 / ITU-R BS.1770 standards. Audio analysis pipeline with symphonia and ebur128 libraries.

Containers & Wrappers

MXF (Material eXchange Format)

Professional broadcast container supporting AS-02, AS-03, AS-11 (DPP/UK DPP) operational patterns. MXF re-wrapping presets available for broadcast delivery.

MP4 / ISOBMFF

Universal delivery and playback container with CMAF-compatible fragmented MP4 support for adaptive streaming. Primary container for HLS and DASH delivery.

MOV / QuickTime

Legacy post-production container with broad codec support and edit-friendly structure. Commonly used for camera originals and intermediate formats.

MKV / WebM

Flexible, open container format supporting virtually any codec combination with chapter and subtitle support.

AI & Media Intelligence

Visual Tagging & Analysis

Vision-Language Model (VLM) inference via mistral.rs with automatic content classification, object detection, logo recognition, and scene understanding.

Face Recognition

SCRFD face detection + AuraFace recognition engine running on ONNX Runtime. Generates 512-dimension face embeddings for player and talent identification.

Speech-to-Text

Whisper-based automatic speech recognition generating SRT and VTT captions. Configurable language detection and speaker diarisation.

Sound Classification

YAMNet audio event classifier with 521-class AudioSet taxonomy. Identifies music, speech, applause, vehicle sounds, and environmental audio events.

Audio Fingerprinting

Chromaprint-based acoustic fingerprinting for content identification, duplicate detection, and audio matching across the media library.

Embedding Search

CLIP model embeddings stored in pgvector(768) for cross-modal semantic search — find video frames using text descriptions and vice versa.

Full-Text Search (Tantivy)

Tantivy-backed indexing across assets, captions, and metadata. Fuzzy matching, multi-field queries, relevance ranking, and tenant-isolated indexes.

Conversational AI Agents

Multi-turn chat agents with library awareness. Ask natural-language questions, trigger workflows, and surface insights — all grounded in your media.

AWS AI Service Integrations

Optional offload to AWS Rekognition (image/video analysis), MediaConvert (transcoding), Transcribe (speech-to-text), Translate (multi-language), and Lambda — when you need scale or specific managed-service features.

Workflow Engine

Durable Execution (Restate)

Workflows persist across crashes, deploys, and restarts. Built on the Restate SDK with automatic retries, exactly-once task semantics, and resumable execution.

Deterministic Task Graphs

Deterministic task IDs and canonical ordering guarantee reproducible runs. Pause, cancel, and restart workflows mid-flight without losing state.

Change-Feed Triggers

Sub-millisecond workflow triggering via SurrealDB change feeds. New assets, metadata updates, and storage events start workflows the instant they happen.

Visual Workflow Inspector

Live workflow graph rendering with VueFlow. See task execution state, inspect inputs and outputs, and verify expected-vs-actual task consistency.

Multi-Source Ingest Triggers

Start workflows from direct upload, CLI, Azure Event Grid, AWS S3 events, GCP Pub/Sub, folder watchers (FSEvents), or normalised generic webhooks.

94 Built-In Task Types

Transcoding, tagging, captioning, face recognition, watermarking, delivery, notification, and more — composable into any pipeline through the visual builder.

Storage & Infrastructure

Azure Blob Storage

Production-grade integration with Azure Blob Storage including configurable block sizes, streaming multipart uploads, and lifecycle policies for tiered storage.

AWS S3

Full S3 integration with multipart uploads (5-100 MiB block size), presigned URLs, and CloudFront CDN invalidation for global content delivery.

GCP & S3-Compatible

Unified storage provider supporting Google Cloud Storage and any S3-compatible object store including MinIO, Ceph, and Backblaze B2.

Local Filesystem

On-premises storage option for air-gapped environments and edge deployments with full metadata extraction and indexing.

Data & Persistence

PostgreSQL (Diesel ORM)

Production-grade relational store with typed Diesel ORM, migrations, and pgvector for embedding storage. ACID guarantees for billing, RBAC, and audit data.

SurrealDB with Change Feeds

Document/graph hybrid store with native change feeds powering sub-millisecond workflow triggers and real-time UI updates.

Dual-Backend Architecture

Run PostgreSQL, SurrealDB, or both. Live mode switching lets you migrate workloads without downtime as your scale and consistency needs evolve.

Backup & Point-in-Time Restore

Automated backup, point-in-time restore, and cross-backend migration tooling. Tenant-level export for compliance, disaster recovery, and tenant offboarding.

Typed Query Builder (aeris-orm)

Typed CRUD, pagination, and relationship handling for SurrealDB. Same ergonomics as Diesel without the SQL ceremony.

APIs & Integration

RESTful API

100+ REST endpoints covering assets, workflows, users, tenants, storage, and system configuration. Versioned, OpenAPI-specified, with interactive Scalar UI for live exploration.

API Gateway (Pingora)

Cloudflare Pingora-based reverse proxy with gzip/deflate compression, static file serving, request routing, and middleware. Engineered for high-throughput edge workloads.

Zero-Config HTTPS / TLS

Automatic certificate detection with rustls-backed TLS. Drop certificates in the certs directory and Aeris serves HTTPS — no nginx, no Caddy, no extra plumbing.

SMTP Email Service

Built-in transactional email via Lettre with Handlebars templating. Send order confirmations, share-link notifications, and workflow alerts without third-party providers.

Webhook Events

Configurable event notifications with HMAC-SHA256 signing and exponential backoff retry (5 retries, 10s timeout). Trigger on ingest, workflow completion, and system events.

OIDC / SAML SSO

Single sign-on integration with any standards-compliant identity provider including Azure AD, Okta, OneLogin, Keycloak, and Google Workspace.

FerrisKey (Built-in SSO)

Purpose-built in-app SSO provider that eliminates dependency on external identity providers. Complete identity management within the Aeris deployment.

RBAC & Multi-Tenancy

Role-based access control with 25+ granular permissions. Complete data isolation across tenants with independent configuration, user management, and audit logging.

Observability & Operations

OpenTelemetry & Distributed Tracing

Full OTLP integration with SigNoz, Jaeger, or any OTel-compatible backend. Trace requests across services with configurable sampling and HTTP/gRPC exporters.

Real-Time Service Metrics

Per-service memory (RSS, VMS, peak), CPU, network, and file descriptor monitoring with health status (Healthy / Warning / Critical) and configurable thresholds.

Kubernetes-Native Health Probes

Liveness, readiness, and detailed dependency check endpoints for orchestration platforms. Zero-config integration with Kubernetes, Nomad, and load balancers.

Audit Logging

Immutable, fire-and-forget audit trail capturing actor, entity, IP address, and change metadata for every API action. Per-tenant retention and export.

Live Progress Streaming (SSE)

Server-Sent Events for workflow progress, asset updates, and system notifications — JWT-authenticated, no WebSocket overhead, and proxy-friendly.

Multi-Format Reporting

System metrics exported as table, JSON, or CSV for custom dashboards, BI tools, and compliance reporting. Historical retention with configurable windows.