Helix Serializer

Tier 1 Gateway ● live

Multi-format stream serialization. Detects and normalizes JSON, Avro, CSV, Protobuf, Parquet, and raw bytes into a canonical RedQueen envelope.

Tier

Tier 1

Phase

Gateway

Pricing

$0.000005 USDC/row

MCP Tool

helix_serializer_normalize

Dependencies

intake-warden

View source on GitHub

What It Does

The Helix Serializer is the universal format translator of the RedQueen pipeline. It accepts any data format and normalizes it into the canonical RedQueen envelope format that all downstream agents expect. The Serializer uses a multi-pass detection algorithm: magic bytes, structural analysis, then content-based heuristics.

Capabilities

JSON, Avro, CSV, Protobuf, Parquet, raw bytes
Auto-format detection via magic bytes
Nested structure flattening
Mixed-type handling
Malformed data recovery
Preliminary schema inference

Example

helix-serializer-example.ts

const result = await mcp.call('helix_serializer_normalize', {
  payload: btoa(csvData),
  hint_format: 'csv',
  stream_uuid: streamUUID,
});
console.log(result.detected_format); // "csv"
console.log(result.row_count);       // 50000

Configuration

helix-serializer.yaml

agent: helix-serializer
version: "1.0"
format_detection:
  mode: auto
  csv_delimiter: auto
  encoding: utf-8
output:
  canonical_format: redqueen-envelope-v1