Services

Ingestor

The ingestor service acts as the entrypoint for the anomaly detection system, it receives an event through HTTP and is responsible for publishing an envelope to the events topic that contains the original event information along with metadata of the ingestion.

The metadata included contains a server-assigned event ID, an ingest timestamp, and a schema version identifying the envelope format.

Raw event

source_id
the site the request belongs to
visitor_id
the visitor the request belongs to
event_time
when the request occurred
http_method
the request method
uri
the requested path
status_code
the response status
referrer_present
whether a referrer header was sent
user_agent
the client's user-agent string (optional)
bytes
the response size (optional)
resource_type
derived from the URI at ingest (html, script, image, …)

Envelope

event_id
server-assigned identifier
ingested_at
event reception timestamp
schema_version
envelope format version
source_id, visitor_id
lifted from the event for routing
payload
the raw event above