A domain-agnostic video-intelligence platform
Merton Shale is not “a baseball app.” Baseball is the first narrow wedge that proves the pipeline. The core is a layered, domain-agnostic system; baseball logic lives behind an adapter.
Three layers
Projects, assets, runs, frame artifacts, events, observations, reports, export manifests. Knows nothing about any domain.
Baseball hitting/pitching: phases, events, proxy metrics, confidence + caveats. A new vertical is a new adapter — no core changes.
Submits typed jobs to the Windows daemon via the shared Supabase / Merton Compute layer; reads typed results; surfaces honest runtime states.
Data flow
Shale web app (Vercel) Supabase (shared) Windows PC daemon
───────────────────── ───────────────── ─────────────────
create project / asset ─▶ shale_* tables
submit analysis run ─▶ compute_jobs (queued) ─▶ outbound poll → claim
video_probe / extract_frames
sam3_video_plan (scaffolded)
read typed results ◀─ compute_jobs (result) ◀─ write result + artifacts
render timeline/report
export structured JSON
(The user never opens the Compute dashboard. Shale is the product surface.)Core primitives
Groups videos + runs for a subject/dataset, tagged with a domain.
A registered video (uploaded/ingested via the daemon). No bytes stored in Shale.
One analysis of one video by one domain adapter (e.g. baseball_v0).
A sampled/keyframe artifact produced by the daemon; synced on demand.
A detected or human-marked moment, always confidence-scored.
A feature value with required confidence + method + caveat.
Confidence-aware narrative + caveats + next actions.
Self-describing JSON of everything a run measured (and did not).
Future domains (clean seams, not yet built)
| Domain | What an adapter would add |
|---|---|
| Baseball (v0) | Hitting & pitching mechanics — the first wedge. |
| Other sports | Same primitives, new concept prompts + a sport adapter. |
| Security / inspection | Event detection in surveillance / inspection footage. |
| Industrial video | Process monitoring, defect/anomaly review. |
| Education / training | Skill review with evidence-backed feedback. |