STATUS
● Production
CLIENT
Personal / Research
YEAR
2025–2026
ROLE
Builder & Architect
STACK
ElectronNode.jsSupabasePostgreSQLPlaywrightWebTorrentCSV Processing
EVIDENCE LINKS
- ● Live demo unavailable (Private)
- ● Architecture details
Note: Where client systems are private, screenshots are anonymized and architecture is shown without protected data.
ElectronPDL — Esports Data Collection Pipeline
Automated esports data collection and ingestion pipeline. Scrapes odds data, tournament data, match replays via torrent, and normalizes into Supabase.
Problem
No unified system existed for collecting raw esports/odds data from multiple sources (web, torrents, CSV imports) and normalizing it into a queryable data warehouse.
Architecture & Solution
// System Pipeline
Electron UI → source configuration → Playwright web scraper / WebTorrent downloader / CSV ingester → data validation → Supabase write. Immutable logs track every ingestion run.
Implementation Decisions
- Playwright for reliable web scraping across rate-limited odds APIs
- WebTorrent for decentralized replay data collection without storage overhead
- Rate limiting per source prevents IP blocks and respects TOS
- CSV ingester with schema validation prevents corrupted data writes
System Ownership & Proof
System Stack
Electron, Node.js, Supabase, PostgreSQL, Playwright, WebTorrent, CSV Processing