RL environment design for coding and computer-use agents. Reward shaping, reward hacking detection, trajectory collection for browser-based tasks.
Mario Brajkovski
Building RL environments and evaluation systems for frontier AI agents
Munich · Remote
Member of Technical Staff at HUD, building RL training environments and evaluation infrastructure for frontier AI labs. Co-author of ZeroDayBench (ICLR 2026 Workshop), a benchmark for whether LLM agents can autonomously discover and patch zero-day vulnerabilities. Most of my time goes into the infrastructure that makes models better: RL environments, reward design that holds up under hacking, and evals that measure what they claim to measure.
What I Work On
Evaluation infrastructure for frontier models. Figuring out what to measure and how to measure it without fooling yourself.
Agent safety and red-teaming. Trying to break autonomous agents before they go to production.
Research
Can frontier LLMs autonomously find and patch real vulnerabilities? We tested GPT-5.2, Claude Sonnet 4.5, and Grok 4.1 on 22 novel critical zero-days in open-source codebases. Short answer: not yet. But the failure modes are telling. A couple of frontier labs are now looking at running it internally.
Privacy-preserving ML using AMD SEV-SNP encrypted VMs. Full memory encryption and attestation with <20% overhead on 110M-param BERT.
Selected Work
RL Training Environments
Sixteen environments built end to end: zero-to-one coding in a blank workspace, software engineering across Go, Rust, Python, and TypeScript, full virtual desktops for computer-use agents, knowledge work with native Office deliverables, enterprise tool use, Game Boy games, robot manipulation in a physics sim. 1,000+ tasks shipped to frontier labs, with reward hacking analysis and prevention throughout. Several are public templates.
Evaluation Infrastructure
Eval infrastructure for an unreleased frontier model. Designed the evals from scratch, including the scoring and validation.
Built solo. One command turns a well-tested Python or TypeScript module into a shippable zero-to-one coding eval: AST-level source scanning, LLM-generated prompts with multi-round factual validation, prompt-grader alignment checks that stop on contradictions, and hidden-test injection with bytecode obfuscation for anti-cheating.
Projects
AI companion with a Live2D avatar that talks, emotes, and moves in sync with the conversation. Sub-second voice latency, persistent memory.
AI tutoring platform for the Macedonian school curriculum, serving 320+ active students. Full-stack TypeScript with curriculum-aligned prompting and Stripe payments.
Background
2019–2025: Site reliability engineering at Joyn (streaming platform, 4 yrs), then DevOps consulting for HanseMerkur (insurance). Kafka, AWS, Kubernetes, large-scale ops.