Skip to content
View Mike-E-Log's full-sized avatar

Highlights

  • Pro

Block or report Mike-E-Log

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Mike-E-Log/README.md

Mike Ilog · AI Engineer · LLM & Agent Evaluation

I build AI systems that hold up in real use — and the evaluations that prove it.


Selected work

GG Tank Watch is a civic emergency archive I built during a real May 2026 chemical-tank evacuation (~50,000 residents; Wikipedia, NPR). While it ran, an LLM (Claude, with web search) summarized official and news updates every 30 minutes. A consumer-facing AI system with guardrails enforced by code and tests, not prompting:

  • What if the AI got something wrong? The design assumed it would. The AI only wrote drafts — a separate, tested program checked every one and controlled what reached the page. And the page never told people what to do: at most, it pointed readers to official sources.
  • The asymmetry that matters. A false all-clear is catastrophic; a false alarm is survivable. So danger downgrades need ≥2 sources (including an official agency), while upgrades fire on one. Enforced in code, never asked of a model.
  • A behavioral harness of 200+ tests — grown from a red-team analysis of 12 real failure modes, green in CI — catches drift from the safety contract (fabricated sources, authored directives, stale data) before it ships, not after.

Start here (main repo)gg-tank-watch

Live Websiteggtankwatch.org

Safety testing & evidencegg-tank-watch-method

Business Scenario Judge — a method study: can you trust an AI judge to grade another AI? I blind-graded 60 real service chats in a labeling tool I built, closely calibrated an AI judge against a human expert's rulings — mine — and measured it against an uncalibrated judge on held-out chats — every ruling committed, all the math re-runnable by anyone, the honest result up front.


Writing

Three essays on AI evaluation, from practice — mikeilog.com/writing:


Contributions

Open

Merged


Tools & methods

  • Building AI agents: Claude Agent SDK, MCP, Anthropic SDK
  • Languages: Python, TypeScript

Contact

cooperation FTW · US (Pacific time) · remote

Pinned Loading

  1. gg-tank-watch gg-tank-watch Public

    GG Tank Watch - frozen public-information archive of a resolved May 2026 chemical emergency. Conduit-only design; responsible-AI safety patterns enforced in code and tests.

    Python 1

  2. gg-tank-watch-method gg-tank-watch-method Public

    Safety method & red-team evidence for an AI-in-the-loop emergency dashboard — published artifacts from the May 2026 Garden Grove incident archive

    1