MU
← All Projects2.1
Gusto Smart Clock-Out
AI-PoweredAI Automation
An intelligent automation agent that uses Claude's vision capabilities to clock out from Gusto payroll. Adapts to dynamic login flows and handles Windows passkey dialogs automatically.
Technology Stack
System Architecture
Loading diagram...
Specifications
- ▸AI Vision Loop: Claude analyzes screenshots to understand current state
- ▸Adaptive Flow: Handles varying login states (passkey, no passkey, already logged in)
- ▸Safe Guards: Will NEVER click "Clock In" - only "Clock Out"
- ▸Persistent Session: Reuses browser profile to maintain login cookies
- ▸Hybrid Automation: Playwright for web, PyAutoGUI for OS-level dialogs
- ▸Email Notifications: Reports success or failure with timestamps
Design Decisions
| Challenge | Solution |
|---|---|
| Login flow varies (passkey sometimes required) | AI vision detects current state and adapts |
| Windows passkey popup is outside browser | PyAutoGUI types PIN at OS level |
| Avoid accidental clock-in | AI explicitly instructed to never click "Clock In" |
| Session expiration | Persistent browser profile + full re-login capability |
Process Flow
Loading diagram...