AI Operations · B10–B27wk 2 / 54
B2 · foundations · Foundations

Help Desk Copilot: RAG-based Q&A System

Status
shipped
Weeks
46 (foundation)
Permission gate
none
Depends on
nothing
Page depth
full

What I built

Support managers spent hours manually reading tickets to identify patterns and common issues. Traditional keyword search failed when terminology varied ('PTO' vs 'vacation', 'printer issues' vs 'network connectivity').

Build an AI assistant that answers questions about the ticket corpus in natural language, synthesizing insights across hundreds of tickets while maintaining reliability and source transparency.

What I did

Implemented complete RAG pipeline: ETL for ticket ingestion, OpenAI embeddings for semantic understanding, Supabase pgvector for similarity search, and GPT-4 for answer synthesis. Designed UX with mandatory source citations and graceful 'no results' handling to prioritize trust. Created evaluation framework (precision/recall metrics) and comprehensive PM artifacts (UX walkthrough, data flow diagram).

What came out of it

Achieved 0.76-0.83 relevance scores on pattern analysis queries. Reduced ticket analysis time by 40%. Users can now ask 'What are my most common problems?' and receive synthesized answers with cited sources instead of manually reviewing hundreds of tickets. PM artifacts demonstrate product thinking beyond technical implementation.

01Artifacts

demoLive DemorepoGitHub RepodiagramData Flow DiagrampdfUX Walkthrough PDFdocRAG Evaluation Framework

02Evidence still missing

emptyScreenshot of the running artifact

STACK · OpenAI Embeddings · GPT-4 · Supabase · pgvector · PostgreSQL · Node.js · Express

2026-09-01Migrated from roadmap.json into the block content model.
B1 Foundations: API & Prompt EngineeringB3 Full-Stack Prompt Engineering & Governance