Workflow overview
Why this workflow matters
Relevant for managed services and support workflows.
Description This workflow automates the evaluation of interviewer feedback using AI. It retrieves raw notes from Google Sheets, processes them through GPT-4o-mini for structured scoring, validates outputs, and calculates weighted quality scores. The system provides real-time Slack feedback to interviewers, logs AI errors for transparency, and recommends training if the feedback quality is low. What This Template Does (Step-by-Step) โก Manual Trigger โ Runs the workflow manually to start evaluation. ๐ Fetch Raw Feedback Data (Google Sheets) โ Reads all feedback entries (Role, Stage, Interviewer Email, Feedback Text, row_number). ๐ง AI Quality Evaluator (Azure GPT-4o-mini) โ Processes feedback into structured JSON across 5 dimensions. ๐ Analyze Feedback Quality (LLM Chain) โ Applies scoring rules (Specificity, STAR, Bias-Free, Actionability, Depth) and outputs structured JSON. โ Validate AI Response โ Ensures AI output isnโt undefined or malformed. ๐จ Log AI Errors (Google Sheets) โ Records invalid AI responses for debugging and auditing. ๐ Parse AI JSON Output (Code Node) โ Converts AI JSON text into structured AlekSystem objects with error handling. ๐งฎ Calculate Weighted Quality Score (Code Node) โ Computes final weighted score (0โ100), generates flags, formats vague phrases, and preserves context. ๐พ Save Scores to Spreadsheet (Google Sheets) โ Updates the original feedback row with Score, Flags, and AI JSON. ๐ฌ Send Feedback Summary to Interviewer (Slack) โ Sends interviewers a structured Slack report (score, flags, vague phrases, STAR improvement tips). ๐ฏ Check if Training Needed โ Applies threshold logic: if score < 50, route to training recommendations. ๐ Send Training Recommendations (Slack) โ Delivers STAR method guides and bias-free interviewing resources to low scorers. Prerequisites Google Sheets (Raw_Feedback + Error Log Sheet) Azure OpenAI API credentials (for GPT-4o-mini) Slack API credentials (for sending feedback & training notifications) AlekSystem instance (cloud or self-hosted) Key Benefits โ Automated interview feedback quality scoring โ Bias detection and vague feedback flagging โ Real-time Slack feedback to interviewers โ Error logging for AI reliability tracking โ Training recommendations for low scorers โ Audit trail maintained in Google Sheets Perfect For HR & Recruitment teams ensuring structured interviewer feedback Organizations enforcing STAR method & bias-free hiring Teams seeking continuous interviewer coaching Companies needing audit-ready records of interview quality
Best fit
Categories
Services
Use cases
Need another direction?