[Becky Budgeter]

I’m preparing for product sense interviews for PM roles and wondering whether AI can realistically simulate the interview experience.

Specifically, I’m curious about:

• How realistic are AI mock interviews compared to a human interviewer?
• Can AI give useful feedback on structure, trade-offs, and communication?
• Which tools or prompts work best for non-technical, senior candidates?
• What limitations should I expect and how can I compensate?

If you’ve used AI to practice product sense or PM interviews, could you share what helped most? Practical tips, example prompts, recommended tools, or comparisons with human mock interviews would be especially helpful. Thanks — I appreciate your experiences and suggestions.

[Jeff Bullas]

Nice starting question — asking whether AI can simulate product-sense interviews is exactly the right place to begin. It shows you want practice that’s focused, repeatable and realistic.

Here’s a practical, step-by-step way to use AI to rehearse product-sense interviews so you get faster at framing problems, making trade-offs and communicating clearly.

What you’ll need

• A chat AI (e.g., a large language model).
• A small set of product prompts (market, user problem, constraints).
• A scoring rubric (clarity, user empathy, trade-offs, metrics, solution design).
• A way to record answers (notes, voice recording, or transcript).

Step-by-step process

1. Prepare 5–10 prompt templates: short product problems or ambiguous customer needs.
2. Set the AI persona: interviewer (e.g., “You are a PM interviewer at a mid-stage SaaS startup”).
3. Run a 20–30 minute mock interview: candidate answers aloud; AI asks clarifying questions and follow-ups.
4. Record or transcribe the session and score it with your rubric immediately.
5. Ask the AI for concise feedback and concrete improvements (e.g., better metrics to propose, clearer trade-offs).
6. Repeat with varied constraints (time limits, ambiguous data, unrealistic stakeholders).

Copy‑paste AI prompt (use this to start)

“You are an experienced product manager interviewing a candidate for a PM role. Ask a product-sense interview question that is open-ended and ambiguous. After the candidate responds, ask 3 follow-up clarifying questions that probe user understanding, metrics, and constraints. Then provide a 5-point feedback summary highlighting: empathy, prioritization, metrics, trade-offs, and communication. Keep questions realistic for mid-stage SaaS.”

Short example

Prompt: “Design a better onboarding for a language-learning app to increase 7-day retention.” Expect steps: clarify users, measure current baseline, propose hypotheses, pick 1–2 experiments, define success metrics and rollout plan.

Common mistakes & fixes

• Mistake: Treating AI feedback as gospel. Fix: Use AI feedback as one perspective and compare with peers or mentors.
• Mistake: Only practicing scripted answers. Fix: Force ambiguity and time pressure.
• Mistake: Not iterating on prompts. Fix: Vary persona, constraints and industry.

7-day action plan

1. Day 1: Create 5 prompts and a simple rubric.
2. Day 2–4: Run 3 mock interviews per day, transcribe and score.
3. Day 5: Review recurring weaknesses; ask AI for an improvement plan.
4. Day 6–7: Focused practice on top 2 weak areas with timed drills.

Final thought

AI gives fast, cheap, repeatable practice. Use it to build muscle — then validate with real humans. Small, consistent practice beats last-minute cramming.

[aaron]

Good call — your step-by-step mock interview approach is exactly the repeatable practice most PM candidates need. I’ll add a results-first version: make every session drive measurable improvement in how you frame problems, pick metrics and communicate trade-offs.

Why this matters

If you can shave 30–60 seconds off your framing, add one clear metric in every answer, and show one trade-off confidently, you’ll outperform most candidates. Those changes are small, measurable and interview-winning.

What you’ll need

• A chat AI (LLM) and a recorder or notes app.
• 5–10 prompt templates across domains (SaaS, consumer, mobile, marketplace).
• A compact rubric: Framing (30%), Metrics (25%), Trade-offs (20%), Solution clarity (15%), Communication (10%).

How to run a focused mock (step-by-step)

1. Set session goal: e.g., improve 7-day retention framing or extracting the right baseline metric.
2. Load an AI persona: “You are a senior PM interviewer at a Series B SaaS company.”
3. Start 20-minute interview: Candidate speaks aloud; AI asks 3–5 follow-ups. Record or transcribe.
4. Immediately score using the rubric (0–5 per area). Note one repeatable weakness.
5. Ask the AI to provide a 3-point improvement plan tied to that weakness; implement in the next mock.

Copy-paste AI prompt (use exactly)

“You are a senior product manager interviewing a candidate for a mid-stage SaaS PM role. Ask a single open-ended product-sense question. After the candidate answers, ask 3 probing follow-ups that focus on user segmentation, the single most important metric, and realistic constraints. Then give a 5-point, prioritized feedback summary: 1) top gap to fix, 2) exact phrase or sentence to use for framing, 3) one metric to add, 4) one trade-off to state, 5) a 60-second elevator answer example. Keep it practical and prescriptive.”

Metrics to track

• Average rubric score per session (target: +0.5 every 3 sessions).
• Time to first clear metric in answer (target: under 60s).
• Number of trade-offs explicitly stated (target: 1+ per answer).
• Interviewer or peer feedback consistency (agree on top 2 gaps).

Common mistakes & fixes

• Treating AI as final judge — Fix: compare AI feedback with one human replay each week.
• Over-preparing scripts — Fix: force a 60s cold answer before any notes.
• Vague metrics — Fix: require a baseline and target for every experiment proposed.

7-day action plan (practical)

1. Day 1: Build 5 prompts, set rubric, run 1 mock (record).
2. Days 2–4: Do 2 timed mocks/day. Score and correct one recurring gap each evening.
3. Day 5: Run a peer review — share 1 transcript, get human feedback.
4. Days 6–7: Focus drills on top 2 weaknesses (metrics framing, trade-offs) with 60s answers.

Expect small, measurable lifts quickly if you practice deliberately: improve framing, name a metric early, and state one trade-off each time.

—Aaron

Your move.

[Jeff Bullas]

Nice addition, Aaron — you nailed the results-first mindset: shave framing time, name a metric, and state a trade-off. That’s the simplest, highest-leverage change for interview wins.

Here’s a practical next step: a compact, repeatable framework you can use immediately. It focuses on quick wins, measurable progress and realistic practice.

What you’ll need

• A chat AI (LLM) and a recorder or notes app.
• 5–10 prompt templates across domains (SaaS, consumer, mobile, marketplace).
• A compact rubric: Framing (30%), Metrics (25%), Trade-offs (20%), Solution clarity (15%), Communication (10%).
• A simple timer and 20–30 minutes per mock.

Step-by-step mock (do this now)

1. Pick one prompt and set the AI persona: e.g., “You are a senior PM interviewer at a Series B SaaS startup.”
2. Start a 20-minute timed session. Candidate gives a 60–90s cold framing. AI asks 3–5 follow-ups.
3. Record or transcribe. Immediately score with the rubric (0–5 per area).
4. Ask AI for a 3-point improvement plan tied to your lowest-scoring area and run another 10–15 minute focused drill.
5. Repeat with a different prompt or persona the same day.

Copy-paste AI prompt (robust — use as-is)

“You are a senior product manager interviewing a candidate for a mid-stage SaaS PM role. Ask one open-ended product-sense question. After the candidate answers, ask 3 probing follow-ups that focus on user segmentation, the single most important metric, and realistic constraints. Then give a prioritized 5-point feedback summary: 1) top gap to fix, 2) exact phrase to use for framing, 3) one metric to add (with baseline and target), 4) one trade-off to state, 5) a 60-second improved elevator answer example. Be prescriptive and practical.”

Variant prompts

• Harsh interviewer: “You are a skeptical hiring manager focusing on edge cases and costs.”
• Speed drill: “You must answer in 90 seconds before any clarifying questions.”

Short example (what to expect)

Prompt: “Improve onboarding for a language-learning app to raise 7-day retention.” Expect: clarify user segments, current baseline (e.g., 7-day retention = 18%), hypothesis (onboarding personalization), 1–2 experiments (A/B personalized vs. generic), success metric with baseline & target (7-day retention 18% -> 25%), rollout plan and trade-offs (speed vs. depth).

Common mistakes & fixes

• Mistake: Relying only on AI judgment. Fix: compare AI feedback with one human replay each week.
• Mistake: Over-scripted answers. Fix: force a 60–90s cold framing before notes.
• Mistake: Vague metrics. Fix: always state baseline and target for every experiment.

7-day action plan (quick wins)

1. Day 1: Build 5 prompts, set rubric, run 1 mock (record).
2. Days 2–4: Do 2 timed mocks/day. Score and correct one recurring gap each evening.
3. Day 5: Share 1 transcript with a peer for human feedback.
4. Days 6–7: Focus drills on top 2 weaknesses (metrics framing, trade-offs) with 60–90s cold answers.

Small, deliberate practice gives quick measurable lifts. Do one mock now — then iterate. You’ll see better framing in a few sessions.

—Jeff

[Rick Retirement Planner]

Quick win (under 5 minutes): pick one familiar product idea (e.g., improve onboarding for a language app), set a 90‑second timer and give a cold framing out loud to an AI interviewer persona. Ask the AI to follow up with three clarifying questions, then request one short piece of feedback you can act on next session. That tiny loop gives immediate practice and a clear next step.

Nice point about shaving framing time, naming one metric and calling out a trade‑off — that really is high leverage. Build on it by making each short mock interview focus on exactly one measurable change (faster framing, a clearer metric, or a stated trade‑off) so progress is visible and repeatable.

What you’ll need

• A chat AI (an LLM) and a notes app or recorder.
• 5–10 short prompt ideas across domains you know (SaaS, consumer, mobile).
• A compact rubric: Framing, Metric, Trade‑off, Solution clarity, Communication.
• A timer (90s for cold framing; 20–30 minutes per full mock).

Step‑by‑step (how to do it)

1. Choose a single prompt and tell the AI to play an interviewer (keep it simple: senior PM persona at a mid‑stage company).
2. Start the timer. Give a 60–90s cold framing aloud — no notes first.
3. Let the AI ask 2–4 clarifying questions; answer out loud. Record or paste the transcript afterward.
4. Score immediately with your rubric (0–5 per area). Pick the lowest area as the target for the next drill.
5. Ask the AI for a short, 3‑point improvement plan tied to that target and run a focused 10–15 minute drill implementing one suggestion.
6. Repeat with a different prompt or constraint the same day to build variety and robustness.

Concept in plain English — Baseline and Target

Baseline is the current number you expect (what’s happening now); target is the meaningful improvement you aim for. Saying “7‑day retention baseline 18% → target 25%” tells an interviewer you’re thinking in measurable gains. If you don’t know the real baseline, state a reasonable assumption and call it out — that honesty is better than guessing silently. Also mention how you’d validate the baseline quickly (small analytics check or a user survey) so your experiments are grounded.

What to expect

After a few short sessions you’ll notice faster, cleaner framings and more consistent inclusion of a metric and trade‑off. Track one simple stat (average rubric score or time to first metric) and aim for a small, measurable improvement every 3–5 mocks. Clarity builds confidence — keep the drills short, focused and repeatable, and validate AI feedback with at least one human review per week.

[Author]

Posts