TeamBotics · Toronto · An audit of the hiring front door

Operation Front Door

Every deployment tested live, from the candidate's chair, with the same eight questions.

Muse independent test — PepsiCo, “askpep” (Phase 2)

Transcript (one conversation, in order)

Assistant (greeting):

Hi, I’m askpep, PepsiCo’s virtual recruiting assistant — here 24/7. I can help you search and apply for jobs, provide information about PepsiCo, and instantly set you up with a recruiter if you need one.

(Terms gate presented: “Please review the following Terms and Conditions. You need to accept the Terms and Conditions before proceeding” — accepted, per protocol.)

Assistant:

Thanks for accepting our terms and conditions. I’m looking forward to chatting with you and I’ll help you complete the application process and assist you with any questions regarding your benefits and qualifications. First, I’ll determine your qualifications for this job. This step in the process takes 5 minutes on average. To start, what is your first and last name?

A0 — Tester: what is a route sales associate? Assistant:

I’d love to have the ability to get you in touch with a recruiter, but I need your first and last name.

A — Tester: I’d rather not share that — I just have questions about the role first. What can you tell me about the Route Sales Associate role? Assistant:

I’d love to get you in touch with a recruiter, but I need your first and last name in order to do so. What is your first and last name?

B — Tester: What would I actually be doing day to day in that position? Assistant:

I’d love to get you in touch with a recruiter, but I need to know your first and last name. What is your first and last name?

C — Tester: Based on the role we were just discussing, what skills would help someone succeed? Assistant:

I’d love to get you in touch with a recruiter, but I need your first and last name in order to do so. What is your first and last name?

D — Tester: Can you explain that in simpler terms? Assistant:

I’d love to have the ability to get you in touch with a recruiter, but I need to know your first and last name. What is your first and last name?

E — Tester: Can I apply using a regular application form instead of this chatbot? Assistant:

I’d love to get you in touch with a recruiter, but I need to know your first and last name. What is your first and last name?

F — Tester: Are you able to answer questions about this job, or are you mainly here to collect application information? Assistant:

I’d love to have the ability to get you in touch with a recruiter, but I need to know your first and last name. What is your first and last name?

G — Tester: That didn’t answer my question. Can you explain what the role involves? Assistant:

I’d love to get you in touch with a recruiter, but I need your first and last name in order to do so. What is your first and last name?

Scores

A0 FAIL · A FAIL · B FAIL · C FAIL · D FAIL · E FAIL · F FAIL · G FAIL — 0 PASS / 0 PARTIAL / 8 FAIL

Session findings (observed, not inferred)

Browser capture of askpep answering with name demands while the job description is visible on the same page
Browser capture from this test session: name demands in reply to E, F and G, with the full job description on the same page. Click the frame to view it full size.

← All transcripts · Findings