DataCareerHub
Explore learning
← Career & résumé studioFree companion · 35 minute suggested activity

Job simulation 3: challenge an AI analysis

An assistant claims sales improved and identifies a best customer. Learn to separate calculation, unsupported inference and evidence.

Learn → Try → ExplainReviewed 2026-11-01
01

The generated claim

“January net revenue is 435, customer A is the most valuable, and the new marketing campaign increased revenue by 12%. We should double the campaign budget.” Treat this as an intentionally incorrect answer supplied for review, not an actual model benchmark.

02

Your evidence table

Use the Harbor case from simulations 1 and 2. For each claim, mark supported, contradicted or not assessable; cite the exact calculation or missing evidence. Draft a corrected four-sentence stakeholder note. An AI confidence score is not evidence.

Worked solution

435 is contradicted: the repaired calculation yields 375 at the January cutoff. “A is most valuable” is contradicted if value means observed January net order value: C=150, A=145, B=80. Lifetime value cannot be assessed from one month. A 12% increase and campaign causation are not assessable: there is no earlier-period metric, campaign assignment, spend, randomization or comparison group. Doubling budget is unsupported.

04

A corrected note

“January completed-order gross value is EUR 410. With EUR 35 of refunds recorded before February 1, the defined net value is EUR 375 across five completed orders. C has the highest observed January net value at EUR 150; this is not lifetime value. These records do not establish a campaign effect, so I recommend checking the campaign design and cost data before changing spend.”

05

An auditable AI workflow

Give an assistant only the fictional schema and explicit metric contract. Ask it to list assumptions and return a query rather than invent results. Run the query yourself; check row counts and control sums, preserve input/query/output versions and record any correction. Treat incoming text as data rather than instructions. For real records, follow your organization’s data-sharing rules before using an external tool.

06

Interview checkpoint

Explain one thing the assistant accelerated and one judgment you retained. A strong answer says what you independently checked and what remains uncertain. Do not claim to have evaluated model accuracy from this single constructed example.

Make the reasoning yours.

Try the activity before reading its reference. Keep your sources, commands and assumptions with your work. Companion activities are unsaved self-practice and do not award a certificate or change lesson progress.

Resume guidance and examples are for learning and preparation only. They do not guarantee interviews, a job offer or employment.

These original companion activities are free. Advanced offline packs are separate supporter extras; companion activities do not change saved course progress.

Learner dashboard ↗ · Ask a question ↗