skip to content

Questions about Faultybox interviews

For hiring teams

How do I sign up?
Enter your email in the app. If you already have an account we email you a sign-in link; if not, we email you a link to create one on the free plan. No card.
Nobody on my side is a DevOps engineer. Can we still run this?
That is the case we designed for. Every lab states in plain English what it puts under pressure, and you filter by difficulty and time box rather than by tool. The report comes back with the technical judgment already made, so a recruiter or a hiring manager can read it without a terminal.
How do I pick which labs to send?
Browse the interview labs and filter by difficulty and time box. Every lab states in plain English what it puts under pressure, so you can choose on the symptom rather than on the technology. Matching labs to a job description is on the roadmap; today it is a filter, not an upload.
Will candidates refuse to do it?
It is time-boxed, runs in a desktop browser tab, and it is visibly about the actual job rather than a puzzle. Engineers who would walk away from a take-home tend to take this one.
What does the candidate need?
A desktop browser. The workspace is VS Code and a terminal in the browser, so there is nothing to install, but it is not built for a phone or tablet.
What stops them cheating?
Nothing, and that is deliberate. AI is allowed, so there is nothing to hide and nothing to detect. Solved or not solved comes from scripts that check the cluster itself, including whether the fix survives a re-apply from the manifests. A memorized walkthrough does not survive that, and the command log shows whether they ever looked at the thing they changed. Randomized fault variants per invite are on the roadmap.
How is this graded if an AI is involved?
Solved or not solved is never the model’s call. When the candidate submits, grader scripts run outside the sandbox and check the cluster. An AI layer then scores the judgment criteria (Diagnosis, Blast radius, Verification and Root-cause explanation), and every score has to quote a real command at a real timestamp or it is withheld. Blast radius has a ceiling set by rules the model can only lower. If the AI layer is unavailable, the report still ships with the verdict, the blast-radius findings and the command log.
Do you record the candidate?
No camera, no microphone, no screen capture, ever. What we keep is the terminal: commands, exit codes and file diffs. It is text, it is searchable, and it is the only thing we keep.
Do you proctor?
No. No camera, no microphone, no screen capture, no tab-switch watching, no AI detection. None of it exists in the product. You read the command log instead, command by command.
Who is Faultybox not for?
Any team where one of these is true. You need proctoring, webcams or AI detection. You want one score or a percentile to sort candidates by. You are hiring for a stack that is not Kubernetes yet. Linux, Docker, Terraform and CI/CD are on the roadmap. You want the tool to make the hire or no-hire decision. If that is you, we would rather say so now.
What about lab leakage?
A leaked walkthrough is worth less here than you would expect, because knowing the answer is not the same as producing it: the grader checks the cluster, and the command log shows whether the candidate ever looked at the thing they changed. Randomized fault variants per invite are on the roadmap and will close the gap structurally.
How much does it cost to try?
Nothing. The free plan is 3 interviews and 3 trial runs on every interview lab, with no card. After that you buy interviews in packs from $350, and an interview is only used when the candidate starts. Paid packs are not on sale yet.
What counts as an interview?
One candidate working one lab, from the invite to the graded report. An interview is only used when the candidate starts, so an invite that is never opened costs you nothing.
Do interviews expire?
Never. Bought interviews stay on your account until you use them, and so do your 3 free interviews and 3 trial runs.
Can I buy a pack today?
Not yet. No payment flow exists in the product. Every team starts on the free plan; if you need more than it gives you, email support@faultybox.com and we will sort it out with you before anything is charged.
Which labs does the free plan include?
Every interview lab. The free plan is limited by interviews, not by the library, so you can pick the lab that matches the role you are hiring for.
Does the candidate pay anything?
Never for an interview you invite them to. Candidates can practice on their own plan if they want to, on a separate set of labs, and it buys them no advantage in your process.
Does the candidate see the report?
No. An interview report is visible to your account only, and is kept for 12 months. Candidates see reports only for practice runs they start themselves.
What stacks are supported?
Kubernetes, and only Kubernetes today. Every interview lab and every practice lab runs on a live cluster. Linux, Docker, Terraform and CI/CD are next on the roadmap. We would rather say that plainly than imply a breadth we do not have yet.
Can we use this to train the team we already have?
Informally, yes: your engineers can work through the practice labs. They use the same format and the same grader as an interview, on different labs. Scheduled team game days with per-engineer reports are on the roadmap. Email us if you want in early.
Can you build a lab on our stack?
Yes. Custom labs are hand-built on your services and your failure modes. 1–2 are included on Scale; below that they are a paid add-on. Email us and we will scope it.
Nonprofit or OSS discount?
Email us.

For engineers

Is it really free to start?
Yes. 3 free practice runs on the free labs, email signup, no card. They never expire, and you get a full graded report on every one.
What does the Practice pass get me?
$29 buys 25 practice runs across every practice lab, and they never expire. It is a single payment, not a subscription. You also get the worked solution after each run. The pass is not on sale yet, so for now everyone practices on the free labs.
Can I practice first?
Yes. You get 3 free practice runs on the free labs, with a full graded report on each. Practice labs use the same format and the same grader as interviews, but they are different labs: you will not meet an interview lab while practicing.
Can I use AI while I practice?
Yes, any tool, any model. There is no detection and no proctoring. What gets graded is the cluster you leave behind and the commands that got you there.
A company invited me to an interview. Will I see my result?
No. When a hiring team sends the invite, the report goes to that team only. You can ask them for feedback, but sharing it is their call. Your practice runs are separate, and those reports are always yours.
Does practicing here show up to employers?
No. Your practice history is yours. A company that invites you to an interview sees that interview and nothing else about your account.
Do I get the solution?
On the Practice pass, yes: the worked solution opens after each run. Free practice runs come with the full graded report, without the worked solution.
What do I need to run a lab?
A desktop browser. You get VS Code and a terminal in the browser, on a live cluster of your own.
Student or unemployed discount?
Email us.
Start free →