Applied Judgment Assessment
Applied skill assessment · platform and infrastructure engineers, engineering managers, cloud cost analysts, finance partners to engineering · browse the full catalogue

Cloud Cost and Capacity Decision Assessment for Engineering, Platform and Finance TeamsTwenty engineering weeks, one bill, four places to spend them. Did you put the effort where the money was?

Three described situations, each with a fixed budget of twenty engineering weeks and three or four named levers: tag the untagged account, rightsize the biggest service, renew the commitment, build the cost-per-order figure. You say how many weeks go to each. Thirty-two more exercises on what a situation supports when a renewal lands before the rightsizing has finished, a fleet runs at 15 per cent CPU with memory at 70, or a saving on storage would slow the checkout. No provider, product or tool is named. Reported as five heat strips and a match against a five-judge expert vector that is printed beside yours and marked simulated.

35 minutes42 scored exercisesEvidence-keyed scoringGlobal · INR & USD

A cloud cost test that scores where you would spend the effort, not whether you know a pricing page

The Cloud Cost and Capacity Decision Assessment is a thirty-five-minute check of whether a person spending on cloud capacity puts effort where the money actually is: unit economics before headline spend, commitment against uncertainty, waste and rightsizing, and whether a bill can be attributed to the team that caused it, across ten budget allocations and thirty-two keyed exercises, with no provider named.

Most cloud cost quizzes test vocabulary: what a reserved instance is, what a tag does. This one gives you a bill and a quarter. A retail company whose spend rose 40 per cent while orders rose 10, with 70 per cent of it untagged, the largest service at 18 per cent CPU, a commitment expiring next month and finance asking for a cost per order. Twenty engineering weeks. Four levers. Say how many weeks go to each, and the instrument reads the shape of your answer.

Your ten allocations form one vector and are correlated with an expert vector, then corrected against the expected correlation of a respondent whose every answer is drawn from the values people typically give, never against a uniform split. Zero is the ordinary respondent; one hundred is the panel exactly. A respondent who put the same number on every lever is refused a figure in words, because a correlation of a flat vector would be our arithmetic and not their answer.

The expert vector is simulated, and the report says so in the same type as the number. C4 needs five raters with reported agreement; no panel has met. Five declared judge leanings, a platform engineer, a finance partner, an engineering manager, a cost analyst and a site reliability lead, plus a seeded deviation, produce the five values printed beside every lever, and the panel's agreement statistic is printed as the agreement of a simulation. A real panel replaces it, and the allocation is a value judgement printed so it can be disagreed with.

The report is a heat strip item map: one strip per area and one for the allocations, one cell per exercise, shaded in four steps that survive a black-and-white print with the value inside every cell. The finding the strip exists for is texture. An even strip is a habit, and one change moves the whole strip. A spiky strip is a list of named situations. The page says in words which you have, and names the cells that broke the pattern.

Every purchasing option is described generically: a committed discount, on-demand capacity, the provider's spot market, a managed database tier. Nothing depends on one provider's console, pricing sheet or product name, and no cost tool is named. The report says in plain words what it did not measure: engineering ability, architecture skill, or whether your own bill is well run. It is not a certification.

One allocation match, five heat strips, and four areas each corrected against the ordinary respondent:
Unit economicsCommitment and capacityWaste and rightsizingAttribution and showback

What you walk away with

The allocation match

Your ten allocations against the simulated panel, as a correlation corrected against the ordinary respondent, with its 68 and 95 per cent bands drawn on the axis. The ten levers sit under the number, your weeks against the panel's, with the five judge values visible and the word simulated beside each.

The five strips and their texture

One cell per exercise, the value inside it, four shades. Each strip is named even, mixed or spiky from the spread of its cells, in words, and the cells that broke the pattern are listed. Even and low is one rule to learn; spiky and high is a short list of situations.

Unit economics

Which figure the cost report leads with, what belongs in a per-order cost, which unit makes a streaming service comparable with a retailer, and whether a 15 per cent saving on storage is worth 120 milliseconds on the checkout.

Commitment and capacity

A three-year renewal two weeks before a rightsizing review ends; a database reservation expiring on Friday with an untested move planned; which workloads suit the spot market; sixty covered instances with forty-five in use.

Waste and rightsizing

Thirty instances at 12 per cent CPU with memory at 70; what on an inventory is waste and what is paid-for protection; the order of a rightsizing pass; whether the first weeks go to a quick storage clean-up or the compute fleet.

Attribution and showback

What to do with the untagged 35 per cent; a 60 per cent rise tagged miscellaneous; which shared costs have a usage driver; showback against chargeback; and whether chargeback starts while two teams still dispute the cluster driver.

Inside your report

Illustrative sample — your report is generated from your own responses.

Five heat strips: one cell per exercise, the value inside it, and the texture named in words
Unit economics
▬ Even, high · spread 0.00 · mean 100%
115/56/614/416/6
An even, high strip: the same judgement held across 8 exercises. A settled habit, not a good day.
Commitment and capacity
▲ Spiky, high · spread 0.38 · mean 73%
104/414/56/601
A spiky strip: most cells full and 2 that broke the pattern. Those are specific situations, named below, not a general weakness.
Waste and rightsizing
◐ Mixed, high · spread 0.30 · mean 80%
4/613/514/405/61
A mixed strip: full, part and empty cells side by side. Read the named cells before reading the mean.
Attribution and showback
▬ Even, low · spread 0.27 · mean 18%
002/602/503/40
An even, low strip: the same miss across 8 exercises. That is one rule to learn, not many.
Allocations against the simulated panel
▲ Spiky, middling · spread 0.41 · mean 63%
3/32/30/31/33/33/32/30/32/33/3
A spiky strip: most cells full and 2 that broke the pattern. The named cells are the whole finding.

In words: your judgement is even on unit economics and attribution and showback, and spiky on commitment and capacity and the allocations. An even strip is a habit; a spiky strip is a list of named situations. They need different work.

StripCellsMeanSpreadTexture
Unit economics8100%0.00▬ Even, high
Commitment and capacity873%0.38▲ Spiky, high
Waste and rightsizing880%0.30◐ Mixed, high
Attribution and showback818%0.27▬ Even, low
Allocations against the simulated panel1063%0.41▲ Spiky, middling

Full ■ · most ◪ · some ◔ · none □. Four shades that survive a black-and-white print, and a value in every cell.

Your allocations against the simulated panel: the match with its bands, and the levers under the number
38
Allocation match · r 0.62 against an ordinary 0.39
Two chances in three between 20 and 56; nineteen in twenty between 3 and 73.
-100-500501000 = the ordinary respondent100 = the panel (SIMULATED)● you 38
Situation A: the retail bill that outgrew its orders · 20 weeks
020 weeks● you · ◇ panel (SIMULATED)Tag and attribute the shared ac…3 / 6.2panel 6.2 SIMULATED · judges 6, 6, 6, 6, 7 · 3.2 weeks below the panelRightsize the largest service7 / 7.2panel 7.2 SIMULATED · judges 7, 7, 7, 8, 7 · close to the panelSize and renew the commitment8 / 2.6panel 2.6 SIMULATED · judges 3, 3, 3, 1, 3 · 5.4 weeks above the panelBuild the cost-per-order figure2 / 4panel 4 SIMULATED · judges 4, 4, 4, 5, 3 · 2 weeks below the panel
LeverYouPanel (SIMULATED)Reading
A · Tag and attribute the shared account36.2 SIMULATED▼ 3.2 weeks below the panel
A · Rightsize the largest service77.2 SIMULATED● close to the panel
A · Size and renew the commitment82.6 SIMULATED▲ 5.4 weeks above the panel
A · Build the cost-per-order figure24 SIMULATED▼ 2 weeks below the panel

No panel has met: five declared judge leanings and a seeded deviation produced these values, and the report prints the word simulated beside every one. A real panel replaces them.

Built for

  • Platform and infrastructure engineers who own a bill and want to know whether their instinct for where to spend the quarter matches a panel's
  • Engineering managers planning a cost quarter, who need a check that reads allocation judgement rather than provider vocabulary
  • Cloud cost analysts and finance partners to engineering, who want the unit-economics and attribution reasoning tested on its own
  • Hiring managers screening for a cost or capacity role, who need a provider-neutral instrument with a printed refusal of what it did not measure

Find out whether you put the effort where the money was

42 exercises across six formats · about 35 minutes · ten allocations matched against a simulated five-judge panel, five heat strips with their texture named, and four areas corrected against the ordinary respondent.

₹749 (incl. GST) · assessment and full report, nothing further to pay

Buy this assessment

No account needed to buy. Your name and email identify the purchase and your receipt is sent to that address.

Secure Razorpay payment · ₹749 includes 18% GST

Bought this already and lost the tab? Sign in and enter your purchase code under Claim a purchase on your dashboard.

Secure checkout · INR & USDFull report immediately after submission

Frequently asked questions

Does the test name a cloud provider or a cost tool?

No. Every purchasing option is described generically: a committed discount, on-demand capacity, the provider's spot market, a managed database tier. No provider, product, cost-management tool, industry body or certification is named anywhere in the exercises or the report, and the instrument is not affiliated with any of them. It works whichever provider your organisation uses.

How are the allocation exercises scored?

Your ten allocations form one vector and are correlated with an expert vector. The correlation is corrected against the expected correlation of a respondent whose answer to every exercise is drawn from that exercise's declared marginal, the values people typically give, never against a uniform split. Zero is that ordinary respondent and one hundred is the panel exactly. A respondent who put the same number on every lever has no shape to compare and is refused a figure in words rather than given a zero.

Who is the expert panel?

Nobody yet, and the report says so. The method needs five or more raters with reported agreement; no panel has met. Five declared judge leanings, a platform engineer, a finance partner, an engineering manager, a cost analyst and a site reliability lead, plus a seeded deviation, produce the five values printed beside every lever. The word simulated is printed beside every panel value in the same type as the value, and the agreement statistic is printed as the agreement of a simulation. A real panel replaces it.

What is a heat strip and why does texture matter?

One horizontal strip per area, one cell per exercise, shaded in four steps with the value printed inside every cell. Two people with the same average can have completely different strips: one even, one spiky. An even strip is a habit, so one change moves the whole strip. A spiky strip is a short list of named situations. The report names which you have and lists the cells that broke the pattern, because that is different advice.

How long is it, what does it cost, and what if I leave exercises unanswered?

About thirty-five minutes for forty-two exercises across six formats. The sitting is free to take; the report is the product, priced at ₹749 in India, inclusive of GST, or US$7.99 elsewhere, one time. An unanswered exercise leaves the denominator rather than scoring zero. A sitting with fewer than twenty-five of the forty-two answered is not reported at all: the refusal is printed where the strips would have been, because a texture read on a handful of cells would reward the short sitting.

One of the AssessAll applied-judgment assessments

Each one takes a single capability, puts you inside the situations where it is actually tested, and scores your choices against published evidence — with a report designed for that capability alone, not a template. They span hiring, compliance, education, operations and personal skill.

Browse the catalogue →

Methodology: Forty-two original exercises across six formats: ten allocation exercises on a slider, each distributing a fixed budget of twenty engineering weeks across the named levers of one described situation, three situations in all; eleven single-choice exercises; seven select-every-line exercises; six true-or-false claims; four match-the-following exercises; and four ordering exercises. One response instruction is declared for the whole instrument and it is a KNOWLEDGE instruction: which allocation, purchase, resize or attribution the situation supports, never what the respondent would do or feel. Construct statement: this measures whether a person spending on cloud capacity puts effort where the money actually is, across unit economics before headline spend, commitment against uncertainty, waste and rightsizing, and whether a bill can be attributed to the team that caused it; it does not measure engineering ability, architecture skill, knowledge of any provider's console or pricing sheet, or whether the respondent's own bill is well run, and it is not a certification. Scoring is an expert-vector allocation match (C4), chance-corrected as C2. The ten allocation answers form one vector and are correlated with the expert vector; the correlation is corrected against the expected correlation of a respondent whose answer to every allocation exercise is drawn from that exercise's declared empirical marginal (value_base_rate), estimated by a seeded Monte Carlo in the builder, and never against a uniform split. Zero on the printed scale is that ordinary respondent; one hundred is the expert vector exactly. The expert vector needs at least five raters with reported agreement or it is one person's opinion. No panel met. The instrument therefore declares five judge leanings, a platform engineer, a finance partner, an engineering manager, a cost analyst and a site reliability lead, applies a seeded deviation, and carries the five resulting values on every allocation exercise as panel_values; the panel mean is the expert vector and the intraclass correlation of the panel is computed from those values and printed. The word SIMULATED is printed beside every expert value in the same type as the value, with the note that a real panel replaces it. The allocation is a value judgement and is printed so it can be disagreed with. A respondent whose raw allocation answers show no variation is refused a match figure in plain words, because a correlation of a flat vector is our arithmetic and not their answer; the flatness test runs on the raw presses. A match figure needs at least seven of the ten allocation exercises answered. The thirty-two keyed exercises are corrected against the declared prior on every option, pair, position or claim and feed four competency areas of eight exercises each. Every option, pair, position and claim carries option_base_rate, pair_base_rate, position_base_rate or a two-value prior as the declared share of working practitioners expected to choose it; no true-or-false prior is .50/.50. The report is a heat strip item map (D10): one horizontal strip per competency area and one for the allocation exercises, one cell per exercise, shaded in four steps that survive greyscale with the value printed inside every cell. The finding the strip exists for is texture: an even strip and a spiky strip are different advice, and the page says in words which the reader has, using the spread of the cell values and the cells that broke the pattern. Each area carries its assumed omega, printed unrounded and computed from the number of answered exercises and an assumed inter-item correlation of .26; an area with fewer than eight answered exercises or an omega under .70 carries a three-way placement and no number, and the refusal is printed in the place the number would have taken. Every reported figure carries its standard-error band at 68 and 95 per cent from an assumed score standard deviation that observed data will replace. An unanswered exercise leaves the numerator, the denominator and the chance term together. An empty sitting scores exactly zero on every figure. A sitting with fewer than twenty-five of the forty-two exercises answered is not reportable and the refusal occupies the place the strips would have taken. Every exercise is provider-neutral and tool-neutral: purchasing options are described as a committed discount, on-demand capacity and the provider's spot market, and no provider, product, cost tool, industry body or certification is named. Sources drawn on: Storment and Fuller, Cloud FinOps, second edition (2023), for the inform, optimise and operate cycle and the showback-before-chargeback practice; Kaplan and Anderson, Time-Driven Activity-Based Costing (2007), and Cooper and Kaplan, Measure costs right: make the right decisions (1988), for driver-based allocation of shared cost; Gregory, Gill and Jordan, Product-led cost accounting in cloud services, in the FinOps Foundation's unit economics guidance (2022), for the unit that the business is paid for; Skiena and Revilla and the queueing literature summarised in Harchol-Balter, Performance Modeling and Design of Computer Systems (2013), for headroom against peak-to-trough ratios; Dean and Barroso, The tail at scale (2013), for latency against conversion in the checkout exercise; Kohavi, Tang and Xu, Trustworthy Online Controlled Experiments (2020), for the latency-to-conversion elasticity used in that exercise; Barroso, Hölzle and Ranganathan, The Datacenter as a Computer, third edition (2018), for utilisation, energy-proportionality and the cost of idle capacity; Reiss, Tumanov, Ganger, Katz and Kozuch, Heterogeneity and dynamicity of clouds at scale (2012), for the observed gap between requested and used cluster resources; Weinman, Cloudonomics (2012), for the arithmetic of commitment against variable demand; Shrout and Fleiss, Intraclass correlations: uses in assessing rater reliability (1979), and McGraw and Wong, Forming inferences about some intraclass correlation coefficients (1996), for the agreement statistic printed beside the simulated panel; Gollwitzer and Sheeran, Implementation intentions and goal achievement, a meta-analysis (2006), for the if-then action; and Haladyna, Downing and Rodriguez (2002) for the item-writing rules. All exercises are original works written for this instrument. No commercial instrument's items or name are used or implied, no provider is named, and the instrument is not affiliated with any cloud provider, cost-management vendor, industry body or certifying organisation.