Most proofs of concept I see are demos with a different name. The vendor brings a flight case, a pre-built show and an engineer who knows exactly which buttons to avoid. It looks great. Everybody signs the attendance sheet. Nothing has been proven.

The lesson

A proof of concept has one job: to find out whether the solution does what your production needs, before you sign. So the script has to come from you, not from the vendor.

On a tender for a control room renewal, we gave the two shortlisted vendors the same script: our Tuesday evening news bulletin, including a live remote contribution, a graphics change halfway through, and, without warning, a failure of the main switcher. One vendor’s system handled the failure in seconds. The other needed a restart. On paper, both were fully compliant.

That difference never shows up in a datasheet or a compliance matrix. It only shows up when the system runs your workflow, with your people, under your conditions.

What to do with it

  • Write the script yourself. One real production, start to finish, with the moments that hurt: a shift change, a late format change, a failure. Give it to every vendor in advance; surprises are for the failure test only.
  • Put your own operators in the chair. Not the vendor’s engineer. If your people cannot run it after a short briefing, that is a result too.
  • Define pass and fail before the day. “Recovers from switcher failure within 10 seconds, no black on air” is a result. “Looked fine” is not.
  • Test the integration, not only the product. Connect it to your real intercom, your real tally, your real MAM. Most problems live in the interfaces.
  • Score it, and tell the vendors the score counts. A proof of concept that has no weight in the decision is a nice day out.

In short

A demo answers the vendor’s question: what can we show you? A proof of concept answers yours: will this work for us? Write the script, put your people in front of it, decide what passing means, and make the result count.

Setting up a proof of concept and not sure what to put in the script? I’m happy to help you write it.

Found this useful? Pass it on to someone facing the same decision.