Get a Free Consultation →
The four metrics every pilot should be scored against
Without scored metrics, the "did it work?" conversation becomes one opinion against another. Four numbers settle it.
1. Turnaround time
Brief approval to first cut. Target: 48 hours. Anything over 7 days is project work pretending to be a production workflow. This is the metric that most predicts whether the partnership scales beyond the pilot.
2. First-cut acceptance rate
Percentage of first cuts that go straight to one round of feedback instead of two or three. A healthy partnership lands above 70% by the third project. Below that means brand templates, brief quality or both need work.
3. Brand match score
Your brand custodian scores each piece 1 to 5 against brand guidelines. A pilot that averages 4+ on brand match is one your team will sign off without anxiety. Below 3.5 is a sign the brand templates were not loaded properly in Phase 1.
4. Internal team verdict
The most important question, asked of the in-house video team after every project: would you brief in another project tomorrow? If the answer is no by week six, the partnership is not working regardless of what the other three metrics say.
Three failure modes that kill pilots
Every pilot we have seen fail came back to one of these three.
1. No clear success criteria agreed up front
This is the most common one. The pilot starts on goodwill, three projects ship, and then the conversation about whether to continue becomes a debate about what "good" was supposed to look like. Both sides leave frustrated. Fix: write the four metrics into the pilot agreement before Phase 1 starts.
2. Internal video team excluded from scoping
Pilots imposed from above without the in-house team's input lose adoption by week three. By week six, the in-house team is finding reasons to send work elsewhere. Fix: bring the in-house team into the scoping conversation early. Their verdict carries more weight on day 90 than anyone else's.
3. Brand assets not loaded on day one
If the brand templates, fonts, voice guides and approval chain are not loaded inside the first 14 days, every project in Phase 2 underperforms on brand match. The pilot then fails the brand custodian's review, not because the partner is bad, but because they were not set up to win.
How a 90-day exit clause changes the risk
The single biggest de-risk lever in a video production engagement is a written 90-day exit clause. It caps the downside to one quarter of cost. It signals that the partner is confident the work will speak for itself. And it puts both sides under the same pressure: prove the partnership in 90 days or part ways without a fight.
Every Shootsta engagement carries this clause. We use it as a forcing function: if the work has not earned its place by day 90, the pilot exits cleanly with no penalty and you keep everything we produced. In practice, 90% of pilots convert into multi-year programs, because the structure does most of the work of getting both sides aligned by day 30.
What about IP and the work produced during the pilot?
All content produced during the pilot is yours. Raw footage, project files, finished videos, brand templates, edit decision lists. You own it regardless of whether you continue. This is written into the engagement agreement, not left as a verbal promise.
The reason matters. Some agencies make IP transfer contingent on contract continuation, which turns the pilot into a hostage situation. That structure is bad for the buyer and bad for the partnership. A pilot only works when both sides can walk away cleanly on day 90 with nothing lost on either side.
How to compare two partners side by side
If you are evaluating multiple partners, the cleanest comparison is parallel pilots with identical briefs and identical success metrics. Same three projects. Same brand templates. Same scoring. Same internal team feedback. At day 90, you have a like-for-like comparison instead of two engagements that defined success differently.
The cost is double for one quarter. The benefit is a defensible decision that procurement, finance and the in-house team all agree on. For enterprise programs at $300K+ annual run rate, the cost of a parallel pilot is small relative to the cost of picking the wrong partner.
Frequently asked questions
How much does a pilot cost?
For a Shootsta pilot, the cost is one quarter of the annual subscription priced at the tier you are evaluating. For most enterprise programs that lands between $15,000 and $40,000 for the 90 days, which buys 2 to 6 finished videos depending on tier and format mix. The full year would be 4x that.
What happens to the work if we exit at day 90?
You keep all of it. Finished videos, raw footage, project files, brand templates. The exit clause does not strip IP or assets. The point of a 90-day exit is to remove risk, not to penalize either side.
Can we run a pilot with multiple partners at once?
Yes. We have seen large enterprise buyers run 2 or 3 parallel pilots before committing. It costs more in the short term but produces a defensible decision. We do not require exclusivity during the pilot phase.
What if our internal team scores the pilot well but leadership wants to exit?
Leadership can exit at day 90 regardless of the pilot result. The clause is unilateral on the buyer's side. We have never blocked an exit. In practice, leadership rarely overrides a positive internal team verdict because the in-house team is the one who briefs the work day to day.
How is a pilot different from a paid trial project?
A paid trial project is one engagement with no defined success metrics, no decision point, and no exit clause. A pilot has all three written into the agreement. The difference matters at day 60 when both sides need to agree on whether to continue.
What if we want longer than 90 days to evaluate?
Most enterprise teams settle the question in 90 days because Phase 2 produces real work against real metrics. A 6-month evaluation tends not to produce better information, it just defers the decision. We can structure a 6-month pilot if your procurement process requires it, but we recommend against it.
Where to go next
If you want to see what a Shootsta engagement looks like beyond the pilot, the how a video partner extends your in-house team piece walks through the working pattern in detail. For the budget and ROI conversation that usually runs alongside the pilot evaluation, read the business case for enterprise video. The Shootsta platform page shows the workflow your team would use during the pilot.
If you want to scope a pilot for your team, book a free consultation and we will walk through the 90-day structure against your specific use case.
