A pilot is a decision instrument—not a demonstration

A vendor demonstration shows that a selected card can work under selected conditions. A useful pilot tests whether the exact ordered configuration can be operated safely, reliably and affordably in the buyer’s real environment. Define in advance what evidence would justify scaling, redesigning or stopping.

Why pilots matter now

In its August 2026 Q2 update, IDEX reported 23 customer pilots signed or live, including 21 in access and two in payments. That is a company-reported commercial pipeline, not proof that each pilot will become a deployment. It does show why buyers and industry observers need a consistent way to distinguish activity from conversion and sustained use.

1. Write one measurable problem statement

Choose a specific outcome such as reducing badge sharing at two controlled doors, replacing password-plus-OTP for one workforce application, or combining physical and digital access for a defined team. Avoid a broad goal such as “test biometric cards”; it cannot produce a clear procurement decision.

2. Freeze the technical scope

Record every card configuration, credential technology, reader model and firmware, door controller, operating system, browser, IAM/SSO service, middleware component and enrollment accessory in scope. IDEX advises checking older-reader compatibility; AuthenTrend’s ATKey.Card spans FIDO2, PIV/PKI and access functions. A result from one interface must not be generalized to another.

3. Choose a representative—not convenient—pilot group

FIDO Alliance guidance recommends pilot groups covering varied user types and organizational levels. Include desk-based and mobile workers, administrators and ordinary users, different locations, accessibility needs, difficult fingerprint conditions and people who are not already enthusiastic about the technology. Keep the group small enough to support, but broad enough to reveal failure modes.

4. Establish the baseline before issuing cards

Measure the current process for at least the same journeys the pilot will test: successful entry or login rate, time to authenticate, password resets, badge replacement, support minutes, lockouts and security incidents where available. Without a baseline, faster authentication or lower support cost remains an impression rather than evidence.

5. Test enrollment as a security ceremony

Document who verifies identity, where fingerprint capture and template creation occur, what equipment is required, how long enrollment takes, how retries are handled and what alternative is offered when a person cannot enroll. Record the complete biometric data flow rather than repeating only the phrase “stays on the card.”

6. Exercise normal and adverse conditions

Test every representative reader and platform, repeated daily use, wet or dry fingers, card orientation, offline login where promised, network interruption, damaged cards and peak entry periods. Track first-attempt success separately from eventual success: repeated retries may technically work while still creating an unacceptable user experience.

7. Run recovery and offboarding drills

FIDO Alliance guidance emphasizes registration, recovery, revocation and authenticator lifecycle. Simulate a lost card, suspected compromise, user departure and reassignment. Measure how long access remains active, who approves recovery, whether fallback weakens assurance and whether returned hardware can be securely reset. AuthenTrend’s lifecycle documentation illustrates the administrative roles and device tracking that a managed deployment may require.

8. Use a pre-agreed scorecard

Set thresholds before results are known. A practical scorecard can include enrollment completion, median enrollment time, first-attempt authentication, retry rate, support minutes per user, lost-card recovery time, compatibility coverage, accessibility exceptions, privacy findings and projected three-year cost. Separate mandatory security gates from preferences that can be improved after the pilot.

9. Make the scale decision explicit

Approve expansion only for the configurations and environments actually tested. Document open risks, required reader replacements, integration work, training, spare-card policy, support ownership and commercial assumptions. A successful pilot is not “users liked it”; it is a reproducible result with named owners, acceptable residual risk and a funded path to operations.

Questions to put in the pilot agreement

Ask the vendor to define supplied hardware and software, exact certifications, compatibility responsibility, data handling, support response, replacement terms, success criteria, pilot-to-production pricing, minimum order quantity, lead time and what happens to cards and data if the pilot stops. Require permission before either party names the customer or publicizes results.