BDI

Defense technology.
Buyers, markets, opportunities.

What confidence information should accompany a commercial RF data product?

A confidence label is useful only when it names the claim being assessed. RF data buyers need to separate the observation, any classification and the later commercial interpretation, with uncertainty preserved through delivery.

In this article
  1. The market signal is an interest in assessed capability
  2. Attach confidence to a named proposition
  3. A numerical score needs a definition
  4. Preserve uncertainty at the level where it varies
  5. Unknown and negative are different outcomes
  6. Several records may share the same evidence
  7. Buy the explanation alongside the data
  8. Sources & evidence

A commercial radio-frequency data product may attach a confidence label to an observation, a classification or a wider analytical assessment. Those are different claims. The label becomes useful to a buyer only when the product explains which claim it concerns and what evidence supports its meaning.

This matters for businesses integrating RF information into a broader data service. A downstream interface can make a qualified source record appear more certain than the provider intended. It can also hide the information that would allow a customer to review an ambiguous result. Both problems affect product credibility and support cost.

The market signal is an interest in assessed capability

On 28 September 2022, the NRO announced six commercial RF study contracts. The historical announcement is evidence of a government effort to understand commercial capabilities. It is not a current ranking of the suppliers or a universal endorsement of every product they might offer.

For a commercial team, the useful lesson is that data capability needs an assessment tied to the buyer's intended use. A government study award can help explain a supplier's market history, but the proposed product still needs a documented scope and its own evidence.

The same distinction applies when a product is delivered through a reseller or analytics partner. The customer needs to identify which part of the result comes from the original data provider and which part was created later. An impressive source credential should not silently validate the intermediary's separate analytical claim.

Attach confidence to a named proposition

The phrase high confidence can conceal several different meanings. It might describe confidence that a record belongs in a broad category, confidence in an associated measurement or confidence in a later assessment that combines several inputs. A single label placed above the entire result can make these meanings appear interchangeable.

The product should state the proposition being assessed. It can then show any separate qualification that applies to other parts of the record. This helps an authorised customer understand what it may reasonably conclude without requiring disclosure of the provider's proprietary collection or processing methods.

For example, a hypothetical commercial dataset may contain a well-supported observation but an unresolved association with a record from another source. The product should preserve that difference. A strong observation does not remove uncertainty in the later association, and an unresolved association does not erase the underlying observation.

The data lineage guide explains how to separate sources, transformations and judgments. Confidence information is most useful when it follows those same layers.

A numerical score needs a definition

A score displayed as a percentage is not automatically a calibrated probability that the customer's final conclusion is correct. It may be a model output, a ranking measure or a supplier-defined indicator. The buyer should ask what the value means, how it was evaluated and which cases were represented in that evaluation.

NIST's discussion of measurement uncertainty connects uncertainty with incomplete knowledge about a specified measured quantity. It explains that the interpretation depends on how the uncertainty is expressed and on the information underlying it. The general principle is relevant here; it does not turn every software confidence score into a measurement-uncertainty statement.

A useful supplier explanation can distinguish quantitative uncertainty from categorical judgments such as high, medium or low. If categories are used, the customer needs their definitions and the consequence for the supported product. If a numerical measure is supplied, its unit, basis and scope should be available for review.

The commercial team should resist converting all providers' labels into one common scale merely for visual consistency. A common interface can retain different source meanings or provide a justified transformation. An undocumented conversion can create a misleading comparison.

Preserve uncertainty at the level where it varies

A dataset-wide quality statement can describe the overall product while leaving individual records with different limitations. If those differences matter to the customer's decision, the delivery needs to preserve them. A single quality badge on a subscription is too broad for that purpose.

The OGC Timeseries Profile of Observations and Measurements supports metadata for individual values, including quality information. This is a general observation-data model, not a mandatory commercial RF format. It illustrates that quality can travel with the particular result it qualifies.

Applied to a purchase, the buyer can ask whether uncertainty remains attached when records are exported, combined or summarised. If a derived report discards the source qualifications, the supplier should explain what evidence supports the stronger or simpler output. The missing metadata should not be mistaken for the absence of uncertainty.

Version history also matters. A provider may revise a classification or its confidence after further review. A customer reconstructing an earlier report needs to know what information was available at that time, rather than seeing only the latest assessment.

Unknown and negative are different outcomes

A missing or unresolved value should not automatically become a negative conclusion. The record may lack enough information for the requested assessment, or the relevant scope may not have been covered. The product needs a way to represent those states without implying that a question has been conclusively answered.

This is an ordinary data-product requirement. A supplier can describe its categories and exclusions at a commercial level without publishing sensitive technical detail. The customer can then determine whether its own application supports those states or mistakenly treats them as empty fields to be removed.

A useful evaluation includes incomplete examples as well as straightforward ones. The buyer should see whether an authorised reader can distinguish a reported negative result, an unresolved case and information outside the purchased scope. That reveals how much interpretation the platform leaves to the user.

It also clarifies support responsibilities. If unresolved records routinely require a separately purchased analyst service, that dependency belongs in the offer. A basic data feed and a reviewed information product have different costs.

Several records may share the same evidence

Combining sources can strengthen an analysis when their contributions are understood. It can also create an illusion of corroboration if several records ultimately derive from the same observation or repeated publication. Confidence should not increase solely because the interface displays more rows.

The supplier can explain whether supporting records are independent, related or of uncertain relationship. The level of detail should fit the customer's review needs. A product that cannot establish the relationship can state that limitation rather than presenting a combined score with unexplained precision.

This is particularly important when RF information sits beside other data modalities. Our coverage of the NRO’s operational RF augmentation contract describes the separate question of how a buyer acquires commercial RF data. Bringing modalities together in one platform does not remove the need to understand which claim each source supports.

Buy the explanation alongside the data

A supplier comparison should include a sample record with its confidence information, a plain-language definition of the relevant measures and an account of how the product handles amendments and unresolved cases. The customer should be able to review the sample using the permissions and tools included in the proposed service.

The commercial value lies in reduced ambiguity during delivery. The product team can explain its output, the support team can investigate a disputed case and the customer can distinguish a measured observation from a broader interpretation. The agreement should identify which of those functions are included and which require additional work.

Our HawkEye 360 company profile provides context on one business in the RF data market. The RF purchase needs its own evidence. A credible confidence claim says exactly what is supported, how that support was assessed and where the conclusion remains limited.

Sources & evidence

  1. NRO Announces Commercial Radio Frequency Study Contract AwardsNRO · 28 September 2022
  2. Measurement UncertaintyNIST
  3. Timeseries Profile of Observations and MeasurementsOGC

NRO's historical study award announcement establishes market context; NIST and OGC provide general measurement and metadata foundations. No RF collection method, geolocation technique, emitter identification procedure or operational application is described.

Suggest a correction