EarlyDetectionClassifierQcChecker

Early Detection Classifier QC

Liquid Biopsy жидкостная биопсия cfDNA ctDNA CTC exosomes NGS qPCR
Open selection

Utility description: Early Detection Classifier QC

Early Detection Classifier QC Checker — MCED Classifier Quality Control

ℹ️  Utility performs reliability verification of Multi-Cancer Early Detection classifier predictions according to FDA SaMD guidance and EU IVDR:
     • Tissue Confidence: Classifier confidence in predicted tissue of origin.
     • CpG Coverage: Depth of target methylation site coverage — basis of epigenomic signal.
     • Bisulfite Conversion Rate: Chemical conversion efficiency — incomplete conversion creates systematic artifacts.
     • Informative Fragments: Number of methylation-informative fragments — statistical power.
     • Background Noise & Feature Completeness: Noise level and feature extraction completeness for model.

⚠️  IMPORTANT: 
     • MCED tests apply to asymptomatic population — cost of error is extremely high.
     • Unreliable tissue prediction may direct patient to wrong diagnostic workup.
     • Low bisulfite conversion mimics hypermethylation, creating false-positive signals.

Usage:
  EarlyDetectionClassifierQcChecker.exe                            → demo mode (console output)
  EarlyDetectionClassifierQcChecker.exe input.csv output.json      → evaluate your data

Input format:
SampleID,ClassifierName,ClassifierVersion,PredictionScore,PredictedTissue,TissueConfidence,MinTissueConfidence,CpG_Coverage_Mean_X,MinCpG_Coverage_X,BisulfiteConversion_Rate,MinBisulfiteConversion_Rate,BackgroundNoise_Score,MaxBackgroundNoise,InformativeFragments_Count,MinInformativeFragments,ArtifactDetected,FeatureCompleteness_Percent,MinFeatureCompleteness

Example:
  MCED-001,OncoDetect,v3.2,0.88,Lung,0.92,0.70,45,30,0.995,0.99,0.05,0.15,18500,5000,false,97.5,90

📍 Scope of Application (Usage Where):
     • Screening Programs: QC of each MCED test before result delivery.
     • Clinical Trials: Prediction validation in multi-center trials.
     • MCED Developers: Production classifier performance monitoring.
     • Regulatory Inspections: Documentation of SaMD QC system.

— WHY IS THIS NEEDED?
MCED ML classifiers operate at sensitivity boundary where input data quality determines output reliability.
Model may produce confident prediction even on degraded sample — without QC this goes undetected.
Automated verification separates biological signal from technical noise.
This is critically important for patient safety in population screening.

⚠️  CRITICAL:
• Bisulfite Conversion ≥99%: Below this threshold, data is systematically distorted.
• Tissue Confidence ≥0.70: Low confidence = unreliable localization.
• Informative Fragments ≥5000: Lower count reduces statistical power.
• Feature Completeness ≥90%: Missing features may bias prediction.
• Artifacts: Any artifacts require retesting.

Key features:
• Seven-parameter MCED prediction reliability assessment
• Adaptive logic for positive and negative results
• Integration of epigenomic and ML-specific metrics
• Three-tier classification (Reliable / Low Confidence / Technical Fail)
• Compliance with FDA SaMD and EU IVDR requirements

Critical parameters:
• Tissue Confidence: ≥ 0.70 (for positive results)
• CpG Coverage: ≥ 30×
• Bisulfite Conversion: ≥ 99%
• Informative Fragments: ≥ 5,000
• Background Noise: ≤ 0.15
• Feature Completeness: ≥ 90%
• Artifacts: None detected

💡 Usage tips:
1. Confidence Thresholds: Set MinTissueConfidence based on validation cohort.
2. Conversion Control: Include control samples with known methylation status in each run.
3. Drift Monitoring: Track prediction score distribution over time for model drift detection.
4. Retesting: Upon TECHNICAL_FAIL, automatically initiate repeat analysis.
5. Documentation: Save all QC metrics as part of SaMD audit trail.

⚠️ Note: This utility assesses technical reliability of classifier prediction. It does not replace physician clinical interpretation but guarantees that MCED result is based on quality input data and correct model operation.

input.csv

SampleID,ClassifierName,ClassifierVersion,PredictionScore,PredictedTissue,TissueConfidence,MinTissueConfidence,CpG_Coverage_Mean_X,MinCpG_Coverage_X,BisulfiteConversion_Rate,MinBisulfiteConversion_Rate,BackgroundNoise_Score,MaxBackgroundNoise,InformativeFragments_Count,MinInformativeFragments,ArtifactDetected,FeatureCompleteness_Percent,MinFeatureCompleteness
MCED-2026-SCR-001,OncoDetect_MC,v3.2,0.88,Lung,0.92,0.70,45.0,30.0,0.995,0.99,0.05,0.15,18500,5000,false,97.5,90.0
MCED-2026-SCR-002,OncoDetect_MC,v3.2,0.45,Colon,0.52,0.70,22.0,30.0,0.975,0.99,0.22,0.15,3200,5000,true,78.0,90.0
MCED-2026-SCR-003,OncoDetect_MC,v3.2,0.03,None,0.0,0.70,52.0,30.0,0.998,0.99,0.03,0.15,22000,5000,false,98.2,90.0
MCED-2026-SCR-004,OncoDetect_MC,v3.2,0.72,Liver,0.85,0.70,38.0,30.0,0.992,0.99,0.08,0.15,12000,5000,false,94.0,90.0

URS & FS — User Requirements and Functional Specification

This document describes the controlled interface and behaviour of EarlyDetectionClassifierQcChecker for Early Detection Classifier QC Checker.

Domain limits and critical parameters

Key fragments from the source description are shown below. Before production use, limits must be verified against the approved specification, registration dossier and local SOPs.
  • This is critically important for patient safety in population screening.
  • ⚠️ CRITICAL:
  • • Bisulfite Conversion ≥99%: Below this threshold, data is systematically distorted.
  • • Tissue Confidence ≥0.70: Low confidence = unreliable localization.
  • • Informative Fragments ≥5000: Lower count reduces statistical power.
  • • Feature Completeness ≥90%: Missing features may bias prediction.
  • Critical parameters:
  • • Tissue Confidence: ≥ 0.70 (for positive results)
  • • CpG Coverage: ≥ 30×
  • • Bisulfite Conversion: ≥ 99%
  • • Informative Fragments: ≥ 5,000
  • • Background Noise: ≤ 0.15
  • • Feature Completeness: ≥ 90%

URS — User Requirements Specification

IDRequirementCriticalityAcceptance criterion
URS-001The utility shall accept an input.csv file for Early Detection Classifier QC Checker with headers defined in the data contract.HighThe file is processed without manual header editing.
URS-002The utility shall perform deterministic QC evaluation without machine learning and without probabilistic conformance decisions.HighIdentical input data, rule version and configuration produce reproducible results.
URS-003The utility shall validate mandatory fields, data types, ranges, units and domain plausibility.HighSchema, conversion and range errors are explicitly reported.
URS-004The utility shall apply domain limits and rules from the description, approved specification, registration dossier and local SOPs.HighEach check has PASS/WARNING/FAIL and a clear message.
URS-005The utility shall generate output.json with machine-readable results, source values, warnings, failures and critical findings.HighJSON is suitable for LIMS/ELN/MES integration and QA/QC review.
URS-006The utility shall preserve traceability between batch/sample, input file, applied rules and final status.HighOutput contains identifiers, checked parameters and audit metadata.
URS-007The documentation shall support IQ/OQ/PQ, CSV/CSA and review by internal QA or inspectors.MediumURS, FS, input/output contract and test scenarios are supplied with the utility.
URS-008The utility shall be used as a QC decision-support tool and not as a substitute for approved specifications and QA/QP release decision.MediumDocumentation states change control and limit-verification expectations.

input.csv contract

#FieldTypeSamplePurpose
1SampleIDstring / controlled vocabularyMCED-2026-SCR-001Sample or laboratory specimen identifier.
2ClassifierNamestring / controlled vocabularyOncoDetect_MCBiological/molecular component controlled as a CQA.
3ClassifierVersionstring / controlled vocabularyv3.2Controlled input parameter for deterministic QC rules.
4PredictionScoredecimal0.88Controlled input parameter for deterministic QC rules.
5PredictedTissuestring / controlled vocabularyLungControlled input parameter for deterministic QC rules.
6TissueConfidencestring / controlled vocabulary0.92Controlled input parameter for deterministic QC rules.
7MinTissueConfidencestring / controlled vocabulary0.70Controlled input parameter for deterministic QC rules.
8CpG_Coverage_Mean_Xdecimal45.0Controlled input parameter for deterministic QC rules.
9MinCpG_Coverage_Xdecimal30.0Controlled input parameter for deterministic QC rules.
10BisulfiteConversion_Ratedecimal0.995Controlled input parameter for deterministic QC rules.
11MinBisulfiteConversion_Ratedecimal0.99Controlled input parameter for deterministic QC rules.
12BackgroundNoise_Scoredecimal0.05Controlled input parameter for deterministic QC rules.
13MaxBackgroundNoisedecimal0.15Controlled input parameter for deterministic QC rules.
14InformativeFragments_Countinteger / decimal18500Count parameter used for microbiological, particulate or cellular control.
15MinInformativeFragmentsdecimal5000Controlled input parameter for deterministic QC rules.
16ArtifactDetectedstring / controlled vocabularyfalseControlled input parameter for deterministic QC rules.
17FeatureCompleteness_Percentdecimal97.5Controlled input parameter for deterministic QC rules.
18MinFeatureCompletenessdecimal90.0Controlled input parameter for deterministic QC rules.
SampleID,ClassifierName,ClassifierVersion,PredictionScore,PredictedTissue,TissueConfidence,MinTissueConfidence,CpG_Coverage_Mean_X,MinCpG_Coverage_X,BisulfiteConversion_Rate,MinBisulfiteConversion_Rate,BackgroundNoise_Score,MaxBackgroundNoise,InformativeFragments_Count,MinInformativeFragments,ArtifactDetected,FeatureCompleteness_Percent,MinFeatureCompleteness
MCED-2026-SCR-001,OncoDetect_MC,v3.2,0.88,Lung,0.92,0.70,45.0,30.0,0.995,0.99,0.05,0.15,18500,5000,false,97.5,90.0
MCED-2026-SCR-002,OncoDetect_MC,v3.2,0.45,Colon,0.52,0.70,22.0,30.0,0.975,0.99,0.22,0.15,3200,5000,true,78.0,90.0
MCED-2026-SCR-003,OncoDetect_MC,v3.2,0.03,None,0.0,0.70,52.0,30.0,0.998,0.99,0.03,0.15,22000,5000,false,98.2,90.0

Input validation rules

IDFieldRuleCriticality
VR-001SampleIDThe field shall match an approved dictionary or accepted string representation.High
VR-002ClassifierNameThe field shall match an approved dictionary or accepted string representation.High
VR-003ClassifierVersionThe field shall match an approved dictionary or accepted string representation.High
VR-004PredictionScoreThe field shall match an approved dictionary or accepted string representation.Medium
VR-005PredictedTissueThe field shall match an approved dictionary or accepted string representation.Medium
VR-006TissueConfidenceThe field shall match an approved dictionary or accepted string representation.Medium
VR-007MinTissueConfidenceThe field shall match an approved dictionary or accepted string representation.Medium
VR-008CpG_Coverage_Mean_XThe field shall match an approved dictionary or accepted string representation.Medium
VR-009MinCpG_Coverage_XThe field shall match an approved dictionary or accepted string representation.Medium
VR-010BisulfiteConversion_RateThe field shall match an approved dictionary or accepted string representation.Medium
VR-011MinBisulfiteConversion_RateThe field shall match an approved dictionary or accepted string representation.Medium
VR-012BackgroundNoise_ScoreThe field shall match an approved dictionary or accepted string representation.Medium
VR-013MaxBackgroundNoiseThe field shall match an approved dictionary or accepted string representation.Medium
VR-014InformativeFragments_CountThe field shall match an approved dictionary or accepted string representation.Medium
VR-015MinInformativeFragmentsThe field shall match an approved dictionary or accepted string representation.Medium
VR-016ArtifactDetectedThe field shall match an approved dictionary or accepted string representation.Medium
VR-017FeatureCompleteness_PercentThe field shall match an approved dictionary or accepted string representation.Medium
VR-018MinFeatureCompletenessThe field shall match an approved dictionary or accepted string representation.Medium

FS — Functional Specification

IDFunctionImplementation
FS-001CLI executionSupport execution modes: demo mode without arguments and production mode input.csv output.json.
FS-002CSV importRead input.csv in UTF-8/CSV-compatible format and validate header and expected columns.
FS-003Schema validationCheck mandatory fields, column count, unknown key fields and empty mandatory values.
FS-004Type conversionConvert numeric, flag and text values; invalid format is recorded as a row-level error.
FS-005Domain rule engineApply rules for Early Detection Classifier QC Checker, including critical limits from the description and approved specification.
FS-006Status aggregationProduce final status: FAIL for critical failure, WARNING for non-critical deviation, PASS for conformance.
FS-007JSON exportWrite output.json with detailed checks, source values, warnings, failures and critical findings.
FS-008Audit supportKeep result structure suitable for review, deviation investigation and calculation reproduction.
FS-009Integration contractSupport the scenario LIMS/ELN/MES → input.csv → utility → output.json → portal/admin review.
FS-010Error handlingReturn explicit messages for missing file, empty CSV, invalid schema, output write failure and invalid format.

Example output.json

{
  "utilityId": "earlydetectionclassifierqcchecker",
  "utilityFolder": "EarlyDetectionClassifierQcChecker",
  "package": "LiquidBiopsy",
  "overallStatus": "PASS|WARNING|FAIL",
  "sourceFile": "input.csv",
  "processedAtUtc": "2026-06-10T00:00:00Z",
  "checks": [
    {
      "parameter": "SampleID",
      "value": "MCED-2026-SCR-001",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-001"
    },
    {
      "parameter": "ClassifierName",
      "value": "OncoDetect_MC",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-002"
    },
    {
      "parameter": "ClassifierVersion",
      "value": "v3.2",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-003"
    },
    {
      "parameter": "PredictionScore",
      "value": "0.88",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-004"
    },
    {
      "parameter": "PredictedTissue",
      "value": "Lung",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-005"
    },
    {
      "parameter": "TissueConfidence",
      "value": "0.92",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-006"
    },
    {
      "parameter": "MinTissueConfidence",
      "value": "0.70",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-007"
    },
    {
      "parameter": "CpG_Coverage_Mean_X",
      "value": "45.0",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-008"
    },
    {
      "parameter": "MinCpG_Coverage_X",
      "value": "30.0",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-009"
    },
    {
      "parameter": "BisulfiteConversion_Rate",
      "value": "0.995",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-010"
    },
    {
      "parameter": "MinBisulfiteConversion_Rate",
      "value": "0.99",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-011"
    },
    {
      "parameter": "BackgroundNoise_Score",
      "value": "0.05",
      "status": "PASS|WARNING|FAIL",
      "message": "Deterministic rule-based check result",
      "ruleReference": "FS-RULE-012"
    }
  ],
  "criticalFindings": [],
  "warnings": [],
  "audit": {
    "inputHash": "sha256:<calculated at runtime>",
    "rulesVersion": "<utility executable version>",
    "documentation": "EarlyDetectionClassifierQcChecker.documentation.html"
  }
}

Traceability matrix

URSFSTestEvidence
URS-001FS-001, FS-002OQ-001Verify execution and import of valid input.csv.
URS-002FS-005, FS-006OQ-004Repeat the same dataset and compare output.json.
URS-003FS-003, FS-004, FS-010OQ-002, OQ-003Verify missing columns and invalid types.
URS-004FS-005, FS-006OQ-004, PQ-001Verify critical deviations on real/boundary data.
URS-005FS-007, FS-009OQ-005Verify JSON schema and downstream-system suitability.
URS-006FS-008OQ-006Verify identifiers and audit metadata.
URS-007FS-008, FS-010IQ-001, OQ-007Verify documentation completeness and control evidence.
URS-008FS-005, FS-008PQ-002Verify review workflow and no replacement of QA decision.

IQ/OQ/PQ test scenarios

IDScenarioExpected result
IQ-001Verify executable, input.csv, documentation and checksum availability.Delivery set is complete; version is recorded.
OQ-001Valid sample row from input.csv.PASS or acceptable WARNING according to rules.
OQ-002Remove a mandatory CSV column.Schema error or FAIL with missing-column reference.
OQ-003Place a non-numeric value into a numeric field.Type-conversion error with row/field reference.
OQ-004Set a critical parameter outside the limit.FAIL and critical finding.
OQ-005Verify output.json structure.All mandatory sections are present and JSON is valid.
OQ-006Verify batch/sample traceability.Input and result identifiers match.
PQ-001Verify 3–5 real user batches/samples.Result is confirmed by QC/QA review.
PQ-002Verify deviation workflow and manual QA decision.Utility supports review but does not replace approved decision.

QA/QC and change control

  • Do not rename columns without updating validator, documentation and test set.
  • Retain input.csv, output.json, executable version and checksum.
  • Before production use, perform IQ/OQ/PQ or equivalent CSV/CSA verification.
  • Critical limits shall be verified against the approved specification, registration dossier and local SOPs.
  • The utility provides structured QC decision support; final release decision remains with QA/QP and approved procedures.

Included in packages

Liquid Biopsy QC Suite

QC and pre-analytical control package for liquid biopsy workflows: cfDNA/ctDNA, CTC, EV/exosomes, methylation, NGS/qPCR/ddPCR, sample quality, contamination, sensitivity and reporting checks.

Open