Outlier_Detection_Grubb_Dixon

Outlier Detection Grubb Dixon

Lumex QC URS & FS input.csv output.json rule-based LIMS-ready outlier
Open selection

Utility description: Outlier Detection Grubb Dixon

Outlier Detection Grubb Dixon — Statistical Outlier Analysis (Grubbs and Dixon)

ℹ️  Utility applies Grubbs' and Dixon's criteria to detect anomalous values:
   • Grubbs' Test (G): For normally distributed data (N > 3).
   • Dixon's Q Test: For small samples (3 ≤ N ≤ 10).
   • Significance Level (Alpha): Usually 0.05 (95% confidence interval).

⚠️  CRITICAL: Presence of an outlier (Status: FAIL) requires investigation!
   Automatic removal of outliers without technical justification is prohibited by GMP.

Usage:
 Outlier_Detection_Grubb_Dixon.exe                            → demo mode (console output)
 Outlier_Detection_Grubb_Dixon.exe input.csv output.json      → evaluate your data

Input format:
BatchNumber,Alpha,Value1,Value2,Value3,...

Example:
 STAT-SERIES-001,0.05,10.1,10.2,10.0,10.3,12.5

— WHY IS THIS NEEDED?
During method validation (USP <1225>) and routine control (e.g., Uniformity of Dosage Units USP <905>), ensuring data homogeneity is crucial.
• Outliers may arise from pipetting errors, air bubbles, instrument glitches, or sample heterogeneity.
• Grubbs' test is most powerful for detecting a single outlier in a normal distribution.
• Dixon's Q test is simple to calculate and widely used for quick checks of small series (3-10 replicates).
• The utility automatically calculates statistics (G and Q) and compares them with critical tabular values.

⚠️  CRITICAL:
• "FAIL" status means the statistical hypothesis of no outliers is rejected.
• If an outlier is detected, raw data (chromatograms, spectra) must be checked for technical errors.
• Retesting of the series is allowed only according to approved SOPs.
• For multiple outliers, iterative methods or other tests (e.g., Tukey's test) are required.

Key features:
• Dual check (Grubbs + Dixon) for increased reliability.
• Calculation of cleaned mean (excluding outlier) to assess anomaly impact.
• Report generation for LIMS archiving.

Critical parameters:
• Grubbs G Statistic: < Critical Value
• Dixon Q Statistic: < Critical Value
• Alpha: 0.05 (Standard)

💡 Usage tips:
1. Use for replicate injection series (Precision) or individual dosage units (Uniformity).
2. Ensure data follows normal distribution before applying Grubbs' test.
3. For N > 10, Dixon's test is less effective; rely on Grubbs' or multiple outlier tests.
4. Always document the decision to exclude a data point from calculation.

⚠️ Note: This utility implements classical compendial approaches to handling anomalous results, consistent with FDA and EMA Data Integrity requirements.

input.csv

BatchNumber,Alpha,Val1,Val2,Val3,Val4,Val5,Val6,Val7,Val8,Val9,Val10
STAT-SERIES-001,0.05,10.1,10.2,10.0,10.3,10.1,10.2,10.1,10.0,10.2,10.1
STAT-SERIES-002,0.05,10.1,10.2,10.0,10.3,10.1,12.5,10.1,10.0,10.2,10.1
STAT-SERIES-003,0.05,5.0,5.1,5.2,5.0,5.1,5.0,5.1,5.2,5.0,5.1

Utility description

Outlier Detection Grubb Dixon — Statistical Outlier Analysis (Grubbs and Dixon)

ℹ️  Utility applies Grubbs' and Dixon's criteria to detect anomalous values:
   • Grubbs' Test (G): For normally distributed data (N > 3).
   • Dixon's Q Test: For small samples (3 ≤ N ≤ 10).
   • Significance Level (Alpha): Usually 0.05 (95% confidence interval).

⚠️  CRITICAL: Presence of an outlier (Status: FAIL) requires investigation!
   Automatic removal of outliers without technical justification is prohibited by GMP.

Usage:
 Outlier_Detection_Grubb_Dixon.exe                            → demo mode (console output)
 Outlier_Detection_Grubb_Dixon.exe input.csv output.json      → evaluate your data

Input format:
BatchNumber,Alpha,Value1,Value2,Value3,...

Example:
 STAT-SERIES-001,0.05,10.1,10.2,10.0,10.3,12.5

— WHY IS THIS NEEDED?
During method validation (USP <1225>) and routine control (e.g., Uniformity of Dosage Units USP <905>), ensuring data homogeneity is crucial.
• Outliers may arise from pipetting errors, air bubbles, instrument glitches, or sample heterogeneity.
• Grubbs' test is most powerful for detecting a single outlier in a normal distribution.
• Dixon's Q test is simple to calculate and widely used for quick checks of small series (3-10 replicates).
• The utility automatically calculates statistics (G and Q) and compares them with critical tabular values.

⚠️  CRITICAL:
• "FAIL" status means the statistical hypothesis of no outliers is rejected.
• If an outlier is detected, raw data (chromatograms, spectra) must be checked for technical errors.
• Retesting of the series is allowed only according to approved SOPs.
• For multiple outliers, iterative methods or other tests (e.g., Tukey's test) are required.

Key features:
• Dual check (Grubbs + Dixon) for increased reliability.
• Calculation of cleaned mean (excluding outlier) to assess anomaly impact.
• Report generation for LIMS archiving.

Critical parameters:
• Grubbs G Statistic: < Critical Value
• Dixon Q Statistic: < Critical Value
• Alpha: 0.05 (Standard)

💡 Usage tips:
1. Use for replicate injection series (Precision) or individual dosage units (Uniformity).
2. Ensure data follows normal distribution before applying Grubbs' test.
3. For N > 10, Dixon's test is less effective; rely on Grubbs' or multiple outlier tests.
4. Always document the decision to exclude a data point from calculation.

⚠️ Note: This utility implements classical compendial approaches to handling anomalous results, consistent with FDA and EMA Data Integrity requirements.

URS & FS — User Requirements and Functional Specification

This document describes the controlled interface, user requirements and functional behaviour of Outlier_Detection_Grubb_Dixon. The utility is intended for automated verification of laboratory, pharmacopoeial, analytical or manufacturing QC parameters using input.csv and producing a structured output.json result.

Domain limits and critical parameters

Before production use, all limits must be verified against the approved specification, registration dossier, pharmacopoeial monograph, validated method and local SOPs.
  • • Outliers may arise from pipetting errors, air bubbles, instrument glitches, or sample heterogeneity.
  • • Grubbs' test is most powerful for detecting a single outlier in a normal distribution.
  • • Dixon's Q test is simple to calculate and widely used for quick checks of small series (3-10 replicates).
  • • The utility automatically calculates statistics (G and Q) and compares them with critical tabular values.
  • • "FAIL" status means the statistical hypothesis of no outliers is rejected.
  • • If an outlier is detected, raw data (chromatograms, spectra) must be checked for technical errors.
  • • Retesting of the series is allowed only according to approved SOPs.
  • • For multiple outliers, iterative methods or other tests (e.g., Tukey's test) are required.
  • • Dual check (Grubbs + Dixon) for increased reliability.
  • • Calculation of cleaned mean (excluding outlier) to assess anomaly impact.
  • • Report generation for LIMS archiving.
  • • Grubbs G Statistic: < Critical Value
  • • Dixon Q Statistic: < Critical Value
  • • Alpha: 0.05 (Standard)
  • • Dixon's Q Test: For small samples (3 ≤ N ≤ 10).

URS — User Requirements Specification

IDRequirementCriticalityAcceptance criterion
URS-001The utility shall accept an input.csv file with exact headers defined in the data contract.HighThe file is processed without manual header editing.
URS-002The utility shall perform deterministic evaluation for Outlier Detection Grubb Dixon using input values, approved limits and domain rules.HighEach row receives a PASS / WARNING / FAIL status.
URS-003The utility shall validate mandatory fields, data types, numeric ranges, units and domain plausibility.HighSchema, format and conversion errors are explicitly reported.
URS-004The utility shall identify critical deviations for parameters stated in the method description and specification.HighA critical deviation causes FAIL or a dedicated critical finding.
URS-005The utility shall generate output.json with machine-readable results, source values, warnings and failures.HighJSON is suitable for LIMS/ELN/MES integration, QA/QC review and archival.
URS-006The result shall not depend on machine learning or undocumented heuristics.MediumAll decisions are based on explicit rules, thresholds and input values.
URS-007The system shall preserve traceability between batch/sample, input data, applied rules and final status.HighThe output contains the batch/sample identifier and checked parameters.
URS-008The documentation shall support IQ/OQ/PQ preparation and inspection discussion.MediumURS, FS, CSV/JSON contract and test scenarios are supplied with the utility.
URS-009The utility shall support batch processing of multiple input.csv rows.MediumEach row is evaluated independently; errors in one row do not mask errors in others.
URS-010The utility shall support a simple operating model: demo mode and execution with input/output files.MediumThe CLI scenario is reproducible in test and production environments.

input.csv contract

#FieldTypeSamplePurpose
1BatchNumberstringSTAT-SERIES-001Batch or lot identifier used for traceability, review and deviation investigation.
2Alphadecimal0.05Controlled input parameter used by deterministic QC rules and traceable result generation.
3Val1string / decimal10.1Controlled input parameter used by deterministic QC rules and traceable result generation.
4Val2string / decimal10.2Controlled input parameter used by deterministic QC rules and traceable result generation.
5Val3string / decimal10.0Controlled input parameter used by deterministic QC rules and traceable result generation.
6Val4string / decimal10.3Controlled input parameter used by deterministic QC rules and traceable result generation.
7Val5string / decimal10.1Controlled input parameter used by deterministic QC rules and traceable result generation.
8Val6string / decimal10.2Controlled input parameter used by deterministic QC rules and traceable result generation.
9Val7string / decimal10.1Controlled input parameter used by deterministic QC rules and traceable result generation.
10Val8string / decimal10.0Controlled input parameter used by deterministic QC rules and traceable result generation.
11Val9string / decimal10.2Controlled input parameter used by deterministic QC rules and traceable result generation.
12Val10string / decimal10.1Controlled input parameter used by deterministic QC rules and traceable result generation.
BatchNumber,Alpha,Val1,Val2,Val3,Val4,Val5,Val6,Val7,Val8,Val9,Val10
STAT-SERIES-001,0.05,10.1,10.2,10.0,10.3,10.1,10.2,10.1,10.0,10.2,10.1
STAT-SERIES-002,0.05,10.1,10.2,10.0,10.3,10.1,12.5,10.1,10.0,10.2,10.1
STAT-SERIES-003,0.05,5.0,5.1,5.2,5.0,5.1,5.0,5.1,5.2,5.0,5.1

FS — Functional Specification

IDFunctionImplementation
FS-001CSV importRead input.csv in UTF-8/CSV-compatible format and validate the header and expected columns.
FS-002Schema validationCheck mandatory fields, column count, critical missing values and row structure.
FS-003Type conversionConvert numeric, flag and text values; invalid formats are recorded as row-level errors.
FS-004Domain rule engineApply domain rules for Outlier Detection Grubb Dixon, including limits from the utility description and approved specification.
FS-005Status aggregationProduce final status: FAIL for critical failure, WARNING for non-critical deviation, PASS for conformance.
FS-006JSON exportWrite output.json with detailed checks, source values, warnings, failures and critical findings.
FS-007Audit supportKeep the result structure suitable for review, deviation investigation, calculation reproduction and IQ/OQ/PQ preparation.
FS-008Integration contractSupport the production scenario: LIMS/ELN/MES creates input.csv, the utility returns output.json, and the portal displays description and documentation.
FS-009Error handlingReport errors unambiguously and do not substitute missing values with calculated values unless the rule is explicitly defined.
FS-010Version control supportDocument the utility version, input contract, executable checksum and rule application date.

Example output.json

{
  "utilityId": "outlier-detection-grubb-dixon",
  "utilityName": "Outlier_Detection_Grubb_Dixon",
  "overallStatus": "PASS|WARNING|FAIL",
  "sourceFile": "input.csv",
  "checks": [
    {
      "parameter": "BatchNumber",
      "value": "STAT-SERIES-001",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    },
    {
      "parameter": "Alpha",
      "value": "0.05",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    },
    {
      "parameter": "Val1",
      "value": "10.1",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    },
    {
      "parameter": "Val2",
      "value": "10.2",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    },
    {
      "parameter": "Val3",
      "value": "10.0",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    },
    {
      "parameter": "Val4",
      "value": "10.3",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    },
    {
      "parameter": "Val5",
      "value": "10.1",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    },
    {
      "parameter": "Val6",
      "value": "10.2",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    },
    {
      "parameter": "Val7",
      "value": "10.1",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    },
    {
      "parameter": "Val8",
      "value": "10.0",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    },
    {
      "parameter": "Val9",
      "value": "10.2",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    },
    {
      "parameter": "Val10",
      "value": "10.1",
      "status": "PASS|WARNING|FAIL",
      "message": "Rule-based check result"
    }
  ],
  "criticalFindings": [],
  "warnings": [],
  "generatedFor": "QA/QC review and LIMS integration"
}

Traceability matrix

URSFSOQ/PQ coverage
URS-001, URS-003FS-001, FS-002, FS-003OQ-001/OQ-002/OQ-003
URS-002, URS-004FS-004, FS-005OQ-004/PQ-001
URS-005, URS-007FS-006, FS-007OQ-005/PQ-002
URS-008, URS-010FS-008, FS-010IQ-001/OQ-006

OQ/PQ test scenarios

IDScenarioExpected result
OQ-001Valid sample rowPASS or acceptable WARNING according to the rules.
OQ-002Mandatory column missingSchema error or FAIL.
OQ-003Non-numeric value in numeric fieldType-conversion error.
OQ-004Critical parameter outside limitFAIL and critical finding.
OQ-005Multiple rows with different statusesIndependent row-level evaluation.
PQ-001User real batch/sampleReviewed result with retained input/output files.

QA/QC and change control

  • Do not rename columns without updating the validator, documentation and test set.
  • Retain input.csv, output.json, executable version, documentation and checksum.
  • Before production use, perform IQ/OQ/PQ or equivalent CSV/CSA verification.
  • Critical limits must be verified against the approved specification, local SOPs and registration dossier.

Included in packages

Lumex QC Suite

A single Lumex package combining the former Lumex and Lumex2 sets: instrumental and general pharmaceutical QC, AAS/ICP, CE, HPLC, NIR/PAT, stability, dissolution, content uniformity, system suitability and statistical control.

Open

Radiology QC Suite

QC package for radiology and diagnostic imaging: radiopharmaceuticals, PET/SPECT, contrast media, iodinated and gadolinium products, plus particle, sterility and endotoxin checks.

Open