CASE STUDY

Case Study: Cross-Border CAL Workflow Delivers Significant Cost Savings  

Continuous Active Learning Workflow for a Boutique UK Law Firm 

Client Boutique entertainment and media law firm, London 
Matter Type Complex commercial litigation 
Review Universe 70,773 documents 
Services Provided TAR 2.0 (Continuous Active Learning), managed review, validation 

The Challenge

A leading specialist law firm based in London was engaged in a complex commercial litigation matter requiring the review of a substantial cross-border document population. Faced with more than 70,000 potentially relevant documents, tight case deadlines, and mounting review costs, the client needed a defensible and efficient review strategy that could accelerate decision-making without sacrificing quality or accuracy. 

A traditional linear review model would have required significant reviewer hours, increased costs, and extended timelines—creating the very inefficiencies and inconsistencies that often define the eDiscovery “quality rollercoaster.” The client sought a more agile approach that could deliver reliable results, improve review precision, and provide transparency throughout the lifecycle of the matter.  

Sandline’s Approach

Sandline was retained as the independent forensic examiner and implemented a collection strategy rooted in fSandline Global deployed a Technology-Assisted Review (TAR 2.0) workflow powered by Continuous Active Learning (CAL), combining advanced analytics with experienced attorney oversight to create a smarter, more adaptive review process. Unlike legacy TAR 1.0 methodologies that depend on a static seed set, CAL continuously refines the predictive model as reviewers code documents, allowing the system to improve accuracy and prioritization in real time. 

Consistent with Sandline’s philosophy of combining leading technology with proactive project management and senior-level expertise, the workflow was designed to maximize efficiency while maintaining defensibility at every stage of the review. This approach enabled the legal team to focus reviewer time on the documents most likely to be relevant, significantly reducing unnecessary review effort while maintaining confidence in the results. 

Workflow Overview

Sandline ingested and processed a large volume of data, leveraging email threading, near-duplicate identification, and nonresponsive analysis to reduce the review population to an initial set of 70,773 documents. 

  • Documents were then surfaced to reviewers through a dynamic Priority Review Queue, ensuring that the materials most likely to be responsive were reviewed first and maximizing the value of each hour of attorney review time. 
  • As reviewers coded documents, the TAR model continuously retrained and recalibrated, refining responsiveness predictions after each review cycle and improving prioritization accuracy over time. 
  • Throughout the engagement, Sandline’s project management team closely monitored relevance rates, model stability, and statistical coverage metrics in real time, providing transparent reporting and proactive recommendations to the client as the review progressed. 
  • When relevance rates among queued documents began approaching the established 60% threshold, Sandline recommended a formal validation sample to determine whether the review could be defensibly concluded. 

To ensure consistency and accuracy prior to validation, the team also performed mass-tag reconciliation between the original relevance coding field and the TAR relevance field, resolving minor discrepancies—typically fewer than 10 documents per cycle—before final validation and closure. 

Review Composition 

Of the 70,773 documents in the review universe, 35,666 were coded by human reviewers while the TAR model predicted the remaining 35,107 documents. Among the human-reviewed set, 62.1% were found to be responsive—a high rate indicating well-targeted collection and search term efforts. 

Metric Result 
Total Documents in Review Universe 70,773 
Documents Coded by Human Reviewers 35,666 
Documents Predicted by TAR Model 35,107 
Human-Reviewed Responsiveness Rate 62.1% 

Validation Metrics 

Sandline performed a formal elusion sample of 500 documents drawn from the TAR-predicted non-responsive set. The results confirmed the review could defensibly conclude: 

Validation Metric Result 95% Confidence Interval 
Elusion Rate 4.6% 2.94% – 6.82% 
Precision 100.0% 100.00% – 100.00% 
Recall 93.2% 89.98% – 95.64% 
Richness 33.6% 32.75% – 34.68% 

What These Numbers Mean 

Elusion Rate (4.6%): The elusion rate estimates the proportion of responsive documents remaining in the set the model classified as non-responsive. At 4.6%, this translates to approximately 1,613 potentially missed documents (range: 1,029–2,392). This falls within accepted industry thresholds for a defensible TAR review and is classified as a low elusion rate given the responsiveness of the dataset. 

Precision (100.0%): Every document the model identified as responsive was genuinely responsive. The model retrieved zero false positives, a statistically robust result confirmed by the confidence interval. 

Recall (93.2%): The review captured approximately 93 out of every 100 responsive documents in the universe. This exceeds common industry benchmarks for defensible review. 

Richness (33.6%): The model estimated that 33.6% of the full universe was responsive. This figure appears lower than the 62.1% reviewer-coded rate because it accounts for the TAR-predicted non-responsive documents, which are expected to contain very little responsive material. Both figures are consistent with a well-functioning TAR process. 

Efficiency and Cost Savings 

Efficiency Metric Result 
Documents Eliminated from Manual Review 35,107 
Reduction in Manual Review Volume 49.6% 
Average Reviewer Speed 46 docs/hour 
Estimated Review Hours Saved ~763 hours 

TAR eliminated the need to manually review 35,107 documents. Based on the team’s average review speed of 46 documents per hour, this translates to approximately 763 hours of review time saved—time that would otherwise have been spent reading documents the model correctly identified as non-responsive. 

Client Outcome

Upon reviewing the validation metrics, the client confirmed acceptance of the elusion results and authorized conclusion of the TAR review. The final production set was then prepared for disclosure. 

The engagement demonstrated a review process that was not only cost-effective and legally defensible, but also reflective of Sandline’s commitment to delivering consistent, high-quality outcomes through agile workflows, senior-level expertise, and proactive collaboration. By leveraging a cross-border CAL-driven TAR 2.0 strategy, the team achieved strong accuracy while significantly reducing the time and expense of manual review—helping the client move beyond the traditional eDiscovery “quality rollercoaster” and toward a more efficient, predictable, and defensible review process. 

Why Sandline

  • Senior level project management support with 30-minute response times with AI expertise. 
  • Real-time reporting on model health, relevance trends, and review progress. 
  • Proactive communication: regular status updates including mass tagging reconciliation, relevance rate tracking, and clear recommendations on when to validate and conclude. 
  • Defensibility-first approach: formal elusion sampling with confidence intervals, documented methodology, and transparent client sign-off. 
  • Platform expertise: deep experience with Continuous Active Learning workflows and Priority Review Queues, within RelOne and Everlaw,  ensuring reviewers spend time where it matters most. 
  • Scalable global team, including London-based resources with global capabilities across US, EMEA and APAC time zones