Efficient Internal Investigation with RAL in Review Center

Using custom analytics and RelOne‘s new assisted learning tool (RAL), Sandline‘s Review team successfully completed an internal investigation review ahead of schedule while only reviewing 55% of the document set. This innovative workflow not only ensured a high recall rate but also significantly reduced review costs.

Challenges

The project presented several key challenges. First, the client required a fast turnaround, setting a demanding 30-day deadline for completing the review. Additionally, budget constraints necessitated a cost-effective approach without sacrificing quality. Finally, the initial dataset contained 114,672 documents, which required extensive culling to narrow the scope and focus the review effort.

Expertise

To overcome these challenges, our team applied advanced filters and culling methods, reducing the document set from 114,672 to 46,065. We utilized a Prioritization Review in the Review Center, setting a relevance cutoff at 60%. After reviewing 25,334 documents, the team paused the review upon determining that the relevance rate for the remaining 20,000 documents was under 10%. To validate the results, we conducted an “Elusion” test, which confirmed a recall rate of 96.6% and an elusion rate of just 2.5%. These results are among the best we’ve achieved with Continuous Active Learning (CAL) and highlight the effectiveness of this new version of the tool.

Results

The review was completed two weeks ahead of schedule, demonstrating the efficiency of the workflow and exceeding the client’s expectations. The built-in classification index in the Review Center eliminated the need for manual score management, while automatic updates and streamlined validation testing enhanced accuracy and ease of use. The updated dashboards provided clear metrics on elusion rate, recall, and precision, further simplifying the process.

Client Feedback

Thanks so much to you, Stacey, Val and the entire project team for all of your excellent support over the last few weeks, and please also extend our sincere thanks to the review team, who did a great job both substantively and in making such good progress in the final weeks of December!