Databricks for NLP and Content Analysis at Elsevier Labs

Elsevier Labs adopted Databricks to develop natural language processing (NLP) algorithms across their vast content archive. The platform enabled distributed development, faster experimentation, and collaboration through shared notebooks. Previously fragmented workflows were unified, allowing multiple teams to process terabytes of text and petabytes of supplementary data efficiently.

Benefits & outcomes

  • Reduced project timelines from weeks to days
  • Expanded team involvement from 2–3 specialists to 15+ contributors
  • Accelerated algorithm development (e.g., CoreNLP integrated in a day)
  • Created a concordancer in under an hour for large-scale regex querying
  • Improved internal visibility and reusability of R&D outputs
  • Centralized code and data access, enhancing collaboration and oversight

Notes & quotes

“We used to have to do a lot of manual data transfer… Databricks eliminated that.” — Ron Daniel, Labs Director

“I can take one of Elsevier Labs’ existing Databricks notebooks and immediately demonstrate what they were looking for.” — Brad Allen, Chief Architect

The platform transformed notebook-based collaboration into an informal demo environment for senior stakeholders.


Publisher / company: Elsevier / Databricks
Date of case study: 11/12/2015
Source: https://www.databricks.com/blog/2015/11/12/elsevier-labs-deploys-databricks-for-unified-content-analysis.html