Text and data mining

As the volume of scholarly output increases, we recognize that researchers are increasingly interested in using tools such as text and data mining (TDM) to explore patterns and trends across large databases of content. Elsevier has for many years actively collaborated with researchers and institutes to facilitate text and data mining, both by enabling access and by investing in our platforms to support these initiatives. Our text and data mining policy is intended to be a set of guidelines to help researchers understand how to easily access and mine content published by Elsevier.

We are always happy to support and accommodate researchers who have specific text mining needs and for any questions please email universalaccess@elsevier.com

Policy

Elsevier's policy

As a publisher we believe it is our job to help meet the needs of researchers and we are committed to reducing the barriers to mining content.  To achieve this, we have adopted a license –based approach which both formalizes the right to mine into our academic agreements and delivers a flexible way in which researchers can gain access to our API through a self-service portal. Specially:

  • Academic subscribers:  Text- and data-mining enabling clauses for non-commercial purposes will be included in all new ScienceDirect subscription agreements and upon renewal for existing customers. Librarians interested in adding the TDM clause to their existing agreement prior to renewal are able to request a simple contract e-amendment via their Elsevier Account Manager.
  • Corporate and other subscribers: Please contact your Elsevier Account Manager to find out more about our text mining products and services. 
  • Non-subscriber access: Requests are considered on a case-by-case basis, and can be made by emailing universalaccess@elsevier.com.

We request that all access to content for text mining purposes takes place through our APIs and remind you that in order to maintain performance and availability for all users, the terms and conditions of access to ScienceDirect continue to prohibit the use of robots, spiders, crawlers or other automated programs, or algorithms to download content from the website itself.

How to gain access

How to gain access to the API

We are committed to streamlining the administrative process for mining and have created a self- service developer's portal to enable researchers to easily gain access to the ScienceDirect API's. Once the institutional agreement is updated, researchers at subscribing institutions will need to follow three steps:

  1. Register their details using the online form on the developer's website
  2. Accept our API conditions via a "click-through" agreement
  3. Receive a unique API token that will enable the delivery of the content they wish to mine, delivered in an XML format suitable for text mining

The registration for the API is quick and simple see our developer's website for further details.

Conditions of text mining

Terms and conditions of text and data mining

  • Please note that text mining access is provided to subscribers for noncommercial research purposes only. 
  • All access to content for text mining purposes must take place through our APIs and remind you that in order to maintain performance and availability for all users, the terms and conditions of access to ScienceDirect continue to prohibit the use of robots, spiders, crawlers or other automated programs, or algorithms to download content from the website itself.
  • Text mining outputs must adhere to the following conditions:
    • Outputs can contain "snippets" of up to 200 characters, excluding text entity matching or bibliographic metadata.
    • Where Snippets and/or bibliographic metadata are distributed, they should be accompanied by a DOI link that links back to original content.
    • Where images are used you should clear the rights for reuse with the relevant copyright owner and/or rights holder.
    • Any TDM Output which is redisplayed should include a proprietary notice in the following form: "Some rights reserved. This work permits non-commercial use, distribution, and reproduction in any medium, provided the original author and source are credited." Researcher should recognize the fact that although the researcher will 'own' his or her research output, the snippets displayed in the output may contain rights of the publisher, the underlying author or third parties

For further details please see our TDM license information.

For researchers who have specific text mining needs which fall outside the terms and condition above, please email your details to univeraslaccess@elsevier.com  and we will be happy to accommodate.

Feedback

Feedback

Elsevier's updated policy is a reflection of our ongoing collaboration within the research community. We encourage anyone with feedback and ideas to contact us via universalaccess@elsevier.com.

Elsevier's open letter in response to the request for Elsevier to withdraw its text and data mining policy

Links and resources