Text and data mining
As the volume of scholarly output increases, we recognize that researchers are increasingly interested in using tools such as text and data mining (TDM) to explore patterns and trends across large databases of content. Elsevier has for many years actively collaborated with researchers and institutes to facilitate text and data mining, both by enabling access and by investing in our platforms to support these initiatives. Our text and data mining policy is intended to be a set of guidelines to help researchers understand how to easily access and mine content published by Elsevier.
We are always happy to support and accommodate researchers who have specific text mining needs and for any questions please email firstname.lastname@example.org
As a publisher we believe it is our job to help meet the needs of researchers and we are committed to reducing the barriers to mining content. To achieve this, we have adopted a license–based approach which both formalizes the right to mine into our academic agreements and delivers a flexible way in which researchers can gain access to our API through a self-service portal. Specially:
- Academic subscribers: Researchers can text mine subscribed content on ScienceDirect for non-commercial purposes, via the ScienceDirect API's. Text and data mining enabling clauses for non-commercial purposes will be included in all new ScienceDirect subscription agreements and upon renewal for existing customers. Librarians interested in adding the TDM clause to their existing agreement prior to renewal are able to request a simple contract e-amendment via their Elsevier Account Manager.
- Corporate and other subscribers: Please contact your Elsevier Account Manager to find out more about our text mining products and services.
- Non-subscriber access: Requests are considered on a case-by-case basis, and can be made by emailing email@example.com.
We request that all access to content for text mining purposes takes place through our APIs and remind you that in order to maintain performance and availability for all users, the terms and conditions of access to ScienceDirect continue to prohibit the use of robots, spiders, crawlers or other automated programs, or algorithms to download content from the website itself.
For open access content: Text and data mining permissions are determined by the author's choice of user license. This information is detailed in the individual articles.
How to gain access
How to gain access to the API
We are committed to streamlining the administrative process for mining and have created a self-service developer's portal to enable researchers to easily gain access to the ScienceDirect API's. Once the institutional agreement is updated, researchers at subscribing institutions will need to follow three steps:
- Register their details using the online form on the developer's website.
- Accept our API conditions via a "click-through" agreement.
- Receive a unique API token that will enable the delivery of the content they wish to mine, delivered in an XML format suitable for text mining.
Please note that open access content can be accessed via our API for text and data mining purposes without registration and without having to obtain or use an API key.
The registration for the API is quick and simple see our developer's website for further details.
Conditions of text mining
Terms and conditions of text and data mining
- Please note that text mining access is provided to subscribers for noncommercial research purposes only.
- All access to content for text mining purposes must take place through our APIs and remind you that in order to maintain performance and availability for all users, the terms and conditions of access to ScienceDirect continue to prohibit the use of robots, spiders, crawlers or other automated programs, or algorithms to download content from the website itself.
- Text mining outputs must adhere to the following conditions:
- Outputs can contain "snippets" of up to 200 characters, excluding text entity matching or bibliographic metadata.
- Where Snippets and/or bibliographic metadata are distributed, they should be accompanied by a DOI link that links back to original content.
- Where images are used you should clear the rights for reuse with the relevant copyright owner and/or rights holder.
- Any TDM Output which is redisplayed should include a proprietary notice in the following form: "Some rights reserved. This work permits non-commercial use, distribution, and reproduction in any medium, provided the original author and source are credited." Researcher should recognize the fact that although the researcher will 'own' his or her research output, the snippets displayed in the output may contain rights of the publisher, the underlying author or third parties
- For open access content mined through the API, the terms and conditions of re-use are governed by the applicable open access user license.
For further details please see our TDM agreement information.
For researchers who have specific text mining needs which fall outside the terms and condition above, please email your details to firstname.lastname@example.org and we will be happy to accommodate.
Elsevier's updated policy is a reflection of our ongoing collaboration within the research community. We encourage anyone with feedback and ideas to contact us via email@example.com.