Are you planning a text mining or AI project? Becker Library can help you find vendor policies on scraping and training and navigate questions around limitations on access or use.
Before You Start
To ensure continued, uninterrupted access to library databases for the university, it is essential to stay compliant with vendor policies. Before you begin scraping or training, we encourage you to review our updated subject guide on Text Mining and AI with Library Resources, specifically:
- Before You Get Started: Essential pre-project steps.
- A Note on GenAI Tools: Guidance on using library data with Generative AI tools.
Finding Datasets and Tools
The updated guide also includes information on library-licensed resources such as Web of Science API Expanded and Elsevier Research Project APIs. For select resources, you can find:
- The scope of the data available
- Links to publisher policies and restrictions on use
- Links to vendor-supplied documentation on how to obtain API keys (where applicable) and access data
The guide also identifies key open resources (e.g., PubMed Central, arXiv) that may similarly meet your project needs.
Need Help?
If you have questions about a specific product or use case, email us at AskBecker@wustl.edu or reach out to the vendor directly.