Tokenized product information for centrally approved medicines within EU (extracted May 3, 2022)
type: Dataset
description: The text corpus was compiled on May 3, 2022, by scripted downloading of all available English language product information files for all centrally approved medicinal products within the EU, from the European Medicines Agency website. Package Leaflet (PL) and Summary of product characteristics (SmPC) documents for each medicinal product, excluding multiplicate documents for medicinal products with more than one strength or pharmaceutical preparation, were used. The PDF files were scraped using the pdfplumber version 0.6.1 package in Python 3.8.10 to extract all text except page numbering, headers, and footers. Line breaks and special characters (excluding punctuation characters) were removed, and punctuation was added to sentences where this was missing (such as headings) to avoid false aggregation. All paragraphs were tokenized on a sentence level using the Natural Language Toolkit (NLTK) version 3.7 tokenizer This database contains sentence-level tokenized product infomation from all centrally approved medicinal products within the EU (May 3, 2022) including Summary of product characteristics (SmPC) and Package leaflet (PL) documents. A total of 1258 medicinal products were initially included, of which 5 were subsequently excluded due to document compatibility issues. From these, a total of 783 K sentences were extracted from PL and SmPC documents.
citation: CreativeWork
  name: Bergman E, Sherwood K, Forslund M, Arlett P, Westman G (2022) A natural language processing approach towards harmonisation of European medicinal product information. PLoS ONE 17(10): e0275386. https://doi.org/10.1371/journal.pone.0275386
conditions of access: http://publications.europa.eu/resource/authority/access-right/PUBLIC
conditions of access: info:eu-repo/semantics/openAccess
creative work status: completed
  type: DefinedTerm
  in defined term set: http://publications.europa.eu/resource/authority/dataset-status
  term code: COMPLETED
creator: Gabriel Westman
date modified: 2022-10-25
date published: 2022-09-29
language: English
is part of: https://doi.org/10.5878/ywxf-f380
keywords: Computer and Information Sciences
  type: DefinedTerm
  term code: 102
keywords: Basic Medicine
  type: DefinedTerm
  term code: 301
keywords: Information Science
keywords: Artificial Intelligence
keywords: Pharmacy
publisher: Uppsala University
distribution: data/PL_export_all_220822.csv
  type: DataDownload
  additional type: data
  conditions of access: http://publications.europa.eu/resource/authority/access-right/PUBLIC
  conditions of access: info:eu-repo/semantics/openAccess
  content size: 45445981
  encoding format: text/csv
distribution: data/SmPC_export_all_220822.csv
  type: DataDownload
  additional type: data
  conditions of access: http://publications.europa.eu/resource/authority/access-right/PUBLIC
  conditions of access: info:eu-repo/semantics/openAccess
  content size: 157577340
  encoding format: text/csv
distribution: documentation/PI data desc.txt
  type: DataDownload
  additional type: documentation
  conditions of access: http://publications.europa.eu/resource/authority/access-right/PUBLIC
  conditions of access: info:eu-repo/semantics/openAccess
  content size: 986
  encoding format: text/plain
version: 1

PropertyValue
property ID: DOI
value: 10.57804/ggrw-hr06

PropertyValue
property ID: DOI
value: 10.1371/journal.pone.0275386

Gabriel Westman
type: Person
affiliation: Uppsala University
family name: Westman
given name: Gabriel

Uppsala University
type: Organization

English
type: Language
alternate name: eng

Information Science
type: DefinedTerm
description: The field of knowledge, theory, and technology dealing with the collection of facts and figures, and the processes and methods involved in their manipulation, storage, dissemination, publication, and retrieval. It includes the fields of COMMUNICATION; PUBLISHING; LIBRARY SCIENCE; and informatics.
term code: D007254

LINGUISTICS
type: DefinedTerm

Artificial Intelligence
type: DefinedTerm
description: Theory and development of COMPUTER SYSTEMS which perform tasks that normally require human intelligence. Such tasks may include speech recognition, LEARNING; VISUAL PERCEPTION; MATHEMATICAL COMPUTING; reasoning, PROBLEM SOLVING, DECISION-MAKING, and translation of language.
term code: D001185

Pharmacy
type: DefinedTerm
description: The practice of compounding and dispensing medicinal preparations.
term code: D010604