Skip to content

In this repository, scripts used for and descriptions of transformations of raw FNCT towards semantic integrated data can be found.

License

Notifications You must be signed in to change notification settings

MarkusSchilling/fnct-data-transformation

Repository files navigation

FNCT Data Transformation

This repository hosts a set of Python scripts developed to streamline the processing and semantic integration of Full-Notch Creep Test (FNCT) data. The scripts are provided as Jupyter Notebooks (ipynb files). FNCT is a critical method used to assess the slow crack growth (SCG) and environmental stress cracking (ESC) resistance of polymers, particularly polyolefins like high-density polyethylene (PE-HD) - see Literature section for more details.

Overview

The scripts transform raw and manually entered/added FNCT data into organized data stored using a standardized vocabulary. This process leads to the creation of data aligned with the FAIR principles (Findable, Accessible, Interoperable, and Reusable) and therefore enhances data interoperability and prepares them for further automated analysis. Moreover, the conversion of raw FNCT data into semantically enriched formats, such as RDF, is facilitated. For the creation of semantic integrated FNCT data, the OntoFNCT framework may be used. The transformation workflow includes the following key steps:

  1. Folder Setup: Automatically organizes directories for primary data, metadata, and secondary data.
  2. Excel File Processing: Converts raw FNCT data from Excel files into CSV format, ensuring data integrity and preventing overwrites.
  3. Secondary Data Aggregation: Combines and processes secondary data from multiple sources into a unified CSV file, including key metrics calculations like final elongation and residual fracture surface based on available information.
  4. Metadata Integration: Extracts and stores metadata separately, capturing essential test information for traceability.

Example Data

Besides the scripts, some example FNCT data stemming from FNCT experiments performed at Bundesanstalt für Materialforschung und -prüfung (BAM), Berlin, Germany, are provided in the example data folder in this repository. This data regarded is also available in the open Zenodo repository Dataset of comprehensive Full-notch creep tests (FNCT) of selected high-density polyethylene (PE-HD) materials.

Getting Started

The scripts are designed to be user-friendly, with built-in checks for folder existence and overwrite protection to safeguard data integrity. For researchers and test operators, this provides an efficient way to prepare FNCT data for further analysis or semantic integration without the need for extensive manual data handling. In particular, files that can be saved and examined step by step are created so that the overall process is traceable and not all scripts have to be executed. Depending on the requirements, only parts of the scripts can be executed (not the entire pipeline, if applicable). It is also possible and desirable to adapt the scripts to your own requirements.

Requirements

  • Python 3.x
  • Libraries: pandas, numpy, rdflib

License

This repository is open-source and available under the MIT License.

Literature

For more details on the scripts presented in this repository and when using those, please refer to

M. Schilling, N. Marschall, U. Niebergall, M. Böhning, TBD.

Bibtex:

@article{Schilling2024,
   author = {Schilling, Markus and Marschall, Niklas and Niebergall, Ute and Boehning, Martin},
   title = {Modernizing FNCT Data Handling in Polymer Labs: Towards Efficient Management},
   journal = {Polymer},
   pages = {},
   ISSN = {},
   DOI = {},
   url = {},
   year = {2024},
   type = {Journal Article}
}

available open access at: Polymer.

A dataset comprising example FNCT data can be found in the open Zenodo repository named Dataset of comprehensive Full-notch creep tests (FNCT) of selected high-density polyethylene (PE-HD) materials (2023).

For more details on digitalization efforts in the field of materials science and engineering (MSE) and the FNCT, the following literature may be considered.

Digitalization in MSE

FNCT

About

In this repository, scripts used for and descriptions of transformations of raw FNCT towards semantic integrated data can be found.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published