Automating (Meta)Data Transfer to Coscine (RDM II-modular) - Registration for Doctoral Candidates
Dr. rer. nat. Ute Trautwein-Bruns
Contact for Content-Related Matters
- Send Email
- Research Data
- Staff Development Measures:
- Spheres of Action:
- Promote Capacity for Innovation and Research
- Participation Fee:
If you attended our courses on the research data management platform Coscine and Metadata, you know we need to securely store our data and annotate them with meaningful metadata and that Coscine can help you here. You probably also know doing that by hand can be tedious. Let’s automate it!
In this course, we will use a Jupyter Notebook to create Python script for automated data transfer in a step-by-step process. We will interact with the Coscine projects and resources using the Coscine Python SDK. In the end, you will have the foundations to create your own scripts to automate your data workflows, enabling you to transfer data and metadata from a local computer or server to Coscine.
This event is part of a series of in-depth modules on research data management (FDM II - modular), which are offered regularly on a monthly basis. The basics on research data management are covered by the Moodle course "Research Data Management - an Overview (RDM I - online)". Please use this course as introduction to research data management.
Once you have completed this course module, you will understand the basic functionalities of the Coscine Python SDK and automating data workflows. You will be able to apply and build upon this knowledge to create and automate your own research data management solutions.
Presentation, exercise, discussion
In this hands-on workshop, we will use a step-by-step approach using a Jupyter Notebook to create our data workflow script. This includes
Creating a configuration file
Reading the configuration file
Using the Coscine Python SDK to connect the Coscine REST API
Fill in the metadata form for a file in Coscine
Upload a file and the metadata via the REST API
Use S3 to create a directory structure in Coscine and upload data
Update file and directory metadata using the REST API
Extract metadata from a file and automate filling in the metadata form
Prerequisite for this workshop is the participation in the self-paced course “Research Data Management - an Overview (RDM I – online)”. The Coscine platform is introduced in more detail in the workshop “RDM platform Coscine – more than free quota! (RDM II-modular)” on October 25, 2023. Metadata and application profiles are covered in “Metadata Basics and Creating Application Profiles for Coscine (RDM II – Modular)” on November 29, 2023. It is highly advisable to attend these two courses if you are not yet familiar with these concepts. Some experience with the programming language Python is a plus.
PC/laptop, microphone, loudspeaker, Internet & optional camera
Further Information on Target Audience
Researchers from other Universities interested in Coscine are welcome
10:00 - 12:00
|Course Coordinator:||Kseniia Dukkart, Catherine Esther Gonzalez, Nicole Parks|
You will get the access link to the above-mentioned event via email at least 3 days before the start date. If you are registering on short notice, please email the contact for organizational matters to receive the access link.
|Slots:||3 up to 15|
|Cooperation:||In cooperation with the IT Center and the University Library of RWTH Aachen University.|