User Tools

Site Tools


linux:datamanagement

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
linux:datamanagement [2017/11/27 12:45]
deul [Data from the big international observatories]
linux:datamanagement [2020/11/24 07:48] (current)
deul [Data generated in the Astrophysical and Optical labs]
Line 1: Line 1:
 ======Data Management====== ======Data Management======
-Your data is stored on the STRW data storage media which can be either the local disk of your workstation, the local-to-the-server direct attached disks of a server or on the bulk storage devices. As part of the data management cycle you need to keep track of your data and make sure that at the end of your employment at the Observatory you either copy your data to your new institute or provide the computergroup with a list of pointers to allow them to store your data onto a save archive.+Your data is stored on the STRW/IL data storage media which can be either the local disk of your workstation, the local-to-the-server direct attached disks of a server or on the bulk storage devices. As part of the data management cycle you need to keep track of your data and make sure that at the end of your employment at the Observatory you either copy your data to your new institute or provide the computergroup with a list of pointers to allow them to store your data onto a save archive
 + 
 +The Observatory has a semi filled in template for {{ :linux:semi-template_formulier_datamanagementplan_versie_september_2016_.pdf |the NWO data management form}}.
  
 =====Sources of data===== =====Sources of data=====
Line 18: Line 20:
  
 In general final data products are published and made available to the community. This can be done in several ways, depending on the size of the data or the type of product. For small data set the Centre Donnees Stelleair at Strassbourg is the standard place when published in European journals. For larger data sets one might opt to make the data available through a project website (which can be hosted by the Observatory) or through the associated big international observatory. In general final data products are published and made available to the community. This can be done in several ways, depending on the size of the data or the type of product. For small data set the Centre Donnees Stelleair at Strassbourg is the standard place when published in European journals. For larger data sets one might opt to make the data available through a project website (which can be hosted by the Observatory) or through the associated big international observatory.
-====Data generated in the Sackler and Optical labs==== 
  
 +Data coming out of local research will always be stored on local disks (bulk storage) at the Obsrevatory. Just contact the computergroup so that they can copy the data to bulk storage and make it available for further access.
 +
 +====Data generated in the Astrophysical and Optical labs====
 +At the two Observatory laboratories data is produced by the instruments acquisition board and stored locally on lab computers. Data that will be used in further processing can be stored on the ''%%Lab Astrophysics%%'' share. This share is located on the High Availability disk cluster, though a Windows file server.
 +
 +This share is accessible both from the data acquisition equipment and from the personal desktops of the lab associates. The storage device is on a special secure medium and is snapshotted regularly as a form of backup.
 +
 +Users are responsible for keeping track of the data and retaining its integrity. The Windows accounts and access rights can help in this task.
 ====Data produced by theoretical work and simulations==== ====Data produced by theoretical work and simulations====
 +As a result of theoretical calculations or model simulations, data may be produced that are further processed to allow astronomical interpretation. These calculations can take place on the desktop or on server levels, where storing the data will most efficiently be done on the local-to-the-cpu storage devices. So either the local disks of the desktop or the local attached disk devices for the servers. 
 +
 +Similarly to the data processing for data coming from the big observatories it is the users responsibility keep track of the data and its integrity. As most of this processing is done on the Linux computing environment, similar facilities can help out in this process.
linux/datamanagement.1511786716.txt.gz · Last modified: 2017/11/27 12:45 by deul