Skip to main content

OLCF User Meeting 

June 22-25 dates for OLCF User Meeting confirmed with user council.

Feedback on last user meeting:

Meeting format was excellent. Please keep this format.

More opportunity for interaction between OLCF staff and Users requested.

More opportunity for interaction between OLCF users is requested.

Ask users what they would like to see/do at the meeting. –Perhaps a survey question?

Action item: in 4 months call for the OUG EB to form a working group on the meeting.

User Facility Data storage and sharing policy

Requested summary of DOE Office of Science Policy on Data management plans (DMP) and User facilities, like OLCF.

  • Data Management Plans (DMPs) that address sharing and preservation of digital data are required for all Office of Science research solicitations and invitations for new, renewal, and some supplemental funding issued on or after October 1, 2014.
  • These requirements do not apply to applications to use Office of Science user facilities. (User facilities can set their own requirements for DMPs in requests for time/use of this facility)
  • DMPs that explicitly or implicitly commit data management resources at a facility beyond what is conventionally made available to approved users should be accompanied by written approval from that facility.
  • https://science.energy.gov/funding-opportunities/digital-data-management/

OLCF Policy

  • By default, there is no lifetime retention for any data on OLCF resources. OLCF specifies a limited post-deactivation timeframe during which data will be retained. When the retention timeframe (90 days) expires, the OLCF retains the right to delete data. If you have data retention needs outside of the default policy, please notify the OLCF. Users can request a temporary user account extension for data access. The project and user data retention exist to reclaim storage space after an account is deactivated
  • https://www.olcf.ornl.gov/kb_articles/data-management-policy/

Discussion:

  • It is agreed that this policy is reasonable.
  • Users who must provide DMP to obtain funding should be aware that User facilities may not be able meet needs beyond those stated in the facility data policies. User Facilities should make this clear.
  • Requested Provisions beyond OLCF data policy should come with support for hardware and staff.
  • Data reduction and transfer should be considered as part of DMPs.
  • Researchers must work with program managers on how to best curate their data. This includes but us not limited to: How much of the raw data should be kept and how the overall data should be archived and stored.

Question posed to the OLCF by the Council: Can users who have obtained funding for data storage resources attach their large capacity storage devices directly to OLCF resources to avoid data transfer?

 Discussion: This is something that OLCF should explore. We have a model for accepting extra resources for things like liaison support for projects that do not normally get this support.

Question posed by OLCF: Within the constrains of the current data policy, how can user facilities be a better resource for users’ data management needs?

Discussion: By ensuring that users have access to rapid and user-friendly data transfer

  1. More DTNs
  2. More tools for transfers to the HPSS, namely out Globus on the HPSS for ease of use. Does not matter if hsi is what is running under the covers, it is the click-and-forget nature, and fault tolerance offered by the globus interface that users want.

 

The User Conference Call

Attended by 31 users, this call focused on methods for Cross-Compiling for Titan. The slides are linked below.

Slides: CrossCompile-Titan (download pptx) , OLCF_news_9_14 (download pptx)