Transfer data with Globus 🌐

Globus 🌐📁🔀📁🌐
Globus is the modern, secure, web interface to transfer between between research endpoints. It excels at transferring huge data sets across the network, and it’s the preferred method to bring voluminous datasets onto Discworld

Authentication

🔑🦁 Globus handles data access securely with your university credentials.
Go to app.globus.org and validate through your university (UNSW sign-on)

Everything from here on in will engage your uni identity (zID)

The crown ♕ should be next to your UNSW provided identity:
this is what you share with collaborators to enable data access.

📬 Sharing Files & Folders

Within the Globus File Manager you can share a Globus collection with another user through the Permissions system.

Step 1

Step 2

Step 3

Step 4

Step 5

Step 6

📁 File Management

🔎 Most Globus data is in publicly searchable collections, but their contents are locked 🔒

You can contact your counterpart to request they to share a particular collection with your Globus identity

Definitions

Globus has two core concepts: the Globus endpoints (organisational data transfer clearing house) and the collections (managed datasets) within them.

The nice thing is Globus endpoints are public —searchable through the 📁 File Manager— while collections are private by default and you choose to share them with other uni indetities.

endpoints

This is a specific location & server that manages the high-throughput data transfer work. It is set up by an organisational storage admin, so the the physical server gateway is configured for best data transfer & org policies.

The endpoint does the invisible mapping work so you can find the collection you are looking for.

collections

The collection contains raw datafrom which you can set off a Transfer job

guest collections

You can Share Data Using Globus without needing to touch the accounts on the underlying server.

You do this by creating a guest collection within the endpoint your data is stored in. This is a guest collection that only sees your own data, and allows you to grant Roles to other Globus identities.

Please follow the 8 steps in How To Share Data Using Globus to manage your own guest collection and share an email invite.

Discworld Globus details

University storage data mover

Dedicated data mover servers exist to transfer your data onto the university central research storage solution (the ESS).

While capacity is being added, transfers may be limited by total data pipeline until dedicated physical networking is configured.

UNSW-EMU

A dedicated mapped collection exists that maps to /data/lab/<lab_name> to manage a lab group’s data and interface with the cryotem instrumentation

Subscribed Mapped Collection (GCS) on ResTech (gd1) 
Owner: 9d5f4d54-e4b6-4834-9122-a4bef7ef7732@clients.auth.globus.org 
Domain: m-ff62ba.88a567.36fe.gaccess.io  
Description: (not set)  
Organization: The University of New South Wales (UNSW) 
Department: EMU
Subscription: University of New South Wales
Keywords: (not set) 

Discworld StructBio /User Data

A dedicated collection exists that maps to /data/ess/<zID> to cleanly structral data transfer from external sources to UNSW zID@ad.unsw.edu.au email address.

Subscribed Mapped Collection (GCS) on ResTech (gd1) 
Owner: 9d5f4d54-e4b6-4834-9122-a4bef7ef7732@clients.auth.globus.org 
Domain: m-XXXXXX.88a567.36fe.gaccess.io 
Description: External Structural Biology data (crystallography, cryo, beamline, etc) endpoint for UNSW researchers 
Organization: UNSW Mark Wainwright Analytical Centre  
Department: Structural Biology Facility 
Subscription: University of New South Wales
Keywords: Discworld, MWAC, structural-biology, cryoEM, crystallography 

Assistance — Data Sharing

Almost all collections you share will be guest collections within an existing mapped collection.

Please contact us if you’d like to access data not already in an existing collection