This guide explains how to access and copy SAIL data on Iris.
Data is available on Iris for 6 months. Afterwards:
– FASTQs and cell x gene matrices -> moved to deep storage archive on AWS
– Other files (including BAMS) -> deleted
Restoring archived data incurs costs. To request data unarchiving submit this iLab form.
– Must be in the MSK network
– Must be logged in with MSK username
– Must be on an MSK machine
– User must be part of the lab’s HPC group. The lab admin manages users through SailPoint. (changes take up to 2 hours to take effect)
Access to SAIL data is controlled at the lab level through SailPoint, MSK’s identity management system. Your lab admin manages who can view the data. If you don’t have access yet, ask them to add you to the group.
Adding or removing group members:
1. Go to SailPoint
2. Login with MSK credentials
3. In the row for GRP_hpc_<groupname> or GRP_collab002_<groupname>, click Member(s).
4. Add any MSK member.
Permission Denied/No folder found
To verify your access, run groups on Iris and confirm you see a group matching your lab’s SailPoint group
[<your_username>@IRIS]$ groups
your_username grp_hpc_groupname grp_collab002_groupname
If you don’t see your lab’s group, contact your lab admin to add you via SailPoint. This update will take up to 2 hours. If you are still having issues or your lab has no group on SailPoint, please reach out to Tobi(krauset@mskcc.org) & Matt (willm16@mskcc.org)for assistance. Please contact SAIL before reaching out to HPC if you experience permissions issues.
3. In the ‘server address’ field enter: smb://issweka1-smb.mskcc.org/collab002_datalake_prod010
4. Click connect
5. Enter your MSK SSO credentials to login to the server. To access your data, enter your lab’s directory
1. Open File Explorer (Win + E).
2. Press Ctrl + L or click the address bar.
3. Type the SMB path: \\issweka1-smb.mskcc.org\collab002_datalake_prod010
4. Enter your MSK SSO credentials to login to the server
5. To access your data, enter your lab’s directory
1. Connect to Iris
ssh <your_username>@islogin01
2. Navigate to Data
cd /data1/collab002/sail/shared/data/collaborators/<labname>/projects
Replace <labname> accordingly.
3. Copy (Sync) Your Data
Always use -rL to copy recursively and follow symlinks. We recommend creating a dedicated folder in your Iris drive to copy data into, for example:
/data1/<groupname>/sail/projects/
rsync -rL --ignore-existing . /data1/<groupname>/sail/projects/
Replace <groupname> accordingly. --ignore-existing avoids overwriting existing files.