Differences between revisions 23 and 24
Revision 23 as of 2019-11-26 12:22:54
Size: 6473
Editor: mbroe
Revision 24 as of 2019-11-27 07:39:50
Size: 6074
Editor: hajek
Comment: Removed References section as the links were all going to a login page which our credentials don't work on.
Deletions are marked like this. Additions are marked like this.
Line 111: Line 111:
=== Reference Documentation ===
 * [[https://wiki.hpcc.msu.edu/display/hpccdocs/HPCC+Quick+Reference+Sheet|HPCC Quick Reference Sheet]]
 * [[https://wiki.hpcc.msu.edu/pages/viewpage.action?spaceKey=hpccdocs&title=Documentation+and+User+Manual|Documentation and User Manual]]
 * [[https://wiki.hpcc.msu.edu/pages/viewpage.action?pageId=1343596|iCER Products and Services (Buy-in and Storage)]]

HelpdeskDocsTemplate/logo.png HelpdeskDocsTemplate/UTS.png

MSU Institute for Cyber-Enabled Research (ICER) High-Performance Computing Cluster (HPCC)

Oakland University has 4 buy-in nodes as part of the MSU Institute for Cyber-Enabled Research (ICER) High-Performance Computing Cluster (HPCC). Oakland University faculty can get priority access on the buy-in nodes, but also access resources on the entire cluster.

Getting Started

General Information

For general information about ICER, see the ICER About page. You may find the Introduction to HPCC page useful as well.

Account Request

To utilize Oakland University's ICER nodes, you will need 2 accounts:

  1. MSU Community ID

Instructions for obtaining these accounts can be found below.

MSU Community ID

Your MSU Community ID will grant you sign-in access to various community web portals. In the case of Oakland University, your MSU Community ID is needed to request an account for the HPCC and follow-up requests (such as a Primary Investigator requesting shared research space for a research group) through https://contact.icer.msu.edu. The MSU Community ID username will be your Oakland University e-mail address.

  1. The first step is to request an MSU Community ID at https://community.idm.msu.edu/selfservice/.

    1. Follow the link to "Create a Guest Account (Community ID)"
    2. Make sure to use your real name and Oakland University e-mail address when submitting the request.
  2. You should receive an e-mail from help@msu.edu with a subject of "MSU Community ID Account Created - Please Complete Setup" to your Oakland e-mail address.

    1. Follow the link in that e-mail to create a password for your MSU Community ID account.


This account will be used to access the HPCC through SSH (Secure Shell) via gateway.hpcc.msu.edu. The user account will be a randomized set of letters and numbers (e.g. fgiz3dm4).

  1. Once you have an MSU Community ID you need to request an account for the iCER HPCC.
    1. Login to https://contact.icer.msu.edu/community_id

    2. On the "Community ID", fill out the Principal Investigator name (optional) and Click "Submit".
      1. If you are a student please put the name of the faculty or staff member you are working with in the Principal Investigator name (optional) field.
  2. iCER will create the account and you will receive confirmation of the creation in your OU e-mail account.

System Access

When you have your accounts, you will be able to log into OU's buy-in nodes on cluster at iCER with the directions at https://wiki.hpcc.msu.edu/display/ITH/Connect+to+HPC+System and https://wiki.hpcc.msu.edu/#DocumentationandUserManual-SystemAccess.

The cluster is primarily accessed by means of the Secure Shell (SSH) network protocol. An SSH connection can be opened to hpcc.msu.edu from a terminal prompt (Mac/Linux) or a program like PuTTY (Windows). Windows users may find using MobaXterm more feature rich then PuTTY and supports graphical applications. See https://wiki.hpcc.msu.edu/display/ITH/Install+SSH+Client for details.

Note: Please review Software Regulations Policy 870 and submit a Software & Hosted Solution Purchasing Checklist form prior to installing software on any Oakland University equipment.

Your initial connection will be to gateway.hpcc.msu.edu (e.g. ssh fgsjdke2@gateway.hpcc.msu.edu ). From the gateway you can further SSH to a dev node (e.g. ssh dev-intel16).

One of the first things you may wish to do if you are new to the cluster is to load the powertools modules and view the available examples and commands:

module load powertools

Job Submission examples

Once on the gateway system you may wish to view some of the examples to get and understanding of job submission. To get the examples try the following, lines beginning with a # are comments and should not be executed:

# Assuming you are already on gateway.hpcc.msu.edu via SSH.
# SSH to a dev node
ssh dev-intel16
# Load the powertools module
module load powertools
# Get the helloworld example
getexample helloworld
# change to the helloworld directory
cd helloworld
# Look over the README file
# Run the README file to compile the helloworld.c and submits the jobs with qsub
# Check the status of your submission
qstat -u $USER

Scratch Space

See the following documentation link regarding File Systems on the cluster https://wiki.hpcc.msu.edu/display/ITH/File+Systems

Note that scratch space is not available on the gateway, files older than 45 days are automatically deleted, and files on scratch are not backed up. When on a node in the cluster other than the gateway you can reference the scratch space with $SCRATCH.

# Example of changing to your scratch directory
# Print name of current working directory

Buy-in Nodes

The 4 buy-in nodes that we have are part of the "laconia (intel16)" cluster and are considered "Intel16 — Large Memory" nodes as referenced in Compute Resources

You should be able to check the status of the nodes and the jobs running on them with the following:

module load powertools
priority_status -g oakland-university
  1. Laconia (intel16), Intel16 — Large Memory Node Names
    1. lac-311
    2. lac-312
    3. lac-313
    4. lac-314

TSSHowTo TechnicalServiceSystem