Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Section
Column
width20%

Include Page
Upcoming Events
Upcoming Events

Include Page
New Pages
New Pages

Include Page
Quick Links
Quick Links

Dumbo login node dumbo1 maintenance on Friday 3/17/2017 from 11 am to 2 pm

 

There is a scheduled maintenance on Friday 3/17/2017 from 11 am to 2 pm for login node dumbo1 on HPC cluster Dumbo. There are 2 login nodes on Dumbo cluster, login-1-1 and login-2-1. We will be updating login-2-1 at this time. dumbo0 will be online during the maintenance window, the hostname dumbo0.es.its.nyu.edu should always work. Please run Linux command hostname to check which login node you are on. We’ll broadcast warning information via Wall message 10 mins before the update, please save all work and logout before the update starts.

 

Column
width60%
Note
All the jobs running on dumbo should not be effected.
Panel
borderStylenone

Welcome to High Performance Computing (HPC) at New York University 

NYU HPC, within IT, operates and supports high performance computing resources and assists the NYU research community in their use. HPC resources are open to NYU faculty and staff, and faculty-sponsored students, and may be used for class instruction. IT is also available to partner with faculty as they seek funding for research with substantial technology components - see HPC Stakeholders and also ITS Research Computing. We can also assist in access to and collaboration with a number of national and state HPC facilities.

Panel
bgColorwhite
borderStylenone

Anchor
ACCESS
ACCESS
Getting and Renewing Access

Expand
Note

For how to log in, see Logging in to the NYU HPC Clusters

Excerpt Include
Getting or renewing an HPC account
Getting or renewing an HPC account
nopaneltrue

Anchor
STAKEHOLDERS
STAKEHOLDERS
HPC Stakeholders

Expand

Excerpt Include
HPC Stakeholders
HPC Stakeholders
nopaneltrue
(more...)

Anchor
FACILITIES
FACILITIES
Compute and Storage Facilites

Expand

Excerpt Include
Clusters
Clusters
nopaneltrue

Excerpt Include
Storage
Storage
nopaneltrue

See Clusters and Storage for more information.

Anchor
LOGIN
LOGIN
Logging in to the NYU HPC Clusters 

Expand

Excerpt Include
Logging in to the NYU HPC Clusters
Logging in to the NYU HPC Clusters
nopaneltrue

Anchor
SOFTWARE
SOFTWARE
Finding and Using Software

Expand

A variety of commercial and open-source software is available on the NYU HPC clusters, and can be accessed via Environment Modules.

Note
titleImportant

The login nodes are not suitable for computational work, they are a limited and shared resource for preparing and submitting computational jobs, developing and compiling software, and managing data. Computational work should instead be run via the batch system.

Expand
titleUsing NYU software on your own computer

NYU HPC hosts licenses for a number of commercial software packages which are suitable for workstation as well as HPC use, such as Matlab, COMSOL and Mathematica.  Contact us about accessing these packages.

Expand
titleGetting new software installed on the HPC clusters

If you need a free or open source software package which is not currently available on the HPC clusters, contact us. Usually we can install it for you, or suggest an alternative which is already available.

Our ability to buy and install commercial software depends on the cost and on how widely it will be used. We may also be able to host licenses or share costs with you in return for making the software available also to the NYU research community, so if you need a specific commercial package contact us to discuss it.

Expand
titleCompiling and developing software

Intel and GNU compilers are available on the clusters. For most code, we recommend the Intel compilers 

For debugging we have the GNU debugger gdb, the Intel debugger idb and Totalview by Roguewave. Debugging is best performed with an interactive batch session.

There is more about compiling and debugging on the old wiki pages.

Expand
titleUsage examples on Mercer

 

Include Page
snippet - Usage examples
snippet - Usage examples

Anchor
DATA
DATA
Managing data: Storage, collaboration and moving data around

Expand

Filesystems, their optimal usage and your space allocation are described under Storage.

Quotas

On Mercer, enter 'myquota' at the prompt to see how much space you have used and available on each filesystem.  

Security and collaboration: file permissions and ACL on NYU HPC clusters

By default, only you can edit, or even see, your files. You can grant permission for your colleagues to see or edit files with setfacl, and you can check the permissions on a file or directory with getfacl.

Excerpt Include
snippet - File permissions and Access Control Lists
snippet - File permissions and Access Control Lists
nopaneltrue
(more...)

Transferring files to and from the HPC clusters

Excerpt Include
How to copy files to and from the HPC clusters
How to copy files to and from the HPC clusters
nopaneltrue

Once you have an SSH tunnel, you can transfer files to and from the HPC clusters - including  BuTinah at NYUAD.

Anchor
QSUB
QSUB
Running jobs with qsub: How to use the batch system

Expand

Excerpt Include
Running jobs on the NYU HPC clusters
Running jobs on the NYU HPC clusters
nopaneltrue

Anchor
TUTORIALS
TUTORIALS
Tutorials, FAQs and how to get help

Expand

For help with any aspect of scientific or high performance computing on the NYU HPC clusters, email us at hpc@nyu.edu.

Excerpt Include
Tutorials
Tutorials
nopaneltrue

FAQ

Include Page
FAQ Index
FAQ Index

Anchor
MAINTENANCE
MAINTENANCE
Monthly Maintenance Window

Expand

To provide the best possible service, ITS must regularly update and perform routine maintenance on its systems and networks. Some of these activities require that the affected systems and networks be shut down. While this work is essential, we also recognize that it presents an inconvenience. To enable those who use these systems to better plan for maintenance, we have guidelines for scheduling routine maintenance and upgrades to the HPC clusters as described below.

A MONTHLY SCHEDULED MAINTENANCE OF UP TO 12 HOURS WILL BE TAKEN, IF NEEDED, BEGINNING AT 8AM ON THE FIRST MONDAY OF EACH MONTH

Major scheduled maintenance and upgrade activities will take place, if needed, once per month.  These will be scheduled for the first Monday of each month at 8am to noon to start these scheduled maintenance and upgrade activities. The maintenance period may often be brief or not used at all, but can last up to 12 hours if this amount of time is needed to complete the work.

We have chosen early morning on the first Monday of each month for our maintenance work as it has been the time period during the week which has low usage on our clusters.

A notification will be sent to all HPC account holders announcing any scheduled maintenance work in advance.

A WEEKLY SCHEDULED MAINTENANCE OF UP TO FOUR HOURS (MONDAY 8 AM to NOON) MAY BE USED TO ADDRESS SMALLER MAINTENANCE AND UPGRADE NEEDS.

This time will not be used if not needed.

Column
width20%
Panel
borderWidth2
titleFeatured Research

Excerpt Include
An Event-Driven Model for Estimation of Phase-Amplitude Coupling at Time Scales of Cognitive Phenomena
An Event-Driven Model for Estimation of Phase-Amplitude Coupling at Time Scales of Cognitive Phenomena
nopaneltrue

More featured research using NYU HPC