Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Cluster and Storage Options

All cluster accounts are created with a fixed 200 MB home directory disk quota.

In addition, a directory is automatically created in filesystem /scratch on the head node and each compute node. The directory is named with your Tufts UTLN; such as /scratch/utln/. There is no quota and no backup for files located there. Typically ~100+ gig is available. In addition this file system is subject to automated cleaning based on a moving window of 28 days. You may use this for temporary storage supporting your research computing needs. Note: this storage is not available to your desktop as a mounted file system, but you can access it via your ssh login or through a file transfer program such as WinScp.

For additional temporary storage beyond what is offered in /scratch, Tufts UIT provides a 2TB file system called /cluster/shared/. This file system is subject to automated cleaning based on a moving window of 56 days. There is no quota and no backup for files you located here. Access to this storage is by request and with suitable application requirement/justification. The naming convention is the same as /scratch/ and thus would be /cluster/shared/utln/. Please work out of your named directory.

Finally, another available file system is /tmp. This file system is used by applications and the operating system for temporary storage. Please note that it is under the same 28 day cleaning rule as /scratch.

Finally, please note, /cluster/shared/ file system is mounted on all nodes, but /tmp and /scratch/ are local to a compute node.

Storage Summary Table

FileSystem

Quota

Backups

Max. Capacity

Cleaning Window

Availability

/tmp

no

no

10 gig

28 days

node specific

/cluster/shared/utln

no

no

~2 TB

56 days

everywhere

/scratch/utln

no

no

~190 gig

28 days

login node

/scratch/utln

no

no

~20 gig

28 days

compute nodes

/cluster/home

yes

yes

200meg/account

none

everywhere

Research Storage Solution

Tufts UIT provides a networked storage solution to faculty researchers who request it based on their identified needs. This solution is often used in support of grant based projects that produce large size of data sets, and these data sets need both to be accessed by multiple users and to be backed up. Such networked storage solution usually supports a small lab where multiple persons may interact with research data from computers at different locations. Another possibility is to request that the storage be made available to one or more accounts on the research cluster.

For additional information, please contact Lionel Zupan, Associate Director for Research Computing, at x74933 or via email Lionel.Zupan@Tufts.edu.

To request storage

Storage User guide

Research database (HPCdb) node

Cluster users may request access to mySQL database for supporting their research computing needs. Requests are treated like software requests. Please reference the Software Request Policy statement in this document.Click here for details.

Network Concurrent Software Licenses

...

Action Needed

Command

Usage

Display contents of a file

cat

cat filename

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="5843d1f491e9bb58-bc71aaf4-4381490a-8641a103-24a997b61f1b53645133ae2a"><ac:plain-text-body><![CDATA[

Copy a file

cp

cp [-op] source destination

]]></ac:plain-text-body></ac:structured-macro>

Change file protection

chmod

chmod mode filename or
chmod mode directory_name

Change working directory

cd

cd pathname

Display file (/w pauses)

more

more filename

Display first page of text

less

less filename

Display help

man

man command or
man -k topic

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="3cc1febc0708991b-1cb65577-4650418d-a407a00b-af67991d8db8931f6024f911"><ac:plain-text-body><![CDATA[

Rename a file

mv

mv [-op] filename1 filename2 or
]]></ac:plain-text-body></ac:structured-macro>
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="ca9509e0f088b2dd-cd0aa47f-482245c1-b037bf2a-ee569f3ac8ce1d0155138599"><ac:plain-text-body><![CDATA[mv [-op] directory1 directory2 or
]]></ac:plain-text-body></ac:structured-macro>
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="78cdb8827b6cbe7f-3721e6d3-4dab4add-bbbc8cb0-be188fa2b2797c77aac65b0f"><ac:plain-text-body><![CDATA[mv [-op] filename directory

]]></ac:plain-text-body></ac:structured-macro>

Compare file

diff

diff file1 file2

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="913cdc659ec8d1f0-4a8b6382-4bbe413e-9169817c-358b9ee0886065cf2fee6887"><ac:plain-text-body><![CDATA[

Delete file

rm

rm [-op] filename

]]></ac:plain-text-body></ac:structured-macro>

Create a directory

mkdir

mkdir directory_name

Delete a directory /w files in it

rmdir -r

rm -r directory_name

Delete a directory

rmdir

rmdir directory_name

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="44086eaa4a1f90af-6d281bf6-4a354b22-8c269901-f685f44e8a456d7a7c471b2c"><ac:plain-text-body><![CDATA[

Display a list of files

ls

ls [-op] directory_name

]]></ac:plain-text-body></ac:structured-macro>

Change the password

passwd

passwd

Display a long list (details)

ls -l

ls -l directory_name

Display current directory

pwd

pwd

...

Action Needed

Command

Usage

System verification

lsid

lsid

Display load levels

lsmon

lsmon

Display hosts

lshosts

lshosts

Summarize past usage

bacct

bacct or
bacct job ID #

Display hosts

bhosts

bhosts

View current jobs

bjobs

bjobs or
bjobs job ID #

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="fb409ffdd6b08e2c-333b396b-4b714b3c-956c85ba-63175dd96805213c5a100c34"><ac:plain-text-body><![CDATA[

Run LSF batch job

bsub

bsub [-op] filename

]]></ac:plain-text-body></ac:structured-macro>

Kill a job

bkill

bkill job id #

Review/select queue

bqueues

bqueues or
bqueues queue_name

Suspend a job

bstop

bstop job ID #

Changes job order (new or pending)

btop

btop job ID | "job_ID"(index_list)"

Resume suspended jobs

bresume

bresume job ID #

View job history

bhist

bhist job ID #

...