The old (original) Calculus data storage server


Some time after Maths departmental home directories migrated from the former geometry2 fileserver to ICT storage in 2007, we started to run out of space on the new ICNFS storage service and it wasn't very long before geometry2 was brought back out of retirement, renamed as calculus and rebuilt with an additional 14-disk array attached to provide 1.7 Tb of local storage. This server is shared via NFS to all of the Maths and Stats compute cluster nodes.

Where is the calculus filespace?

For technical reasons relating to using large numbers of disks in ZFS filesystem pools, there are 3 separate storage pools on calculus called home, bitbucket1 and bitbucket2 respectively and these are mounted on Maths systems as follows:

  • home: /home/calculus/home (400 Gb)

  • bitbucket1: /home/calculus/bitbucket1 (670 Gb)

  • bitbucket2: /home/calculus/bitbucket2 (670 Gb)

As with all other Maths storage servers, no disk quotas are imposed but storage usage is monitored and users will be advised if free filespace falls to a low level.

How do I use calculus?

calculus is intended to be accessed only from the systems its filespace is mounted on and you can't log into it directly. To create your own storage folder on calculus, you simply log into any of the Maths systems that mount the calculus filesystems (one of the Maths compute cluster nodes or the Stats cluster) change to one of the three directories listed above and create your own folder. Here's how you do it:

  1. log into any compute cluster node or a Stats cluster machine

  2. decide where you want to create your folder - in the home area or on one of the two bitbuckets and create your folder using the mkdir command; for example, you might want to create some storage space called 'my_zone' in bitbucket1 so you would type:

    mkdir /home/calculus/bitbucket1/my_zone

  3. you can name your new folder anything you like although using your username is suggested as it makes it easier for others to see who owns it. Now, if you want to you can restrict access to your new folder to just yourself - this is optional but advisable if you have sensitive data, programs that you have written yourself, etc that you don't want to share with others. You can do this with chmod - here's an example where we change the permissions of the 'my_zone' folder just created to restrict access to the owner only:

    chmod 700 /home/calculus/bitbucket1/my_zone

That's all there is to it.

Are disk quotas imposed on calculus?

No! Per-user disk quotas are not imposed as this would defeat the object of this facility. However, there is a finite limit set by the available space in each disk pool - the maximum contiguous file space that can be provided in each of the bitbucket1 and bitbucket2 pools is 670 Gb while the home pool is limited to 400 Gb

Is data on calculus backed up?

Yes, it is mirrored daily to ma-backup1 which in turn is mirrored to the Maths offsite server in Milton Keynes.

Can I mount calculus on my own computer via NFS?

At the moment, no because no-one has asked for this facility and for security reasons only known computers are allowed to do this. But this can be arranged on request.

About the calculus server

calculus is a HP DL360 server fitted with 6 disks using the built-in hardware RAID controllers - 2 disks are a RAID 1 mirrored pair and used as the system disk while the remaining 4 are set up as a RAID 5 array and used for the /home storage. A Dell PV 220 SCSI disk array containing 14 x 147 GB disks is attached to calculus via two additional disk controllers, with 7 disks to each controller. Each group of 7 disks is arranged as a ZFS RAIDz1 pool with 6 active disks and one hot spare in each pool and these form the bitbucket1 and bitbucket2 storage pools. Calculus runs FreeBSD 8.2.

Andy Thomas

Research Computing Officer
Department of Mathematics

last updated: 21.09.2014