Current news...
August 2024 update:
Introducing clustor3: this new large data storage server, which has joined the existing clustor and clustor2 servers, is now online and in use. With an anticipated usable storage capacity of around 1 petabyte, it uses a similar ZFS-based set-up as used on clustor2 but this time with over three times the number of hard disks (36 as opposed to 10) that are each over twice the size (18TB each instead of 8TB). The same accelerated intent log (SLOG) and level 2 caching (L2ARC) schemes based on fast SSDs (solid state disks) as used on clustor2 are being used in conjunction with lz4 data compression to provide a 'real' effective capacity of over double the 648TB of physical disk storage.
The server is currently being used to back-up archive1, the tape backup server, before that server is ugraded to better support 8 terabyte tape drives after which it will become available for general use next week.
Owing to the huge amounts of data being generated by users of the GPU servers, most of which needs to be kept for one reason or another and not simply deleted or moved elsewhere after a few months, a new storage server specifically to support all of the GPU servers now in use in Maths is being set up. With a usable storage capacity of over 200 terabytes, GPU users will be able to store data on it directly from all of the main GPU servers in addition to the fast local on-server storage facilities each GPU server has.
Older news items:
-
-
- March 20th: March 2024 update, substantial upgrade of the NextGen HPC cluster started
- November 20th: November 2023 update
- September 25th: September 2023 update
- August 18th: August 2023 update
- June 30th: June 2023 update
- March 15th: March 2023 update
- August 13th: Mid-August 2022 update
- July 5th: Early July update, RStudio upgrade for apollo Stats MSc server
- June 15th: June update, Huxley server room expansion, Huxley 616 network management improvements
- May 4th: April update, tape backups, development of a new Hadoop/Spark platform completed
- March 16th: March update, job management for the forrest GPU server, development of a new Hadoop/Spark platform
- December 23rd: a mini-HPC for Stats
- August 14th: two more compute servers added to the Stats MSc compute pool
- July 19th: July update: extensive updates to the Stats MSc compute servers, CUDA and cuDNN updates for nvidia4
- June 19th: June update: new archival server, storage upgrade for Keaveny cluster, Firedrake build servers & Big Blue Button server
- May 21st: Degond Cluster becomes a full HPC
- March 24th: Degond Cluster fully upgraded
- February 25th: a GPU server for the StatML CDT
- February 1st: Bazooka Hadoop cluster control network switch replaced
- September 24th: all Stats' general purpose compute systems now running Ubuntu 18.04
- August 9th: new GPU server nvidia4 introduced
- April 7th: Magma software upgraded to version 2.25-4
- March 17th: a new 8 card GPU server installed
- March 2nd: another backup server added
- February 28th: internal network expansion, ma-backup4 and GPU servers coming soon
- February 6th: more large compute servers for Stats
- November 1st: NextGen is shutting down on November 1st in readiness for relocation
- September 29th: matlab2018 queue has now been discontinued on the NextGen cluster
- August 24th: matlab2018 queue to be discontinued on the NextGen cluster
- August 14th: more servers for Stats, remote monitoring upgrades, better system status reporting and more power supplies
- June 23rd: more servers in the server room, expanded Bazooka Hadoop cluster now available for use
- May 29th: R Shiny server memory replaced & remote management added
- April 12th: NextGen cluster Maple 2019 upgrade completed
- March 16th: Planned Bazooka Hadoop cluster upgrade, reorganisation of backup servers
- February 19th: ma-offsite2 now online
- January 19th: Matlab 2018b upgrade ongoing
- December 14th: Matlab upgrade to version R2018b started, Stats section compute & storage enhancements completed, silos3 and 4 introduced
- September 18th: more local storage for Stats modal server and new PostgreSQL database server launched
- August 29th: new 'du' command options, cluster R upgrade and ma-backup3
- July 2nd: nvidia3 now has two GPU cards
- May 15th: Early summer update
- March 29th: Easter update
- March 24th: spring update
- March 10th: late winter update
- December 15th: pre-Christmas update
- November 22nd: late November update
- October 8th: start of 2017/2018 academic year update
- 2017: Midsummer's Day update
- June 16th, 2017: mid-June update
- June 2nd, 2017: Early summer update
- April 20th, 2017: Spring update 2
- March 22nd, 2017: Early spring update
- March 10th, 2017: Winter update 2
- February 22nd, 2017: Winter update
- November 2nd, 2016: Autumn update
- October 21st, 2016: Late summer update 2
- October 14th, 2016: Late summer update
- February 19th, 2016: Winter update
- December 11th, 2015: Autumn update
- September 14th, 2015: Late summer update 2
- May 2nd, 2015: Spring update 2
- April 26th, 2015: Spring update
- November 11th, 2014: Autumn update
- September 17th, 2014: Summer update 2
- July 17th, 2014: Summer update
- March 15th, 2014: Spring update
- November 2nd, 2013: Summer update
- May 24th, 2013: Spring update
- January 23rd, 2013: Happy New Year!
- November 22nd, 2012: No news is good news...
- November 17th, 2011: A revamp for the Maths SSH gateways
- September 7th, 2011: Failed systems under repair
- August 14th, 2011: Introducing calculus, a new NFS home directory server for research users
- July 19th, 2011: a new staging server for the compute cluster
- July 19th, 2011: A new Matlab queue and improved queue documentation
- June 30th, 2011: Updated laptop backup scripts
- June 18th, 2011: More storage for the silo...
- June 16th, 2011: Yet more storage for the SCAN...
- June 10th, 2011: 3 new nodes added to the Maths compute cluster
- May 21st, 2011: Announcing SCAN large storage and subversion (SVN) servers
- May 26th, 2011: Reporting missing scratch disk on macomp01
- May 21st, 2011: Announcing completion of silo upgrades
- May 16th, 2011: Announcing upgrades for silo
- April 14th, 2011: Goodbye SCAN 3, hello SCAN 4
- March 26th, 2011: quickstart guide to using the Torque/Maui cluster job queueing system
- March 9th, 2011: automatic laptop backup/sync service, new collaboration systems launched
- May 20th, 2010: Scratch disks are now available on all macomp and mablad compute cluster systems
- March 11th, 2010: Introduing job queueing on the Fünf Gruppe compute cluster
- October 16th, 2008: Introduing the Fünf Gruppe compute cluster
- June 18th, 2008: German City compute farm now expanded to 22 machines
- February 7th, 2008: new applications on the Linux apps server, unclutter your desktop
- November 13th, 2007: aragon and cathedral now general access computers, networked Linux Matlab installation upgraded to R2007a
- September 14th, 2007: Problems with sending outgoing mail for UNIX & Linux users
- July 23rd, 2007: SCAN available full-time over the summer vacation, closure of Imperial's Usenet news server
- May 15th, 2007: Temporary SCAN suspension, closure of the Maths Physics computer room, new research computing facilities
- January 14th, 2005: Exchange mail server upgrade, spam filtering with pine and various other enhancements