MareNostrum 4 begins operation

The MareNostrum supercomputer is beginning operation and starts executing applications for scientific research. MareNostrum 4, hosted by Barcelona Supercomputing Center, is entirely aimed at generating scientific knowledge and its computer architecture has been called ‘the most diverse and interesting in the world’ by international experts. The Spanish Ministry of Economy, Industry and Competitiveness has funded the purchase of the supercomputer, whose installation cost €34 million in total.

11.1 Petaflops of processing power

MareNostrum provides 11.1 Petaflops of processing power – that is, the capacity to perform 11.1 x (1015) operations per second– to scientific production. This is the capacity of the general-purpose cluster, the largest and most powerful part of the supercomputer, which will be increased thanks to the installation of three new, smaller-scale clusters, featuring emerging technologies, over the next few months. The capacity of 11.1 Petaflops is 10 times greater than that of MareNostrum 3, which was installed between 2012 and 2013.

According to the Top500 ranking published on 19 June, the MareNostrum 4 supercomputer’s general-purpose cluster is the third most powerful one in Europe and the thirteenth in the world. The Top500 list is based on how quickly supercomputers execute the high-performance linpack benchmark.

Barcelona Supercomputer Center's crown jewel: supercomputer MareNostrum 4
Barcelona Supercomputer Center’s crown jewel: supercomputer MareNostrum 4

A tool of great value for science

Supercomputers are used for basic and applied research thanks to their ability to perform large calculations, execute large simulations and analyse large amounts of data. Today, they are used in almost all scientific disciplines, from astrophysics and materials physics to biomedicine, and are used in engineering and industry.

During its first four months of operation, MareNostrum 4 is used for research projects on climate change, gravitational waves, a vaccination against AIDS, new radiation treatments to fight cancer and simulations relating to the production of fusion energy, among other areas.

Access via scientific committees

MareNostrum 4 is available to all scientists in Europe via a selection process managed by scientific committees. For the chance to use the supercomputer, researchers must submit a request to the Spanish Supercomputing Network (RES, according to its initials in Spanish) – which provides access to 16% of the computing hours available on the machine – or to PRACE (the Partnership for Advanced Computing in Europe) – which manages access to 80% of its computing hours. The remaining 4% is reserved for use by BSC researchers. The MareNostrum 4 supercomputer is designated as a Special Scientific/Technical Infrastructure Facility by the Spanish Ministry of Economy, Industry and Competitiveness.

Detail of MareNostrum 4 power and data grid
Detail of MareNostrum 4 power and data grid

Barcelona Supercomputing Center

Barcelona Supercomputing Center is the leading supercomputing centre in Spain. It specialises in High Performance Computing and its mission is twofold: to offer supercomputing facilities and services to Spanish and European scientists, and to create knowledge and technology to be transferred to society.

Barcelona Supercomputing Center employs 500 staff, of whom 27 form part of the Operations Department, which manages the supercomputer, and 400 who work in research across a wide range of areas. The Computer Sciences Department, which works to influence how future supercomputers will be built, programmed and used, is the centre’s largest department. Research is also carried out in the fields of personalised medicine and drug discovery, as well as climate change, air quality and engineering.

BSC is a Severo Ochoa Centre of Excellence and a leadership-level (Tier-0) member of the PRACE infrastructure, as well as managing the Spanish Supercomputing Network. It was created in 2005 and is a consortium formed by the Spanish Government Ministry of Economy, Industry and Competitiveness (60%), the Catalan Government Department of Enterprise and Knowledge (30%) and the Univeristat Politècnica de Catalunya (UPC) (10%).

MareNostrum 4: technical summary

MareNostrum 4 has been dubbed the most interesting supercomputer in the world thanks to the heterogeneity of the architecture it will include once installation of the supercomputer is complete. Its total speed will be 13.7 Petaflops. The supercomputer includes two separate parts: a general-purpose block and a block featuring emerging technologies. It has 5 storage racks with the capacity to store 14 Petabytes (14 million Gigabytes) of data. A high-speed Omnipath network connects all the components in the supercomputer to one another.

The general-purpose block has 48 racks with 3,456 nodes. Each node has two Intel Xeon Platinum chips, each with 24 processors, amounting to a total of 165,888 processors and a main memory of 390 Terabytes. Its peak performance is 11.15 Petaflops. While its performance is 10 times greater than its predecessor, MareNostrum 3, its energy consumption will only increase by 30% to 1.3 MW per year.

The block of emerging technologies is formed of clusters of three different technologies, which will be incorporated and updated as they become available on the market. These technologies are currently being developed in the United States and Japan to speed up the arrival of the new generation of pre-exascale supercomputers. They are as follows:

  • Cluster comprising IBM POWER9 and NVIDIA Volta GPUs, with a computational capacity of over 1.5 Petaflops. IBM and NVIDIA will use these processors for the Summit and Sierra supercomputers that the US Department of Energy has ordered for its Oak Ridge and Lawrence Livermore National Laboratories.
  • Cluster formed of Intel Knights Hill (KNH) processors, with a computational capacity of over 0.5 Petaflops. These are the same processors as those to be used in the Theta and Aurora supercomputers that the US Department of Energy has ordered for the Argonne National Laboratory.
  • Cluster composed of 64-bit ARMv8 processors in a prototype machine with a computational capacity of over 0.5 Petaflops. This cluster will use the cutting-edge technology of the Japanese supercomputer Post-K.

The aim of gradually incorporating these emerging technologies into MareNostrum 4 is to allow BSC to experiment with what are expected to be the most advanced technological developments over the next few years and evaluate their suitability for future iterations of MareNostrum.

MareNostrum 4 has a disk storage capacity of 14 Petabytes and is connected to BSC’s big data facilities, which have a total capacity of 24.6 Petabytes. Like its predecessors, MareNostrum 4 will also be connected to European research centres and European universities via the RedIris and Géant networks.

Mare Nostrum 4
Mare Nostrum 4