CERN Computing Seminar

Science data processing in the Cloud: first experience in Gaia

by Mr Paul Parsons (The Server Labs)

Europe/Zurich
503/1-001 - Council Chamber (CERN)

503/1-001 - Council Chamber

CERN

162
Show room on map
Description

With the maturing of Cloud Computing, it is now feasible to run scientific applications in the cloud. Data storage and high performance computing resourcesare fundamental for scientific applications. Outsourcing these services leverages scalability, flexibility, high availability at lower prices compared with traditional in-house data processing.

The Server Labs has developed and driven a highly successful feasibility study on behalf of the European Space Agency which identified clear benefits of relocating Gaia's distributed astrometric processing  to the Cloud. This session evaluates Amazon's EC2/S3 suitability for this scenario. The aim is to demonstrate how cloud computing systems can be a viable and cost-effective solution for HPC applications. A new study is currently underway  for Gaia to test a new simulated dataset with 60 million primary stars and 1TB of data, and scale out to 1000 Amazon EC2 nodes.

About the speaker

Paul Parsons is Co-Founder & CTO of The Server Labs. He has over 20 years of experience in software development and was senior software engineer in the European Space Agency (ESA). After ESA, he worked in the Deutsche Boerse, Commerzbank and DG Bank, designing and implementing real time distributed systems. Since then he has been an architect in different industries, designing high performance solutions. In 2004 he co-founded The Server Labs and has been actively involved technically in many clients, including the Gaia project for ESA.


Organised by: V.Innocente /PH Department and Miguel Angel Marquina - IT Department
CERN Computing Seminars and Colloquia