6th  Inverted  CERN School of Computing 2013
25-26 February, CERN

Testing methods and tools for large scale distributed systems


Ramon Medrano Llamas

A few questions

  •  Is testing different for deployment and

  • What testing tools are available at each phase?

All the answers at iCSC

Testing is one essential component of the quality assurance process of any software development project; in particular, most of the systems developed nowadays are born distributed: large backends that run in big data centers to serve millions of clients. Is testing different for these large scale systems? What are the testing methodologies applicable at each phase? Are they different and if so why? What practical tools are best suitable to implement these methodologies? How to successfully integrate testing and profit in the new generation of development processes? This series will review and compare the testing methods and associated tools and will illustrate the review with test cases from LHC experiments.


Targeted audience :

Software developers involved in large-scale distributed projects, and associated operational staff and managers

Lecture 6

Testing methods and tools for large scale distributed systems

Lecture: Testing for development, deployment and operation

A few questions addressed in the lecture

Tuesday  26 February


09:30 10:30


Testing for development, deployment and operation

Ramon Medrano Llamas



This lectures is comprised of two parts:
- tools and techniques for development and deployment
- tools and methods for large scale operation.

  • In the first part, new methodologies and tools that have arisen in the past few years not only to help the development but also to smoothly deploy features on live systems automatically driven by test results will be presented and compared.

    Keywords: SCM, agile methodologies, TDD, continuous integration, cloud deployments, legacy management, deployment rollback.


  • In the second part, modern methodologies and tools focused on operation will be presented. Based on live testing, auto recovery and proactive monitoring, they help reducing the fire fighting overhead and increasing the autonomy of the system.

    Keywords: DevOps, live testing, system wide profiling, autonomic computing, monitoring.


This theme is aimed at software developers interested in automating the quality assurance process of their software development projects and/or get a sneak peek on latest testing tools.

It also targets those involved in operation of computing systems willing to improve and expedite their response to incidents and requests.


The attendees are expected to gain an overview of the testing techniques, tools and motivations during the development process and why testing automation is essential. They will also get an overview of the new operational techniques based on improved relationships between development and operation teams.

Pre-requisite knowledge and dependencies

Little is required, but knowledge of common software tool chains, classic software development strategies and common software life will help fully benefit from the lecture.



  GPU computing and HEP  
Lecture 1
Lecture 2
  All lectures  
  Computer vision  
  Lecture 3  
  Lecture 4  
  Lecture 5  
  All lectures  
  Testing methods and tools  
Lecture 6
  Grid interpretation  
  Lecture 7  
  Programme overview  
  All lectures at iCSC2013  
  All questions addressed  


Copyright CERN

Print version