Category Archives: Scientific computing

Booting Ubuntu-14.04 cloud images without a cloud

Ubuntu-trusty

So, Ubuntu-14.04, Trusty Tahr, is out; and booting the cloud images requires a bit more hacking than booting the 12.04 cloud images. Here goes:

Get the image, resize and loop-back mount it:

wget cloud-images.ubuntu.com/trusty/current/trusty-server-cloudimg-amd64-disk1.img
qemu-img convert -c -O qcow2 trusty-server-cloudimg-amd64-disk1.img trusty-server-cloudimg-amd64-disk1_30GB.qcow2
qemu-img resize trusty-server-cloudimg-amd64-disk1_30GB.qcow2 30G
sudo modprobe nbd
sudo qemu-nbd -c /dev/nbd0 `pwd`/trusty-server-cloudimg-amd64-disk1_30GB.qcow2
ls image || mkdir image
sudo … Read the rest

Booting Ubuntu-12.04 cloud images without a cloud

images

I was recently asking myself why the P2V concept has not been more fully embraced by the open-source community – and generalized to V2C, virtual machine to cloud instance. From a scientific computing perspective, it would be ideal to seamlessly be able to prototype a data analysis in a virtual machine on a laptop and then run large-scale data … Read the rest

3PGCIC-2011

Back in Barcelona to present a paper at 3PGCIC-2011 – a well organized and pleasant conference with a varied program. Good discussions on distributed computing. Excellent social arrangements including the reception banquet at the charming Institut d’Estudis Catalans and a visit to the Mare Nostrum supercomputer of the BSC – located in a former chapel.

.… Read the rest

Taking citizen cyberscience a step further

Citizen Science

Recently I’ve stumbled upon the terms citizen science and citizen cyberscience. The last term was apparently invented by Shuttleworth Fellow Francois Grey as a label for BOINC-based distributed computing projects like seti@home, folding@home and his own lhc@home. Grey is also behind the Citizen Cyberscience Centre in Geneva – on the web pages of which there’s more information to be … Read the rest

CERN School of Computing 2011 was… awesome

LectureNyhavnCSCCanoeing

As exemplified on the pictures above (from the photo gallery of one of the students), CERN School of Computing includes a good deal of extracurricular activities. Which probably goes a long way in explaining the good and humorous atmosphere in the classroom.

Having spent a lot of energy preparing the exercise with the great CSC team, it really was great … Read the rest

The vision of GridFactory

factory_c

In this post I’ll try to explain the vision behind a software suite I wrote at the Niels Bohr Institute, University of Copenhagen, 2009-11.

The ideas for the software arose from my dual involvement with the high energy physics and the e-science groups. Some of the code originated in previous projects, including distributed computing efforts of the ATLAS experiment at … Read the rest

CERN School of Computing 2011 – Exercise 2

In this exercise we’ll solve the same assignment as in exercise 1, but using a prepackaged GridPilot application.

  • Download and install GridPilot
  • Start GridPilot and answer the initial questions – enable only the computing system “GridFactory” and set the submission host to gridfactory.nbi.dk
  • Import the app “ttbar_exercise”
  • Select the application/dataset “ttbar_exercise-100k-events” and click “Run”
  • Select the application/dataset “ttbar_exercise-merge” and
  • Read the rest

CERN School of Computing 2011 – Exercise 1

pT diboson distribution.

pT diboson distribution.


This exercise was created for the 2011 CERN CERN School of Computing, hosted by the Niels Bohr Institute, University of Copenhagen.

Credits: physics content of this exercise by Jørgen Beck Hansen from the Niels Bohr Institute.

LHC Monte Carlo event generation and analysis

Read the rest

Browser certificate and key export

This is a follow-up post to my previous post “Front door locks”.

I’m happy to announce a little utility that exports TCS certificate/keys to the hard disk – more precisely to your “.globus” directory where grid tools expect to find them.

Here follows instructions on how to use it:

First, you of course need to have some TCS credentials … Read the rest

Applications

The original purpose of GridPilot was to make it easy for researchers to run, preserve, rerun, share computations on the emerging national and international grid infrastructures. The word infrastructure is used in plural here – indicating our failure to create the grid. Thus GridPilot was born with a pluggable backend support.

Eventually, I created my own take at a grid … Read the rest

GridFactory software suite – overview and documentation

In this post I’ll give an overview of the GridFactory software suite (including GridPilot) and provide the minimum information to get started as well as pointers to more thorough documentation.

Introduction

Overview

GridFactory is a software suite composed of the following programs:

factory_c_smallGridFactory server
The GridFactory server is the software running on the server to which jobs are submitted. It

Read the rest

GridFactory server installation instructions

Notice that currently the software has only been tested on Ubuntu-9.10, 10.04 and Fedora-12, 13 – i386*

Notice also that you must first install SUN/Oracle’s Java (=1.6), either from a distribution repository or directly from Oracle.

Download and installation on Ubuntu

Download

Download mod_gacl, mod_gridfactory, gridfactory_server: either use your browser and get the files from

Read the rest

Public beta!

download

Dear grid warriors: new tools are now available to assist you in your battles. The GridFactory software suite, including GridPilot, is now available for download.

Supported platforms

GridPilot and GridWorker have been tested on the following platforms:

  1. Ubuntu 9.0.4, 9.10, 10.0.4 – i386
  2. Windows XP i386, Windows Vista i386 and Windows 7 i386 and x86_64
  3. Mac OS X 10.6
  4. Read the rest