News

XtreemFS 1.5 released: Improved support for Hadoop and SSDs

Desktopgrid Federation - 14 March 2014 - 1:05pm

The XtreemFS team released a new stable version of the cloud file system XtreemFS. XtreemFS 1.5 (Codename "Wonderful Waffles") comes with the following major changes:

- Improved Hadoop Support: Read and write buffers were added to improve the performance for small requests. The team also implemented support for multiple volumes e.g., to store input and output on volumes with different replication policies.
- SSDs support: So far, an OSD was optimized for rotating disks by using a single thread for disk accesses. Solid State Disks (SSDs) cope well with simultaneous requests and show a higher throughput with increased parallelism. To achieve more parallelism per OSD when using SSDs, multiple storage threads are supported now.
- Multi-Homing Support: XtreemFS can be made available for multiple networks and clients will pick the correct address automatically.
- Multiple OSDs per Machine: Machines with multiple disks have to run an OSD for each disk. The team simplified this process with the new xtreemfs-osd-farm init.d script.
- Bugfixes for Read/Write and Read-Only Replication: The team fixed a problem which prevented read/write replicated files to fail-over correctly. Another problem was that the on-demand read-only replication could hang and access was stalled.
- Replication Status Page: The DIR status page has got a visualization for the current replica status of open files. For example it shows which replica is the current primary or if a replica is unavailable.

The team prepared a tutorial which walks you through the setup of a read/write replicated XtreemFS volume on a single machine. The tutorial lets you stream a video from the volume and simulate the outage of a replica. You'll learn about the details of the XtreemFS replication protocol and why the video stalls for some seconds and then playback resumes.

AlmereGrid has put the tutorial to the next level: They created a setup of eight Raspberry Pi mini-computers running XtreemFS - packaged in a briefcase. Check the website CloudCase.eu for more details and the video which shows the briefcase and the demonstrated fail-over.

You can use XtreemFS directly in your application with our C++ and Java client libraries. This way you avoid any overhead due to Fuse and can access advanced XtreemFS features which are only available through the maintenance tool "xtfsutil" otherwise e.g., adding replicas.

From using XtreemFS it's only a small step to dive into the XtreemFS source code itself. The team collected several introductory documents for novices in a Google Drive folder "XtreemFS Public". For example, have a look how to setup the XtreemFS Server Java projects in Eclipse.

More information is available at http://xtreemfs.org/

Leslie Versweyveld 2014-03-14T12:05:35Z

Winner of ViSH 2013 Competition receive felicitations

GLOBAL excursion - 11 March 2014 - 6:03pm

The winners of the ViSH 2013 Competition, a group of students from the IES David Bujan school in Galicia, Spain, have received special certificates from the local authorities to recognize their achievement.

Categories: News

Socientize project invites to contribute to the Citizen Science White Paper

Desktopgrid Federation - 11 March 2014 - 2:25pm

Fermin Serrano, project leader of the Socientize project, explains why it is important to participate in the consultation phase for the White Paper on citizen science that is now open until March 27. The white paper will play a role in for instance European Commission policy on citizen science. Fermin Serrano also explains why he was happy to be at the Citizen Cyber Science Summit in London, where this interview was done.

The Socientize project addresses the future of Citizen Science in Europe. In Citizen Science there are different roles of participation to make science more efficient using different tools including mobile devices, desktop grid computing and so on. Socientize is not only about science, it is also a social process dealing with policy outcomes.

The Citizen Cyber Science Summit was an excellent opportunity for the Socientize project partners to meet with their different stakeholders.

You can contribute your own ideas to the White Paper at whitepaper.socientize.eu

Watch the interview at http://vimeo.com/88191636

Leslie Versweyveld 2014-03-11T13:25:11Z

New routes for LHC@Home

Desktopgrid Federation - 11 March 2014 - 2:16pm

LHC@Home is a crowd computing project that allows citizens to donate unused computing time to scientists at CERN. LHC@Home co-ordinator Ben Segal gives an overview of the achievements thus far and the plans to not only let volunteers use their computers but also their brains. At the Citizen Cyber Science Summit in London he showedPrimeur Magazinea glimps of this LHC@Home future.

This year is the tenth anniversary of LHC@Home, one of the very first BOINC projects, set up to study the beam's stability in the accelerator. The application had to be compiled and installed on each user platform.

Since two years, LHC@Home 2.0 uses 3000 virtual machines all of the time all over the world, allowing to study much more general problems. Instead of receiving the compiled package of the application, the user receives a virtual machine where the problems are being sent to the user. The virtual machine can access all the libraries and all the modules necessary for any experiment at CERN. This technology runs theoretical physics' applications. The calculations are used to build up a database of theoretical simulations.

A next step is to not only use the volunteer's computer power but also his thinking capacity. In this approach, the volunteers can select and modify the tunable parameters in the Citizen CyberLab project. Unskilled people can do this very well, according to Ben Segal. A game platform prototype has been developed to help the volunteer scientist in this process.

More information is available at http://lhcathome.web.cern.ch/

Watch the interview at http://vimeo.com/88191103

Leslie Versweyveld 2014-03-11T13:16:10Z

SOMNO.NETZ and ER-flow has signed an MoU

ER-flow - 7 March 2014 - 1:07pm
The SOMNO.NETZ and ER-flow projects have signed a Memorandum of Understanding for collaboration in porting medical imaging applications as workflows to be executed on an OpenStack cloud infrastructure.   The SOMNO.NETZ project coordinator, Prof. Dr. Dagmar Krefting from the Technical University and the Charite Hospital in Berlin, has a long track of collaboration with the group of Dr. Silvia Olabarriaga of the Academic Medical Center of the University of Amsterdam, which participates in ER-flow. Dr. Krefting participated in the SHIWA project, and is familiar with the platform.    During the collaboration, the two groups will jointly investigate how to port medical imaging applications to a cloud infrastructure using WS-PGRADE. The first steps have been taken using the WS-PGRADE portal operated by SZTAKI, and now a new portal is being configured to access the German private cloud resources.   In the month of March 2014, a member of the Berlin team (Christof Jansen) is visiting the AMC for training on workflow development and portal configuration. He presented a talk at the AMC about the various German projects that will use this infrastructure for sharing and computing medical image data (see photo).     Kitti Varga 2014-03-07T12:07:20Z

SHIWA Technology on ECCB 2014

ER-flow - 3 March 2014 - 2:01pm

Our tutorial proposal has been accepted to the 13th European Conference on Computational Biology (ECCB'14). This tutorial will provide an introduction to the use of scientific workflows for bioinformatics data analysis, integration and scaling and will highlight the main differences and similarities between Galaxy, Taverna and WS-PGRADE systems.

ECCB'14 will be in Strasbourg, from September 7 to 10, 2014.

Kitti Varga 2014-03-03T13:01:21Z

New project to help the agriculture

Big Data and Agriculture Team - 3 March 2014 - 10:52am

Our new project has been signed last week.

New project to help the agriculture

LPDS News - 3 March 2014 - 10:52am

Our new project has been signed last week.

Categories: News

Recommendations for educational policy makers

GLOBAL excursion - 25 February 2014 - 7:59am

We recently published a brochure dedicated to educational policy makers. This publication includes a series of key questions dedicated to policy makers in education as well as a concrete set of proposals for action. The questions and recommendations are derived from our 2,5 years of intensive work with teachers and scientists across Europe to promote science in schools.

The publication also describes teacher’s experiences with the ViSH,  a central point for teachers to access and create interactive learning material related to various science topics, and its related activities.

The full publication can be downloaded here:

Gx final publication for educational policy makers

Categories: News

Open Discovery Space (ODS) and ViSH

GLOBAL excursion - 21 February 2014 - 10:39am

Open Discovery Space is a community-oriented social platform that hosts the largest collection in Europe of eLearning resources, scenarios and activities. It supports a network for teachers by teachers and offers state of the art tools – adaptable to local needs, languages and culture – to enable teachers to discover, collaborate , exchange and share resources and best practice across Europe.

Now, the ViSH and ODS will be closer connected as ODS is going to harvest as well as integrate ViSH to the its repository!

http://opendiscoveryspace.blogactiv.eu/2014/02/19/ods-the-european-schoolnet-in-brussels/

Categories: News

News from our partner project: NANOPINION CONTEST: “DISTILLED NANOIDEAS”

GLOBAL excursion - 17 February 2014 - 10:49am

The DISTILLED NANOIDEAS competition is an interactive contest for teachers and their students, who are invited to present and share a world-changing idea from the nanotechnology world. The competition aims to promote a meaningful dialogue about nanotechnologies; present the Ethical, Legal & Social Aspects; use nanOpinion tools; and engage people in active creation of tomorrow’s world.

Teachers and their students are invited to open their creativity window and show their ideas through arts using every possible technique (e.g. painting, sculpturing etc.) and share their work through a 3-minute video, presentation or photo album. The contest is open until 15 April 2014. The winners will be announced on the nanOpinion portal and Facebook page.

URL: http://www.nanopinion.eu/en/competition

 

Categories: News

Final Event and Award Ceremony

GLOBAL excursion - 13 February 2014 - 9:28am

We are close to our final event, which will take place in Brussels, 14th to 16th of February 2014 at the European Schoolnet.

One of the highlights will be the Award Ceremony for our ViSH 2013 Competition Winners. Out of the many submissions that we received for this competition 3 overall winners were selected in addition to the two winners for each category. You can brows through all winning excursions here: http://vishub.org/contest

For those who want to watch the Award Ceremony live, where Mr. José Cotta, Head of Digital Science Unit of the European Commission, will hand over the certificates and prizes to our winners, you can follow it online: http://vishub.org/events/11#Global

Categories: News

IDGF Crowd computing presence at the 3rd Citizen Cyberscience Summit in London, February 20-22, 2014

IDGF-SP - 7 February 2014 - 9:49am

The 3rd Citizen Cyberscience Summit will be held in London, February 20-22, 2014. This summit is a major Citizen Cyberscience event. On the first day the scene will be set - hearing from some of the leading figures in citizen science and exploring the process of public engagement and participation, outreach of citizen science to the developing world, and the undertaking of "extreme" citizen science projects, in rain forests, the arctic tundra, or urban jungles.

On the second day experts will discuss the hardware and software that powers citizen cyberscience. There will be panel discussions with citizen scientists about participation and engagement, and a showcase of new and future citizen science projects.

On the third day the Hack Day will continue with workshops about developing hardware and software prototypes, lightning talks with demos and mock-ups, and an Open Space to work on ideas and challenges. The organizers will wrap up the day with a Hack Day Show and Tell and a Reception.

There are several presentations about Desktop Grids and Crowd computing and several IDGF members talk about related projects:

- On Thursday, Juan Hindo will talk about World Community Grid and Volunteer Computing on Mobile Phones.
- On Friday,  Ofer Arazy, Associate Professor at University of Alberta, presents "The effects of online motivational stimuli on the likelihood of contribution to volunteer computing initiatives".
- IDGF member Fermin Serrano will lead a "Workshop on Policy recommendations to support Citizen Science in Europe" with crowd computing implications as well.
- On Friday IDGF member Peter Hannape, will talk about a Desktop Grid related topic: P2P Food Lab.
- On Saturday IDGF member Ben Segal will talk about LHC@home: new perspectives in citizen cyberscience for particle physics".
- This presentation is followed by IDGF member Ad Emmen talking about "Desktop Grid with Raspberry Pi - Setting up a Crowd computing demo corner to explain distributed computing".

Leslie Versweyveld 2014-02-07T08:49:06Z

IDGF Crowd computing presence at the 3rd Citizen Cyberscience Summit in London, February 20-22, 2014

Desktopgrid Federation - 7 February 2014 - 9:34am

The 3rd Citizen Cyberscience Summit will be held in London, February 20-22, 2014. This summit is a major Citizen Cyberscience event. On the first day the scene will be set - hearing from some of the leading figures in citizen science and exploring the process of public engagement and participation, outreach of citizen science to the developing world, and the undertaking of "extreme" citizen science projects, in rain forests, the arctic tundra, or urban jungles.

On the second day experts will discuss the hardware and software that powers citizen cyberscience. There will be panel discussions with citizen scientists about participation and engagement, and a showcase of new and future citizen science projects.

On the third day the Hack Day will continue with workshops about developing hardware and software prototypes, lightning talks with demos and mock-ups, and an Open Space to work on ideas and challenges. The organizers will wrap up the day with a Hack Day Show and Tell and a Reception.

There are several presentations about Desktop Grids and Crowd computing and several IDGF members talk about related projects:

- On Thursday, Juan Hindo will talk about World Community Grid and Volunteer Computing on Mobile Phones.
- On Friday,  Ofer Arazy, Associate Professor at University of Alberta, presents "The effects of online motivational stimuli on the likelihood of contribution to volunteer computing initiatives".
- IDGF member Fermin Serrano will lead a "Workshop on Policy recommendations to support Citizen Science in Europe" with crowd computing implications as well.
- On Friday IDGF member Peter Hannape, will talk about a Desktop Grid related topic: P2P Food Lab.
- On Saturday IDGF member Ben Segal will talk about LHC@home: new perspectives in citizen cyberscience for particle physics".
- This presentation is followed by IDGF member Ad Emmen talking about "Desktop Grid with Raspberry Pi - Setting up a Crowd computing demo corner to explain distributed computing".

Leslie Versweyveld 2014-02-07T08:34:13Z

Yannick Legré has been appointed EGI.eu director

Desktopgrid Federation - 5 February 2014 - 9:37am

Yannick Legré has been appointed EGI.eu director from February on. Catherine Gater who was acting director of EGI.eu will be leaving for the Europeana project led by the British Library in London. EGI.eu is co-ordinating a European e-Infrastructure consisting of a Grid and a federated Cloud.

Yannick Legré has been involved in the European Grid since the very early days with the European DataGrid project in 2001. Later on, he was the driving force of HealthGrid and participated in several European projects, including the DEGISCO Desktop Grid project.

Leslie Versweyveld 2014-02-05T08:37:02Z

Bloom taxonomy for ViSH and ViSH editor

GLOBAL excursion - 2 February 2014 - 11:53am

Do you know what a Bloom taxonomy is? Basically Air Blowerit is a classification of learning objectives. Here is the wikipedia link, if you want to know more about it:

http://en.wikipedia.org/wiki/Bloom’s_taxonomy

We have such a taxonomy now for the ViSH and the VISH editor. Can be very helpful for teachers when using the ViSH

Categories: News

Moving towards the Clouds

gUSE SF - 31 January 2014 - 11:20am

Thanks to the latest release of gUSE/WS-PGRADE, from now you can send your applications to run on cloud resources.

The gUSE/WS-PGRADE v3.6.2 provides you a new solution to directly access the clouds without brokering. You can also run your jobs on cloud resources by only using a valid user name and password to the corresponding cloud service.

Behind the scenes, the direct cloud access solution is based on the job submitter DCI Bridge distribution (the capability of job forwarding from master to slave DCI Bridge): the master DCI Bridge – that directly connected to gUSE – forwards the jobs through the Amazon EC2-based frontend service to the slave DCI Bridge – located in the cloud. Technically, the master DCI Bridge started - by the EC2-based service – a Virtual Machine that was created from an earlier saved image, containing the properly configured slave DCI Bridge.

Thanks to this new development, you can use cloud in the WS-PGRADE portal as ordinary resource type: you can create, configure and submit workflows just the way you always do.

More information:

Portal User Manual, chapter 21 within Menu-Oriented Online Help
Admin Manual, chapter VI
DCI Bridge Manual, chapter 2.18

Moving towards the Clouds

gUSE SF - 31 January 2014 - 11:20am

Thanks to the latest release of gUSE/WS-PGRADE, from now you can send your applications to run on cloud resources.

The gUSE/WS-PGRADE v3.6.2 provides you a new solution to directly access the clouds without brokering. You can also run your jobs on cloud resources by only using a valid user name and password to the corresponding cloud service.

Behind the scenes, the direct cloud access solution is based on the job submitter DCI Bridge distribution (the capability of job forwarding from master to slave DCI Bridge): the master DCI Bridge – that directly connected to gUSE – forwards the jobs through the Amazon EC2-based frontend service to the slave DCI Bridge – located in the cloud. Technically, the master DCI Bridge started - by the EC2-based service – a Virtual Machine that was created from an earlier saved image, containing the properly configured slave DCI Bridge.

Thanks to this new development, you can use cloud in the WS-PGRADE portal as ordinary resource type: you can create, configure and submit workflows just the way you always do.

More information:

Portal User Manual, chapter 21 within Menu-Oriented Online Help
Admin Manual, chapter VI
DCI Bridge Manual, chapter 2.18

New submission service to be introduced

ER-flow - 28 January 2014 - 12:13pm
The technology provider team of the ER-flow project has completed a major upgrade of the SHIWA Simulation Platform. The key component of the upgraded platform is the new web service based submission service which replaces the previous GT4 based GEMLCA Service.   As a result, to deploy and/or access remotely the submission service will be much easier than previously. There is a further advantage: Certificates are no longer required to access and use the submission service. The SHIWA Repository was expanded with workflow engine management which was done previously by the GEMLCA Repository. As a result, there will be only a single repository instead of the previous two ones. The SHIWA Portal was also upgraded to support the new submission service.    The development tests were completed successfully and the helio community will run the end user tests from 28th January using helio Taverna workflows. As soon as the tests are completed we will release the upgraded SHIWA Portal.  Kitti Varga 2014-01-28T11:13:04Z

New SHIWA Portal release

ER-flow - 21 January 2014 - 10:24am

The SHIWA Portal upgrade is completed and tested. The new portal is based on gUSE 3.6.1.

The principle changes are that the Workflow Editor will run on current versions of Java. The main improvement in gUSE v3.6.1 is the solution for debugging of job submissions by applying breakpoints in WS-PGRADE workflows. By this tool the users can interact with workflows at runtime: they can directly influence and change workflow’s submission processes and results by enabling or prohibiting the progress of job instances at breakpoints.

To access the SHIWA Portal, please use: http://ssp.shiwa-workflow.eu

Kitti Varga 2014-01-21T09:24:53Z

Pages

Subscribe to MTA SZTAKI LPDS aggregator - News