My time in Amsterdam is coming to an end. Not only did Allison and I explore a lot, but we also learned a lot and are now finalising our projects. So, for one last time, I guess it’s time to …
Performance and Encryption goals – can you really have it all? Read More »
Sadly, this is my last post for the Summer of HPC. It’s been a great two months! Today, I’d like to talk about the final results of my project, namely the use of my animation framework for the coastal defence/wave demonstration, and the web framework I created for the simulation. First, a video of the coastal defence simulation in action!
Hi everyone! In my last blog post I introduced the Intel Movidius Neural Compute stick and sketched out a rough idea of what it is good for. In this post, I would like to build up on that and describe …
First of all, I wanted to share the final presentation of my project, in which some of the concepts mentioned in previous articles are explained in a more visual way. After two articles in which the basics of aerodynamics and …
Hi everybody! The time has come to talk about parallelization and MPI, the heart of our topic and my project. First, the problem the parallel Radix Sort can solve will be presented. Then, we will see the algorithm before talking …
Just a quick info: This blog post was written by Allison Walker and Kara Moraw. Due to a missing plugin, the shared authorship is not displayed correctly, so we’re letting you know like this instead. ** This post is intended …
8 weeks in Amsterdam: Too Dutch of a good thing? Read More »
In last blog post I talked about over/under sampling as a method to address unbalanced datasets. As a data transformation method it is important that we are cautious when evaluating performance of classifiers when we are performing over/under sampling. In …
Preprocessing pipeline and train/test set separation Read More »
This will be the last blog post, so Martin, don’t be sad. Before leaving this amazing summer school, let me sum up what I achieved. In overall, this experience has been amazing. Although there were ups and downs throughout my …
The goal of my project is to construct a classifier (learner) that will be able to recognize (and possibly predict) abnormal behavior of HPC system. Naturally abnormal behavior and faults represent relatively small part of the overall data collected from …
Research is an iterative process, and when writing code, we are often carving out a small area of functionality. Software version control is an essential part of this process, since we may want to try explore possible solutions, and revert …
“It works on my machine” – evangelising continuous integration in HPC research Read More »
As I explained in previous posts, I’m following a transfer learning approach to training the model that I will use to detect action units on faces. This means that I’m going to be taking an existing network, removing a few …
The hyperparameter realm: teaching facial expressions to a DNN Read More »
Python programming language which its main philosophy is ‘code readability’ has entered our lives in 1991. After the Python developer Van Rossum has decided to pursue his career on Google, Google has became the tower of strength of Python. Then …
PRACE summer school is advancing fast! In this post, I’ll be sharing some of the experience acquired during this summer. In my own case, I’ve been asked to develop a plugin for Slurm, the most adopted job scheduler in HPC …
Let’s imagine you have a working code and now you are producing some results. What do you feel? You are very happy, of course, but you feel the urge to improve your code. It’s always a good idea to parallelize …
Hello dear passengers, the new topic about my project is equality! I believe the topics in SoHPC should be comprehensible for everyone, so I decided to make a game to explain how HPC and Deep Learning works with a game. …
Hello World! Since my last blog post quite some time has passed, and wherein a lot of progress was made on my project! After a very warm welcome by my supervisors and the other colleagues working at ICHEC I immediately …
Bird pun, check. Now let’s move on to the next installation of Allison’s Summer of HPC blog! A quick recap: my project is all about improving the accessibility of meteorological radar data for ornithologists at the University of Amsterdam. These …
Hi dear readers! Today, as promised, I will present and explain my challenge called oneGBSortChallenge! Then, complements about Radix Sort will be given, in particular how to deal with negative and real numbers but also with other kinds of data …
#oneGBSortChallenge and complements about Radix Sort [Difficulty: Medium] Read More »
Many hands make light work (or maybe just Lumos if you’re a wizard). How about many processors?
Today, HPC and Machine Learning are on the menu! I’ll explain what we are really doing here!
Then I’ll show you some incredible things I saw in what I call now my chamber of wonders.
I hope this post was worth the wait!
Welcome, all! I have been working on an Industrial electricity consumption prediction project. I have received this data from a Slovene company which sells electricity to its customers. The dataset is a 15 mins Electricity Consumption data spanning one year …
What secrets are hidden in the data? – Data Prep and Analysis Read More »
