Software Engineering Blog

Jan. 3, 2017

Migrating a legacy frontend build system to Webpack

Migrating a legacy frontend build system to Webpack

Full Article »

Dec. 12, 2016

GitHub repository as job scheduling system to orchestrate large data transfer

The ICGC Data Coordination Centre was tasked to transfer an over 700TB dataset into cloud storage systems. We developed a simple and reliable job scheduling system based on GitHub repository, and successfully employed it to orchestrate and track the execution of over 45,000 transfer jobs to complete the task.

Full Article »

Dec. 9, 2016

Adding support for multiple authors in Jekyll

OICR being a research institute, a portion of the team, in particular those of us more on the science side, is used to Academic Publishing and its related conventions such as Academic Authorship. It was not long before we were asked for supporting multiple authors in a blog post.

Full Article »

Dec. 1, 2016

tmux your local dev environment

Web developers spend a lot of time in the terminal. Add in a tab for a text editor, another one for running tests and yet another for git and the amount of terminal tabs balloons. Tmux is used a lot on servers to share sessions between users, but it can also be used locally in tandem with tmuxinator and tmux-resurrect to manage this headache.

Full Article »

Nov. 25, 2016

Shading Elasticsearch

Shading or package renaming a.k.a class relocation is a process of creating an uber-jar which contains its dependencies and package names of some of the dependencies are renamed. In this blog post I will provide instructions how to create an Elasticsearch jar file with shaded dependencies to save you from the perils of Jar Hell.

Full Article »