Software Engineering Blog

Posts by: Junjun Zhang

Build workflows collaboratively using reusable and shareable packages

Build workflows together without duplicating work.

Junjun Zhang
Mar. 31, 2021

Proof of Concept: Implement Directed Acyclic Graph DB with Version Control using Elasticsearch

A step-by-step illustration on how Elasticsearch could be used to implement a version controlled directed acyclic graph database.

Junjun Zhang
Sep. 28, 2017

GitHub repository as job scheduling system to orchestrate large data transfer

The ICGC Data Coordination Centre was tasked to transfer an over 700TB dataset into cloud storage systems. We developed a simple and reliable job scheduling system based on GitHub repository, and successfully employed it to orchestrate and track the execution of over 45,000 transfer jobs to complete the task.

View Full Blog