Slides and code from my RebelCon talk For anyone who is interested, I've just posted slides for my talk here. You can also check out the source code for the pipeline I demonstrated on GitHub.
bash Exporting environment variables from dotenv files Here's a nice shortcut for bash that exports all environment variables from a dotenv (.env) file into the current terminal session.
airflow Configuring Airflow DAGs with YAML The Apache Airflow UI is nice to look at, but it's a pretty clunky way to manage your pipeline configuration. One alternative is to store your DAG configuration in YAML and use it to set the default configuration in the Airflow database when the DAG is first run.
open data Cork Open Data Dashboard The Cork Open Data Dashboard is a visualisation and analysis tool for several of the datasets on Cork City's open data portal, built with open source tools including Docker, InfluxDB and Grafana. The
docker Rolling your own analytics dashboard with InfluxDB, Grafana and Docker For a pet project, I decided to build my own dashboard for charting and analysing time series metrics. There are lots of options out there for doing this. For data aggregation and querying,
kian egan Called Kian? It's probably because of this guy. The number of babies called Kian in Ireland increased sharply after the band Westlife became popular. Is this relationship coincidental? Or is there some deeper meaning? The Central Statistics Office in Ireland provide
docker Strategies for controlling service startup order with Docker Compose As of version 1.6.0, Docker Compose supports a depends_on option that allows you to specify dependencies between the various services that you have defined. For instance, if we specify that