2022 to 2024

Worked @ Australian Government

Architected and engineered a Google Cloud Platform organization and Azure Entra / DevOps organization

For both the migration of data from a Hadoop platform (Nifi and Impala/Hive) to Google Cloud Platform and the ingestion of public data to BigQuery

Designing and developing a mono repo (using Python poetry) for managing Google Cloud Functions / Workflows / Apache Beam / Dataflow / Dataform pipelines in Python / JavaScript

Building custom Docker images for Dataflow and Flask web applications

Deploying to GCP using Terraform and Bash scripts with the Gloud SDK as scheduled Dataflow runs

Analysing source systems (Teradata and Microsoft SQL Server) and reverse engineering requirements from the Nifi pipelines due to missing corporate knowledge and documentation

Calling an LLM (Google Gemini) through Vertex AI using BigQuery ML from Dataform

Management of project tasks and deliverable in Jira and Azure DevOps

Full stack machine learning architecture as well as web development

Development and architecture of a web application for integration of Natural Language Processing (NLP) predictions and labelling with business reporting

Python Flask, Alembic, SQLite3, AdminLTE (built on top of Bootstrap) with JavaScript libraries including DropZone.js

Use of Git (and Bitbucket)

Configuration of Linux environment

Maintaining and developing R scripts that read and write from many data sources and targets

Sourcing data from multiple data warehouses (Teradata and Oracle) into R environment

2021 to 2022

Worked @ Australian Government

Primarily working on both on-prem and Cloud Microsoft Data platforms including SQL Server, Power BI and Azure

Contributed to architecture for an Azure Data Analytics platform

Building solutions on Azure Databricks including configuring clusters, writing shell scripts, engineering data between on premises SQL Server to Azure SQL Managed Instance and Azure Data Lake Storage (Gen2)

Configuring CNTLM proxy for authenticating against a Windows proxy from a Linux machine

Refactoring machine learning models (Python) from SQL Server Machine Learning Services to Databricks

Python development for automation of things and ML pipelines

Strategies for source control of Power BI PBIX files in Git

Gathering requirements from business areas and subsequent development of Power BI dashboards

Curating and orchestrating data using a SQL first ELT framework

2020 to 2021

Worked @ Australian Government

Website upgrade solution architecture and development, including Node.js

Setting up CI/CD with Git hooks.

Use of many other technology stacks including Python / Powershell for automation frameworks.

2019 to 2020

Worked @ Australian Government

2019/20: Primarily working on strategic Information Management projects. Assessing the technology landscape and building proof of concepts in SQL Server, Power BI, Python and web technologies.

2017 to 2019

Worked @ Consulting

Teradata: 2016, working on end to end data project from data sourcing to BI and Aanlytics

SAS: 2019, worked no a new Viya deployment.

2006 to 2016

Worked @ Australian Government

In various data related roles within the Health sector.

2002 to 2006

Bachelor of Science

Major: Mathematics (Computational)

Minor: Physics