All of my in-depth insights on data engineering, programming, business, and more, gathered in chronological order.
In this blog post, I’ll walk you through the journey of building an end-to-end data pipeline using Google Cloud Storage, BigQuery, dbt, and Looker. This project was a fascinating exploration of modern data engineering practices, leveraging powerful tools to transform raw data into actionable insights.
Cocoa prices recently surged past $10,000 per metric ton for the first time, more than doubling January’s $4,200 level and nearly quintuple March 2023’s $2,927. This increase was driven by adverse weather conditions and heavy rains in West Africa, which negatively impacted crop yields and spread black pod disease. However, prices have started to decline due to improved weather conditions in West Africa and cautious buying from chocolate producers.
In the world of football, the debate over who reigns supreme in any position is a favorite pastime among fans. Recently, a discussion with a friend prompted an intriguing question: who is the best goalkeeper in European football at the moment? As someone who values objectivity over bias, I realized that relying solely on personal observations wouldn’t suffice due to the vast number of matches across European leagues. Thus, I turned to data analysis to find an answer.
Faced with the challenge of managing extensive Excel datasets, we turn to the robust capabilities of Azure’s Data Factory to streamline and automate the process of data transformation.
This project was aimed at enhancing my expertise in SQL (with a special focus on Microsoft SQL Server), Azure Cloud and Services, Power BI, Database Schemas, Normalization, and the two distinct data processing systems: Online Transaction Processing (OLTP) and Online Analytical Processing (OLAP).