My Data Science Portfolio
About Me
Hello! I'm Brian Lau, a passionate data scientist and developer who loves transforming raw data into actionable insights. With expertise in data visualization, statistical analysis, and machine learning, I enjoy solving real-world problems and sharing my work with the community. Welcome to my portfolio!
Project: Factory Shoe Production
This project showcases a real-time dashboard for analyzing shoe production data across multiple factories in China, Vietnam, and Indonesia. The dashboard dynamically fetches production metrics from a cloud-hosted Supabase database.
Technologies & Skills Used:
- JavaScript
- HTML & CSS
- Supabase
- Data Visualization
- API Integration
- Microsoft SQL Server and SSIS
| Date | Factory | Country | Production | Pairs per Minute |
|---|
ETL Process: From Raw Data to SQL Server
The process starts by collecting raw data files from Asia factories in TXT or CSV format. Using VBA in Excel, we perform data cleansing, transformation, and aggregation. Once the data is refined, it is uploaded into a SQL Server database to serve as the single source of truth.
- Extract: Retrieve TXT or CSV files from various sources.
- Transform: Use VBA in Excel to clean, validate, and transform the data.
- Load: Upload the processed data into SQL Server.
This standardized database is then used to create dynamic dashboards and reports to monitor and compare factory efficiencies.