À propos de Ahmed
I help companies design and optimize Databricks-based data platforms on Azure.
Many organizations struggle with high Databricks costs, unstable pipelines, and missing governance. I specialize in building scalable, cost-efficient architectures using Delta Lake, Unity Catalog, and Infrastructure as Code.
With experience in enterprise environments and a Databricks Professional certification, I deliver production-ready data platforms — not just notebooks.
Things I specialize in:
✔ Databricks platform setup from scratch
✔ Migration from legacy data warehouse to Delta Lake
✔ Cluster optimization & cost monitoring
✔ CI/CD for data platforms
✔ Unity Catalog governance setup
Arabe
Bilingue ou natif
Anglais
Bilingue ou natif
Néerlandais
Capacité professionnelle limitée
Accepte de travailler sur site
Antwerp (jusqu’à 50 km)
Expériences
- Mediterranean Shipping CompanySenior Data Engineeroctobre 2024 - Aujourd'hui (1 an et 8 mois)Antwerp, Belgium• Build and maintain scalable data pipelines to ingest and process diverse event-driven data streams, including telemetry and other IoT-generated events.• Utilize Databricks and Delta Lake for efficient storage, transformation, and querying of large-scale datasets.• Develop and manage CI/CD pipelines using Azure DevOps to automate deployment and testing processes.• Implement Infrastructure as Code (IaC) solutions with Bicep for consistent and efficient infrastructure provisioning.• Ensure robust version control and collaboration using Azure DevOps Git repositories.• Collaborate with data scientists and stakeholders to design and implement end-to-end data workflows.• Monitor and optimize data pipelines for performance, reliability, and cost-efficiency.• Enable data governance and security by defining and enforcing standards for data cataloging, versioning, and access control.• Generate actionable insights through exploratory data analysis and custom analytics solutions tailored to varied data types.
- Melexis Technologies NVData Engineeroctobre 2023 - septembre 2024 (10 mois)Tessenderlo, LI, Belgium• Designed and implemented data pipelines using Databricks and Airflow.• Orchestrated pipelines using Airflow and Databricks Workflows (jobs).• Leveraged PySpark to transform and load data into efficient formats (Delta Lake) for optimized analytics.• Automated data product deployments using Databricks jobs within a GitLab CI/CD pipeline.• Developed cost monitoring and control mechanisms for Databricks, optimizing resource utilization.• Ensured platform maintainability through Infrastructure as Code (IaC) using Terraform.• Implemented Databricks Unity Catalog to streamline data management and governance.• Communicated technical solutions to data engineering, BI, and end-user teams to ensure alignment.
- Verhaert - Masters In InnovationData scientist/ Engineerdécembre 2022 - septembre 2023 (10 mois)Antwerp, Belgium• Microsoft Azure Data demonstrating a strong foundation in Azure data services.• Leveraged expertise in Azure Databricks platform for efficient data ingestion and transformation.• Developed data pipelines to ingest, curate, and consolidate big data from diverse sources (SQL server, CSV, XML, JSON).• Wrote PySpark (and SQL) notebooks to transform and load data into formats like Parquet and Delta Lake.• Trained and tested machine learning and deep learning models for various applications.• Optimized data pipelines for performance and scalability to ensure efficient data processing.• Deployed and maintained machine learning models in production environments for real-world impact.
Recommandations
Soyez le premier à recommander Ahmed
Contribuez à la réussite de ce freelance en partageant votre expérience de collaboration avec lui.
Ces profils de freelance correspondent également à vos critères
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Formations
- PhD in Nuclear PhysicsKU Leuven2022
- Master of ScienceUniversity of Applied Sciences (FH Aachen)2018European Master of Science
Certifications
- Databricks Certified Data Engineer ProfessionalDatabricks2025
- Databricks Certified Data Engineer AssociateDatabricks2024