À propos de Omar
Striving to master the Big data Stack with a keen interest in Google Cloud in order to become a fully-fledged Data architect.
My wide spectrum of experiences allowed me to design, build and deploy scalable and orchestrated data pipelines on GCP that conveys the business need of clients harnessing a high variety of cloud services like Dataflow, Google Cloud Storage, BigQuery, and Workflows.
Having a good knowledge of CICD pipelines, both data project life-cycle and organization, and best practices. Eager to contribute and open to learning to be on the cutting edge of data and cloud.
Français
Capacité professionnelle complète
Anglais
Bilingue ou natif
Allemand
Notions
Accepte de travailler sur site
Paris (jusqu’à 50 km)
Expériences
- AutobizLead Data Ops Engineer GCP - Google Cloud DataPlatform Conception & MigrationE-COMMERCEavril 2022 - Aujourd'hui (4 ans et 2 mois)Paris, France• Conceiving the architecture for the DataPlatform from the hierarchy of the projects to the groups and users service accounts.• Working on the pilot project for the migration to be used as a template and a proof of concept for the upcoming projects in the platform.• Building scalable data pipelines using apache beam (Dataflow) to both ingest and transform data following business rules.• Conceiving the infrastructure architecture to create various resources and service accounts in BigQuery Dataflow Workflows and Scheduler for each project.• Building Gitlab CI pipelines to automate tests and code deployments in GCP.
- RenaultLead Cloud Data Engineer - Materials and Substances Monitoring "MatSub"AUTOMOBILEjuin 2020 - mars 2022 (1 an et 9 mois)Paris Metropolitan Area, France• Migrating 7 Data projects from HDFS to GCP using the Renault Datalake Loader.• Managing data ingestion from multiple sources via NIFI connections in Google Cloud Storage.• Orchestrating data ingestion and processing using DAGs in Airflow and Cloud Composer to industrialize data pipelines.• Developing and optimizing BigQuery scripts to create and manage RAW and GOLD tables in all development environments.• Developing Python scripts for data cleaning, processing and filtering that adhere to precise business rules.• Coordinating between migration and users teams to smooth the migration process.• Replicating legacy databases inside BigQuery by using NIFI connections to backup projects.• Developing and maintaining the backend of a reporting tool that assists Business to assure conformity with regulation with regards to hazardous materials and substances percentages inside car parts.• Exploring ways to visualize data using Spotfire for multiple projects
- Renault GroupeData Engineer - VIN dispersion tools "VDT", Data collection IndustrializationAUTOMOBILEjanvier 2019 - juin 2020 (1 an et 5 mois)Paris, France• Tracking and reporting of marketing expenses of dealers around the world via data visualization• Translating business needs and rules into complex pipelines to help future decision making of marketing action plans.• Automating data ingestion from Sent-in files inside HDFS buckets via NIFI to create RAW tables in Hadoop.• Creating workflows using Oozie to orchestrate jobs to create tables.• Analyzing and checking data conformity before ingestion to have up-to-date KPIs with business predictions.• Assisting in the development of a monitoring tool to check in-coming files for any irregularities.• Documenting both the functional and technical sides of the project.• Leading the RUN phase by identifying and analyzing bugs erroneous data using KANBAN methodology.• Supervising and coaching the run-team in India.
Recommandations
Ces profils de freelance correspondent également à vos critères
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Formations
- Engineer's degree, Computer Systems Networking and Telecommunicationssup'com2018Engineer's degree, Computer Systems Networking and Telecommunications
- Bachelor of Science in MathematicsIPEIT - Institut Préparatoire aux Etudes d'Ingénieurs de Tunis2015Bachelor's degree, Mathematics