Mohamed-Helmi Hichri

As a Big Data Expert, I provide consultancy services focused on Big Data & Cloud solutions.

Expertise Areas: Data Architecture, Data Governance, Data Engineering, Data Warehousing, Data Ingestion, Data Quality, Security, DataOps, Batch & Streaming Analytics, Monitoring

Technologies: Cloudera Ecosystem (CDP, CDH, HDP), Hadoop, Spark, NiFi, Ansible, Terraform, AWS, Azure, Elasticsearch, Kibana, Grafana, Kerberos, Ranger, TLS, Prometheus, PostgreSQL, Python, SQL, Kedro, Great Expectations

As a technical lead, I work on some of the most exciting distributed data projects at private and public sector organizations.

Engage from Proof of Concept (PoC) stages through to production implementation on complex distributed environments.

Hereunder a hint on some of my activities:

• Translate customers' requirements into efficient, resilient and secure architectures

• Provide technical expertise on data ingestion, data engineering, data Warehousing, …

• Installation, Administration, Upgrade, Configuration of: CDP & CDH & HDP platforms (on-premise and on the cloud)

• Setup High Availability on CDP/HDP/CDH services (HDFS, YARN, Hive, Ranger, HBase, Oozie)

• Enable security on CDP/HDP/CDH clusters (Kerberos, LDAP, Ranger, MIT KDC, FreeIPA, Active Directory, TLS, Encryption at Rest)

• Troubleshoot and debug major issues on platform & services

• Audit and tune platform services

• Design disaster recovery architecture (data replication, RTO, RPO)

• Prepare and share engagement reports with customers

• Advise and share best practices with customers

• Lead POCs (Proof of Concepts) with customers/Prospects

Sectors: Banking, Insurance, Telecommunications, Construction, Automotive, Public services

Regions: mainly France, but also Spain, Italy and Switzerland

Build a CloudWatch like solution for collecting all types of infrastructure data (logs & metrics) for Société Générale's Private Cloud, from scratch :

o Define the architecture (API, ingestion pipeline, data restitution methods)

o Implement Rest API for data ingestion and restitution: Flask/Python3, gunicorn, nginx, redis, celery, Postgresql

o Setup CI/CD pipeline: github, Jenkins, SonarQube, XL Deploy, pytest

o Setup backend infrastructure: Hadoop, Kafka, NiFi, Elasticsearch, Kibana, Druid, Superset, Grafana

o Collect several TBs of data per day

• Code review / Big Data community/ innovation

o Review data ingestion pipeline with team members and other developers

o Animate Big Data community (between data engineers and data scientists)

o Help data scientists run their algorithms smoothly on our platform

o POC of new tools: opendistro, Presto, Sherlock for druid, Burrow, Jolokia

• Dev/Ops

o Build real-time and batch data pipelines using Python scripts, NiFi, Kafka, Spark (pyspark) ...

o Collect data from multiple sources (database and streams, third parties APIs ...) using NiFi, Logstash, Sqoop ...

o Implement Batch/Real time processing use cases using Apache Spark (pyspark)

o Manage Hadoop/Kafka/Druid/Elasticsearch/NiFi clusters (upgrade, security, troubleshooting ...)

o Build new infrastructure resources (Druid/Elasticsearch ...) using Terraform and Ansible

• I participate in recruitment process by interviewing new candidates