Data and ML Engineering
Last modified on 19.11.2024Freelancer / Self-Employed Remote Work Available from: 19.11.2024 Available up to: 100% On-site Availability: 40%
Locations
Projects
Expand 2 Jahre 2 Monate 12/2022 - Today Market Share Prediction
Senior Data/ML EngineerGCP ServicesKubernetesKubeflowAirflowDeepChecksVertex AIPrometheusGrafanaPythonArgo CDBigQueryMLflowArgoCDetc
Market Share Prediction
Expand 5 Monate 08/2022 - 12/2022 Connected Data Analytics
Senior Data EngineerAWS ServicesAirflowSparkEMRBambooSonarQubeScalaPythonetc.
Connected Data Analytics
Expand 9 Monate 12/2021 - 08/2022 Data Platform Task Force
Senior Data EngineerGCP ServicesAirflowPythondbtStitchKubernetesPostgresBigQueryHelmLookerMetabaseetc.
Data Platform Task Force
Expand 9 Monate 05/2021 - 01/2022 Companion Data
Senior ML EngineerAWS ServicesAirflowSparkAirbyteMLflowKafkaKafka-connectdbtetc.
Companion Data
Expand 1 Jahr 04/2020 - 03/2021 Sales Gap Analysis based on publicly available datasets and transactional data
Tech LeadKubernetesKubeflowApache SparkPythonBigQueryHelmscikit-learnDocker
Sales Gap Analysis based on publicly available datasets and transactional data
Education and Training
Expand 2 Jahre 8 Monate 10/2013 - 05/2016 Software Systems Engineering
Master of Science, RWTH Aachen
Software Systems Engineering
Master of Science, RWTH AachenExpand 2 Jahre 10 Monate 10/2010 - 07/2013 Computer Science, Bachelor of Science
Graduated with Honors, University of Tirana, Tirana, Albania
Computer Science, Bachelor of Science
Graduated with Honors, University of Tirana, Tirana, AlbaniaPosition
- Data Engineer or Machine Learning Engineer building production grade data pipeline or model training and deployment pipelines
Competences
Top Skills
Products / Standards / Experiences / Methods
PROFILE
- Experienced technology consultant with a wide range of skills and cross-industry know-how. Focused on designing and implementing customized production grade solutions in Data and Machine Learning Engineering space.
PROFESSIONAL SUMMARY
- 12+ years of experience in Software Engineering
- 8+ years of experience in Data and Information Management
- 6+ years of experience in Cloud
- Productionazing data pipelines
- Deploy user facing ML use cases to production
- Optimizing for cost and time Machine Learning workflows
- Automating all the steps in Machine Learning workflows
- Modernizing data ingestion and data quality checking workflows
- Lead projects with up to 6 team members
- Certified Cloud Solutions Architect
TOOLS
Machine Learning:
- scikit–learn
- pandas
- seldon–core
- Kubeflow
- MLflow
- Ray
DBMS:
- BigQuery
- Presto
- Hive
- Redshift
- MySQL
- MongoDB
- dbt
- Postgres
Big Data:
- Spark
- Kafka
- ElasticSearch
- Airbyte
- Stitch
Cloud Technologies:
- GCP
- AWS
- Azure
Platform:
- Kubernetes
- Helm
- Docker
- Terraform
- sops
- ArgoCD
Orchestration:
- Airflow
- Kubeflow
CI/CD:
- Jenkins
- GitLab CI/CD
- Bamboo
Methodologies:
- Scrum
- Kanban
WORK EXPERIENCE:
03/2021 – today
Place of Work: Munich, Germany
Role: Senior Consultant, ML/Data Engineer
Customer: Freelance12/2016 – 03/2021
Place of Work: Munich, Germany
Role: Senior Consultant, ML/Data Engineer
Customer: Data ReplyEARLIER WORK EXPERIENCES:
01/2014 – 07/2015
Role: Student Helper
Customer: RWTH Aachen University, Informatik Zentrum, Lehrstuhl für Informatik 5
Tasks:
- Development of Web Services to allow storing and annotating multimedia data using relational and non-relational databases in microservice architecture.
09/2010 – 08/2013
Role: Software Developer
Customer: Helius Systems, Tirana, Albania
Tasks:
- Full-stack software developer in several projects used by up to 1500 users. Languages used: VB, SQL, C# and ASP.NET, Crystal Reports.
Cloud Providers:
- AWS
- GCP
- Azure
PERSONAL PROJECTS
2023 - 2023:
cost-efficient-gpu-platform
- Ray, Python, Kubernetes, Kubeflow, KubeRay, Helm
- Build a Multi-GPU Kubernetes cluster to run distribute machine learning training with Ray and Kubeflow.
2022 - 2022:
ab-testing-for-mlops
- Python, Kubernetes, Helm, Seldon-core, Grafana, Prometheus, Streamlit
- Implement A/B Testing in a microservice architecture for MLOps.
2021 - 2021:
kubeflow-spark
- Python, Kubeflow, Spark, Kubernetes, Helm
- Orchestrate Spark Jobs using Kubeflow.
2021 - 2021:
spark-dockerfile-multi-stage
- Spark, Docker
- Multi stage Dockerfile for Spark jobs.
2021 - 2021:
analytics-platform-diy
- Python, MySQL, Hive, Trino, Spark, Kubernetes
- Deploying an analytics platform on a Kubernetes cluster with automated deployment tools.
2020 - 2020:
immoscout-bot
- Python, Flask, chat bot
- Build a chat bot system that automatically crawls different websites to find apartments, and quickly send notifications in Telegram.
Operating Systems
Programming Languages
Databases
Industries
- Retail
- Finance
- Automotive
- Manufacturing
- Sports Brand
- FitTech
- HealthTech