Experience
SedraPay
AI/MLOps consultant
June 2022
I was tasked by the client to create a Proof of concept for a machine learning/Artificial intelligence algorithm that can extract date from identity cards of arabian nations and check the documents' authenthicity.
In order to push forward with quick prototypying I suggested using Azure's form recognizer and training it to get the desired result. I then created and deployed a react based web app that can be used to upload ID images and it will fill out the field's with the extracted data.
Technologies: Azure, Form Recognizer, Azure SDK, REST, AIOps, MLOps, React, NGINX
Sahariano
Data Engineer Consultant
May - June 2022
As a data engineer consultant my main responsability was to improve the reliability and efficiency of the ETL pipelines mainly the underlying scraping scripts and data ingestion processes.
I was able to provide my client with an average of 4 to 5 times improvement in resource management and time consumption turning 1-2 minute tasks per input to a measily 15 seconds. This increase in effieciency was accompanied with an increase in reliability and top of the line logging.
Technologies: Python, Selenium, MySQL, SQLAlchemy
Plotly
R Consultant
Oct - Nov 2022
As an R expert I was tasked with helping alleviate the burden on the main developer of plotly.R a data-viz library that's used by more than 11 million downloads. I was able to help resolve some issues in their github repo.
Technologies: R, ggplot, Plotly.R, Git, Github
GreekAdvisors
Software & Data Engineer
July 2021 - Present
I was tasked by the client to create scrapers for tradingview.com, deploying them to AWS and creating a GUI and a website from where he and his team will be able to manage their resources and watch the progress of the scrapers.
I leveraged boto3 and the SSH protocol in order to make it easy to provision EC2 instances, start them, manage the setup/update process, upload new files for the scrapers, get the status of each instance and some important stats (like Avg. time per line, EDT, progress ...).
Technologies: Python, React, Flask, uWSGI, NGINX, AWS, SSH, Selenium, boto3, MongoDB, SQLite
The Big Data Company
Software & Data Engineering Consultant
June 2021 - June 2022
As a Data/Software engineering consultant I was tasked with building multiple APIs to help TBDC provide accurate results and beautiful GIS maps.
During my tenure with TBDC, I managed to build a dockerized statistics API leveraging the power of R that was proxied by an ExpressJs server in order to allow for concurrent users. I also built a crawler that consumes the API of one of the Agriculture machinery manufacturor and creates chloropleths that are then saved in an S3 bucket and referenced back in database so the TDBC app could display those image in a Facebook 'news feed' style manner.
Technologies: R, Docker, Node, Express, AWS, S3 buckets, MySQL, GDAL, Google Maps API, Gitlab, OpenAPI, REST