Andre Santos Barros da SilvaData Engineer
Data Scientist || Data Engineer || Machine Learning Engineer || Software Engineer Working with pipelines of data using Python, Airflow and Cloud. I am a person who seeks challenges. I like to always be in professional development. That's why I'm always taking courses and reading. I believe that there is not only talent, but development and motivation.
Certifications
B2 Upper Intermediate
B2 Upper Intermediate, B1 Intermediate
10/07/2021
Tech stack
B2 Upper Intermediate
B1 Intermediate
AWS CLI (6)
RedShift (4)
PySpark (4)
SQL Server Integration Services (SSIS) (4)
Oracle Database (4)
Apache (4)
Azure (4)
Scala (4)
Python (3)
MySQL (3)
GitHub (2)
MongoDB (2)
Django (1)
AWS CloudFormation
AWS Lambda
Experience
Data EngineerToro Investiments
08/2020 - Currently

Development any data integrations to storage on Data Lakes, to process and bring information for all the necessary teams. Working with user registration, financial transactions and marketing data. Currently working with Batch process and near real time. ETL with Apache Airflow CI/CD with azure Databases: Oracle, SQL Server, AWS-Athena Enviroments: Clouds AWS, OCI and OnPremise Dev Languages: Python

PySpark
Oracle Database
AWS CLI
RedShift
Scala
Apache
Azure
SQL Server Integration Services (SSIS)
Data EngineerTembici
10/2019 - 07/2020

CRUD Development with Django on AWS, for payments tools. CI/CD with GitHub Databases: MySQL Dev Languages: Python Enviroments: Clouds AWS

Python
AWS CLI
Django
GitHub
Data EngineerTGR
01/2019 - 10/2019

Development any data integrations to storage on Data Lakes, for telecom data. Working with batch process. Development in analysis to check and bettering quality of internet. CI/CD with GitHub Databases: MySQL and PostgreSQL Enviroments: Clouds AWS and On Premise Dev Languages: Python

Python
MySQL
AWS CLI
GitHub
Data EngineerAxiros
06/2017 - 10/2018

CI/CD with GitHub Databases: MySQL, MongoDB Enviroments: Clouds AWS Dev Languages: Python Creation of recommendation template to check for degradation problems in the internet signal. I participated in device data collection, cleaning, and storage in Datalake and participated in the development of model training and sending for testing in controlled environments. A simple classification model was used with sci kit, but with adequate results to be improved with more data.

Python
MongoDB
MySQL
Education
MasterUSP
01/2017 - 01/2018
Degre physicsUSP
01/2009 - 12/2015