Developing all the engineering foundation to build the Data Lake ecosystem needed to work with the data sources and visualizations. In addition, configuring all the clusters following best practices to ensure the best performance and availability.
technologies involved
AWS, Databricks, PostgreSQL and Python
what was deeployed?
All the infrastructure including notebooks, storage, jobs and clusters configuration to build the Data Lake ecosystem.
