Senior Lead Spark, Scala, GCP Bilingüe

Senior Lead Spark, Scala, GCP

Over 7+ years of experience in handling large scale data migration projects, building of migration pipelines, validation framework and automations of entire data migration process
Should have experience in ETL projects with hands on experience in GCP, Spark, Scala and Informatica
Proficient in a Spark Scala programming for building and automating data pipelines
Should possess strong communication, planning, and interpersonal skills
Should have good knowledge on Airflow orchestration and preparing DAGs
Working knowledge of Google Cloud Platform on GCS, Bigtable, BigQuery
Good understanding of cloud design considerations and limitations and its impact on Pricing
Proficient in a Python/Scala programming for building and automating data pipelines.
Should have experience in building streaming pipelines using Kafka
Knowledge of Monitoring and auditing tools in GCP
Plan, Configure, Deploy and Operate a cloud solution
Ensure Performance standards by configuring Auto-Scaling Solution to meet varying Load requirements.
Pre and post validations of data, strong skills in data validation frameworks, reconciliation of large data set between different systems
Experience in doing different testing like regression, integration and performance
Experience in version control tools like Git

Must Have Skills:
GCP, Scala Spark, Airflow
Nice to Have Skills: Informatica, Kafka