GCP-Data/Bigdata Lead Engineer

T2 Innovations - GCP-Data/Bigdata Lead Engineer

Job roles and responsibilities:

  1. Minimum 3 to 4 years hands on designing, building and operationalizing large-scale enterprise data solutions and applications using GCP data and analytics services like, Cloud DataProc, Cloud Dataflow, Cloud BigQuery, Cloud PubSub, Cloud Functions.
  2. Hands-on experience in analyzing, re-architecting and re-platforming on-premise data warehouses to data platforms on GCP cloud using GCP/3rd party services.
  3. Experience in designing and building data pipelines within a hybrid big data architecture using Java, Python, Scala & GCP Native tools.
  4. Hands-on Orchestrating and scheduling Data pipelines using Composer, Airflow.
  5. Experience in performing detail assessments of current state data platforms and creating an appropriate transition path to GCP cloud.

Technical Skills Required:

  1. Strong Experience in GCP data and Analytics Services
  2. Working knowledge on Big data ecosystem-Hadoop, Spark, Hbase, Hive, Scala etc.,
  3. Experience in building and optimizing data pipelines in Spark
  4. Strong skills in Orchestration of workflows with Composer/Apache Airflow.
  5. Good knowledge on object-oriented scripting languages: Python (must have) and Java or C++.
  6. Good to have knowledge in building CI/CD pipelines with GCP Cloud Build and native GCP services.
  7. GCP Professional Data Engineer certification is a PLUS.

Contact Us
close slider

    Send Us Message