Staff Data Engineer

Sep 08, 2022
San Francisco, United States
... Not specified
... Intermediate
Full time
... Office work

Job Title:

Staff Data Engineer

Requisition ID:

R017121

Job Description:

Staff Data Engineer

Responsibilities

  • Design and build Data Pipelines to collect, transform, store, analyze, explore and visualize.
  • Design and build cloud-based data lakes and data warehouses
  • Work with the product team to understand data sources, use cases and data models.
  • Choose the right technology stack to align with the use cases and scalability.
  • Collaborate with the other team members across different teams.
  • Develop alert & monitoring systems and procedures for faster disaster recovery. 
  • Provide technical directions and mentor other engineers

Qualifications

  • BA/BS degree in Computer Science, similar technical field of study or equivalent practical experience.
  • Strong experience in Software Development in Java or Python
  • Working experience in building data warehouses and data lakes.
  • 5+ years of experience in working with relational databases such as MySQL, Postgres etc.
  • 2+ years of experience in NoSQL databases like Bigtable, Cassandra, HBase etc.
  • Expert level SQL skills and database performance concepts.
  • Experience in relational and dimensional data modeling.
  • Experience with developing extract-transform-load (ETL).
  • Understanding of distributed computing frameworks like Apache Spark and Flink.
  • Should be able to communicate and articulate his/her thought process effectively with the other team members.

Preferred Qualifications

  • Experience building data warehouse, data lake and data pipeline using Google Cloud Platform (GCP)
  • Experience with large scale distributed systems with large datasets.
  • Experience in distributed computing framework – Hadoop, Spark, Flink or Storm 
  • Experience with messaging systems like Kafka and RabbitMQ
  • Knowledge of advertising platforms.
COMPANY JOBS
615 available jobs
WEBSITE
Top Jobs