Data Pipeline Architect

Apr 11, 2024
San Jose, United States
... Not specified
... Intermediate
Full time
... Office work


WHAT YOU DO AT AMD CHANGES EVERYTHING

We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our mission is the AMD culture. We push the limits of innovation to solve the world’s most important challenges. We strive for execution excellence while being direct, humble, collaborative, and inclusive of diverse perspectives. 

AMD together we advance_




THE ROLE:

We are seeking a highly skilled and experienced Data Pipeline Architect to join our dynamic team.

THE PERSON:

The ideal candidate will have a strong background in designing and scaling data pipelines using Kafka, Spark, and Flink for data ingestion to the Apache Iceberg platform. The successful candidate will be responsible for designing, developing, and implementing scalable and robust data pipeline architectures, ensuring high data quality and availability.

KEY RESPONSIBILITIES:

  1. Design, develop, and implement scalable data pipeline architectures using Kafka, Spark, and Flink.
  2. Manage data ingestion, processing, and distribution across multiple data sources and sinks using Apache Iceberg.
  3. Collaborate with data scientists and engineers to ensure the architecture supports business requirements.
  4. Optimize data pipelines for performance and scalability.
  5. Implement data governance and security measures.
  6. Troubleshoot and resolve data pipeline issues.
  7. Monitor data pipeline performance and address any failures or exceptions.
  8. Stay updated with the latest industry trends and technologies to ensure the data architecture is modern and efficient.

PREFERRED EXPERIENCE:

  1. Proven experience as a Data Pipeline Architect or similar role.
  2. Strong experience with Kafka, Spark, and Flink for data ingestion.
  3. Experience with Apache Iceberg platform.
  4. Strong knowledge of data pipeline and workflow management tools.
  5. Proficient in SQL and experience with other programming languages such as Java, Python, etc.
  6. Strong problem-solving skills and ability to troubleshoot complex data issues.
  7. Excellent communication and collaboration skills.
  8. Knowledge of data governance and data security measures.

ACADEMIC CREDENTIALS:

Bachelor’s degree in computer science, Information Systems, or a related field. A master’s degree is preferred.

 

LOCATIONS:

San Jose or Austin

 

#LI-MF2

#LI-HYBRID




At AMD, your base pay is one part of your total rewards package.  Your base pay will depend on where your skills, qualifications, experience, and location fit into the hiring range for the position. You may be eligible for incentives based upon your role such as either an annual bonus or sales incentive. Many AMD employees have the opportunity to own shares of AMD stock, as well as a discount when purchasing AMD stock if voluntarily participating in AMD’s Employee Stock Purchase Plan. You’ll also be eligible for competitive benefits described in more detail here.

 

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.   We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

At AMD, your base pay is one part of your total rewards package.  Your base pay will depend on where your skills, qualifications, experience, and location fit into the hiring range for the position. You may be eligible for incentives based upon your role such as either an annual bonus or sales incentive. Many AMD employees have the opportunity to own shares of AMD stock, as well as a discount when purchasing AMD stock if voluntarily participating in AMD’s Employee Stock Purchase Plan. You’ll also be eligible for competitive benefits described in more detail here.

 

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.   We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

THE ROLE:

We are seeking a highly skilled and experienced Data Pipeline Architect to join our dynamic team.

THE PERSON:

The ideal candidate will have a strong background in designing and scaling data pipelines using Kafka, Spark, and Flink for data ingestion to the Apache Iceberg platform. The successful candidate will be responsible for designing, developing, and implementing scalable and robust data pipeline architectures, ensuring high data quality and availability.

KEY RESPONSIBILITIES:

  1. Design, develop, and implement scalable data pipeline architectures using Kafka, Spark, and Flink.
  2. Manage data ingestion, processing, and distribution across multiple data sources and sinks using Apache Iceberg.
  3. Collaborate with data scientists and engineers to ensure the architecture supports business requirements.
  4. Optimize data pipelines for performance and scalability.
  5. Implement data governance and security measures.
  6. Troubleshoot and resolve data pipeline issues.
  7. Monitor data pipeline performance and address any failures or exceptions.
  8. Stay updated with the latest industry trends and technologies to ensure the data architecture is modern and efficient.

PREFERRED EXPERIENCE:

  1. Proven experience as a Data Pipeline Architect or similar role.
  2. Strong experience with Kafka, Spark, and Flink for data ingestion.
  3. Experience with Apache Iceberg platform.
  4. Strong knowledge of data pipeline and workflow management tools.
  5. Proficient in SQL and experience with other programming languages such as Java, Python, etc.
  6. Strong problem-solving skills and ability to troubleshoot complex data issues.
  7. Excellent communication and collaboration skills.
  8. Knowledge of data governance and data security measures.

ACADEMIC CREDENTIALS:

Bachelor’s degree in computer science, Information Systems, or a related field. A master’s degree is preferred.

 

LOCATIONS:

San Jose or Austin

 

#LI-MF2

#LI-HYBRID

COMPANY JOBS
1789 available jobs
WEBSITE