Data Engineer

Data Engineer

What you will do

Let’s do this. Let’s change the world. In this vital role as Data Engineer at Amgen you will be responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data initiatives and, visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes

1. Design, develop, and optimize data pipelines/workflows using Databricks (Spark, Delta Lake) for ingestion, transformation, and processing of large-scale data. A knowledge of Medallion Architecture will be an added advantage.
2. Build ETL pipeline with Informatica or other ETL tools.
3. Support data governance and metadata management.
4. Collaborate with Data Architects, Business SMEs, and Data Scientists to design and develop end-to-end data pipelines to meet fast paced business needs across geographic regions
5. Identify and resolve complex data-related challenges
6. Adhere to best practices for coding, testing, and designing reusable code/component
7. Analyze business and technical requirements and begin translating them into simple development tasks
8. Execute unit and integration tests, and contribute to maintaining software quality
9. Identify and fix bugs and defects during development or testing phases
10. Contribute to the maintenance and support of applications by monitoring performance and reporting issues
11. Use CI/CD pipelines as part of DevOps practices and assist in the release process

What we expect of you

We are all different, yet we all use our unique contributions to serve patients.

Basic Qualifications:

1. Master’s/Bachelor’s degree and 4 to 8 years of Computer Science, IT or related field experience

Preferred Qualifications:

1. Experience with Software engineering best-practices, including but not limited to version control, infrastructure-as-code, CI/CD, and automated testing
2. Knowledge of Python/R, Databricks, cloud data platforms
3. Strong understanding of data governance frameworks, tools, and best practices.
4. Knowledge of data protection regulations and compliance requirements (e.g., GDPR, CCPA)

Must-Have Skills:

1. Bachelor’s or master’s degree in computer science, Data Science, or a related field.
2. Hands on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), python for workflow orchestration, performance tuning on big data processing
3. Proficiency in data analysis tools (eg. SQL)
4. Proficient in SQL for extracting, transforming, and analyzing complex datasets from relational data stores
5. Strong programming skills in Python, PySpark, and SQL.
6. Familiarity with Informatica and/or other ETL tools.
7. Experience working with cloud data services (Azure, AWS, or GCP).
8. Strong understanding of data modeling, entity relationships

Professional Certifications

1. AWS Certified Data Engineer (preferred)
2. Databricks Certificate (preferred)

Soft Skills:

1. Excellent problem-solving and analytical skills
2. Strong communication and interpersonal abilities
3. High attention to detail and commitment to quality
4. Ability to prioritize tasks and work under pressure
5. Team-oriented with a proactive and collaborative mindset
6. Willingness to mentor junior developers and promote best practices
7. Adaptable to changing project requirements and evolving technology