Job Title: AWS Data Engineer
Technology: AWS (EMR, Redshift, S3, Glue, Kinesis and Lambda), SQL, ETL, Python/Java
Experience: 4 to 8 years
Data Engineer (a) Work with Amazon personnel and analysts to understand requirements
and design solutions based on information provided by Amazon.
(b) Build highly available distributed systems of data extraction, ingestion, and
processing of large data sets using native Amazon and AWS technologies like
EMR, Redshift, S3, Glue, Kinesis and Lambda.
(c) Write SQL and data warehousing queries. Work with developers, TPM and
PM on the overall end to end design and provide solutions in line with the
design.
(d) Design, implement and support an analytical data infrastructure providing
ad-hoc access to large datasets and computing power.
(e) Interface with other technology teams of Amazon to extract, transform, and
load data from a wide variety of data sources using SQL and AWS big data
technologies.
(f) Build highly scalable, re-usable programs/scripts using Unix shell, Python,
Ruby, Java etc. which solves data problems.
(g) Develop integrations on ETL tools like Informatica, AWS Big Data
technologies or any other 3rd party tool.
(h) Update relevant documentation consisting of designs, technical
specifications, and production support documentation.
(i) Collaborate with Amazon's personnel and analysts and technical architects
during the term of engagement.
(j) Work with Amazon quality assurance / testing resources of Amazon to
develop test scripts and support testing needs.
(k) Assist in resolving defects identified during testing by either Party; or
(l) Provide on-going status updates and highlight risks for the deliverables to
Amazon.
Mandatory skill sets- AWS (EMR, Redshift, S3, Glue, Kinesis and Lambda), SQL, ETL, Python/Java
Preferred skill sets- Python/Java - Either of the one programming languages experience
Year of experience required- 4 to 8 years
Qualifications- Graduate Engineer or Management Graduate
Required Skills
Amazon Kinesis, Amazon S3, AWS Devops, AWS Glue, AWS Lambda, AWS Redshift, Electronic Medical Records (EMR), Extract Transform Load (ETL), Java, Python (Programming Language), Structured Query Language (SQL)