Responsibilities

Data engineer for the Data and Analytics organization. Responsibilities include:

Analyze and interpret complex data and provide resolutions to data issues.

Coordinate with data analyst to validate requirements, perform interviews with users and developers.

Perform tests and validate data flows and prepare ETL processes according to business requirements.

Perform ETL tuning and SQL tuning.

Perform data modeling and schema design, including dimensional and big data modeling.

Designing and implement a data conversion strategy from legacy to new platforms.

Perform design validation, reconciliation and error handling in data load processes.

Design and prepare technical specifications and guidelines including ER diagrams and related documents.

 

Qualifications

Knowledge of AWS Infrastructure including S3, SNS, Ec2, CloudWatch and RDS

Min 1+ years of experience on Matillion ELT tool and Snowflake Database.

 

Min 5+ years' of experience with ETL/Data Transformation and one or more related products such as Informatica and SSIS.

Min 4+ years' work experience in business intelligence, data warehousing, and logical/physical model design required

Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

Experience in building AWS Data Pipelines using Python/Scala, Apache Spark, SparkSQL, S3 Data Lake, Snowflake, Redshift

Good to have - Experience with any of the NoSQL datastores such as ElasticSearch, MongoDB, DynamoDB, Cassandra