Data Engineer

Job Description

Responsibilities

• Will act as a both a Business Analyst and Data Engineer/Analyst.
• Will perform tasks related to Data Engineering, Development, Analysis, Reporting, Visualization.
• Develop presentations interface w/ business.
• Extract, transform and then visualize data then analyze data in table.
• Use of SQL and Google Bit query to extract data.
• Enable automated data preparation for model training.
• Ensure data quality and accessibility for all types of data used.
• Design, build, enhance, and launch ETL processes for new and existing data sources.
• Augment existing data with output from machine learning analysis/algorithms.

Required Skills

• Skill set is a very SQL minded previous experience with Tableau, Google Cloud, Big Query
  Standard SQL Syntax, and Python.
• Able to roll up their sleeves and code and know how to work with and elicit requirements from the business as well as curate the data, extract it transform it, and then visualize it.
• Knowledge of web applications and web content.
• Expert usage of SQL and python.
• Familiarity with tools for analysis of large datasets.

Required Experience

• 6+ years of experience (Sr-level) Strong Data engineering & Strong Programming experience with object-oriented/object function scripting languages: Spark with Python/Scala/Java.
• 4+ years of experience (Mid-level) Experience with big data tools: Hadoop, Apache Spark, Kafka, etc.
• 1+ years of strong technical Experience with AWS cloud services such as (S3, RDS, EC2, ECS, Lambda, SQS, SNS, DynamoDB, CloudFormation, etc), Terraform, Chef, Docker, Ansible. CI/CD ( Jenkins, Artifactory, Nexus).
• 2+ years of experience with build tools like maven, gradle, grunt, gulp, git, npm, yarn, lein, boot, Xcod.
• Experience with stream-processing systems: Storm, Spark-Streaming, etc. & DevOps engineering (Nice to have).
• 2+ Years of experience with relational SQL, Snowflake and NoSQL databases, such as Postgres and Cassandra.
• Business Experience with marketing, eCommerce, retail, merchandizing industry.

Education Requirements

• Bachelor’s Degree in Computer Science, Computer Engineering or a closely related field.

Equal Employment Opportunity (EEO): All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.