Vaga Back-End

Senior Data Engineer

AWS EC2 (Elastic Compute Cloud) Python SPARQL

DataArt

DataArt

Grande empresa

Salário: Não especificado

Aceito candidatos dispostos a se mudar

Descrição da empresa

DataArt is a global software engineering firm that takes a uniquely human approach to solving problems.

DataArt has earned the trust of some of the world’s leading brands and most discerning clients, including Nasdaq, Travelport, Ocado, Centrica/Hive, Paddy Power Betfair, IWG, Univision, Meetup and Apple Leisure Group among others.

DATAART IN NUMBERS
6000+ professionals
26 years in operation
35+ locations in the USA, Europe, Asia, and Latin America
85%+ employees’ retention
30% women
Glassdoor review score — 4.7
46% seniors

Team satisfaction survey 2022:
94% of our team members would recommend DataArt as an employer to their friends
93% of our team members would spend 2+ more years of their career with DataArt
90% of our team members are satisfied with their total deal at DataArt

Our policy of equal opportunities in employment
We are committed to promoting equal opportunities in employment. You and any job applicants will receive equal treatment regardless of bias including age, disability, gender reassignment, marital or civil partner status, pregnancy or maternity, race, color, nationality, ethnic or national origin, religion or belief, sex or sexual orientation. DataArt is committed to providing a working environment free from harassment and bullying and ensuring all staff are treated, and treat others, with dignity and respect. Our commitment to promoting equal opportunities and creating the workplace free of harassment and discrimination is supported by the implementation of respective policies and controls, provides an appropriate environment to encourage good performance and conduct at all its working locations, at all times.

Atividades e Responsabilidades

CLIENT
Our client is a Holistic wellness and fitness tech company.

PROJECT OVERVIEW
The team is building new applications across multiple platforms (browser, mobile, wearables) using Typescript, React, and Node.

POSITION OVERVIEW
We are seeking a Senior Data Engineer to evolve and support our data platform and infrastructure, which ultimately supports products that help us unlock the hero inside of everyone. This is an individual contributor role where you will need to be excited about the hands-on technical work of data engineering.
If you enjoy helping a high-performing team solve problems and build sophisticated applications that actually improve people’s lives, come join us.

TECHNOLOGY STACK
AWS: Cloud Formation or CDK, Glue, Lambda
Spark
Relational Databases
Snowflake
Python
Airflow

Responsibilities
Build and support large-scale batch and real-time data pipelines with data processing frameworks like Spark and AWS managed services
Use best practices in continuous integration and delivery
Help drive optimization, testing and tooling to improve data quality and our ability to use data to make product decisions
Collaborate with other software engineers, ML engineers and stakeholders, taking learning and leadership opportunities that will arise every single day
Collaborate with the analytics team to support their BI tools and initiatives to deliver the reliability, speed, and scalability of a data platform they’ll love working with
Work in multi-functional agile teams to continuously experiment, iterate and deliver on new product and infrastructure objectives
Optimize the existing data infrastructure which will create a single version of the truth and standardize data into coherent formats for self-service
Keep abreast of new data storage, delivery, analysis, visualization, reporting techniques and software to develop more powerful data infrastructure
Be a trusted technical advisor to customers and solve complex data challenges

Requisitos

Requirements
Hands-on experience with data processing software and algorithms
General knowledge and experience with AWS: Cloud Formation or CDK, Glue, Lambda
Hands-on experience with Spark
Experience in SQL
Experience with data projects
Experience with relational databases
Working experience with Python
Skills working with Airflow or similar
Ability to work well within a team context, from collaborating with teammates and providing code reviews to mentoring and leading
Familiarity with and understanding of Agile software development approaches such as Kanban and Scrum
Upper-Intermediate English level

O que nós oferecemos

We offer • Professional Development: — Experienced colleagues who are ready to share knowledge; — The ability to switch projects, technology stacks, try yourself in different roles; — More than 150 workplaces for advanced training; — Study and practice of English: courses and communication with colleagues and clients from different countries; — Support of speakers who make presentations at conferences and meetings of technology communities. • The ability to focus on your work: a lack of bureaucracy and micromanagement, and convenient corporate services; • Friendly atmosphere, concern for the comfort of specialists; • Flexible schedule (there are core mandatory hours), the ability to work remotely.