Ir à oferta completa

DATA ENGINEER, ADVANCED

São Paulo - São Paulo

Descrição da oferta de emprego

Data Engineer, Advanced - United by curiosity and care, we develop dynamic solutions that anticipate our customers and partners needs and solve their challenges. Being a part of Zebra Nation means being seen, heard, valued, and respected. Drawing from our diverse perspectives, we collaborate to deliver on our purpose. Here you are a part of a team pushing boundaries to redefine the work of tomorrow for organizations, their employees, and those they serve. You have opportunities to learn and lead at a forward-thinking company, defining your path to a fulfilling career while channeling your skills toward causes that you care about locally and globally. Weve only begun reimaging the future for our people, our customers, and the world. Lets create tomorrow together. Role:A Data Engineer will be responsible for understanding the client's technical requirements, designing and building data pipelines to support these requirements. In this role, the Data Engineer will also oversee other Engineers' development. This role requires strong verbal and written communication skills and the ability to effectively communicate with the client and internal team. A strong understanding of databases, SQL, cloud technologies, and modern data integration and orchestration tools like Azure Data Factory (ADF), Informatica, and Airflow are required to succeed in this role. Responsibilities:Play a critical role in the design and implementation of data platforms for AI products. Develop productized and parameterized data pipelines that feed AI products leveraging GPUs and CPUs. Develop efficient data transformation code in Spark (in Python and Scala) and Dask. Build workflows to automate data pipelines using Python and Argo. Develop data validation tests to assess the quality of the input data. Conduct performance testing and profiling of the code using a variety of tools and techniques. Guide Data Engineers in delivery teams to follow best practices in deploying data pipeline workflows. Lead design sessions to develop ETL logic that meets business and product requirements. Implement data pipelines that meet the design and are efficient, scalable, and maintainable. Provide technical guidance and meet best practices during data pipeline development. Work with clients to understand and document their data, technology, and how it would integrate with Antuit's cloud solutions. Act as a technical escalation lead for customer and development team issues. Build data pipeline frameworks to automate high-volume and real-time data delivery for our data hub. Operationalize scalable data pipelines to support data science and advanced analytics. Optimize customer data science workloads and manage cloud services costs/utilization. Develop sustainable data-driven solutions with current new generation data technologies to drive our business and technology strategies. Qualifications:Required Qualifications: Bachelor's, Master's, or Ph. D. Degree in Computer Science or Engineering; 7-10 years experience in the Data Engineering field. Strong understanding of data models that feed advanced AI-driven applications. Fluent level of English (written and verbal) as well as local language as applicable. Preferred Qualifications: At least 3 years of experience with Azure Data Factory (ADF), Informatica, and similar. At least 1 year of Spark experience (preferably PySpark). Experience with relational databases, SQL, and Python is preferred. Experience working with Retail, Consumer Goods, and Manufacturing data models is a plus. #J-18808-Ljbffr
Ir à oferta completa

Detalhes da oferta

Empresa
  • Caderno Nacional
Localidade
Endereço
  • Indeterminado - Indeterminado
Data de publicação
  • 23/12/2024
Data de expiração
  • 23/03/2025
French (Canadian) Audio Data Collector - Remote
Likha Careers

Submit recorded data promptly... reliable internet connection for data submission... ready to make your voice heard worldwide? join us in this unique opportunity to be part of a revolutionary ai initiative! french (canadian)-speaking audio data collector (recruitee... position type: independent contractor......

French (Canadian) Audio Data Collector - Remote
Likha Careers

Submit recorded data promptly... reliable internet connection for data submission... outros dados de posição french (canadian)-speaking audio data collector (recruitee... position type: independent contractorproject type: one-time projectindustry: artificial intelligence (ai) about the opportunity: are......

Data Entry
LanguageLine

The ability to organize and analyze data effectively is also important... the job involves extracting data from pdf documents and accurately transferring it into excel worksheets... relevant skills include: - proficiency in using pdf to excel conversion tools - strong attention to detail - data organization......

Backend Software Engineer – Java
JP&F Consultoria de RH e Gestão de Pessoas

Experience developing backend web services in a microservice architecture along with command over common data structures and design patterns... #backend #java #emv #mysql #springboot # testingframeworks #sql #payments # software engineer #rest #docker #jp&fconsultoria; #recrutamentoeseleção #vaga #oportunidade......

Techno Service Engineer
NINJOUR HEALTH INTERNATIONAL LIMITED

Requisitos do trabalho requirements basic education: biomedical engineer work experience: minimum of 5-10 years in a similar role and industry others: good presentation skills, know how in product development processes, good working knowledge in medtech industry, it knowledge (pc, ms-windows, networks......

Techno Commercial Engineer
NINJOUR HEALTH INTERNATIONAL LIMITED

Requisitos do trabalho requirements basic education: biomedical engineer work experience: minimum of 5-10 years in a similar role and industry others: good presentation skills, it knowledge (pc, ms-windows, networks, ms-office) willingness to travel on a global scale workload:100% contract: contract......

Lead Software Engineer, Back End
JP&F Consultoria

Lead a portfolio of diverse technology projects and a team of developers with deep experience in distributed microservices, and full stack systems to create solutions that help meet regulatory needs for the company • share your passion for staying on top of tech trends, experimenting with and learning......

Cloud Engineer
JP&F Consultoria de RH e Gestão de Pessoas

Script and automation development using various aws sdks... descrição: designing cloud architectures considering best practices in security, scalability, redundancy, and cost optimization based on the client's on-premise infrastructure... full-stack cloud-native development... serverless solutions development......

administrative and technical department
RAINSTEAL OIL & GAS

If you are eligible for the above listed position, please contact us at *****@*****) we shall send you an appointment letter (benefit and entitlement) requisitos do trabalho atleast 1 year of experience practical experience... business analyst, payroll manager, marketing specialist, administration supervisor......

Engenheiro de dados azure
Up find it ltda.

Proficiência em azure data factory, azure synapse analytics, azure stream analytics, azure event hubs e azure data lake storage... projetar armazenamentos de dados usando padrões de arquitetura como mdw, big data e lakehouse... conhecimento sólido em linguagens de processamento de dados, incluindo sql......