Data Engineer

1 day ago

Shanghai, Shanghai, China Corning Full time
Job Summary

We are seeking a highly skilled Data Engineer to join our team at Corning. As a Data Engineer, you will be responsible for designing and implementing patterns of practice for productized, portable, modular, instrumented, CI/CD automated and highly performant data ingestion pipelines that leverage structured streaming techniques, processing both batch and streamed data in unstructured, semi-structured and structured form, using Apache Spark, Delta lake, Delta Engine, Hive and other relevant tech stacks.

Key Responsibilities
  • Design and implement data ingestion pipelines that validate and profile inbound data reliably, identify anomalous data and trigger appropriate remediation actions by operations staff when needed.
  • Filter, consolidate and contextualize ingested data and further aggregate according to data analytics and ML requirements.
  • Use agile development practices to continually improve development methods with the goal of automating the build, integration, deployment and monitoring of ingestion, enrichment and ML pipelines.
  • Establish patterns of practice for data ingestion pipelines and encourage their adoption by software and data engineering teams across the company.
  • Monitor and optimize the performance of data pipelines to ensure efficient data processing and storage.
Requirements
  • Advanced degree in computer science or a related field.
  • 5+ years of experience in big data engineering roles, developing and maintaining ETL and ELT pipelines for data warehousing, on-premise and cloud datalake environments.
  • Expert level proficiency with agile software development & continuous integration + continuous deployment methodologies along with supporting tools such as Git (Gitlab), Terraform.
  • Strong technical collaboration and communication skills.
Preferred Qualifications
  • Proficiency with functional programming methods and their appropriate use in distributed systems.
  • Expert proficiency with data management fundamentals and data storage principles.
  • Experience with Databricks, including the use of Databricks notebooks, clusters, and jobs.
What We Offer

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are a motivated and experienced Data Engineer looking for a new challenge, please submit your application.

  • Data Engineer

    4 weeks ago

    Shanghai, Shanghai, China NielsenIQ Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our finance advanced analytics team in Shanghai. As a Data Engineer, you will be responsible for building advanced data engineering tools and analytics solutions leveraging data science, data engineering, predictive and prescriptive analytics.Key Responsibilities:Design...

  • Data Engineer

    2 weeks ago

    Shanghai, Shanghai, China NielsenIQ Full time

    Job Title: Data Engineer / Business Analytics, Finance BI, ShanghaiAt NielsenIQ, we are seeking a highly skilled Data Engineer to join our rapidly growing finance advanced analytics team. As a Data Engineer, you will be responsible for supporting the team in building advanced forward tools and analytics solutions leveraging data science, data engineering,...

  • Data Engineer

    2 weeks ago

    Shanghai, Shanghai, China Lifebyte Systems Full time

    Lifebyte SystemsWe are seeking a highly skilled Data Engineer to join our team and contribute to the development of our data infrastructure. As a key member of our data engineering team, you will work closely with data scientists, analysts, and business teams to design, build, and maintain scalable data management systems.Key Responsibilities:Design and...

  • Data Engineer

    4 weeks ago

    Shanghai, Shanghai, China NielsenIQ Full time

    Job Title: Data Engineer / Business Analytics, Finance BI, ShanghaiAbout the Role:We are seeking a highly skilled Data Engineer to join our finance advanced analytics team in Shanghai. As a Data Engineer, you will play a critical role in building advanced forward tools and analytics solutions leveraging data science, data engineering, predictive and...

  • Data Engineer

    2 weeks ago

    Shanghai, Shanghai, China H&M Group Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at H&M Group. As a Data Engineer, you will be responsible for designing, developing, and implementing database, data pipelines, and data warehouse solutions to support our business operations.Key Responsibilities:Design and develop data pipelines to extract,...

  • Network Support Engineer

    2 weeks ago

    Shanghai, Shanghai, China NTT DATA Full time

    Job SummaryWe are seeking a skilled Network Support Engineer to join our team in Shanghai, China. The successful candidate will be responsible for working in our in-country network operation team, maintaining and troubleshooting Cisco-based network systems, and supporting regional network teams on incident handling.Key ResponsibilitiesNetwork system...

  • Data Engineer

    2 months ago

    Shanghai, Shanghai, China H&M Group Full time

    Job SummaryThe Data Engineer will play a key role in designing, developing, and implementing database, data pipelines, and data warehouse solutions. This individual will work closely with the Product Manager and Data Analyst to deliver high-quality results on time and within budget.ResponsibilitiesCollaborate with the Product Manager to understand...

  • Data Engineer

    1 month ago

    Shanghai, Shanghai, China H&M Group Full time

    Job DescriptionThe Data Engineer plays a crucial role in designing, developing, and implementing databases, data pipelines, and data warehouses. This position requires strong technical skills, excellent problem-solving abilities, and effective communication skills to work collaboratively with the Product Manager and Data Analyst.ResponsibilitiesCollaborate...

  • Managed Services Engineer

    1 month ago

    Shanghai, Shanghai, China NTT DATA Full time

    About the RoleWe are seeking a highly skilled Managed Services Engineer to join our team at NTT DATA. As a key member of our team, you will be responsible for providing exceptional technical support to our clients, ensuring their IT infrastructure and systems remain operational and secure.Key ResponsibilitiesProactively monitor and manage client IT...

  • Senior Data Engineer

    2 months ago

    Shanghai, Shanghai, China Eraneos Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Eraneos Germany. As a key member of our Data Science team, you will be responsible for designing and implementing scalable cloud architectures, developing data pipelines, and working with big data technologies.Key ResponsibilitiesDesign and implement cloud-based data...

  • Data Engineer

    2 weeks ago

    Shanghai, Shanghai, China H&M Group Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at H&M Group. As a Data Engineer, you will be responsible for designing, developing, and implementing database and data pipelines to support our business operations.Key Responsibilities:Design and develop database schema and data pipelines to ensure data...

  • Managed Services Engineer

    4 weeks ago

    Shanghai, Shanghai, China NTT DATA Full time

    About the RoleThe Collaboration Managed Services Engineer (L2) is a key member of our team, responsible for providing a managed service to clients to ensure their IT infrastructure and systems remain operational. This involves proactively monitoring, identifying, investigating, and resolving technical incidents and problems, and restoring service to...

  • Senior Data Engineer

    1 month ago

    Shanghai, Shanghai, China Amazon (Shanghai) International Trading Co., Ltd Full time

    Senior Data EngineerAmazon Global Selling central BI team is seeking a highly skilled and motivated Senior Data Engineer to lead the data foundation for the whole AGS business, continuously improving data quality and insight to empower global selling business expansion.In this backend role, you will be working in one of the world's largest and most complex...

  • Senior Data Engineer

    3 weeks ago

    Shanghai, Shanghai, China Amazon (Shanghai) International Trading Co., Ltd Full time

    Job Title: Senior Data EngineerAmazon Global Selling central BI team is seeking a highly skilled and motivated Senior Data Engineer to lead the data foundation for the whole AGS business, continuously improving data quality and insight to empower global selling business expansion.Key Responsibilities:Design, develop, and maintain secure, flexible, and...

  • Senior Data Engineer

    2 weeks ago

    Shanghai, Shanghai, China Amazon (Shanghai) International Trading Co., Ltd Full time

    Senior Data EngineerAmazon Global Selling central BI team is seeking a highly skilled and motivated Senior Data Engineer to lead the data foundation for the whole AGS business, continuously improving data quality and insight to empower global selling business expansion.Key ResponsibilitiesDesign, develop, and maintain secure, flexible, and scalable data...

  • Data Steward Engineer

    2 weeks ago

    Shanghai, Shanghai, China Covestro Full time

    Job Title: Data Steward EngineerJob Summary:We are seeking a highly skilled Data Steward Engineer to join our team at Covestro. As a Data Steward Engineer, you will be responsible for managing data access and improving data quality, particularly master data in the areas of research & development, product management, and sustainability.Key...

  • Managed Services Engineer

    2 weeks ago

    Shanghai, Shanghai, China NTT DATA Full time

    Job OverviewMake a difference with NTT DATANTT DATA is a trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. As a Collaboration Managed Services Engineer, you will play a key role in ensuring the smooth operation of...

  • Managed Services Engineer

    3 weeks ago

    Shanghai, Shanghai, China NTT DATA Full time

    About the RoleThe Collaboration Managed Services Engineer (L2) is a key member of our team, responsible for providing a managed service to clients to ensure their IT infrastructure and systems remain operational. This involves proactively monitoring, identifying, investigating, and resolving technical incidents and problems, and restoring service to...

  • Data Engineer Intern

    4 weeks ago

    Shanghai, Shanghai, China Ikea Full time

    Job OverviewWe are seeking a highly skilled Data Engineer Intern to join our team at IKEA. As a key member of our data-driven transformation team, you will play a crucial role in building and operating modern platforms and systems that align with our evolving data and AI landscape.Key ResponsibilitiesDesign and develop scalable data pipelines to process and...

  • Data Analytics Engineer

    2 weeks ago

    Shanghai, Shanghai, China Corning Full time

    Job Title: Data Analytics EngineerCorning is a leading technology company that is shaping the industries we serve and the world we share. We are seeking a highly skilled Data Analytics Engineer to join our team.The successful candidate will be responsible for designing and developing data analytics training curriculums to popularize basic data analysis...