Data Engineer

3 weeks ago

Shanghai, Shanghai, China Corning Full time
Job Summary

We are seeking a highly skilled Data Engineer to join our team at Corning. As a Data Engineer, you will be responsible for designing and implementing patterns of practice for productized, portable, modular, instrumented, CI/CD automated and highly performant data ingestion pipelines that leverage structured streaming techniques, processing both batch and streamed data in unstructured, semi-structured and structured form, using Apache Spark, Delta lake, Delta Engine, Hive and other relevant tech stacks.

Key Responsibilities
  • Design and implement data ingestion pipelines that validate and profile inbound data reliably, identify anomalous data and trigger appropriate remediation actions by operations staff when needed.
  • Filter, consolidate and contextualize ingested data and further aggregate according to data analytics and ML requirements.
  • Use agile development practices to continually improve development methods with the goal of automating the build, integration, deployment and monitoring of ingestion, enrichment and ML pipelines.
  • Establish patterns of practice for data ingestion pipelines and encourage their adoption by software and data engineering teams across the company.
  • Monitor and optimize the performance of data pipelines to ensure efficient data processing and storage.
Requirements
  • Advanced degree in computer science or a related field.
  • 5+ years of experience in big data engineering roles, developing and maintaining ETL and ELT pipelines for data warehousing, on-premise and cloud datalake environments.
  • Expert level proficiency with agile software development & continuous integration + continuous deployment methodologies along with supporting tools such as Git (Gitlab), Terraform.
  • Strong technical collaboration and communication skills.
Preferred Qualifications
  • Proficiency with functional programming methods and their appropriate use in distributed systems.
  • Expert proficiency with data management fundamentals and data storage principles.
  • Experience with Databricks, including the use of Databricks notebooks, clusters, and jobs.
What We Offer

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are a motivated and experienced Data Engineer looking for a new challenge, please submit your application.

  • Data Engineer

    1 month ago

    Shanghai, Shanghai, China Lifebyte Systems Full time

    Lifebyte SystemsWe are seeking a highly skilled Data Engineer to join our team and contribute to the development of our data infrastructure. As a key member of our data engineering team, you will work closely with data scientists, analysts, and business teams to design, build, and maintain scalable data management systems.Key Responsibilities:Design and...

  • Network Support Engineer

    4 weeks ago

    Shanghai, Shanghai, China NTT DATA Full time

    Job SummaryWe are seeking a skilled Network Support Engineer to join our team in Shanghai, China. The successful candidate will be responsible for working in our in-country network operation team, maintaining and troubleshooting Cisco-based network systems, and supporting regional network teams on incident handling.Key ResponsibilitiesNetwork system...

  • Data Engineering Expert

    2 weeks ago

    Shanghai, Shanghai, China Airwallex Full time

    About the Role:Airwallex is the leading financial technology platform for modern businesses expanding globally. We are seeking a highly skilled Data Engineering Expert to join our team in Singapore and Shanghai.Responsibilities:Develop and maintain large-scale, high-performance distributed data processing systems to drive Airwallex business growth and...

  • Data Engineer

    4 weeks ago

    Shanghai, Shanghai, China H&M Group Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at H&M Group. As a Data Engineer, you will be responsible for designing, developing, and implementing database and data pipelines to support our business operations.Key Responsibilities:Design and develop database schema and data pipelines to ensure data...

  • Managed Services Engineer

    4 weeks ago

    Shanghai, Shanghai, China NTT DATA Full time

    Job OverviewMake a difference with NTT DATANTT DATA is a trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. As a Collaboration Managed Services Engineer, you will play a key role in ensuring the smooth operation of...

  • Senior Data Engineer

    1 month ago

    Shanghai, Shanghai, China Amazon (Shanghai) International Trading Co., Ltd Full time

    Senior Data EngineerAmazon Global Selling central BI team is seeking a highly skilled and motivated Senior Data Engineer to lead the data foundation for the whole AGS business, continuously improving data quality and insight to empower global selling business expansion.Key ResponsibilitiesDesign, develop, and maintain secure, flexible, and scalable data...

  • Data Steward Engineer

    1 month ago

    Shanghai, Shanghai, China Covestro Full time

    Job Title: Data Steward EngineerJob Summary:We are seeking a highly skilled Data Steward Engineer to join our team at Covestro. As a Data Steward Engineer, you will be responsible for managing data access and improving data quality, particularly master data in the areas of research & development, product management, and sustainability.Key...

  • Data Analytics Engineer

    1 month ago

    Shanghai, Shanghai, China Corning Full time

    Job Title: Data Analytics EngineerCorning is a leading technology company that is shaping the industries we serve and the world we share. We are seeking a highly skilled Data Analytics Engineer to join our team.The successful candidate will be responsible for designing and developing data analytics training curriculums to popularize basic data analysis...

  • Data Engineering Specialist for Master Data

    4 days ago

    Shanghai, Shanghai, China Covestro Full time

    Covestro is seeking a highly skilled Data Engineering Specialist for Master Data to join our team.About the JobThe successful candidate will be responsible for managing data access, improving data quality, and ensuring data integration and management solutions meet business requirements. Key responsibilities include analyzing project requirements,...

  • Data Steward Engineer

    3 weeks ago

    Shanghai, Shanghai, China Covestro Full time

    Job SummaryWe are seeking a highly skilled Data Steward Engineer to join our Covestro team. The ideal candidate will have a strong technical background in data management and a passion for data quality.ResponsibilitiesManage data access and improve data quality, particularly master data in the areas of research & development, product management, and...

  • Data Engineer Manager

    4 weeks ago

    Shanghai, Shanghai, China Amazon (Shanghai) International Trading Co., Ltd Full time

    About the RoleAmazon Global Selling Central BI team is seeking a highly skilled and motivated Data Engineer Manager to lead the data foundation for the whole AGS business, continuously improving data quality and insight to empower global selling business expansion.In this role, you will be working in one of the world's largest and most complex data warehouse...

  • Data Engineer for Finance and Analytics

    4 days ago

    Shanghai, Shanghai, China NielsenIQ Full time

    About NielsenIQNielsenIQ is the world's leading consumer intelligence company, delivering unparalleled global reach and a comprehensive understanding of consumer buying behavior.We are seeking an experienced Data Engineer to join our rapidly growing finance advanced analytics team in Shanghai. As a forward-deployed data engineer, you will play a crucial role...

  • Network Support Engineer Specialist

    4 days ago

    Shanghai, Shanghai, China NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Network Support Engineer to join our team in Shanghai, China. As a Network Support Engineer, you will be responsible for working independently on daily network operations and collaborating with regional support teams and vendors.Key Responsibilities:Perform routine network maintenance and troubleshooting...

  • Data Network Engineer

    4 weeks ago

    Shanghai, Shanghai, China Corning Full time

    Job Summary:Corning is seeking a highly skilled Data Network Engineer to join our team. As a Data Network Engineer, you will be responsible for designing, implementing, and maintaining our network infrastructure.Key Responsibilities:Design and implement network solutions, including LAN and WAN, to meet business requirementsTest and troubleshoot network...

  • Quantitative Data Engineer

    3 weeks ago

    Shanghai, Shanghai, China Scientech Research Full time

    About Scientech ResearchWe are seeking a highly skilled Quantitative Developer to join our team at Scientech Research.Job ResponsibilitiesDesign, develop, maintain, and optimize in-house research data platforms, providing quantitative researchers with reliable, high-quality, and stable data sources and analysis tools.Establish protocols for data injection,...

  • Data Engineer for Market Intelligence

    4 weeks ago

    Shanghai, Shanghai, China Thermo Fisher Scientific Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our Market Intelligence team. As a Data Engineer, you will be responsible for acquiring external market intelligence data using technical means based on business requirements.Key Responsibilities:Acquire and process market intelligence data using web scraping techniques.Design data...

  • Data Engineering Architect

    4 weeks ago

    Shanghai, Shanghai, China Airwallex Full time

    About the RoleAirwallex is seeking a highly skilled Data Engineering Architect to lead the strategy, architecture, development, and operation of our data and AI platforms. As a key member of our team, you will play a pivotal role in influencing data-driven and AI-powered decision-making processes.Key Responsibilities: Spearhead the identification and...

  • Data Engineer

    3 days ago

    Shanghai, Shanghai, China H&M Group Full time

    At H&M Group, we're seeking a highly skilled Data Engineer to join our team in Shanghai, China.As a Data Engineer at H&M Group, you will work alongside Product Managers and Data Analysts to design, develop, and implement large-scale data systems, ensuring high-quality results on time and within budget.Your primary responsibilities will include:Communicating...

  • Data Engineer

    3 weeks ago

    Shanghai, Shanghai, China Corning Full time

    At Corning, we're shaping the world through innovation and collaboration. As a Data Engineer, you'll play a critical role in our advanced analytics platforms, driving business growth and success through data-driven insights.ResponsibilitiesDesign and Implement Data Ingestion PipelinesDevelop and implement scalable data ingestion pipelines that leverage...

  • Senior Data Engineering Architect

    3 weeks ago

    Shanghai, Shanghai, China Airwallex Full time

    About the Role:Airwallex is seeking a highly skilled Senior Data Engineering Architect to lead the development and operation of our data and AI platforms.You will play a pivotal role in influencing data-driven and AI-powered decision-making processes and building a high-performing team that excels in a fast-paced environment.Spearhead the identification and...