Data Engineer

4 weeks ago

Shanghai, China Corning Full time

Requisition Number: 65496

 

Corning is vital to progress – in the industries we help shape and in the world we share.

We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts, works, learns, and lives.

Our sustained investment in research, development, and invention means we’re always ready to solve the toughest challenges alongside our customers. 



The global Information Technology (IT) Function is leading efforts to align IT and Business Strategy, leverage IT investments, and optimize end to end business processes and associated information integration technologies.  Through these efforts, IT helps to improve the competitive position of Corning's businesses through IT enabled processes.  IT also delivers Information Technology applications, infrastructure, and project services in a cost efficient manner to Corning worldwide.

Responsibilities

 As a Data Engineer for our advanced analytics platforms, your main responsibilities will be to: 

  • Design and implement patterns of practice for productized, portable, modular, instrumented, CI/CD automated and highly performant data ingestion pipelines that leverage structured streaming techniques, processing both batch and streamed data in unstructured, semi-structured and structure form, using Apache Spark, Delta lake, Delta Engine, Hive and other relevant tech stacks 
  • Ensure that data ingestion pipelines built with these patterns validate and profile inbound data reliably, identify anomalous and trigger appropriate remediation actions by operations staff when needed 
  • Filter, consolidate and contextualize ingested data and further aggregate according to data analytics and ML requirements.
  • Use agile development practices, and continually improve development methods with the goal of automating the build, integration, deployment and monitoring of ingestion, enrichment and ML pipelines 
  • Using your expertise and influence, help establish patterns of practice for the above, and encourage their adoption by software and data engineering teams across the company 
  • Monitor and optimize the performance of data pipelines to ensure efficient data processing and storage.
     
Education, Experience, and Licensing:
  • Advanced degree in computer science, but at a minimum a bachelor's degree in 
  • 5 years of programming proficiency in, at least one modern programming language (e.g. Java, C#, JavaScript, etc.) and at least one other high-level programming language such as Python SQL
  • Expert level proficiency with agile software development & continuous integration + continuous deployment methodologies along with supporting tools such as Git (Gitlab), Terraform
  • 5+ years of experience in big data engineering roles, developing and maintaining ETL and ELT pipelines for data warehousing, on-premise and cloud datalake environments 
  • 3+ years experience with AWS platform services, including AWS S3 & EC2, Data Migration Services (DMS), RDS, EMR, RedShi0ft, Lambda, DynamoDB, CloudWatch, CloudTrail 
  • Strong technical collaboration and communication skills 
     
Technical Qualifications:
  • Proficiency with functional programming methods and their appropriate use in distributed systems
  • Expert proficiency with data management fundamentals and data storage principles
  • Expert proficiency with AWS foundational compute services, including S3 and EC2, ECS and EKS,
  • IAM and CloudWatch
  • Experience with Databricks, including the use of Databricks notebooks, clusters, and jobs
     
Other Qualifications:
  • Demonstrated curiosity and an ability to learn new skills on an ongoing, sustained basis 
  • Demonstrated systems perspective when analyzing problems, thinking about overall operation, failure modes and how to address these problems proactively 
  • A strong sense for the importance of documentation, and the importance of not having to learn things twice 
  • Ability to work in an agile product team environment and balance a diverse set of stakeholder requests 
  • Excellent oral and written communication skills with an ability to break down complex technical systems to help business partners understand the value 
  • Strong technical collaboration and communication skills as well as the ability to drive cultural change and adoption of best practices through community participation 
  • Ability to collaborate with other teams across the company, defining technology roadmaps, sharing experiences and lessons learned for continual improvement 
  • Excellent problem-solving and troubleshooting skills 
  • Process-oriented with great documentation skills 
  • Experience with data visualization tools and techniques
  • Familiarity with machine learning frameworks and libraries
     

 

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. To request an accommodation, please contact us at accommodations@corning.com.

  • Data Engineer

    1 month ago

    Shanghai, Shanghai, China Lifebyte Systems Full time

    Lifebyte SystemsWe are seeking a highly skilled Data Engineer to join our team and contribute to the development of our data infrastructure. As a key member of our data engineering team, you will work closely with data scientists, analysts, and business teams to design, build, and maintain scalable data management systems.Key Responsibilities:Design and...

  • Data Engineer

    1 month ago

    Shanghai, China Lifebyte Systems Full time

    We are looking for a highly skilled Data Engineer to help build and optimise the company's data infrastructure. This position will work closely with data scientists, analysts and business teams to improve the efficiency of the company's data processing and decision making by building efficient data pipelines and storage solutions.Job Responsibilities:...

  • Network Support Engineer

    1 month ago

    Shanghai, Shanghai, China NTT DATA Full time

    Job SummaryWe are seeking a skilled Network Support Engineer to join our team in Shanghai, China. The successful candidate will be responsible for working in our in-country network operation team, maintaining and troubleshooting Cisco-based network systems, and supporting regional network teams on incident handling.Key ResponsibilitiesNetwork system...

  • Data Engineer

    4 weeks ago

    Shanghai, China Corning Full time

    Requisition Number: 65496 Corning is vital to progress – in the industries we help shape and in the world we share. We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts, works, learns, and...

  • MS Engineer

    5 days ago

    Shanghai, China NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Network Support Engineer

    5 months ago

    Shanghai, China NTT DATA Full time

    Job Description Req ID: 283543 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Support Engineer to join our team in Shanghai, Shanghai (CN-SH), China (CN).Role...

  • Data Engineering Expert

    3 weeks ago

    Shanghai, Shanghai, China Airwallex Full time

    About the Role:Airwallex is the leading financial technology platform for modern businesses expanding globally. We are seeking a highly skilled Data Engineering Expert to join our team in Singapore and Shanghai.Responsibilities:Develop and maintain large-scale, high-performance distributed data processing systems to drive Airwallex business growth and...

  • Network Support Engineer

    4 weeks ago

    Shanghai, China NTT DATA Full time

    Job Description Req ID: 298592 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Support Engineer to join our team in Shanghai, Shanghai (CN-SH), China (CN).Working on Cisco...

  • Data Engineer

    1 month ago

    Shanghai, Shanghai, China H&M Group Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at H&M Group. As a Data Engineer, you will be responsible for designing, developing, and implementing database and data pipelines to support our business operations.Key Responsibilities:Design and develop database schema and data pipelines to ensure data...

  • Managed Services Engineer

    1 month ago

    Shanghai, Shanghai, China NTT DATA Full time

    Job OverviewMake a difference with NTT DATANTT DATA is a trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. As a Collaboration Managed Services Engineer, you will play a key role in ensuring the smooth operation of...

  • Senior Data Engineer

    1 month ago

    Shanghai, Shanghai, China Amazon (Shanghai) International Trading Co., Ltd Full time

    Senior Data EngineerAmazon Global Selling central BI team is seeking a highly skilled and motivated Senior Data Engineer to lead the data foundation for the whole AGS business, continuously improving data quality and insight to empower global selling business expansion.Key ResponsibilitiesDesign, develop, and maintain secure, flexible, and scalable data...

  • Data Steward Engineer

    1 month ago

    Shanghai, Shanghai, China Covestro Full time

    Job Title: Data Steward EngineerJob Summary:We are seeking a highly skilled Data Steward Engineer to join our team at Covestro. As a Data Steward Engineer, you will be responsible for managing data access and improving data quality, particularly master data in the areas of research & development, product management, and sustainability.Key...

  • Data Analytics Engineer

    1 month ago

    Shanghai, Shanghai, China Corning Full time

    Job Title: Data Analytics EngineerCorning is a leading technology company that is shaping the industries we serve and the world we share. We are seeking a highly skilled Data Analytics Engineer to join our team.The successful candidate will be responsible for designing and developing data analytics training curriculums to popularize basic data analysis...

  • Data Engineering Specialist for Master Data

    1 week ago

    Shanghai, Shanghai, China Covestro Full time

    Covestro is seeking a highly skilled Data Engineering Specialist for Master Data to join our team.About the JobThe successful candidate will be responsible for managing data access, improving data quality, and ensuring data integration and management solutions meet business requirements. Key responsibilities include analyzing project requirements,...

  • Data Analytics Engineer

    3 months ago

    Shanghai, China Corning Full time

    Requisition Number: 64749 Corning is vital to progress – in the industries we help shape and in the world we share.We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts, works, learns, and...

  • Managed Services Engineer

    5 months ago

    Shanghai, China NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Steward Engineer

    4 weeks ago

    Shanghai, Shanghai, China Covestro Full time

    Job SummaryWe are seeking a highly skilled Data Steward Engineer to join our Covestro team. The ideal candidate will have a strong technical background in data management and a passion for data quality.ResponsibilitiesManage data access and improve data quality, particularly master data in the areas of research & development, product management, and...

  • Data Analytics Engineer

    3 months ago

    Shanghai, China Corning Full time

    : Attend and manage business solution projects. Design and develop data analytics training curriculums to popularize basic data analysis capabilities. Define, design and implement appropriate solutions and options (ie. statistics methods or machine learning techniques) to perform exploratory and targeted data analysis. Apply the findings to quality, process,...

  • Data Engineer

    6 months ago

    Shanghai, China H&M Group Full time

    Job Description The Data Engineer works alongside with Product Manager and Data Analysist in the team to design, development and implementation of database, data pipelines and data warehouse. Proven ability to work independently and as part of a team to deliver high-quality results on time and within budget. Responsibilities Communicate with PM on...

  • Data Engineer Manager

    1 month ago

    Shanghai, Shanghai, China Amazon (Shanghai) International Trading Co., Ltd Full time

    About the RoleAmazon Global Selling Central BI team is seeking a highly skilled and motivated Data Engineer Manager to lead the data foundation for the whole AGS business, continuously improving data quality and insight to empower global selling business expansion.In this role, you will be working in one of the world's largest and most complex data warehouse...