See more Collapse

Data Engineer

2 months ago

Shanghai, Shanghai, China Coins Full time

Responsibilities:

  • Designing, developing, and maintaining highly scalable, reliable, and efficient data processing systems with a strong emphasis on code quality and performance.
  • Collaborating closely with data analysts, software developers, and business stakeholders to deeply understand data requirements and architect robust solutions to address their needs.
  • Focusing on the development and maintenance of ETL pipelines, ensuring seamless extraction, transformation, and loading of data from diverse sources into our data warehouse based on Data-bricks platform.
  • Spearheading the development and maintenance of real-time data processing systems utilizing cutting-edge big data technologies such as Spark Streaming and Kafka.
  • Establishing and enforcing rigorous data quality and validation checks to uphold the accuracy and consistency of our data assets.
  • Acting as a point of contact for troubleshooting and resolving complex data processing issues, collaborating with cross-functional teams as necessary to ensure timely resolution.
  • Proactively monitoring and optimizing data processing systems to uphold peak performance, scalability, and reliability standards, leveraging advanced AWS operational knowledge.
  • Utilizing AWS services such as EC2, S3, Glue, and Data-bricks to architect, deploy, and manage data processing infrastructure in the cloud.
  • Implementing robust security measures and access controls to safeguard sensitive data assets within the AWS environment.
  • Staying abreast of the latest advancements in AWS technologies and best practices, incorporating new tools and services to continually improve our data processing capabilities.

Requirements:

  • Bachelor's or Master's degree in Computer Science or a related field.
  • Minimum of 5 years of hands-on experience as a Data Engineer, demonstrating a proven track record of designing and implementing sophisticated data processing systems.
  • Good understanding of Data-bricks platform and Delta Lake.
  • Familiarity with data job scheduler tools such as Dagster.
  • Proficiency in one or more programming languages such as Scala, Java, or Python.
  • Deep expertise in big data technologies including Apache Spark for ETL processing and optimization.
  • Proficiency in utilizing BI tools such as Metabase for data visualization and analysis.
  • Advanced understanding of data modeling, data quality, and data governance best practices.
  • Outstanding communication and collaboration skills, with the ability to effectively engage with diverse stakeholders across the organization.
  • Extensive experience in AWS operational management, including deployment, configuration, and optimization of data processing infrastructure within the AWS cloud environment.
  • Strong understanding of AWS services such as EC2, S3, Glue, and EMR, with the ability to architect scalable and resilient data solutions leveraging these services.
  • Proficiency in AWS security best practices, with experience implementing robust security measures and access controls to protect sensitive data assets.
  • Hands-on experience with automation and DevOps tools such as Terraform for infrastructure as code and automation purposes.
  • Ability to read and write in English

We have other current jobs related to this field that you can find below

  • Network Support Engineer

    2 weeks ago

    Shanghai, Shanghai, China NTT DATA Full time

    Job Description NTT DATA Services is looking for a Network Support Engineer to join the team in Shanghai, China. If you are an enthusiastic individual who thrives in a dynamic environment, this might be the perfect opportunity for you. Work in-country network operation team. Handle Cisco-based network system operations. Provide support to regional network...

  • Data Engineer

    2 weeks ago

    Shanghai, Shanghai, China H&M Group Full time

    Job Description The Data Engineer works alongside with Product Manager and Data Analysist in the team to design, development and implementation of database, data pipelines and data warehouse. Proven ability to work independently and as part of a team to deliver high-quality results on time and within budget. Responsibilities Communicate with PM on...

  • Network Support Engineer

    2 weeks ago

    Shanghai, Shanghai, China NTT DATA Services Full time

    Req ID:NTT DATA Services is looking for an exceptional Network Support Engineer to join their team in Shanghai, China.Role Responsibilities:- Working in the in-country network operation team.- Handling daily operations on Cisco-based network systems (LAN/WAN/VoIP) independently and collaborating with regional support teams and vendors, which includes: •...

  • Data Steward Engineer

    2 weeks ago

    Shanghai, Shanghai, China Covestro Full time

    Responsibilities:Manage data access and improve data quality, particularly master data in the areas of research & development, product management, and sustainability.Be responsible for data integration, data management solutions, and data quality.Analyze business/project requirements and identify relevant data and tools for data provisioning.Be hands-on...

  • Senior Data Engineer

    4 weeks ago

    Shanghai, Shanghai, China Coins Full time

    Join the Pioneer Crypto Brand in the PhilippinesCoins is the most established crypto brand in The Philippines and has gained the trust of more than 18 million users. Through the easy-to-use mobile app, users can buy and sell a variety of different cryptocurrencies and access a wide range of financial services.Coins is fully regulated by the Bangko Sentral ng...

  • Senior Data Engineer

    2 months ago

    Shanghai, Shanghai, China Coins Full time

    Join the Pioneer Crypto Brand in the PhilippinesCoins is the most established crypto brand in The Philippines and has gained the trust of more than 18 million users. Through the easy-to-use mobile app, users can buy and sell a variety of different cryptocurrencies and access a wide range of financial services.Coins is fully regulated by the Bangko Sentral ng...

  • Senior Data Engineer II

    2 weeks ago

    Shanghai, Shanghai, China RELX Full time

    Are You a Champion for Continuous Improvement?Do you enjoy collaborating with teams to solve complex technical problems in the realm of employer-employee relations?About Our TeamLexisNexis Legal & Professional is part of RELX, a worldwide provider of information-based analytics and decision tools. With 11,300 employees globally, we serve customers in over...

  • Software Engineer II- Azure Data

    2 weeks ago

    Shanghai, Shanghai, China Microsoft Full time

    Overview Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.Microsoft's Azure Data engineering team is leading the transformation of analytics in the...

  • Senior Data Engineer II

    2 weeks ago

    Shanghai, Shanghai, China RELX Full time

    About the Role The Data Engineer performs complex research, design, and software development assignments within a software functional area or product line, and provides direct input to project plans, schedules, and methodology in the development of cross-functional software products. This SWE performs software design — typically across multiple systems;...

  • MS Engineer

    2 weeks ago

    Shanghai, Shanghai, China NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our clients...

  • Data Specialist

    1 month ago

    Shanghai, Shanghai, China Alfa Laval Full time

    At Alfa Laval, we always go that extra mile to overcome the toughest challenges. Our driving force is to accelerate success for our customers, people and planet. You can only achieve that by having dedicated people with a curious mind. Curiosity is the spark behind great ideas. And great ideas drive progress.As a member of our team, you thrive in a truly...

  • Data Specialist

    2 weeks ago

    Shanghai, Shanghai, China Alfa Laval Full time

    At Alfa Laval, we always go that extra mile to overcome the toughest challenges. Our driving force is to accelerate success for our customers, people and planet. You can only achieve that by having dedicated people with a curious mind. Curiosity is the spark behind great ideas. And great ideas drive progress.As a member of our team, you thrive in a truly...

  • Data Specialist

    4 weeks ago

    Shanghai, Shanghai, China Alfa Laval Full time

    At Alfa Laval, we always go that extra mile to overcome the toughest challenges. Our driving force is to accelerate success for our customers, people and planet. You can only achieve that by having dedicated people with a curious mind. Curiosity is the spark behind great ideas. And great ideas drive progress.As a member of our team, you thrive in a truly...

  • Data intern

    2 weeks ago

    Shanghai, Shanghai, China The LEGO Group Full time

    Job DescriptionEmpower your passion for data and make a real impact by joining our Data Engineering team as an InternYou can gain valuable hands-on experience in data operations and contribute to critical business intelligence initiatives. You will work closely with experienced professionals, tackling real-world challenges and developing sought-after data...

  • Data Scientist

    2 weeks ago

    Shanghai, Shanghai, China The LEGO Group Full time

    Job DescriptionUnleash the power of data Are you passionate about data and help The LEGO Group unlock deeper insights, become a true data-driven leader, and connect millions of LEGO fans across China? We are looking for a passionate Data Scientist to join our multinational team. This is your chance to enable Data Science capabilities that impact millions of...

  • Global Data Engineer

    2 months ago

    Shanghai, Shanghai, China BASF SE Full time

    Objectives: To be part of a highly motivated and agile global team that develops innovative digital solutions for marketing and sales within the Global Automotive OEM Coatings business (G-ECO/MD). The transformation into a data driven business unit requires our data to be readily available and consumable in an automated way.Main Tasks: Design and develop...

  • Global Data Engineer

    2 weeks ago

    Shanghai, Shanghai, China BASF SE Full time

    Objectives: To be part of a highly motivated and agile global team that develops innovative digital solutions for marketing and sales within the Global Automotive OEM Coatings business (G-ECO/MD). The transformation into a data driven business unit requires our data to be readily available and consumable in an automated way.Main Tasks: Design and develop...

  • Global Data Engineer

    4 weeks ago

    Shanghai, Shanghai, China BASF SE Full time

    Objectives: To be part of a highly motivated and agile global team that develops innovative digital solutions for marketing and sales within the Global Automotive OEM Coatings business (G-ECO/MD). The transformation into a data driven business unit requires our data to be readily available and consumable in an automated way.Main Tasks: Design and develop...

  • Senior Data Engineer

    2 weeks ago

    Shanghai, Shanghai, China ZEISS Group Full time

    You will play a crucial role in shaping the future of Data Analytics and actively contribute to the success of the digital transformation at ZEISS. In this challenging function, you will help our business units to identify and develop strategic data-driven use case opportunities. You are part of our Enterprise Data Platform team and collaborate with...

  • Lead Data Engineer

    2 weeks ago

    Shanghai, Shanghai, China Eraneos Full time

    What you will find with usWe are a technical, implementation-oriented spin-off of a global management consultancy. Our clients are primarily DAX and Fortune Global 500 companies, which we advise on issues in the areas of analytics, big data and machine learning. Within the group, we take on the development of individual and data-driven solutions in order to...