Data Engineer

4 weeks ago

Shanghai China Coins.ph Full time

Responsibilities:

1. Design, develop, and maintain highly scalable, reliable, and efficient data processing systems with a strong emphasis on code quality and performance.

2. Collaborate closely with data analysts, software developers, and business stakeholders to deeply understand data requirements and architect robust solutions to address their needs.

3. Focus on the development and maintenance of ETL pipelines, ensuring seamless extraction, transformation, and loading of data from diverse sources into our data warehouse based on Data-bricks platform.

4. Spearhead the development and maintenance of real-time data processing systems utilizing cutting-edge big data technologies such as Spark Streaming and Kafka.

5. Establish and enforce rigorous data quality and validation checks to uphold the accuracy and consistency of our data assets.

6. Act as a point of contact for troubleshooting and resolving complex data processing issues, collaborating with cross-functional teams as necessary to ensure timely resolution.

7. Proactively monitor and optimize data processing systems to uphold peak performance, scalability, and reliability standards, leveraging advanced AWS operational knowledge.

8. Utilize AWS services such as EC2, S3, Glue and Data-bricks to architect, deploy, and manage data processing infrastructure in the cloud.

9. Implement robust security measures and access controls to safeguard sensitive data assets within the AWS environment.

10. Stay abreast of the latest advancements in AWS technologies and best practices, incorporating new tools and services to continually improve our data processing capabilities.

 

Requirements:

1. Bachelor’s or Master’s degree in Computer Science or a related field.

2. Minimum of 5 years of hands-on experience as a Data Engineer, demonstrating a proven track record of designing and implementing sophisticated data processing systems.

4. Good understanding of Data-bricks platform and Delta Lake.

Familiar with data job scheduler tool such as Dagster.

5. Proficiency in one or more programming languages such as Scala, Java, or Python.

6. Deep expertise in big data technologies including Apache Spark for ETL processing and optimization.

7. Proficient in utilizing BI tools such as Metabase for data visualization and analysis.

8. Advanced understanding of data modeling, data quality, and data governance best practices.

9. Outstanding communication and collaboration skills, with the ability to effectively engage with diverse stakeholders across the organization.

10. Extensive experience in AWS operational management, including deployment, configuration, and optimization of data processing infrastructure within the AWS cloud environment.

11. Strong understanding of AWS services such as EC2, S3, Glue and EMR, with the ability to architect scalable and resilient data solutions leveraging these services.

12. Proficiency in AWS security best practices, with experience implementing robust security measures and access controls to protect sensitive data assets.

13. Hands-on experience with automation and DevOps tools such as Terraform for infrastructure as code and automation purposes.

14. Can read/write in English.



  • Data Engineer

    2 months ago

    Shanghai, China Coins.ph Full time

    Responsibilities:1. Design, develop, and maintain highly scalable, reliable, and efficient data processing systems with a strong emphasis on code quality and performance.2. Collaborate closely with data analysts, software developers, and business stakeholders to deeply understand data requirements and architect robust solutions to address their needs.3....

  • Senior Data Engineer

    4 weeks ago

    Shanghai, China Coins.ph Full time

    Join the Pioneer Crypto Brand in the Philippines!Coins is the most established crypto brand in The Philippines and has gained the trust of more than 18 million users. Through the easy-to-use mobile app, users can buy and sell a variety of different cryptocurrencies and access a wide range of financial services.Coins is fully regulated by the Bangko Sentral...

  • Senior Data Engineer

    2 months ago

    Shanghai, China Coins.ph Full time

    Join the Pioneer Crypto Brand in the Philippines!Coins is the most established crypto brand in The Philippines and has gained the trust of more than 18 million users. Through the easy-to-use mobile app, users can buy and sell a variety of different cryptocurrencies and access a wide range of financial services.Coins is fully regulated by the Bangko Sentral...

  • MS Engineer

    1 week ago

    Shanghai, China NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Network Support Engineer

    2 weeks ago

    Shanghai, Shanghai, China NTT DATA Full time

    Job Description NTT DATA Services is looking for a Network Support Engineer to join the team in Shanghai, China. If you are an enthusiastic individual who thrives in a dynamic environment, this might be the perfect opportunity for you. Work in-country network operation team. Handle Cisco-based network system operations. Provide support to regional network...

  • MS Engineer

    1 week ago

    Shanghai, China NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Network Support Engineer

    4 weeks ago

    Shanghai, China NTT DATA Full time

    Job Description Req ID: 283543 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Support Engineer to join our team in Shanghai, Shanghai (CN-SH), China (CN).Role...

  • Consultant, Data Engineering

    2 months ago

    Shanghai, China Avanade Full time

    Our talented Data Engineering team ismade up of globally recognized experts - and there’s room for more analyticaland ambitious data professionals. If you’re passionate about helping clientsmake better data-driven decisions to tackle their most complex business issues,let’s talk. Take your skills to a new level and launch a careerwhere you can truly do...

  • Consultant, Data Engineering

    4 weeks ago

    Shanghai, China Avanade Full time

    Our talented Data Engineering team ismade up of globally recognized experts - and there’s room for more analyticaland ambitious data professionals. If you’re passionate about helping clientsmake better data-driven decisions to tackle their most complex business issues,let’s talk. Take your skills to a new level and launch a careerwhere you can truly do...

  • Data Engineer

    2 months ago

    Shanghai, Shanghai, China Coins Full time

    Responsibilities:Designing, developing, and maintaining highly scalable, reliable, and efficient data processing systems with a strong emphasis on code quality and performance.Collaborating closely with data analysts, software developers, and business stakeholders to deeply understand data requirements and architect robust solutions to address their...

  • Data Engineer

    4 weeks ago

    Shanghai, Shanghai, China Coins Full time

    Responsibilities:Designing, developing, and maintaining highly scalable, reliable, and efficient data processing systems with a strong emphasis on code quality and performance.Collaborating closely with data analysts, software developers, and business stakeholders to deeply understand data requirements and architect robust solutions to address their...

  • Data Centre Engineer

    2 months ago

    Shanghai, China Optiver Full time

    WHO WE ARE Optiver is a global market maker with offices in Amsterdam, London, Chicago, Austin, Sydney, Shanghai, Hong Kong, Singapore and Taipei. Founded in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the market through competitive pricing, execution and...

  • Data Centre Engineer

    4 weeks ago

    Shanghai, China Optiver Full time

    WHO WE ARE Optiver is a global market maker with offices in Amsterdam, London, Chicago, Austin, Sydney, Shanghai, Hong Kong, Singapore and Taipei. Founded in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the market through competitive pricing, execution and...

  • MS Engineer

    4 weeks ago

    Shanghai, China NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Data Engineer

    2 weeks ago

    Shanghai, Shanghai, China H&M Group Full time

    Job Description The Data Engineer works alongside with Product Manager and Data Analysist in the team to design, development and implementation of database, data pipelines and data warehouse. Proven ability to work independently and as part of a team to deliver high-quality results on time and within budget. Responsibilities Communicate with PM on...

  • Data Engineer

    4 weeks ago

    Shanghai, China H&M Group Full time

    Job Description The Data Engineer works alongside with Product Manager and Data Analysist in the team to design, development and implementation of database, data pipelines and data warehouse. Proven ability to work independently and as part of a team to deliver high-quality results on time and within budget. Responsibilities Communicate with PM on...

  • Managed Services Engineer

    1 week ago

    Shanghai, China NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Science Lead

    1 month ago

    Shanghai, China Coins.ph Full time

    Join the Pioneer Crypto Brand in the Philippines!Coins is the most established crypto brand in The Philippines and has gained the trust of more than 18 million users. Through the easy-to-use mobile app, users can buy and sell a variety of different cryptocurrencies and access a wide range of financial services.Coins is fully regulated by the Bangko Sentral...

  • Data Science Lead

    4 weeks ago

    Shanghai, China Coins.ph Full time

    Join the Pioneer Crypto Brand in the Philippines!Coins is the most established crypto brand in The Philippines and has gained the trust of more than 18 million users. Through the easy-to-use mobile app, users can buy and sell a variety of different cryptocurrencies and access a wide range of financial services.Coins is fully regulated by the Bangko Sentral...

  • Network Support Engineer

    2 weeks ago

    Shanghai, Shanghai, China NTT DATA Services Full time

    Req ID:NTT DATA Services is looking for an exceptional Network Support Engineer to join their team in Shanghai, China.Role Responsibilities:- Working in the in-country network operation team.- Handling daily operations on Cisco-based network systems (LAN/WAN/VoIP) independently and collaborating with regional support teams and vendors, which includes: •...