Data Engineer

3 weeks ago


Shenzhen, China BID Operations Full time

Job Overview

As a Data Engineer, you will play a pivotal role in designing, developing, and maintaining scalable data pipelines, leveraging cutting-edge technologies such as dbt, Kafka, RabbitMQ, Spark, and ClickHouse within cloud environments, you will ensure the efficient and reliable flow of data across our systems. Your expertise will drive the optimization of our data architecture, enabling insightful analytics and supporting our data-driven decision-making processes.

Job Responsibilities

•Design and implement highly scalable, reliable, and performant data pipelines to support ETL processes, integrating technologies such as Kafka, Spark, ClickHouse, and RabbitMQ.

•Develop and maintain data transformations using dbt, ensuring proper testing, documentation, and version control of all transformation logic.

•Create and maintain dbt models following best practices for modularity, testing, and documentation, while optimizing for performance and maintainability.

•Work within cloud environments to deploy and manage data services, ensuring best practices in security, scalability, and efficiency.

•Develop and maintain robust data storage solutions, optimizing data storage and retrieval processes in ClickHouse or similar technologies.

•Collaborate with data analysts, and other stakeholders to understand data needs and implement systems that support data analysis and reporting.

•Monitor, troubleshoot, and optimize data pipelines, identifying and resolving performance bottlenecks and ensuring data quality and integrity.

•Participate in the design and implementation of data models and schemas that support business processes and objectives.

•Stay abreast of industry trends and advancements in data engineering technologies and methodologies, continuously seeking ways to improve our data systems.

•Ensure compliance with data governance and security policies.

Requirements

•Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

•Proven experience in data engineering, with a strong background in designing and implementing ETL processes within cloud environments.

•Strong programming skills in Python, with experience in developing robust, maintainable, and scalable data processing pipelines.

•Extensive SQL knowledge and experience.

•Experience with dbt, including expertise in SQL transformation logic, testing, and documentation.

•Excellent problem-solving skills and the ability to work collaboratively in a team environment.

•Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

Benefits

·       Competitive salary commensurate with experience

·       Opportunities for professional development and career advancement

·       Collaborative and supportive work environment

·       Flexibility in smart casual dress code

·       Complimentary snacks and beverages available



  • Shenzhen, Guangdong, China BID Operations Full time

    About UsBID Operations is a dynamic and innovative company that relies on data-driven insights to drive business growth.We are seeking a highly skilled Senior Cloud Data Architect to join our team and contribute to the development of scalable data pipelines that support our ETL processes.The RoleEstimated Salary: $140,000 - $180,000 per yearAs a Senior Cloud...


  • Shenzhen, Guangdong, China Western Digital Full time

    Job DescriptionWe're looking for a talented Data Engineer to join our team at Western Digital in China. As a Data Engineer, you'll play a key role in developing and maintaining our data infrastructure, ensuring the quality and integrity of our data.Key ResponsibilitiesDesign and implement data processing and visualization systemsDevelop and deploy data...

  • Data Engineer

    3 weeks ago


    Shenzhen, Guangdong, China Western Digital Full time

    Company OverviewWestern Digital is a leader in the data storage industry, with a rich history of innovation and commitment to excellence. Our mission is to empower individuals and organizations to capture, preserve, access, and transform data in a way that drives progress and improvement.Job DescriptionWe are seeking an exceptional Data Engineer to join our...


  • Shenzhen, Guangdong, China Johnson Electric Full time

    Key Responsibilities: As a Senior Data Engineering Team Lead at Johnson Electric, you will work closely with algo and development engineers to ensure systems are designed and delivered with appropriate requirements. This role is a critical intersection between Algorithms, Software, and Production deployment. Key Responsibilities: Collaborate with...


  • Shenzhen, Guangdong, China Western Digital Full time

    About the RoleAs a Data Engineer at Western Digital, you will be responsible for developing and implementing high-quality data solutions to drive business growth and innovation.Key ResponsibilitiesData process and visualization developmentConsolidate requirements from business teamWrite script to Extract, Transform, and Load dataSetup and Maintain Data...


  • Shenzhen, Guangdong, China Johnson Electric Full time

    Johnson Electric is seeking a highly skilled Machine Learning Data Engineer Team Lead to join our team. As a critical intersection between Algorithms, Software, and Production deployment, this role requires a unique blend of technical expertise and leadership skills.Key Responsibilities:Collaborate with algo and development engineers to ensure systems are...


  • Shenzhen, China Johnson Electric Full time

    Location: prefer to be based in Jiangmen but we can also consider Shenzhen QualiSense is a joint venture between Johnson Electric and Cortica, a global leader in Autonomous AI technology. We take pride in having built a highly experienced, multidisciplinary team with expertise in quality assurance inspections, manufacturing processes and Autonomous AI. We...

  • Senior Data Engineer

    4 months ago


    Shenzhen, China Crypto.com Full time

    Responsibilities Build a universal data platform, meet real-time/offline computing and storage requirements; Define the data pipeline scheme according to the demand scenarios, and deliver it by multiple methods based on various infrastructure; Enhance the data platform, improve the stability and flexibility of data asset, and optimize the resource...

  • Senior Data Engineer

    2 months ago


    Shenzhen, Guangdong, China Crypto Full time

    Key ResponsibilitiesDesign and develop a scalable data platform to meet real-time and offline computing and storage requirements.Define data pipeline schemes based on demand scenarios and deliver them through various infrastructure methods.Enhance the data platform's stability, flexibility, and resource efficiency.RequirementsBachelor's degree or higher in...


  • Shenzhen, Guangdong, China Amazon Innovation Center (Shenzhen) Company Limited - O82 Full time

    Job SummaryWe are seeking a highly motivated Lab Engineer to join our Devices team at Amazon Innovation Center (Shenzhen) Company Limited.About the RoleThis is an exciting opportunity to champion the quality and efficiency of data collection for the organization. As Lab Engineer on the Data Collection team, you will work closely with software and science...


  • Shenzhen, China Western Digital Full time

    公司描述 The future. It’s on you. You & Western Digital. We’ve been storing the world’s data for more than 50 years. Once, it was the most important thing we could do for data. Now we’re helping the world capture, preserve, access and transform data in a way only we can. The most game-changing companies, consumers, professionals, and...


  • Shenzhen, Guangdong, China Western Digital Full time

    At Western Digital, our vision is to power global innovation and push the boundaries of technology. We are a company of problem solvers who achieve extraordinary things given the right technology.We have been doing this for decades, helping people put a man on the moon and energizing the most competitive gaming platforms.Our technology enables systems to...


  • Shenzhen, Guangdong, China Amazon Innovation Center (Shenzhen) Company Limited - O82 Full time

    We are seeking a highly motivated Lab Engineer to champion the quality and efficiency of data collection for the organization, implementing and executing large scale data collection and ensuring deliverables meet and exceed customer expectations.Key Responsibilities: Collaborate with software and science teams to create data collection plans and test...


  • Shenzhen, Guangdong, China ASML Full time

    Job DescriptionWe are seeking a highly skilled C++ Software Development Engineer to join our team at ASML.This is a unique opportunity to work on the development and maintenance of our compute-litho application software, utilizing C++ and big data technologies.About the RoleDesign, develop, and maintain high-performance software applications with million...


  • Shenzhen, Guangdong, China Beijing Century Joyo Information Technology Co., Ltd. Shenzhen Branch Full time

    About Amazon Global Sourcing We are a dynamic team at the forefront of shaping the future of products and businesses. If you're a results-driven individual with a passion for data analysis and strategic influence, we invite you to join us on this exciting journey. About the Role We are seeking a highly skilled Data-Driven Sourcing Strategist to play a...


  • Shenzhen, Guangdong, China NVIDIA Full time

    Senior Product Manager - Datacenter GPUWe are seeking a seasoned professional to join our Data Center Product Management team as a Senior Product Manager for data center GPUs. In this role, you will help define and market data center GPUs for enterprises and cloud service providers.Key Responsibilities:Lead the data center GPU product line through the...


  • Shenzhen, Guangdong, China NVIDIA Full time

    We are seeking a highly skilled data analyst to support our digital supply chain transformation initiative. The ideal candidate will have expertise in data analysis and visualization, as well as software development skills.Key Responsibilities: Collaborate with cross-functional teams to translate data into actionable insights. Design and implement software...


  • Shenzhen, Guangdong, China Green Matrix (Suzhou) Network Technology Co., Ltd. Full time

    We are Siemens Digital Industries Software, a leading provider of solutions for the design, simulation, and manufacture of products across various industries.As a Chief Data Engineer at our company, you will be responsible for the development, architecture design, maintenance, and performance optimization of internal e-commerce, SaaS, and other product...

  • Front-End Engineer

    3 weeks ago


    Shenzhen, Guangdong, China Infini Capital Management Limited Full time

    Job OverviewInfini Capital Management Limited is a leading financial institution seeking an experienced Front-End Engineer to join our team.


  • Shenzhen, Guangdong, China Infini Capital Management Limited Full time

    Key ResponsibilitiesDevelop front-end UI for trading and management systemsCollaborate with internal departments to provide data visualization supportRequirementsQualifications and SkillsBachelor's degree in financial engineering, computer science or related fieldProficient in front-end technologies including HTML, CSS, and JavaScript...