Data Engineer

1 week ago

Minhang, China Solidigm Full time
Job Description

We are seeking a skilled and motivated Data Engineer to join our global and innovative team of data professionals. The ideal candidate will have extensive experience with SQL Databases, ETL processes, Python programming, Kubernetes, GitHub, and system monitoring. This role involves modernizing, designing, developing, and maintaining our backend manufacturing data architecture. You will work closely with various teams to understand data requirements and deliver solutions that drive business insights and efficiencies.

Key Responsibilities:

  • Programming:
    • Write clean, efficient, and maintainable code for data manipulation and automation tasks.
    • Ability to read, debug, support and improve code written by other developers.
    • Develop and implement data processing scripts and workflows.
    • Use GitHub for version control, code reviews, CI/CD, and collaboration with team members.
  • Kubernetes:
    • Deploy and manage containerized applications using Kubernetes.
    • Ensure the scalability, reliability, and performance of data infrastructure on Kubernetes.
  • Databases:
    • Manage and optimize databases in SingleStore, Microsoft SQL, and MySQL environments.
    • Ensure data integrity, security, and performance across database systems.
  • ETL Processes:
    • Design, develop, and maintain ETL pipelines to ensure seamless data flow across various sources and destinations.
    • Optimize ETL processes for performance, scalability, and reliability.
  • Monitoring and Logging:
    • Implement and configure monitoring solutions to track system performance, data pipelines, and applications.
    • Set up alerts and dashboards to proactively address issues and ensure system health and best practices.

Qualifications

Required Qualifications:

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer or in a similar role.
  • Experience with SingleStore, Microsoft SQL, and MySQL databases.
  • Strong proficiency in ETL tools and processes.
  • Expertise in Python and C# programming languages.
  • Experience with Azure and cloud services.
  • Proficiency with container orchestration using Kubernetes.
  • Familiarity with version control systems and CI/CD, particularly GitHub and GitHub Actions.
  • Knowledge of monitoring tools like Datadog or Grafana.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.

Preferred Qualifications:

  • Familiarity with data virtualization
  • Proficiency with project tracking tools, preferably Jira.
  • Excellent problem-solving skills and attention to detail.
  • Active listening skills, including investigating requirements and proactively identifying potential issues.
  • Critical thinker who naturally see opportunities to develop and optimize work processes - finding ways to simplify, standardize and automate.
  • Self-directed imitator. People who take ownership of their work and need no prompting to drive productivity, change, and outcomes.
  • Collaborative partner. Someone who build and leverage cross-functional relationships to bring together ideas, data, and insights to drive continuous improvement in execution.
  • Analytical problem solvers. People who go beyond just fixing to identify root causes, evaluate optimal solutions, and recommend comprehensive upgrades to prevent future issues.
  • Dedicated achiever. Someone who thrive in a fast-paced environment and will stop at nothing to ensure a project is completed and meets regulations.
  • Ability to manage multiple tasks and prioritize effectively.
  • Strong communication and teamwork abilities.

 

Provide expertise on database management/design to drive integration of business data, functions, and systems. Establish standards, guidelines, procedures, and other infrastructure necessary to support the objective of integration of data. Resolve performance problems. Plans and schedules daily tasks, uses judgement on a variety of problems requiring deviation from standard practices. Inadequacies and erroneous decisions would cause moderate inconvenience and expense.



  • Data Engineer

    1 week ago

    Minhang, China Solidigm Full time

    Job Title: Data EngineerWe are seeking a skilled and motivated Data Engineer to join our global and innovative team of data professionals at Solidigm. The ideal candidate will have extensive experience with SQL Databases, ETL processes, Python programming, Kubernetes, GitHub, and system monitoring.Key Responsibilities:Programming:Write clean, efficient, and...

  • Data Engineer

    1 week ago

    Minhang, China Solidigm Full time

    Job Title: Data EngineerWe are seeking a skilled and motivated Data Engineer to join our global and innovative team of data professionals. The ideal candidate will have extensive experience with SQL Databases, ETL processes, Python programming, Kubernetes, GitHub, and system monitoring. This role involves modernizing, designing, developing, and maintaining...

  • Data Architect

    2 weeks ago

    Minhang, China Solidigm Full time

    Job DescriptionThe Data Architect (Engineer) will design, build, and optimize systems for Backend Manufacturing data collection, storage, access, and analytics at scale.The person will create data pipelines that convert manufacturing raw data into formats usable by data science, data-centric applications, and other data consumers. Manage and organize the MFG...

  • Data Architect

    5 days ago

    Minhang, China Solidigm Full time

    Data Architect Job DescriptionThe Data Architect will design, build, and optimize systems for Backend Manufacturing data collection, storage, access, and analytics at scale. This role involves creating data pipelines that convert manufacturing raw data into formats usable by data science, data-centric applications, and other data consumers.The ideal...

  • Data Architect

    2 weeks ago

    Minhang, China Solidigm Full time

    Data Architect Job DescriptionThe Data Architect will design, build, and optimize systems for Backend Manufacturing data collection, storage, access, and analytics at scale.This role involves creating data pipelines that convert manufacturing raw data into formats usable by data science, data-centric applications, and other data consumers. The Data Architect...

  • Solidigm SSD Media Development Engineer

    5 days ago

    Minhang, China Solidigm Full time

    Job Title: SSD Media Development EngineerWe are seeking a highly skilled SSD Media Development Engineer to join our team at Solidigm. As a key member of our Media focused team, you will play a crucial role in Media qualification, Media algorithm development, and SSD performance optimization.Responsibilities:Develop and implement SSD Media Firmware, Media...

  • SSD Media Development Engineer

    1 week ago

    Minhang, China Solidigm Full time

    Job DescriptionYou will be working with a Media focused team in Solidigm's SSD development, and you will play a crucial role in Media qualification, Media algorithm development to achieve world-class SSD performance for Solidigm.Key Responsibilities:Develop and implement SSD Media Firmware, Media model building, algorithm design, and validation.Design and...

  • SSD Media Development Engineer

    5 days ago

    Minhang, China Solidigm Full time

    Job DescriptionJob DescriptionYou will be working with a Media focused team in Solidigm’ s SSD development, and you will play a crucial role in Media qualification, Media algorithm development to achieve world class SSD performance for Solidigm. Your responsibilities will include, but are not limited to:SSD Media Firmware development, Media model building,...

  • SSD Media Development Engineer

    1 week ago

    Minhang, China Solidigm Full time

    Job DescriptionYou will be working with a Media focused team in Solidigm’ s SSD development, and you will play a crucial role in Media qualification, Media algorithm development to achieve world class SSD performance for Solidigm.Job DescriptionYou will be working with a Media focused team in Solidigm’ s SSD development, and you will play a crucial role...

  • Cloud Solutions Engineer

    6 days ago

    Minhang, China Solidigm Full time

    Job DescriptionThis is a commissioned sales position responsible for delivering product presentations to customers, highlighting how Solidigm products provide the optimal solution to their applications.Key Responsibilities:Ensure customer satisfaction and technical acceptance of Solidigm products, including new product design, ramp-up, issue resolution, and...

  • Application Engineer

    3 months ago

    Minhang District, China Regal Rexnord Full time

    SUMMARY By guiding Kollmorgen AGV customers to become experts in utilization of our products and by that securing our business and future. An application engineer is responsible for leading and managing requirement breakdown, designing, implementation and testing applications, in accordance with the projects adopted standards, for integration into larger...

  • Hyperscale Cloud Field Application Engineer

    6 days ago

    Minhang, China Solidigm Full time

    Job DescriptionThis is a commissioned sales position. Responsible for giving product presentations to the customer describing how Intel products provide the optimum solution to their application.Responsibilities:Responsible for overall customer satisfaction and Solidigm product technical acceptance in customer. Including new product design in and ramp up,...

  • Manager of Performance Testing Laboratory

    1 month ago

    Minhang, China Evonik Full time

    What We Provide Join us at Evonik and unlock a realm of possibilities. Collaborate with us to forge innovative solutions that contribute to a more sustainable and healthier world. With a workforce of 33,000, you will have the opportunity to grow, thrive, and explore diverse career paths alongside talented colleagues. We offer competitive compensation,...

  • Lead Performance Testing Lab Specialist

    1 month ago

    Minhang, China Evonik Full time

    What We Provide Join us at Evonik and discover a realm of possibilities. Collaborate with us to develop innovative solutions that contribute to a more sustainable and healthier world. With a workforce of 33,000, you will have the opportunity to explore, excel, and advance your career. We offer competitive compensation, comprehensive health benefits, and...

  • Laboratory Manager for Performance Testing

    1 month ago

    Minhang, China Evonik Full time

    What We Provide Join us at Evonik and embark on a journey filled with opportunities. Collaborate with us to craft innovative solutions that contribute to a more sustainable world, enhancing health, vibrancy, and comfort in life. At Evonik, you will have the opportunity to grow and excel alongside a diverse team of 33,000 professionals. We offer a variety...

  • Performance Testing Lab Manager

    5 months ago

    Minhang, China Evonik Full time

    What we offer Explore a world of opportunities with us. Look ahead with us and help shape innovative solutions to make our world more sustainable and life healthier, more vibrant and more comfortable. At Evonik, you have the chance to explore, thrive, and grow alongside 33,000 colleagues. Among attractive career paths and high-quality development...