Machine Learning Software Platform Architect

2 weeks ago


Shanghai, Shanghai, China NVIDIA Full time

NVIDIA is a leader in High-Performance Computing, Artificial Intelligence, and Visualization. We're seeking a highly skilled and experienced Large Language Model (LLM) based Application Infrastructure engineer to join our team. The successful candidate will work at the intersection of GPU chip design and AI, responsible for the design, development, and maintenance of the infrastructure around NVIDIA's internal large language model aimed at facilitating chip design.

Key Responsibilities:

  • Develop and maintain the infrastructure for managing large language models (LLMs) based application specifically adapted for the chip design and hardware domain.
  • Develop and maintain LLM based applications to serve hardware engineers, such as LLM based QA bot, code generator etc.
  • Collaborate with HW chip designers and LLM research teams to understand the specific needs and challenges of GPU design and ensure the LLM infrastructure is well-suited to these needs.
  • Collaborate with LLM research teams to collect & organize training / fine-tuning data to train hardware specific language model.
  • Optimize the infrastructure for performance, scalability, and reliability, and ensure the secure and efficient management of data.
  • Stay updated with the latest industry trends in AI and machine learning, and continuously look for opportunities to apply these advancements to improve the LLM infrastructure.

Requirements:

  • 5+ years work experience in developing and maintaining AI or machine learning infrastructure, preferably in the context of large language models.
  • BS in computer science or related or equivalent experience.
  • Strong proficiency in Python and web development, and familiarity with LLM related techniques e.g., langchain, vector database, prompt engineering, etc.
  • Understanding of chip design and related computational and data challenges.
  • Experience with data management, including doc cleaning, transformation, and secure storage.
  • Excellent problem-solving skills and the ability to work effectively in a team.
  • In depth understanding of Machine Learning / Deep Learning / NLP concepts.

Preferred Qualifications:

  • You crafted & developed production quality microservices.
  • Strong technical background in cloud/distributed infrastructure.
  • An excellent plus if you are familiar with front-end development using React or Vue.js.
  • Strong understanding of SQL & NoSQL Data platforms.

NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our exclusive engineering teams are rapidly growing. Are you a creative and passionate about applying Machine Learning to solve remarkably interesting problems? Are you interested in being involved in state-of-the-art development in the field of AI & love a challenge? If so, we want to hear from you.



  • Shanghai, Shanghai, China NVIDIA Full time

    Job Title: Machine Learning Software Platform ArchitectNVIDIA is a leading technology company that has made groundbreaking developments in High-Performance Computing, Artificial Intelligence, and Visualization. Our work enables amazing creativity and discovery and powers what were once science fiction inventions from artificial intelligence to autonomous...


  • Shanghai, Shanghai, China NVIDIA Full time

    Job Title: Machine Learning Software Platform ArchitectNVIDIA is a leader in the technology world, known for groundbreaking developments in High-Performance Computing, Artificial Intelligence, and Visualization. Our work enables amazing creativity and discovery and powers what were once science fiction inventions from artificial intelligence to autonomous...


  • Shanghai, Shanghai, China NVIDIA Full time

    About NVIDIANVIDIA is a leading technology company that has revolutionized the industry with groundbreaking developments in High-Performance Computing, Artificial Intelligence, and Visualization. Our GPU, the visual cortex of modern computers, serves as the heart of our products and services, enabling amazing creativity and discovery and powering what were...

  • Cloud Data Architect

    2 months ago


    Shanghai, Shanghai, China Amazon Information Service (Beijing) Co., Ltd. (Shanghai Branch) Full time

    About the RoleWe are seeking a highly skilled Cloud Computing Architect to join our team at Amazon Information Service (Beijing) Co., Ltd. (Shanghai Branch). As a Cloud Computing Architect, you will be responsible for designing and implementing cloud-based solutions for our customers, with a focus on data analytics and machine learning.Key...


  • Shanghai, Shanghai, China Mercedes-Benz Full time

    Job Title: Platform Software ArchitectMercedes-Benz Group China Ltd. is seeking a highly skilled Platform Software Architect to join our Advanced Design Center China in Shanghai, China.Job Summary:We are looking for a talented software architect to design and implement platform architecture for autonomous driving products. The successful candidate will work...


  • Shanghai, Shanghai, China Mercedes-Benz Full time

    Job Title: Platform Software ArchitectWe are seeking a highly skilled Platform Software Architect to join our team at Mercedes-Benz Group China Ltd. in Shanghai, China. As a key member of our Advanced Design Center, you will be responsible for designing and implementing platform architecture for autonomous driving products.Key Responsibilities:Design and...


  • Shanghai, Shanghai, China Mercedes-Benz Full time

    Job Title: Platform Software ArchitectWe are seeking a highly skilled Platform Software Architect to join our Advanced Design Center in Shanghai, China. As a key member of our team, you will be responsible for designing and implementing platform architecture for autonomous driving products.Key Responsibilities:Design and implement platform architecture based...


  • Shanghai, Shanghai, China NVIDIA Full time

    About the RoleNVIDIA is seeking a highly skilled Solutions Architect to collaborate with our largest global alliance partners and enable them with our portfolio of GPU Accelerated Computing solutions, specifically Generative AI and Machine Learning.This individual will be a technical data science and accelerated computing platform advisor, responsible for...


  • Shanghai, Shanghai, China Qualcomm Full time

    Job Summary:Qualcomm is seeking a highly skilled Senior Software Engineer to join our team in China. As a Senior Software Engineer, you will be responsible for designing, developing, and testing software applications for our AI and Machine Learning platforms.Key Responsibilities:Design and develop software applications for AI and Machine Learning...


  • Shanghai, Shanghai, China NVIDIA Full time

    About the RoleNVIDIA is seeking a highly skilled Solutions Architect to collaborate with our largest global alliance partners, enabling them to leverage our portfolio of GPU Accelerated Computing solutions, including Machine Learning and Deep Learning, specifically Generative AI.This individual will be a technical data science and accelerated computing...


  • Shanghai, Shanghai, China NVIDIA Full time

    About the RoleNVIDIA is seeking a highly skilled Solutions Architect to join our team and work with our largest global alliance partners to enable them with our portfolio of GPU Accelerated Computing solutions, including Machine Learning and Deep Learning. As a Solutions Architect, you will be responsible for architecting and creating prototypes, building,...


  • Shanghai, Shanghai, China NVIDIA Full time

    NVIDIA is seeking a highly skilled Solutions Architect to collaborate with our largest global alliance partners in leveraging our portfolio of GPU Accelerated Computing solutions, including Machine Learning and Deep Learning, specifically Generative AI. This individual will be responsible for architecting and creating prototypes, building, pre-training,...


  • Shanghai, Shanghai, China Optiver Full time

    About the Role:Optiver is a global market maker with a presence in multiple continents. Our Shanghai office is a rapidly growing participant in the Chinese markets, trading exchange-listed futures, options, and equities. We are seeking a Senior Machine Learning Platform Engineer to join our team.Key Responsibilities:Design and develop the infrastructure and...


  • Shanghai, Shanghai, China NVIDIA Full time

    Deep Learning Performance Architect InternNVIDIA is pushing the boundaries of deep learning performance by developing innovative processor and system architectures. We are seeking a talented deep learning system performance architect to contribute to our AI performance projection and analysis efforts.Key Responsibilities:Analyze state-of-the-art AI models on...


  • Shanghai, Shanghai, China Optiver Full time

    About Us:Optiver is a global market maker with a presence in multiple continents. Founded in 1986, we are a leading liquidity provider with a strong commitment to improving the market through competitive pricing, execution, and risk management.We provide liquidity to financial markets using our own capital, at our own risk, trading a wide range of products....


  • Shanghai, Shanghai, China Optiver Full time

    About Us:Optiver is a global market maker with a presence in multiple continents. Founded in 1986, we are a leading liquidity provider with a strong commitment to improving the market through competitive pricing, execution, and risk management.We provide liquidity to financial markets using our own capital, at our own risk, trading a wide range of products....


  • Shanghai, Shanghai, China Mercedes-Benz Full time

    Job Title: Android Software ArchitectJob Summary:We are seeking an experienced Android Software Architect to join our team at Mercedes-Benz Group China Ltd. in Shanghai, CN. As a key member of our Research & Development Software department, you will be responsible for designing and implementing the Android system architecture for our smart cockpit...


  • Shanghai, Shanghai, China Optiver Full time

    About UsOptiver is a leading global market maker with a presence in multiple continents. Founded in 1986, we have grown to become a prominent liquidity provider, with a team of over 2,000 employees worldwide. Our mission is to improve the market through competitive pricing, execution, and risk management.Our Shanghai OfficeSince its establishment in 2012,...


  • Shanghai, Shanghai, China Optiver Full time

    About Us:Optiver is a global market maker with a presence in multiple continents. Founded in 1986, we are a leading liquidity provider with a strong commitment to improving the market through competitive pricing, execution, and risk management.We provide liquidity to financial markets using our own capital, at our own risk, trading a wide range of products....


  • Shanghai, Shanghai, China Mercedes-Benz Full time

    Job Title: QNX SW ArchitectMercedes-Benz Group China Ltd. is seeking a highly skilled QNX SW Architect to join our team in Beijing.Job Summary:We are looking for a talented software architect with expertise in QNX and Linux to design and develop platform software for our vehicle products. The ideal candidate will have a strong understanding of ARM and SOC...