Machine Learning Software Platform Architect

2 months ago


Shanghai, Shanghai, China NVIDIA Full time
About NVIDIA

NVIDIA is a leading technology company that has revolutionized the industry with groundbreaking developments in High-Performance Computing, Artificial Intelligence, and Visualization. Our GPU, the visual cortex of modern computers, serves as the heart of our products and services, enabling amazing creativity and discovery and powering what were once science fiction inventions from artificial intelligence to autonomous cars.

Job Description

We are seeking a highly skilled and experienced Large Language Model (LLM) based Application Infrastructure engineer to join our growing team. The successful candidate will work at the intersection of GPU chip design and AI, responsible for the design, development, and maintenance of the infrastructure around NVIDIA's internal large language model aimed at facilitating chip design.

Key Responsibilities
  • Develop and maintain the infrastructure for managing large language models (LLMs) based application specifically adapted for the chip design and hardware domain.
  • Develop and maintain LLM based applications to serve hardware engineers, such as LLM based QA bot, code generator, etc.
  • Collaborate with HW chip designers and LLM research teams to understand the specific needs and challenges of GPU design and ensure the LLM infrastructure is well-suited to these needs.
  • Collaborate with LLM research teams to collect & organize training / fine-tuning data to train hardware specific language model.
  • Optimize the infrastructure for performance, scalability, and reliability, and ensure the secure and efficient management of data.
  • Stay updated with the latest industry trends in AI and machine learning, and continuously look for opportunities to apply these advancements to improve the LLM infrastructure.
Requirements
  • 5+ years work experience in developing and maintaining AI or machine learning infrastructure, preferably in the context of large language models.
  • BS in computer science or related or equivalent experience.
  • Strong proficiency in Python and web development, and familiarity with LLM related techniques e.g., langchain, vector database, prompt engineering, etc.
  • Understanding of chip design and related computational and data challenges.
  • Experience with data management, including doc cleaning, transformation, and secure storage.
  • Excellent problem-solving skills and the ability to work effectively in a team.
  • In-depth understanding of Machine Learning / Deep Learning / NLP concepts.
Preferred Qualifications
  • You crafted & developed production quality microservices.
  • Strong technical background in cloud/distributed infrastructure.
  • An excellent plus if you are familiar with front-end development using React or.
  • Strong understanding of SQL & NoSQL Data platforms.
About the Role

NVIDIA offers highly competitive salaries and a comprehensive benefits package. Our exclusive engineering teams are rapidly growing, and we are looking for creative and passionate individuals who are interested in applying Machine Learning to solve remarkably interesting problems. If you love a challenge and are interested in being involved in state-of-the-art development in the field of AI, we want to hear from you.



  • Shanghai, Shanghai, China NVIDIA Full time

    Job Title: Machine Learning Software Platform ArchitectNVIDIA is a leading technology company that has made groundbreaking developments in High-Performance Computing, Artificial Intelligence, and Visualization. Our work enables amazing creativity and discovery and powers what were once science fiction inventions from artificial intelligence to autonomous...


  • Shanghai, Shanghai, China NVIDIA Full time

    Job Title: Machine Learning Software Platform ArchitectNVIDIA is a leader in the technology world, known for groundbreaking developments in High-Performance Computing, Artificial Intelligence, and Visualization. Our work enables amazing creativity and discovery and powers what were once science fiction inventions from artificial intelligence to autonomous...


  • Shanghai, Shanghai, China NVIDIA Full time

    NVIDIA is a leader in High-Performance Computing, Artificial Intelligence, and Visualization. We're seeking a highly skilled and experienced Large Language Model (LLM) based Application Infrastructure engineer to join our team. The successful candidate will work at the intersection of GPU chip design and AI, responsible for the design, development, and...


  • Shanghai, Shanghai, China NVIDIA Full time

    NVIDIA is a leader in High-Performance Computing, Artificial Intelligence, and Visualization. We are seeking a highly skilled and experienced Large Language Model (LLM) based Application Infrastructure engineer to join our team.Key Responsibilities:Develop and maintain the infrastructure for managing large language models (LLMs) based application...


  • Shanghai, Shanghai, China Mercedes-Benz Full time

    Job Title: Platform Software ArchitectMercedes-Benz Group China Ltd. is seeking a highly skilled Platform Software Architect to join our Advanced Design Center China in Shanghai, China.Job Summary:We are looking for a talented software architect to design and implement platform architecture for autonomous driving products. The successful candidate will work...


  • Shanghai, Shanghai, China Mercedes-Benz Full time

    Job Title: Platform Software ArchitectWe are seeking a highly skilled Platform Software Architect to join our Advanced Design Center in Shanghai, China. As a key member of our team, you will be responsible for designing and implementing platform architecture for autonomous driving products.Key Responsibilities:Design and implement platform architecture based...


  • Shanghai, Shanghai, China NVIDIA Full time

    About the RoleNVIDIA is seeking a highly skilled Solutions Architect to collaborate with our largest global alliance partners and enable them with our portfolio of GPU Accelerated Computing solutions, specifically Generative AI and Machine Learning.This individual will be a technical data science and accelerated computing platform advisor, responsible for...


  • Shanghai, Shanghai, China Qualcomm Full time

    Job Summary:Qualcomm is seeking a highly skilled Senior Software Engineer to join our team in China. As a Senior Software Engineer, you will be responsible for designing, developing, and testing software applications for our AI and Machine Learning platforms.Key Responsibilities:Design and develop software applications for AI and Machine Learning...


  • Shanghai, Shanghai, China NVIDIA Full time

    About the RoleNVIDIA is seeking a highly skilled Solutions Architect to collaborate with our largest global alliance partners, enabling them to leverage our portfolio of GPU Accelerated Computing solutions, including Machine Learning and Deep Learning, specifically Generative AI.This individual will be a technical data science and accelerated computing...


  • Shanghai, Shanghai, China NVIDIA Full time

    About the RoleNVIDIA is seeking a highly skilled Solutions Architect to join our team and work with our largest global alliance partners to enable them with our portfolio of GPU Accelerated Computing solutions, including Machine Learning and Deep Learning. As a Solutions Architect, you will be responsible for architecting and creating prototypes, building,...


  • Shanghai, Shanghai, China NVIDIA Full time

    NVIDIA is seeking a highly skilled Solutions Architect to collaborate with our largest global alliance partners in leveraging our portfolio of GPU Accelerated Computing solutions, including Machine Learning and Deep Learning, specifically Generative AI. This individual will be responsible for architecting and creating prototypes, building, pre-training,...


  • Shanghai, Shanghai, China Optiver Full time

    About the Role:Optiver is a global market maker with a presence in multiple continents. Our Shanghai office is a rapidly growing participant in the Chinese markets, trading exchange-listed futures, options, and equities. We are seeking a Senior Machine Learning Platform Engineer to join our team.Key Responsibilities:Design and develop the infrastructure and...


  • Shanghai, Shanghai, China Optiver Full time

    About the Role:Optiver is a global market maker with a presence in multiple continents, and our Shanghai office is a rapidly growing participant in the Chinese markets. We are seeking a highly skilled Senior Machine Learning Platform Engineer to join our team and help shape the future of our company.Key Responsibilities:Design and develop the infrastructure...


  • Shanghai, Shanghai, China NVIDIA Full time

    We are seeking an AI Software Architect Intern, CUDA to join our Compute Developer Technology team. Intelligent machines powered by AI computers that can learn, reason and interact with people are no longer Science Fiction. Today, a self-driving car can meander through a country road at night and find its way. An AI-powered robot can learn motor skills...


  • Shanghai, Shanghai, China NVIDIA Full time

    Deep Learning Performance Architect InternNVIDIA is pushing the boundaries of deep learning performance by developing innovative processor and system architectures. We are seeking a talented deep learning system performance architect to contribute to our AI performance projection and analysis efforts.Key Responsibilities:Analyze state-of-the-art AI models on...


  • Shanghai, Shanghai, China Optiver Full time

    About Us:Optiver is a global market maker with a presence in multiple continents. Founded in 1986, we are a leading liquidity provider with a strong commitment to improving the market through competitive pricing, execution, and risk management.We provide liquidity to financial markets using our own capital, at our own risk, trading a wide range of products....


  • Shanghai, Shanghai, China Mercedes-Benz Full time

    Job Title: Android Software ArchitectJob Summary:We are seeking an experienced Android Software Architect to join our team at Mercedes-Benz Group China Ltd. in Shanghai, CN. As a key member of our Research & Development Software department, you will be responsible for designing and implementing the Android system architecture for our smart cockpit...


  • Shanghai, Shanghai, China SAP Full time

    Job SummaryA talented software developer is needed to join our cloud native development team. As a senior developer, you will be responsible for developing and delivering solution Change and Deployment Management in Cloud ALM.About the RoleYou will work on development topics as a senior developer, focusing on delivering functionality requested by product...


  • Shanghai, Shanghai, China Mercedes-Benz Full time

    Job Title: QNX SW ArchitectMercedes-Benz Group China Ltd. is seeking a highly skilled QNX SW Architect to join our team in Beijing.Job Summary:We are looking for a talented software architect with expertise in QNX and Linux to design and develop platform software for our vehicle products. The ideal candidate will have a strong understanding of ARM and SOC...


  • Shanghai, Shanghai, China NVIDIA Full time

    NVIDIA is seeking a highly skilled deep learning system performance architect to join our AI performance projection and analysis efforts. As a key member of our team, you will have the opportunity to work on performance projection, analysis, and optimization on state-of-the-art hardware architectures for various AI workloads.Key Responsibilities:Analyze and...