AI/LLM Engineer

2 days ago

Beijing, Beijing, China 大华会计师事务所(特殊普通合伙) Full time CN¥200,000 - CN¥4,000,000 per year

该职位来源于猎聘 Description

The LLM Framework Engineer designs, develops, and deploys scalable AI/ML and GenAI solutions focused on Large Language Models (LLMs). This hands-on role builds robust frameworks for model development and evaluation, leveraging tools like Langflow for agentic and RAG applications, and Datadog for LLM observability. The engineer collaborates with business partners, data scientists, and product teams to deliver innovative, reliable, and compliant AI solutions that drive business value

Expectations

Model Development & Delivery

  • Lead the design, implementation, and deployment of LLM-powered applications, taking models from concept to production.
  • Build and maintain frameworks for prompt engineering, model evaluation, and workflow orchestration (e.g., Langflow, LangChain).
  • Ensure rigorous testing, validation, and quality control of generative AI models, using tools such as

DeepEval.

Observability & Monitoring

  • Integrate Datadog LLM Observability to monitor, troubleshoot, and optimize LLM application performance, cost, and reliability.
  • Instrument applications for end-to-end tracing, token usage, latency, error detection, and operational metrics.
  • Build dashboards and alerts for model drift, performance anomalies, and GenAI metrics.

Research & Continuous Improvement

  • Stay current with generative AI techniques, frameworks, and open-source libraries (e.g., Hugging Face, TensorFlow, PyTorch).
  • Lead and participate in research activities to advance LLM capabilities and best practices.

Collaboration & Stakeholder Engagement

  • Work closely with cross-functional teams to integrate LLM technologies into products and services.
  • Engage business stakeholders to identify opportunities for innovation and value creation.

Engineering Excellence

  • Drive adoption of Agile, DevOps, and CI/CD practices for reliable, scalable delivery.
  • Advocate for automated testing, infrastructure as code, and continuous monitoring.
  • Conduct code reviews and enforce secure coding practices.

Skills Set

Technical Skills

  • Strong hands-on experience in machine learning and GenAI, delivering complex solutions to production.
  • Deep expertise in LLM frameworks and orchestration tools: Langflow, LangChain, MLFlow, DeepEval.
  • Experience with Datadog LLM Observability for monitoring, tracing, and evaluating LLM applications.
  • Proficiency in Python software development, following object-oriented design patterns and best practices.
  • Experience with deep learning frameworks: TensorFlow, PyTorch.
  • Familiarity with Hugging Face Transformers, Spacy, Pandas, and other open-source libraries.
  • Experience with Docker, Kubernetes, and cloud platforms (AWS, Azure, GCP).
  • Knowledge of Postgres, VectorDBs, and scalable data architectures.
  • Experience with evaluation and scoring frameworks (MLFlow, DeepEval).
  • Strong understanding of MLOps, CI/CD, and infrastructure as code.

Observability & Monitoring

  • Hands-on experience instrumenting LLM applications for observability using Datadog, Langflow, and related tools.
  • Ability to build and maintain dashboards, alerts, and metrics for model performance and reliability.

Collaboration & Communication

  • Excellent problem-solving skills and creative thinking.
  • Strong communication and collaboration abilities, working effectively with cross-functional teams.

  • Partner Engineer IV, Voice AI

    6 days ago

    Beijing, Beijing, China SoundHound AI Full time CN¥150,000 - CN¥250,000 per year

    Your Career, our Future—Together.Ready to join something big? At SoundHound AI, we bring voice, generative, and conversational AI together to transform how people interact with products and services. From voice-enabled vehicles to food ordering and customer support, our multilingual, omnichannel technology already impacts hundreds of millions worldwide.The...

  • Senior Applied Scientist(LLM)

    4 days ago

    Beijing, Beijing, China Microsoft Full time CN¥600,000 - CN¥1,200,000 per year

    Microsoft is innovating rapidly in advertising to grow its share of global markets by providing the advertising industry with the state-of-the-art online platform and service. Our team is at the forefront of innovations by harnessing the power of generative AI and LLM-driven agents. We focus on building powerful models, intelligent agents, and scalable...

  • Partner Engineer, Voice AI

    6 days ago

    Beijing, Beijing, China SoundHound AI Full time CN¥120,000 - CN¥240,000 per year

    The Opportunity The Partner Engineer, Voice AI, serves as a trusted advisor to external partners, independently managing mid-scale integration projects. Provides technical leadership and begins influencing internal product direction.What You'll DoOwn medium-complexity partner integrations end-to-endAdvise partners on technical architecture and solution...

  • AI Engineer

    6 days ago

    Beijing, Beijing, China Trexquant Investment LP Full time CN¥150,000 - CN¥200,000 per year

    We are seeking an AI Engineer to join our team. The successful candidate will play a critical role in developing, optimizing, and deploying advanced AI workflows and tools. The role offers a unique opportunity to work on cutting-edge technologies that directly impact our investment strategies.Design and implement systems incorporating large language models...

  • Director of AI Cluster Operation and Maintenance

    6 days ago

    Beijing, Beijing, China PaleBlueDot AI Full time CN¥200,000 - CN¥250,000 per year

    Location:Remote, with willingness to travel overseasCore ResponsibilitiesStrategic Design & Architecture PlanningLead the end-to-end architecture design of overseas AI compute clusters, covering compute, network, storage, and liquid-cooling systems.Deeply understand clients' AI workload requirements and translate them into advanced, reliable, and scalable...

  • AI agent Software engineer

    4 days ago

    Beijing, Beijing, China forestown Full time CN¥1,500,000 - CN¥2,000,000 per year

    Job ResponsibilitiesBe responsible for exploring GenAI application scenarios in the cross-border e-commerce field, designing and implementing GenAI applicationsParticipate in formulating the company's GenAI application technology route and provide support for the company's technology strategyTrack the latest technological developments in the GenAI and LLM...

  • AI software engineer intern

    6 days ago

    Beijing, Beijing, China Intel Corporation Full time CN¥90,000 - CN¥120,000 per year

    Job DetailsJob Description:Artificial Intelligence (AI) is changing our lives and is present everywhere. Intel provides whole software/hardware AI solutions to seamlessly integrate into customers' business.We are looking for a passionate Graduate Technical Intern who will help us to work on AI/LLM based solution for automatical code development and bug...

  • AI Research Intern

    4 days ago

    Beijing, Beijing, China Intel Corporation Full time CN¥40,000 - CN¥80,000 per year

    Job DetailsJob Description:This intern is expected to do first-tier AI research at Intel Labs China, under the careful guidance of leading researchers in the AI community. Specifically, the intern will focus on efficient algorithm designs for LLM-based agent design and reranking towards text/image/video retrieval applications, especially on...

  • Technical Program Manager, Automotive+

    6 days ago

    Beijing, Beijing, China SoundHound AI Full time CN¥1,200,000 - CN¥2,400,000 per year

    Your Career, our Future—Together.Ready to join something big? At SoundHound AI, we bring voice, generative, and conversational AI together to transform how people interact with products and services. From voice-enabled vehicles to food ordering and customer support, our multilingual, omnichannel technology already impacts hundreds of millions...

  • AI Model Training Development Engineer

    20 minutes ago

    Beijing, Beijing, China AMD Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHINGAt AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create...