cache

工作职责1、深度参与或主导CPU/GPU/AI处理器中缓存子系统的架构方案制定和评估； 2、负责缓存层次结构、容量、关联度、替换策略、预取算法等关键微架构设计； 3、设计并优化缓存一致性协议（如MESI、MOESI及其变种）在复杂多核/众核系统中的实现； 4、定义缓存与内存控...

工作职责1. 负责大模型推理场景下KV Cache系统的整体架构设计，制定性能优化策略与技术演进路线，对全局缓存命中率与系统吞吐量负责。 2. 负责KV Cache在HBM-DRAM-SSD多级存储间的全局调度架构设计与性能建模，指导团队完成核心模块的落地与持续优化。 3. 研究并实现 Prefix...

About the role We are looking for an LLM KV Cache Systems Engineer to design and build KV Cache subsystems for large-language-model inference. You will work on memory allocation, lifecycle management, reuse, compression, transfer, tiering, and KV-aware scheduling across single-node and distributed serving systems. This is a systems role. Direct source-level...

We’re looking for a Senior Backend JavaScript Developer to join our Web_archive team and help build and evolve a high-throughput data processing platform.You will own distributed data pipelines and backend services end-to-end—from technical design and implementation to production operation and continuous improvement. This role requires strong Node.js...

该职位来源于猎聘 岗位职责： 1. 设计和搭建基于自研芯片的大模型推理集群系统； 2. 研究并优化大模型推理核心技术，如 PD 分离部署、KV Cache 管理、动态调度策略等； 3. 结合芯片架构特点，制定高效的推理执行方案； 4....

工作职责1. 推理全链路架构规划：负责大模型推理引擎的整体架构设计及开发，制定技术路线图，支撑千卡/万卡级AI算力集群。 2. 推理引擎构建：负责推理引擎架构演进，深入研究Continuous...

工作职责1.负责GPGPU SM memory子系统架构。包含LSU，L1 Dcache， Shared memory等模块的架构和设计工作。任职要求1. 熟悉GPGPU SM微架构 2. 做过GPGPU的memory子系统的开发和设计工作 3. 开发设计过L1D cache模块 3. 深刻理解memory model 4. 能够根据产品特性优化PPA

NVIDIA is leading company of AI computing. At NVIDIA, our employees are passionate about AI, HPC , VISUAL, GAMING. Our SA team is more focusing to bring NVIDIA new technology into difference industries. We help to design the architecture of AI computing platform, analysis the AI and HPC applications to deliver our value to customers, focusing on defining and...

Job Details:Job Description: The Role and Impact：As a Software Engineer on Intel’s Artificial Intelligence Frameworks team, you will contribute to designing, developing, and optimizing distributed inference systems for large language models.Your day-to-day work will involve implementing distributed inference algorithms, optimizing model execution and...

工作职责1、负责多模态大模型、生成模型、文字提取等推理系统建设与性能优化。​ 2、深入优化TensorRT/vLLM /TGI/FlashAttention，开展量化、KV...

该职位来源于猎聘 【职位描述】 训练方向： 负责分布式训练框架的设计与优化，支撑医学大模型（LLM及多模态）的预训练、SFT微调、Post-Training（RLHF/GRPO/PPO等强化学习对齐）全流程训练任务。...

DescriptionPLAY, GROW and WIN To be a part of Virtuos means to be a creator.   At Virtuos, we harness the latest technologies to make games better and more immersive than ever before. That is why we pride ourselves in constantly pushing the boundaries of possibility since our founding in 2004.  Virtuosi is a team of experts – people who have come...

Some careers have more impact than others. If you’re looking for a career where you can make a real impression, join HSBC and discover how valued you’ll be. We are currently seeking an experienced professional to join our team in the role of Senior Consultant Specialist (Model Hosting/Inference Optimization). Business: CTO Platforms (AI...

该职位来源于猎聘 职责描述： 任职要求： 1) 有设计过GPGPU芯片架构的经验 2) 熟悉计算机指令集设计，熟悉CPU、GPU的 SIMT、SIMD、MIMD体系结构 3) 熟悉GPU存储架构设计，包括cache、 scratchpad、shared memory,HBM等 有软硬件系统联合设计和优化经验 5)...

We are looking for a GPU C++ Modeling Engineer intern – Performance/Functional Modeling, Validation and Analysis of Shader. TPC arch team is a fast-growing team which welcomes all level engineers to join. Our aim is to explore and design better architecture of GPU which will help AI program run efficiently and rendering in games become faster and more...

Job Requisition ID JR2024486 Job Category Univ Employment Time Type Full time We are looking for a GPU C++ Modeling Engineer intern – Performance/Functional Modeling, Validation and Analysis of Shader. TPC arch team is a fast-growing team which welcomes all level engineers to join. Our aim is to explore and design better architecture of GPU which will...

工作职责岗位职责 1、负责AI模型量化压缩工具链开发，开展模型量化压缩算法优化、精度损失分析及调优工作，保障模型推理精度与性能平衡。 2、针对地平线BPU芯片，完成LLM、VLM、端到端自动驾驶、VLA等模型的量化压缩适配，负责对应模块需求设计、开发实现、问题定位...

Some careers have more impact than others. If you’re looking for a career where you can make a real impression, join HSBC and discover how valued you’ll be. We are currently seeking an experienced professional to join our team in the role of Senior Consultant Specialist.   Business: Asia & Middle East Technology Job ID: 52390   Principal...

该职位来源于猎聘 Responsibilities 1) Design and implement MLOPS, i.e. set of tools and operating models used to deploy & maintain & monitor machine learning models in production reliably and efficiently 2) Support ML solutions go-live integration. 3) Act as a bridge between data scientists and IT & data engineers & data architects, especially during...

Job Responsibilities: Develop the core functions of the internet financial platform and build the technology infrastructure supporting digital asset trading. Implement RESTful and WebSocket API interfaces to enable customers to receive market data and execute orders. Establish a robust, efficient, and concurrent trading system to...