Software Engineer

Are you an experienced backend engineer with a passion for building large scale distributed systems to enable more innovations on the search, recommendation, and AI services and products. Are you passionate about working on drive and deliver the cutting-edge techniques such as LLM, AIGC by collaborating with AI data scientists? Bing IndexServe platform team have a Senior Software Engineer position to meet your technical expertise. 

Bing Fundamentals team focuses on providing a search and recommendation platform for Microsoft internal partners using the documentation recall and reranking backend service suite. As a team, we manage one of the world's largest distributed systems and have experienced great success in building efficient large scale distributed systems for search. Bing Fundamentals has a per decade rare opportunity to simplify the serving stack, to serve the biggest index with the most efficient way, and to drive up the relevance innovations with advanced deep learning and large language model techniques. The agility of engineering and deployment also presents as a big challenge when handling such a complex system. As Bing embraces the latest LLM innovations, the need for a platform to build up AI intelligence is becoming bigger. 

Within Bing Fundamentals, we are the IndexServe reranking platform team and we have the exciting responsibility of trying to tackle these challenges. As a team, we are trying to build the most agile, performant, stable, experientable yet efficient index serving platform. On this platform, relevance techniques can be quickly implemented, iterated, qualified and flighted to evaluate their customer impacts with convenient while full-funnel debuggability. The same platform also provides all the cutting edged techniques and utilities, like deep learning, machine learning, LLM, JavaScript, C# rankers. It has the most advanced AI toolset for our scientists to innovate, and for our products to serve most relevant documents.

• Conduct timely code reviews to ensure standards, security, test coverage, and maintainability; provide feedback and coaching to improve team skills while leveraging automated tools and best practices.
• Design clear test strategies and architecture proposals that ensure scalability, performance, resiliency, and compliance; collaborate across teams to manage dependencies and validate security.
• Drive engineering excellence through automation, secure design principles, compliance processes, and continuous learning; apply best practices for coding, testing, and deployment.
• Plan and implement secure, efficient deployments with rollback strategies; monitor dependencies, follow safe change practices, and ensure disaster recovery readiness.
• Ensure reliability and supportability by integrating telemetry, responding to live-site issues, reducing incidents, and incorporating customer insights into future designs and solutions. 

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• 5+ years industrial experiences on an Object-Oriented Language, such as C++, C#, or Java
  

Additional or preferred qualifications:

• Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• Experience on high-performance computing (e.g., cache/memory optimization, high-performance GPU programming, compiler-based optimization, fine-grained parallel library, and runtime) or distributed systems (e.g., communication optimization, network architecture design, network programming) is a plus.
• Capable of quantitatively implementing and qualifying a solution in a distributed environment with DevOps model
• Experiences on building Machine Learning/Deep Learning systems is a plus.
• Experience on performance analysis and optimization for both CPUs and GPUs, as well as good understanding on software-hardware codesign, is a plus.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.