Sr Engineer, Server Inference

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities. Join our Inference Server Technologies team, where we develop software that powers state-of-the-art AI inferencing on Tenstorrent’s cutting-edge hardware. Our team builds the layer that works on top of the Tenstorrent ML libraries - designing APIs, deploying workloads, and benchmarking end-to-end inference speed. You’ll help us shape how developers consume and scale model execution on Tenstorrent’s stack. This role is hybrid based in Belgrade, Serbia. We welcome candidates at various experience levels. During the interview process, candidates will be assessed for the appropriate level, and offers will align with that level, which may differ from the one in this posting. Who You Are • An engineer who enjoys designing modern APIs and improving how ML models are deployed in production. • Curious about performance gains through techniques like batching, caching, and model parallelism. • Passionate about clean software architecture and effective abstraction layers. • Motivated to deliver backend systems that developers trust and rely on. What We Need • Backend engineers who enjoy solving performance bottlenecks and scaling infrastructure. • Experience with web technologies, protocols, and system design. • Familiarity with Python, Docker, and Linux-based environments. • Strong coding practices and a clear ability to break down complex problems into high-quality, maintainable code. What You Will Learn • How to optimize end-to-end ML inference on custom silicon. • Strategies for building scalable, reliable software interfaces for real-world AI applications. • How to shape the experience developers have when using Tenstorrent’s hardware for AI workloads. Tenstorrent offers a highly competitive compensation package and benefits, and we are an equal opportunity employer. This offer of employment is contingent upon the applicant being eligible to access U.S. export-controlled technology. Due to U.S. export laws, including those codified in the U.S. Export Administration Regulations (EAR), the Company is required to ensure compliance with these laws when transferring technology to nationals of certain countries (such as EAR Country Groups D:1, E1, and E2). These requirements apply to persons located in the U.S. and all countries outside the U.S. As the position offered will have direct and/or indirect access to information, systems, or technologies subject to these laws, the offer may be contingent upon your citizenship/permanent residency status or ability to obtain prior license approval from the U.S. Commerce Department or applicable federal agency. If employment is not possible due to U.S. export laws, any offer of employment will be rescinded.