Scalability & Efficiency in ML Inference Systems

...
Tunç Gültekin
Machine Learning Chapter Lead

Mar 2024

Scalability and efficiency present considerable challenges in the field of ML model serving systems, particularly when operating and serving a multitude of AI models concurrently. These aspects are vital for our operation, as a customer support automation platform, we maintain thousands of AI models. In this post, we will discuss our approach to handling these tasks within our inference system.

Read More

Schema Evolution at Ultimate

...
Yonatan Wilkof
Staff Engineer & Senior Squad Lead

Feb 2024

Achieving a robust event-driven architecture is no easy feat, therefore it's imperative to keep your data model up to date, concise as well as backwards/forward compatible. This is our story of how we evolve our event schemas.

Read More

Open Sourcing our Skill and Competency Matrix

...
Franziska Hempel
Director of Product Engineering

Feb 2024

We're excited to open source our skill and competency matrix for others to use. In this post we share the challenges we faced with earlier iterations, such as integrating our company values and adapting the matrices to evolving roles, which led us to creating a modular system that caters to diverse roles and career paths while aligning seniority expectations across the RnD department.

Read More

What we learned building our Ultimate developer portal

...
Damian Bojar
Backend Chapter Lead

Jan 2024

Have you ever looked into tools for public APIs documentation? Noticed any patterns? We have, and would love to tell you all about it. This is our story of searching for good tooling around public APIs documentation, and deciding to write it ourselves.

Read More