System Architecture

Flyte is an open source orchestration tool for managing the workflow of machine learning and AI projects. It runs on top of Kubernetes.

A bottom-up, animated guide to HTTP load balancing algorithms.

It is thankfully common wisdom nowadays that documentation must be placed as near as possible to the code it documents, and should be fine-grained to a minimal unit of describability (the thing being documented). The practice provides numerous benefits to the codebase and project as a whole:

The motivations behind building IdempotencyPlug

Google's exprierimental Workload Security Rings classifies the workloads by security requirements and then isolates and enforces each class at the machine boundary.

The kernel's handling of concurrency has changed a lot over the years. In 2023, a kernel developer's toolkit includes tools like completions, highly optimized mutexes, and a variety of lockless algorithms. But, once upon a time, concurrency control came down to the use of simple semaphores; a discussion on a small change to the semaphore API shows just how much the role of semaphores has changed over the course of the kernel's history.

Once you have identified wasteful processes in your organization, how should you go about addressing and reducing this toil for the team?

Since the beginning, GitHub.com has been a Ruby on Rails monolith. Today, the application is nearly two million lines of code and more than 1,000 engineers collaborate on it daily. We deploy as often as 20 times a day, and nearly every week one of those deploys is a Rails upgrade. Upgrading Rails weekly Every […]

A metaphor involving parking meters. Over the years, parking meters in town have evolved into a cumbersome, awkward system. Coins are heavy and you need to have them handy, meters need to be reinfo…

John Maeda says there is a shift in programming from syntax to semantics, due to AI. We talk to him about Microsoft's new Semantic Kernel SDK.

Trillian is an open and crowdsourced knowledge graph backed by a vector store. Its simple API allows anyone to add and search for related concepts.

It was only a matter of time, perhaps, but the skyrocketing costs of designing chips is colliding with the ever-increasing need for performance,

Designing a snapshot coordination system

Railway promises to simplify infrastructure for frontend and web developers. The company recently rewrote its command line interface in Rust.

Kubernetes community can greatly benefit from internal developer platforms to simplify its adoption and day-to-day usage.

The low latency, high throughput and storage needs of the cloud native era require new thinking. Redpanda can help improve performance and keep costs low as it scales.

Could data structures represent the fourth data type in addition to the current block, object and file storage?

We recently led a $2M seed round in ENS Vision.

By creating fully qualified authorization contexts from minimal requests, a policy information point reduces the burden on developers building or integrating policy enforcement points, allows for more flexible and reusable policies, and enriches authorization contexts to allow more precise access decisions.

Can the Small Web be as easy (or easier) to use than the Big Web? (Spoiler: Yes.)

Dr. H. Rusty Harris, associate professor in the Department of Electrical and Computer Engineering at Texas A&M University, has identified a new circuit element known as a meminductor.

Tailscale Funnel lets you share a local service with the internet. Today Xe covers how you can use this productively by sharing the development copy of an application to the world.

We’re a tiny and independent two-person not-for-profit based in Ireland. We’re working on building the Small Web.

Building the Small Web: a public space of individually-owned and controlled places.

Hello! We’re a tiny and independent two-person not-for-profit based in Ireland. We are building the Small Web. No, it’s not web3, it’s web0.

In distributed systems, logical clocks play a key role in the ordering of system events. What are the various logical clock designs, and how do they help with event ordering? This article answers these questions.