Tag:
engineering
(42)Product Evals in Three Simple Steps
Label some data, align LLM-evaluators, and run the eval harness with each change.
23 Nov 2025 Ā· 9 min Ā· eval engineering production
Advice for New Principal Tech ICs (i.e., Notes to Myself)
Based on what I've learned from role models and mentors in Amazon
19 Oct 2025 Ā· 14 min Ā· leadership engineering career š©·
AI Engineer 2025 - Improving RecSys & Search with LLM techniques
Recsys & search are converging with LLMs via semantic IDs, data augmentation, and unified foundation models.
04 Jun 2025 Ā· 1 min Ā· recsys llm engineering production
An LLM-as-Judge Won't Save The ProductāFixing Your Process Will
Applying the scientific method, building via eval-driven development, and monitoring AI output.
20 Apr 2025 Ā· 5 min Ā· eval llm engineering
NVIDIA GTC 2025 - Building LLM-Powered Applications
Chip Huyen and I share what we've learned, best practices, and insights at NVIDIA GTC 2025.
18 Mar 2025 Ā· 1 min Ā· llm engineering production
My Minimal MacBook Pro Setup Guide
Setting up my new MacBook Pro from scratch
17 Nov 2024 Ā· 5 min Ā· engineering misc
39 Lessons on Building ML Systems, Scaling, Execution, and More
ML systems, production & scaling, execution & collaboration, building for users, conference etiquette.
03 Nov 2024 Ā· 10 min Ā· machinelearning engineering production leadership
Building the Same App Using Various Web Frameworks
FastAPI, FastHTML, Next.js, SvelteKit, and thoughts on how coding assistants influence builders' choices.
08 Sep 2024 Ā· 8 min Ā· learning engineering python š
AI Engineer 2024 Keynote - What We Learned from a Year of LLMs
Special double-feature closing keynote from the 6 authors of the hit O'Reilly article on Applied LLMs.
27 Jun 2024 Ā· 2 min Ā· llm ai engineering production
Netflix PRS 2024 - Applying LLMs to Recommendation Experiences
Challenges and lessons from deploying LLM experiences: evals, scalability, guardrails.
31 May 2024 Ā· 2 min Ā· llm engineering production leadership
What We've Learned From A Year of Building with LLMs
From the tactical nuts & bolts to the operational day-to-day to the long-term business strategy.
12 May 2024 Ā· 1 min Ā· llm engineering production leadership š„
Don't Mock Machine Learning Models In Unit Tests
How unit testing machine learning code differs from typical software practices
25 Feb 2024 Ā· 6 min Ā· machinelearning engineering python
AI Engineer 2023 Keynote - Building Blocks for LLM Systems
Evals, retrieval-augmented generation, guardrails, and collecting feedback; all that good stuff.
09 Oct 2023 Ā· 17 min Ā· llm ai engineering production
Patterns for Building LLM-based Systems & Products
Evals, RAG, fine-tuning, caching, guardrails, defensive UX, and collecting user feedback.
30 Jul 2023 Ā· 66 min Ā· llm engineering production š„
Obsidian-Copilot: An Assistant for Writing & Reflecting
Writing drafts via retrieval-augmented generation. Also reflecting on the week's journal entries.
11 Jun 2023 Ā· 6 min Ā· llm engineering š
More Design Patterns For Machine Learning Systems
9 patterns including HITL, hard mining, reframing, cascade, data flywheel, business rules layer, and more.
23 Apr 2023 Ā· 20 min Ā· machinelearning engineering production recsys
RecSys 2022: Recap, Favorite Papers, and Lessons
My three favorite papers, 17 paper summaries, and ML and non-ML lessons.
02 Oct 2022 Ā· 14 min Ā· recsys engineering production
RecSys 2022 Keynote - Is the Juice Worth the Squeeze?
Invited keynote at the Workshop for Online Recommender Systems and User Modeling (ORSUM)
23 Sep 2022 Ā· 2 min Ā· recsys engineering production
Writing Robust Tests for Data & Machine Learning Pipelines
Or why I should write fewer integration tests.
04 Sep 2022 Ā· 19 min Ā· engineering machinelearning production š©·
Simplicity is An Advantage but Sadly Complexity Sells Better
Pushing back on the cult of complexity.
14 Aug 2022 Ā· 10 min Ā· machinelearning engineering production š„
Uncommon Uses of Python in Commonly Used Libraries
Some off-the-beaten uses of Python learned from reading libraries.
31 Jul 2022 Ā· 10 min Ā· python engineering š„
Design Patterns in Machine Learning Code and Systems
Understanding and spotting patterns to use code and components as intended.
12 Jun 2022 Ā· 13 min Ā· machinelearning engineering python š„
Traversing High-Level Intent and Low-Level Requirements
How they differ and why they work better in different situations.
20 Mar 2022 Ā· 7 min Ā· engineering productivity misc
Data Science Project Quick-Start
Hard-won lessons on how to start data science projects effectively.
06 Mar 2022 Ā· 7 min Ā· datascience engineering productivity
System Design for Recommendations and Search
Breaking it into offline vs. online environments, and candidate retrieval vs. ranking steps.
27 Jun 2021 Ā· 13 min Ā· teardown production engineering recsys š„
How to Write Design Docs for Machine Learning Systems
Pointers to think through your methodology and implementation, and the review process.
07 Mar 2021 Ā· 15 min Ā· writing machinelearning engineering
How to Write Better with The Why, What, How Framework
Three documents I write (one-pager, design doc, after-action review) and how I structure them.
28 Feb 2021 Ā· 10 min Ā· writing engineering productivity š©· š„
Feature Stores: A Hierarchy of Needs
Access, serving, integrity, convenience, autopilot; use what you need.
21 Feb 2021 Ā· 19 min Ā· teardown machinelearning engineering š„
How to Win a Data Hackathon (Hacklytics 2021)
What the top teams did to win the 36-hour data hackathon. No, not machine learning.
14 Feb 2021 Ā· 6 min Ā· datascience engineering misc
Applied / Research Scientist, ML Engineer: Whatās the Difference?
A personal take on their deliverables and skills, and what it means for the industry and your team.
08 Nov 2020 Ā· 11 min Ā· datascience machinelearning engineering career
Data Discovery Platforms and Their Open Source Solutions
What questions do they answer? How do they compare? What open-source solutions are available?
25 Oct 2020 Ā· 16 min Ā· teardown datascience engineering
How to Test Machine Learning Code and Systems
Checking for correct implementation, expected learned behaviour, and satisfactory performance.
06 Sep 2020 Ā· 14 min Ā· machinelearning engineering python
Adding a Checkbox & Download Button to a FastAPI-HTML app
Updating our FastAPI app to let users select options and download results.
05 Aug 2020 Ā· 3 min Ā· engineering python til
How to Set Up a HTML App with FastAPI, Jinja, Forms & Templates
I couldn't find any guides on serving HTML with FastAPI, thus I wrote this to plug the hole on the internet.
23 Jul 2020 Ā· 3 min Ā· engineering python til
How to Update a GitHub Profile README Automatically
I wanted to add my recent writing to my GitHub Profile README but was too lazy to do manual updates.
11 Jul 2020 Ā· 3 min Ā· engineering python til
How to Set Up a Python Project For Automation and Collaboration
After this article, we'll have a workflow of tests and checks that run automatically with each git push.
21 Jun 2020 Ā· 20 min Ā· engineering production python productivity
Why Are My Airflow Jobs Running āOne Day Lateā?
A curious discussion made me realize my expert blind spot. And no, Airflow is not late.
17 Jun 2020 Ā· 3 min Ā· engineering production til
A Practical Guide to Maintaining Machine Learning in Production
Can maintaining machine learning in production be easier? I go through some practical tips.
25 May 2020 Ā· 16 min Ā· machinelearning engineering production
6 Little-Known Challenges After Deploying Machine Learning
I thought deploying machine learning was hard. Then I had to maintain multiple systems in prod.
18 May 2020 Ā· 14 min Ā· machinelearning engineering production
OMSCS CS6200 (Introduction to OS) Review and Tips
OMSCS CS6200 (Introduction to OS) - Moving data from one process to another, multi-threaded.
15 Dec 2019 Ā· 7 min Ā· omscs learning engineering
OLX Prod Tech 2019 Keynote - Asia's Tech Giants & SuperApps
Keynote on how Asia's tech giants scale and their SuperApp strategy.
03 Oct 2019 Ā· 3 min Ā· machinelearning engineering leadership
OMSCS CS6300 (Software Development Process) Review and Tips
OMSCS CS6300 (Software Development Process) - Java and collaboratively developing an Android app.
13 Aug 2017 Ā· 5 min Ā· omscs learning engineering
Join 11,800+ readers getting updates on machine learning, RecSys, LLMs, and engineering.