#🔥
21 posts · more than 50k reads
- Improving Recommendation Systems & Search in the Age of LLMs
Model architectures, data generation, training paradigms, and unified frameworks inspired by LLMs.
- Evaluating the Effectiveness of LLM-Evaluators (aka LLM-as-Judge)
Use cases, techniques, alignment, finetuning, and critiques against LLM-evaluators.
- How to Interview and Hire ML/AI Engineers
What to interview for, how to structure the phone screen, interview loop, and debrief, and a few tips.
- Prompting Fundamentals and How to Apply them Effectively
Structured input/output, prefilling, n-shots prompting, chain-of-thought, reducing hallucinations, etc.
- What We've Learned From A Year of Building with LLMs
From the tactical nuts & bolts to the operational day-to-day to the long-term business strategy.
- Patterns for Building LLM-based Systems & Products
Evals, RAG, fine-tuning, caching, guardrails, defensive UX, and collecting user feedback.
- Experimenting with LLMs to Research, Reflect, and Plan
Also, shortcomings in document retrieval and how to overcome them with search & recsys techniques.
- Simplicity is An Advantage but Sadly Complexity Sells Better
Pushing back on the cult of complexity.
- Uncommon Uses of Python in Commonly Used Libraries
Some off-the-beaten uses of Python learned from reading libraries.
- Design Patterns in Machine Learning Code and Systems
Understanding and spotting patterns to use code and components as intended.
- The First Rule of Machine Learning: Start without Machine Learning
Why this is the first rule, some baseline heuristics, and when to move on to machine learning.
- System Design for Recommendations and Search
Breaking it into offline vs. online environments, and candidate retrieval vs. ranking steps.
- Search: Query Matching via Lexical, Graph, and Embedding Methods
An overview and comparison of the various approaches, with examples from industry search systems.
- How to Write Better with The Why, What, How Framework
Three documents I write (one-pager, design doc, after-action review) and how I structure them.
- Feature Stores: A Hierarchy of Needs
Access, serving, integrity, convenience, autopilot; use what you need.
- Real-time Machine Learning For Recommendations
Why real-time? How have China & US companies built them? How to design & build an MVP?
- Unpopular Opinion: Data Scientists Should be More End-to-End
Why (and why not) be more end-to-end, how to, and Stitch Fix and Netflix's experience
- Georgia Tech's OMSCS FAQ (based on my experience)
Why OMSCS? How can I get accepted? How much time needed? Did it help your career? And more...
- Stop Taking Regular Notes; Use a Zettelkasten Instead
Using a Zettelkasten helps you make connections between notes, improving learning and memory.
- My Journey from Psych Grad to Leading Data Science at Lazada
How hard work, many failures, and a bit of luck got me into the field and up the ladder.
- Data Science and Agile (What Works, and What Doesn't)
A deeper look into the strengths and weaknesses of Agile in Data Science projects (Part 1 of 2).