Key themes in my work

New here? These are topics I write & speak about. Alternatively, browse tags or search.

Machine Learning Systems in Industry

Exploring ML systems in industry and how they're implemented.

• System Design for RecSys & Search: Offline vs. online, retrieval vs. ranking.
• Real-time Retrieval: Examples from various companies and how to build an MVP.
• Search Query Matching: Via lexical, graph, and representation learning methods.
• Patterns for Personalization: Via bandits, sequences, graphs, and user embeddings.
• Bandits for RecSys: Industry examples, warm-start, off-policy evaluation.
• Reinforcement Learning for Recsys: Long-term rewards and explore-exploit.
• Content Moderation: Collecting labels, data augmentation, cascade pattern, etc.
• Bootstrapping Data Labels: With semi, active, and weakly supervised learning.
• Data Discovery Platforms: How they help with find data and open source options.
• Feature Stores: As a hierarchy of needs (e.g., access, serving, integrity, etc.)

Machine Learning Techniques

Surveys on machine learning methods.

• Counterfactual Evaluation & Inverse Propensity Scoring: How to run A/B tests offline.
• Measuring and Mitigating Position Bias: Accounting for bias in ordered results.
• Measuring Serendipity in Recommendations: Diversity, novelty, unexpectedness, etc.
• A Brief Survey of NLP: From RNN to Word2Vec to Transformer to BERT to T5.
• Text-to-Image: Diffusion, text conditioning, classifier guidance, and latent space.

Machine Learning & Engineering

Practices at the intersection of ML and engineering.

• Challenges with ML in Production and A Practical Guide to Overcome them.
• Design Patterns: Patterns in ML code & systems such as factory, decorator, proxy, etc.
• Python Patterns: Lesser seen patterns such as mixins, relative imports, etc.
• ML Testing: Implementation, expected learned behavior, and evaluation metrics.
• Pipeline Testing: Managing brittle tests in data & machine learning pipelines.
• Python Project Setup: With a workflow of checks that run with each  git push.

Mechanisms for Business, Product, and Tech Teams

Processes and tools for effective projects and teams.

• Mechanisms for ML Projects: Pilot & copilot, literature reviews, and more.
• Mechanisms for technical teams: Weekly debriefs, learning sessions, WBRs, etc.
• The First Rule of Machine Learning: Start without machine learning.
• Weekly 15-5s: Increase visibility and earn trust with this 15-minute habit.
• Scrum for Data Science: Parts of Scrum that fit the data science process well.
• Agile & Data Science: What works and what doesn’t and tweaks to make it work
• What I Do Before, During, and After a data science project for team productivity.

Learning & Career

Practices that worked well for me and general advice.

• Onboarding Effectively: Mindset, 100-day plan, and balancing learning and doing.
• Data Science Red Flags: What to look out for when interviewing with a new team.
• Read Papers: How it helps you be a better data scientist and my approach.
• Influencing without Authority: Socratic method, earning trust, finding advocates, etc.
• Comparing Data/ML Roles: Data/Applied/Research scientist, and ML engineer.
• Georgia Tech OMSCS FAQ: A guide to applying for and completing OMSCS.

Writing Tips

Especially in the context of a career in tech and data.

• Writing Lessons You Don’t Learn at School: And my writing syllabus.
• Writing Online for Non-Writers: First, write for yourself. And other advice.
• Writing Advice from the Pros: Lessons from David Perell and Sahil Lavingia
• Writing for Tech Careers: Why write, my writing process, and writing at work.
• Why, What, How: A simple framework to make your writing more effective.
• Design Docs for ML Systems: Applying Why-What-How to ML design docs.

Ideas & Opinions

Random ideas and unnecessarily strong opinions.

• The 85% Rule: When pushing harder != better outcomes.
• Beginner’s Mind: A mindset for continued learning and growth.
• In Defence of Simplicity: Pushing back on the cult of complexity.
• End-to-End Data Science: Why it works and examples from Stitchfix and Netflix.
• Machine Learning & Life Lessons: Seven things ML taught me about life.
• My Seven Habits: The seven habits that improved my last decade.

Best Talks I’ve Given

Talks that've received the most positive feedback and engagement.

• RecSys 2022 Keynote: Is the juice worth the squeeze, for real-time recommendations?
• System Design for RecSys & Search: Candidate retrieval and ranking in industry.
• The Importance of Writing in Tech: Why and how I write, and writing at Amazon.

Summaries & Notes

Summaries and permanent notes, tidied up for public consumption.

• Uncommon Uses of Python: A few things from the most popular python libraries.
• RecSys 2022: 3 fav papers, 17 summaries, and many lessons.
• RecSys 2021: Simple models, tech stacks, and ops practices.
• RecSys 2020: Bias, sequential models, bandits, robust offline evaluation.
• Spark+AI Summit 2020: Application-agnostic and application specific talks.

Other resources

That are mostly scattered across the internet.

• applied-ml: Papers and tech blogs on real-world machine learning in industry.
• ml-surveys: Papers summarizing machine learning advances.
• applyingml: Papers, guides, and interviews on how to apply ML effectively.
• ml-design-docs: Template of design docs for machine learning systems.
• testing-ml: Examples of implementation & behavioral tests for ML code.
• python-collab-template: Template with tests, type checks, linting, etc.
• papermill-mlflow: Experimentation workflow for machine learning.
• 1-on-1s: Questions to ask during 1-on-1s, from my time as a manager.