Tag:
machinelearning
(55)39 Lessons on Building ML Systems, Scaling, Execution, and More
ML systems, production & scaling, execution & collaboration, building for users, conference etiquette.
03 Nov 2024 Ā· 10 min Ā· machinelearning engineering production leadership
How to Interview and Hire ML/AI Engineers
What to interview for, how to structure the phone screen, interview loop, and debrief, and a few tips.
07 Jul 2024 Ā· 21 min Ā· machinelearning career leadership š„
Don't Mock Machine Learning Models In Unit Tests
How unit testing machine learning code differs from typical software practices
25 Feb 2024 Ā· 6 min Ā· machinelearning engineering python
Push Notifications: What to Push, What Not to Push, and How Often
Sending helpful & engaging pushes, filtering annoying pushes, and finding the frequency sweet spot.
24 Dec 2023 Ā· 18 min Ā· teardown recsys machinelearning production
Out-of-Domain Finetuning to Bootstrap Hallucination Detection
How to use open-source, permissive-use data and collect less labeled samples for our tasks.
05 Nov 2023 Ā· 12 min Ā· llm eval machinelearning python
More Design Patterns For Machine Learning Systems
9 patterns including HITL, hard mining, reframing, cascade, data flywheel, business rules layer, and more.
23 Apr 2023 Ā· 20 min Ā· machinelearning engineering production recsys
How to Write Data Labeling/Annotation Guidelines
Writing good instructions to achieve high precision and throughput.
12 Mar 2023 Ā· 6 min Ā· machinelearning mechanism survey
Content Moderation & Fraud Detection - Patterns in Industry
Collecting ground truth, data augmentation, cascading heuristics and models, and more.
26 Feb 2023 Ā· 16 min Ā· teardown machinelearning production
Mechanisms for Effective Machine Learning Projects
Pilot & copilot, literature review, methodology review, and timeboxing.
22 Jan 2023 Ā· 7 min Ā· mechanism machinelearning productivity
Writing Robust Tests for Data & Machine Learning Pipelines
Or why I should write fewer integration tests.
04 Sep 2022 Ā· 19 min Ā· engineering machinelearning production š©·
Simplicity is An Advantage but Sadly Complexity Sells Better
Pushing back on the cult of complexity.
14 Aug 2022 Ā· 10 min Ā· machinelearning engineering production š„
Design Patterns in Machine Learning Code and Systems
Understanding and spotting patterns to use code and components as intended.
12 Jun 2022 Ā· 13 min Ā· machinelearning engineering python š„
Bandits for Recommender Systems
Industry examples, exploration strategies, warm-starting, off-policy evaluation, and more.
08 May 2022 Ā· 14 min Ā· teardown recsys machinelearning
Counterfactual Evaluation for Recommendation Systems
Thinking about recsys as interventional vs. observational, and inverse propensity scoring.
10 Apr 2022 Ā· 8 min Ā· recsys eval machinelearning
Red Flags to Look Out for When Joining a Data Team
What to consider for in terms of data, roadmap, role, manager, tooling, etc.
13 Feb 2022 Ā· 8 min Ā· datascience machinelearning career
How to Keep Learning about Machine Learning
Beyond getting that starting role, how does one continue growing in the field?
19 Jan 2022 Ā· 6 min Ā· learning career machinelearning
The Data Scientist Show - Building end-to-end ML systems
Daliana and I had a 2hr chat on all things data science and machine learning.
02 Dec 2021 Ā· 1 min Ā· datascience machinelearning career
Informal Mentors Grew into ApplyingML.com!
More than two dozen interviews with ML Practitioners sharing their stories and advice
25 Nov 2021 Ā· 1 min Ā· machinelearning career š
The First Rule of Machine Learning: Start without Machine Learning
Why this is the first rule, some baseline heuristics, and when to move on to machine learning.
19 Sep 2021 Ā· 8 min Ā· machinelearning š„
MLOps Community - System Design for RecSys & Search
An overview of system design, candidate retrieval, and ranking, with industry examples.
15 Sep 2021 Ā· 1 min Ā· recsys machinelearning production
Bootstrapping Labels via ___ Supervision & Human-In-The-Loop
How to generate labels from scratch with semi, active, and weakly supervised learning.
01 Aug 2021 Ā· 12 min Ā· teardown machinelearning
Mailbag: How to Bootstrap Labels for Relevant Docs in Search
Building semantic search; how to calculate recall when relevant documents are unknown.
20 Jul 2021 Ā· 1 min Ā· machinelearning š¬
SF Big Analytics - System Design for RecSys & Search
Why real-time RecSys? What does the system design look like in industry? How to build an MVP?
13 Jul 2021 Ā· 1 min Ā· recsys machinelearning production
Patterns for Personalization in Recommendations and Search
A whirlwind tour of bandits, embedding+MLP, sequences, graph, and user embeddings.
13 Jun 2021 Ā· 25 min Ā· teardown recsys machinelearning deeplearning
The Metagame of Applying Machine Learning
How to go from knowing machine learning to applying it at work to drive impact.
02 May 2021 Ā· 12 min Ā· machinelearning career š©·
Search: Query Matching via Lexical, Graph, and Embedding Methods
An overview and comparison of the various approaches, with examples from industry search systems.
25 Apr 2021 Ā· 21 min Ā· teardown machinelearning production š„
TalkPython - What ML can Teach Us About Life
Mike and I take a philosophical detour on Talk Python and discuss life lessons from machine learning.
26 Mar 2021 Ā· 1 min Ā· machinelearning life
Choosing Problems in Data Science and Machine Learning
Short vs. long-term gain, incremental vs. disruptive innovation, and resume-driven development.
21 Mar 2021 Ā· 12 min Ā· datascience machinelearning leadership
How to Write Design Docs for Machine Learning Systems
Pointers to think through your methodology and implementation, and the review process.
07 Mar 2021 Ā· 15 min Ā· writing machinelearning engineering
Feature Stores: A Hierarchy of Needs
Access, serving, integrity, convenience, autopilot; use what you need.
21 Feb 2021 Ā· 19 min Ā· teardown machinelearning engineering š„
DataTalksClub - Building an ML System; Behind the Scenes
Design and architecture, tech stack, methodology, results, and lessons learned.
07 Feb 2021 Ā· 5 min Ā· machinelearning production
Real-time Machine Learning For Recommendations
Why real-time? How have China & US companies built them? How to design & build an MVP?
10 Jan 2021 Ā· 21 min Ā· teardown machinelearning recsys production š„
What Machine Learning Can Teach Us About Life - 7 Lessons
Data cleaning, transfer learning, overfitting, ensembling, and more.
22 Nov 2020 Ā· 11 min Ā· machinelearning life
Applied / Research Scientist, ML Engineer: Whatās the Difference?
A personal take on their deliverables and skills, and what it means for the industry and your team.
08 Nov 2020 Ā· 11 min Ā· datascience machinelearning engineering career
Chip Huyen on Her Career, Writing, and Machine Learning
Setbacks she faced, overcoming them, and how writing changed her life.
01 Nov 2020 Ā· 11 min Ā· career machinelearning writing
How to Install Google Scalable Nearest Neighbors (ScaNN) on Mac
Step-by-step walkthrough on the environment, compilers, and installation for ScaNN.
14 Oct 2020 Ā· 3 min Ā· python machinelearning til
How to Test Machine Learning Code and Systems
Checking for correct implementation, expected learned behaviour, and satisfactory performance.
06 Sep 2020 Ā· 14 min Ā· machinelearning engineering python
Mailbag: Parsing Fields from PDFsāWhen to Use Machine Learning?
Should I switch from a regex-based to ML-based solution on my application?
04 Sep 2020 Ā· 4 min Ā· machinelearning š¬
Unpopular Opinion: Data Scientists Should be More End-to-End
Why (and why not) be more end-to-end, how to, and Stitch Fix and Netflix's experience
09 Aug 2020 Ā· 17 min Ā· datascience machinelearning leadership š„
My Notes From Spark+AI Summit 2020 (Application-Specific Talks)
Part II of the previous write-up, this time on applications and frameworks of Spark in production
05 Jul 2020 Ā· 15 min Ā· machinelearning deeplearning production survey
My Notes From Spark+AI Summit 2020 (Application-Agnostic Talks)
Sharing my notes & practical knowledge from the conference for people who don't have the time.
28 Jun 2020 Ā· 11 min Ā· machinelearning deeplearning survey
A Practical Guide to Maintaining Machine Learning in Production
Can maintaining machine learning in production be easier? I go through some practical tips.
25 May 2020 Ā· 16 min Ā· machinelearning engineering production
6 Little-Known Challenges After Deploying Machine Learning
I thought deploying machine learning was hard. Then I had to maintain multiple systems in prod.
18 May 2020 Ā· 14 min Ā· machinelearning engineering production
DataScience SG Meetup - RecSys, Beyond the Baseline
Comparing baselines (matrix factorization) against novel approaches using graphs & NLP.
14 Jan 2020 Ā· 2 min Ā· recsys machinelearning
DataScience SG x ODSC Meetup - Applying ML to Healthcare
In-depth sharing on how to put machine learning systems into production.
09 Oct 2019 Ā· 4 min Ā· machinelearning production
OLX Prod Tech 2019 Keynote - Asia's Tech Giants & SuperApps
Keynote on how Asia's tech giants scale and their SuperApp strategy.
03 Oct 2019 Ā· 3 min Ā· machinelearning engineering leadership
OMSCS CS7646 (Machine Learning for Trading) Review and Tips
OMSCS CS7646 (Machine Learning for Trading) - Don't sell your house to trade algorithmically.
11 May 2019 Ā· 9 min Ā· omscs learning machinelearning python
DATAx - A Production ML system for SEA's Biggest Hospital Group
How we built an ML system to predict hospitalization costs at admission; sharing at DATAx Conference.
06 Mar 2019 Ā· 4 min Ā· production machinelearning
OMSCS CS6601 (Artificial Intelligence) Review and Tips
OMSCS CS6601 (Artificial Intelligence) - First, start with the simplest solution, and then add intelligence.
20 Dec 2018 Ā· 8 min Ā· omscs learning machinelearning python
OMSCS CS7641 (Machine Learning) Review and Tips
OMSCS CS7641 (Machine Learning) - Revisiting the fundamentals and learning new techniques.
27 Dec 2017 Ā· 4 min Ā· omscs learning machinelearning python
Product Categorization API Part 3: Creating an API
Or how to put machine learning models into production.
13 Feb 2017 Ā· 8 min Ā· machinelearning production python š
Product Classification API Part 2: Data Preparation
Cleaning up text and messing with ascii (urgh!)
11 Dec 2016 Ā· 8 min Ā· machinelearning python š
Strata x Hadoop 2016 - How Lazada Ranks Products
How Lazada ranks products to improve customer experience and conversion at Strata 2016.
09 Dec 2016 Ā· 1 min Ā· machinelearning lazada production
Product Classification API Part 1: Data Acquisition
Parsing json and formatting product titles and categories.
11 Oct 2016 Ā· 9 min Ā· machinelearning python š
DataScience SG Meetup - How we got top 3% in Kaggle
Sharing about my first data science competition at DataScience SG.
20 Jun 2015 Ā· 1 min Ā· machinelearning
Join 11,100+ readers getting updates on machine learning, RecSys, LLMs, and engineering.