Carly Richmond

Is it (F)ake?! Image Classification with TensorFlow.js

Can JavaScript tell a real object from a hyper-realistic cake? This talk charts the journey from failed models to a successful cake detector using TensorFlow.js.

Is it (F)ake?! Image Classification with TensorFlow.js
#1about 3 minutes

Using JavaScript and ML to solve a baking show challenge

The speaker introduces the goal of using machine learning to identify hyper-realistic cakes from the TV show "Is it Cake?".

#2about 2 minutes

Collecting and balancing the cake vs not-cake dataset

Images of cakes and non-cakes are collected using Playwright and the Unsplash API to create a balanced binary classification dataset.

#3about 5 minutes

Evaluating pre-trained models for image classification and object detection

Pre-existing models like MobileNet and Coco-SSD are tested on the dataset, but they produce inaccurate and strange classifications.

#4about 6 minutes

Building a custom convolutional neural network from scratch

A custom convolutional neural network is built using TensorFlow.js sequential models and convolution layers, but it fails to accurately classify images.

#5about 5 minutes

Applying transfer learning to improve model accuracy

Transfer learning is used by combining a pre-trained MobileNet feature vector model with a custom classification head, significantly improving results.

#6about 4 minutes

Playing an interactive game to compare human and model performance

An interactive web game allows the audience to test their cake-spotting skills against the various machine learning models.

#7about 1 minute

Key takeaways and resources for getting started with TensorFlow.js

The talk concludes by summarizing the journey from using pre-existing models to applying transfer learning and provides resources for further learning.

Related jobs
Jobs that call for the skills explored in this talk.

Matching moments

The origin of the "Is it Cake?" machine learning project
04:14 MIN

The origin of the "Is it Cake?" machine learning project

Mastering Image Classification: A Journey with Cakes

Building an image classification game inspired by "Is It Cake?"
04:41 MIN

Building an image classification game inspired by "Is It Cake?"

Mastering Image Classification: A Journey with Cakes

Building a machine learning game with JavaScript
02:40 MIN

Building a machine learning game with JavaScript

Building Your Own Classification Model with JavaScript - Coffee with Developers - Carly Richmond

Playing the "Is it Cake?" game and comparing results
03:37 MIN

Playing the "Is it Cake?" game and comparing results

Mastering Image Classification: A Journey with Cakes

Evaluating the pre-trained MobileNet image classification model
03:16 MIN

Evaluating the pre-trained MobileNet image classification model

Mastering Image Classification: A Journey with Cakes

A personal journey with AI technology
02:29 MIN

A personal journey with AI technology

The Software Engineer 2030: From Coder To AI Orchestrator? - Patrick Schnell

Building a custom convolutional neural network from scratch
06:29 MIN

Building a custom convolutional neural network from scratch

Mastering Image Classification: A Journey with Cakes

First attempt using the MobileNet classification model
03:16 MIN

First attempt using the MobileNet classification model

Mastering Image Classification: A Journey with Cakes

Featured Partners

Related Videos

See all videos
Mastering Image Classification: A Journey with Cakes25:19

Mastering Image Classification: A Journey with Cakes

Carly Richmond

Mastering Image Classification: A Journey with Cakes25:19

Mastering Image Classification: A Journey with Cakes

Carly Richmonds

Building Your Own Classification Model with JavaScript - Coffee with Developers - Carly Richmond36:29

Building Your Own Classification Model with JavaScript - Coffee with Developers - Carly Richmond

Carly Richmnd

Machine learning in the browser with TensorFlowjs38:24

Machine learning in the browser with TensorFlowjs

Håkan Silfvernagel

Machine Learning for Software Developers (and Knitters)49:45

Machine Learning for Software Developers (and Knitters)

Kris Howard

AI: Superhero or Supervillain? How and Why with Scott Hanselman25:17

AI: Superhero or Supervillain? How and Why with Scott Hanselman

Scott Hanselman

Machine learning 101: Where to begin?26:25

Machine learning 101: Where to begin?

Lutske De Leeuw

From Code to Motion: Building an Autonomous Hat-Hunting Robot with Kubernetes & ML30:58

From Code to Motion: Building an Autonomous Hat-Hunting Robot with Kubernetes & ML

Daniel Brintzinger

Related Articles

View all articles

From learning to earning

Jobs that call for the skills explored in this talk.