NLU classification and auto ML

Problem

My Attempt

Example raw data
data['Title_Review'] = data.Title.astype(str).str.cat(data['Review_Text'].astype(str), sep=' ')
Logistic Regression classification
Logistic Regression classification
Naive Bayes classification
Naive Bayes classification
XGBoost classification
XGBoost classification
Test set comparison of AUC
Test set comparison of AUC

AWS SageMaker

SageMaker Studio setup
SageMaker Studio setup
Create an autopilot experiment
Create an autopilot experiment
Auto created notebooks in SageMaker
Auto created Notebooks
Hyperparameter tuning list and F1 score
Hyperparameter tuning list and F1 score
Feature importance in terms of SHAP values
Feature importance in terms of SHAP values
  • From within SageMaker Studio make sure to stop all kernels and instances in the “Running Terminals and Kernels” tab
  • Any models you deploy show in deployments and make sure you delete them
  • Look in the SageMaker dashboard and nothing should be running
  • I’m not clear if leaving SageMaker studio is ok so delete that too if you don’t plan to use it again
  • Cleanup your S3 bucket (SageMaker actually adds a lot of files here)
  • Additionally SageMaker exhausts your free-tier KMS and S3 calls quota so expect some charge there as well
Recent SageMaker activity
Recent SageMaker activity

Google AutoML

GCP Natural Language dashboard
GCP Natural Language dashboard
Create Dataset
Create Dataset
Start training
Start training
Training results
Training results

--

--

--

https://linkedin.com/in/rahulaga

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Heart of Darkness: Logistic Regression vs. Random Forest

Machine Learning for Newbies

4 Technology Pillars to Achieve Process Optimization in Manufacturing

Reading Reflection #6

8 Women in Data & Insight to Inspire You in 2022

Learn from Silicon Valley’s Data Engineers: Dimensional Data Modeling is Dead

How to get from Big to Smart Data

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Rahul Agarwal

Rahul Agarwal

https://linkedin.com/in/rahulaga

More from Medium

CountVectorizer vs TfidfVectorizer

BookClassifications By ML_Part 2

Spark-NLP for Healthcare in AWS EMR

Word2Vec SkipGram with Math and Implementation