NLU classification and auto ML

Problem

My Attempt

Example raw data
data['Title_Review'] = data.Title.astype(str).str.cat(data['Review_Text'].astype(str), sep=' ')
Logistic Regression classification
Logistic Regression classification
Naive Bayes classification
Naive Bayes classification
XGBoost classification
XGBoost classification
Test set comparison of AUC
Test set comparison of AUC

AWS SageMaker

SageMaker Studio setup
SageMaker Studio setup
Create an autopilot experiment
Create an autopilot experiment
Auto created notebooks in SageMaker
Auto created Notebooks
Hyperparameter tuning list and F1 score
Hyperparameter tuning list and F1 score
Feature importance in terms of SHAP values
Feature importance in terms of SHAP values
  • From within SageMaker Studio make sure to stop all kernels and instances in the “Running Terminals and Kernels” tab
  • Any models you deploy show in deployments and make sure you delete them
  • Look in the SageMaker dashboard and nothing should be running
  • I’m not clear if leaving SageMaker studio is ok so delete that too if you don’t plan to use it again
  • Cleanup your S3 bucket (SageMaker actually adds a lot of files here)
  • Additionally SageMaker exhausts your free-tier KMS and S3 calls quota so expect some charge there as well
Recent SageMaker activity
Recent SageMaker activity

Google AutoML

GCP Natural Language dashboard
GCP Natural Language dashboard
Create Dataset
Create Dataset
Start training
Start training
Training results
Training results

--

--

--

https://linkedin.com/in/rahulaga

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

K-Means Clustering and the Gap-Statistics

Tomek Links, SMOTE, and XGBoost for Fraud Detection

IMDB Movies Analysis for New Movie Studio

Playing Hide And Seek With Data

Underfitted— Generalized — Overfitted

Universal Data Analytics as Semantic Spacetime

Walk Analysis

Lasso And Ridge Regularization

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Rahul Agarwal

Rahul Agarwal

https://linkedin.com/in/rahulaga

More from Medium

Building A Recommender System With Implicit Feedback Datasets Using Alternating Least Squares

VERTEX AI — (Part 1/2) Introduction and example use case

Use previously implemented ML models — ML Practitioner Quick bits

Predicting M&A Targets Using ML: Unlocking the potential of NLP based variables

png