Extracting, transforming and selecting features

Extracting, transforming and selecting features

Extraction: Extracting features from “raw” data

TF-IDF

Word2Vec

CountVectorizer

FeatureHasher

Transformation: Scaling, converting, or modifying features

Tokenizer

StopWordsRemover

n-gram

Binarizer

PCA

PolynomialExpansion

Discrete Cosine Transform (DCT)

StringIndexer

IndexToString

OneHotEncoder (Deprecated since 2.3.0)

OneHotEncoderEstimator

VectorIndexer

Interaction

Normalizer

StandardScaler

MinMaxScaler

MaxAbsScaler

Bucketizer

ElementwiseProduct

SQLTransformer

VectorAssembler

VectorSizeHint

QuantileDiscretizer

Imputer

Selection: Selecting a subset from a larger set of features

VectorSlicer

ChiSqSelector

RFormula

Locality Sensitive Hashing

MinHash for Jaccard Distance