Embeddings for numerical features in tabular deep learning

The ubiquitous transformers

post-embeddings-for-numerical-features-1.png

The crucial insights on the importance of input representation

post-embeddings-for-numerical-features-2.png

Piecewise linear encodings

post-embeddings-for-numerical-features-3.png

Encoding with periodic activation functions

post-embeddings-for-numerical-features-4.png

Using numerical feature embeddings

post-embedding-for-numerical-features-5.png

Results

Summary