Over 100s of layers
20 or more for preprocessing layers
Preprocessing layers are regular layers.
All layers have some configuration and mainly have configuration graph.
Some layers have state.
Example: Build a binarizer layer:
No trainable weights in preprocessing layers. (It is preprocessing)
No need to make preprocessing layers differentiable. No need for backpropagation.
Mainly three domains of preprocessing layers:
Natural Language Structured Data Images Natural Language:
tf.keras.layers.TextVectorization: An input string (which can be sentences) and it will split the document into individual tokens and map each token to specific index turning document intoa numeric input that can be feed into model.