I noticed that tf.keras.preprocessing.text.Tokenizer does not operate on tensors and is not recommended for new code.
So shouldn't we update that in the NLP course and use tf.keras.layers.TextVectorization instead?
https://github.com/keras-team/keras/blob/v2.15.0/keras/preprocessing/text.py#L329-L343
https://www.tensorflow.org/api_docs/python/tf/keras/layers/TextVectorization
I noticed that
tf.keras.preprocessing.text.Tokenizerdoes not operate on tensors and is not recommended for new code.So shouldn't we update that in the NLP course and use
tf.keras.layers.TextVectorizationinstead?https://github.com/keras-team/keras/blob/v2.15.0/keras/preprocessing/text.py#L329-L343
https://www.tensorflow.org/api_docs/python/tf/keras/layers/TextVectorization