Training Loop in TensorFlow

One Hot Encoding using Tensorflow

Last Updated : 02 Sep, 2020

In this post, we will be seeing how to initialize a vector in TensorFlow with all zeros or ones. The function you will be calling is tf.ones(). To initialize with zeros you could use tf.zeros() instead. These functions take in a shape and return an array full of zeros and ones accordingly.

Code:

import tensorflow as tf 
  
ones_matrix = tf.ones([2, 3]) 
sess = tf.Session() 
ones = sess.run(ones_matrix) 
sess.close() 
  
print(ones) 

Output:

[[1. 1. 1.]  [1. 1. 1.]]

Using One Hot Encoding:
Many times in deep learning and general vector computations you will have a y vector with numbers ranging from 0 to C-1 and you want to do the following conversion. If C is for example 5, then you might have the following y vector which you will need to convert as follows:

One Hot Encoding Example

This can be done as follows:

Parameters passed to the function:

indices: A Tensor of indices.
depth: A scalar defining the depth of the one hot dimension.
on_value: A scalar defining the value to fill in output when indices[j] = i. (default : 1)
off_value: A scalar defining the value to fill in output when indices[j] != i. (default : 0)
axis: The axis to fill (default : -1, a new inner-most axis).
dtype: The data type of the output tensor.
name: A name for the operation (optional).

Code:

indices = [1, 4, 2, 0, 3] 
C = tf.constant(5, name = "C") 
      
one_hot_matrix = tf.one_hot( 
    indices, C, on_value = 1.0, off_value = 0.0, axis =-1) 
  
sess = tf.Session() 
  
one_hot = sess.run(one_hot_matrix) 
  
sess.close() 
  
# output is of dimension 5 x 5 
print(one_hot)

Output:

[[0.0, 1.0, 0.0, 0.0, 0.0 ]

[0.0, 0.0, 0.0, 0.0, 1.0]

[0.0, 0.0, 1.0, 0.0, 0.0]

[1.0, 0.0, 0.0, 0.0, 0.0]

[0.0, 0.0, 0.0, 1.0, 0.0]]

Feel free to change values and see the result.

Code:

indices = [[0, 2], [1, -1]] 
C = tf.constant(5, name = "C") 
      
one_hot_matrix = tf.one_hot( 
    indices, C, on_value = 1.0, off_value = 0.0, axis =-1) 
  
sess = tf.Session() 
  
one_hot = sess.run(one_hot_matrix) 
  
sess.close() 
      
# output is of dimension 2 x 2 x 3 
print(one_hot)  

Output :

[[[1.0, 0.0, 0.0],  

  [0.0, 0.0, 1.0]],  

 [[0.0, 1.0, 0.0],  

 [0.0, 0.0, 0.0]]]

Training Loop in TensorFlow

hackerblack1004

Improve

Article Tags :

Practice Tags :

Similar Reads

Image Recognition using TensorFlow

Image recognition is a task where a model identifies objects in an image and assigns labels to them. For example a model can be trained to identify difference between different types of flowers, animals or traffic signs. In this article, we will use Tensorflow and Keras to build a simple image recog

Implementing Neural Networks Using TensorFlow

Deep learning has been on the rise in this decade and its applications are so wide-ranging and amazing that it's almost hard to believe that it's been only a few years in its advancements. And at the core of deep learning lies a basic "unit" that governs its architecture, yes, It's neural networks.

Save and Load Models using TensorFlow in Json?

If you are looking to explore Machine Learning with TensorFlow, you are at the right place. This comprehensive article explains how to save and load the models in TensorFlow along with its brief overview. If you read this article till the end, you will not need to look for further guides on how to s

Training Loop in TensorFlow

Training neural networks is at the core of machine learning, and understanding how to write a training loop from scratch is fundamental for any deep learning practitioner and TensorFlow provides powerful tools for building and training neural networks efficiently. In this article, we will get into t

Python - tensorflow.identity_n()

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks. identity_n() is used get a list of Tensor with same shape and content as input Tensor. Syntax: tensorflow.identity_n( input, name) Parameters: input: It is a Tensor.name(

Python - tensorflow.math.bincount()

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks. bincount() is present in TensorFlow's math module. It is used to count occurrences of each number in integer array. Syntax: tensorflow.math.bincount( arr, weights, minlen

Using bfloat16 with TensorFlow models in Python

In this article, we will discuss bfloat16 (Brain Floating Point 16) in Python. It is a numerical format that occupies 16 bits in memory and is used to represent floating-point numbers. It is similar to the more commonly used 32-bit single-precision float (float32) and 64-bit double-precision float (

Python | Tensorflow log() method

Tensorflow is an open-source machine learning library developed by Google. One of its applications is to develop deep neural networks. The module tensorflow.math provides support for many basic mathematical operations. Function tf.log() [alias tf.math.log] provides support for the natural logarithmi

Using the SavedModel format in Tensorflow

TensorFlow is a popular deep-learning framework that provides a variety of tools to help users build, train, and deploy machine-learning models. One of the most important aspects of deploying a machine learning model is saving and exporting it to a format that can be easily used by other programs an

Introduction to TensorFlow

TensorFlow is an open-source framework for machine learning (ML) and artificial intelligence (AI) that was developed by Google Brain. It was designed to facilitate the development of machine learning models, particularly deep learning models, by providing tools to easily build, train, and deploy the