There are softwares which translate from any language to any language, however, the promise of the futuristic sign language decoders have always been far away from being a day to day reality. Designing a Neural Network based Sign language to speech translator which purports to translate sign language in real-time to text or speech as the user gestures. For people in the Deaf community, this tool could come in handy as it will not demand any extra hardware and use a camera (Like the ones present on the phone) to detect the pose and gestures. Using Tensorflow, Openpose, OpenCV, and Python