Omar Sharif

Omar Sharif

Graduate student at Dartmouth CS, advised by Prof. Sarah M. Preum. Interested to apply deep learning to understand natural language.

My Notes

My hand notes while I completed the Deep Learning Specialization on Coursera.

  • Neural Networks and Deep Learning Note.
  • Improving Deep Neural Networks Note.
  • Structuring Machine Learning Projects Note.
  • Convolutional Neural Networks Note.
  • Sequence Models Note.

NLP Papers

A subset of papers that I found useful in clarifying my understanding of various NLP topics.

* A Neural Probabilistic Language Model 
* [Word2Vec]/[Negative Sampling]/[GloVe] 
* Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation 
* Sequence to Sequence Learning with Neural Networks 
* Neural Machine Translation by Jointly Learning to Align and Translate (Paper that introduces Attention) 
* Effective Approaches to Attention-based Neural Machine Translation 
* Attention Is All You Need
* [ELMo]/[BERT]/[RoBERTa] 
* [ELECTRA]/[ALBERT]/[XLNet]
* [GPT]/[GPT-2]/[GPT-3]
* T5 (an awesome paper)

Useful Links

Few blog posts/links that I found really useful to understand various fundamental concepts of NLP.

* Andrej Karpathy's coding-based backpropagation post [Link]
* Andrej Karpathy's blog on RNNs [Link]
* Understanding LSTM Networks [Link]
* The Illustrated Word2vec [Link]
* Mechanics of Seq2seq Models With Attention [Link]
* The Illustrated Transformer [Link]
* The Annotated Transformer [Link]
* Visualizing Transformer Language Models [Link]
* The State of Transfer Learning in NLP [Link]
* The Illustrated BERT, ELMo, and co. [Link]
* A Visual Guide to Using BERT [Link]
* Various BERT Pre-Training Methods [Link]

Quotes

Whenever I feel depressed or exhausted, I try to utter few quotes in my mind from here. These points are taken from different books I have read over time.

  • But they plan and Allah plans. Surely, Allah is the best of planners. [Quran 8:30]
  • Practise honesty, integrity and sincererity in every aspect of your life.
  • Life is a echo: “We get back what we give”.
  • Never fear failure. Failure is your friend.
  • Don’t race aganist others, race aganist yourself.
  • The quality of our life depends on the quality of our thoughts.
  • Your eyes show the strength of your soul.
  • No heart have ever suffered when it goes in search of its dreams, because every second of the search is a second’s encourter with God and with eternity.
  • When we strive to become better that we are, everything around us beomes better, too.
  • Our thoughts lead to actions, actions lead to habits and habits form character. “Character determines our destiny”.
  • Try to smile and be kind to others. Smile increases our face value.
  • Don’t expect anything from others. Expect only from yourself and believe in your hard work.
  • Try to make yourself a better person by every passing day, learn new things, expand your knowledge, invest on yourself and practise humility and kindness.
  • Buring desire is the starting point of all achievements.
  • When we form the habit of searching or the positive in every situation, our life will move into its highest dimensions.
  • Winning is not everything, making effort to win is the key.
  • The tree that bears the most fruits also gets the most stones.
  • Turn your promises into commitments. Try to fullfill your commitment in everything that you engage.
  • Try not to be the man of success but rather try to be the man of value.
  • You will never be able to hit a target that you can not see. So visualize your success every moment.
  • Life gives you what you ask of it, it always listening.
  • When you control your toughts, you control your mind. When you control your mind, you control your life. When you control your life, you become the master of your destiny.
  • Respect your time and simplify your life.
  • Never, ever forget the gift of family. It is all you have at the end of your life.
  • There is a huge difference between making a lot of money and making a lot of time.
  • Stop being a prisoner of your past, become the architect of your future.
  • Be humble in evrey stage of your life.
  • And when you want something by heart, all the universe conspires in helping you to achieve it.
  • You must always know what it is that you want.
  • Every blessing ignored becomes a curse.
  • Making a decision is the beginning of things. When someone makes a decision, he is really diving into a strong current that will carry him to places he had never dreamed of when he first made the decision.
  • People need not fear the unknown if they are capable of achieving what they need and want.
  • People are afraid to pursue their most important dreams, because they feel that they don’t deserve them, or that they will be unable to achieve them.
  • Tell your heart that the fear of suffering is worse than the suffering itself.
  • There is only one thing that makes a dream impossible to achieve: the fear of failure.
  • All people who are happy have God within them.
  • The darkest hour of the night came just before the dawn.