This talk will describe my past and ongoing work on translating images and words between very different datasets without supervision. Although Humans often do not require supervision to make connections between very different sources of data, this is still difficult for machines. Recently great progress was made by using adversarial training – a powerful yet tricky method. Although adversarial methods have had great success, they have critical failings which significantly limit their breadth of applicability and motivate research into alternative non-adversarial methods. In this talk, I will describe novel non-adversarial methods for unsupervised word translation and for translating images between very different datasets (with Lior Wolf). As image generation models are an important component in our method, I will present a non-adversarial image generation approach, which is often better than current adversarial approaches (with Jitendra Malik).