Yoshua Bengio

Summary

Yoshua Bengio OC FRS FRSC (born March 5, 1964[3]) is a Canadian computer scientist, most noted for his work on artificial neural networks and deep learning.[4][5][6] He is a professor at the Department of Computer Science and Operations Research at the Université de Montréal and scientific director of the Montreal Institute for Learning Algorithms (MILA).[1]

Yoshua Bengio
Yoshua Bengio in 2019
Born (1964-03-05) March 5, 1964 (age 60)
Paris, France
CitizenshipCanada
Alma materMcGill University
Known for
RelativesSamy Bengio (brother)
AwardsMarie-Victorin Prize (2017)
Turing Award (2018)
AAAI Fellow (2019)
Legion of Honor (2022)
Scientific career
FieldsMachine learning
Deep learning
Artificial intelligence[1]
InstitutionsUniversité de Montréal
MILA
Element AI
ThesisArtificial Neural Networks and their Application to Sequence Recognition (1991)
Doctoral advisorRenato de Mori[2]
Notable studentsIan Goodfellow[2]
Websiteyoshuabengio.org

Bengio received the 2018 ACM A.M. Turing Award (often referred to as the "Nobel Prize of Computing"), together with Geoffrey Hinton and Yann LeCun, for their work on deep learning.[7] Bengio, Hinton, and LeCun are sometimes referred to as the "Godfathers of AI" and "Godfathers of Deep Learning".[8][9][10][11][12][13] In 2024, TIME Magazine included Bengio in its yearly list of the world's 100 most influential people.[14] As of August 2024, he is the world's most-cited computer scientist by h-index.[15]

Early life and education

edit

Bengio was born in France to a Jewish family who had emigrated to France from Morocco. The family then relocated to Canada.[16] He received his Bachelor of Science degree (electrical engineering), MSc (computer science) and PhD (computer science) from McGill University.[2][17]

Bengio is the brother of Samy Bengio,[16] also an influential computer scientist working with neural networks, who is currently Senior Director of AI and ML Research at Apple.[18]

The Bengio brothers lived in Morocco for a year during their father's military service there.[16] His father, Carlo Bengio was a pharmacist and a playwright; he ran a Sephardic theater company in Montreal that performed pieces in Judeo-Arabic.[19][20] His mother, Célia Moreno, was an actor in the 1970s in the Moroccan theater scene led by Tayeb Seddiki. She studied economics in Paris, and then in Montreal in 1980 she co-founded with artist Paul St-Jean l’Écran humain, a multimedia theater troupe.[21]

Career and research

edit

After his PhD, Bengio was a postdoctoral fellow at MIT (supervised by Michael I. Jordan) and AT&T Bell Labs.[22] Bengio has been a faculty member at the Université de Montréal since 1993, heads the MILA (Montreal Institute for Learning Algorithms) and is co-director of the Learning in Machines & Brains program at the Canadian Institute for Advanced Research.[17][22]

Along with Geoffrey Hinton and Yann LeCun, Bengio is considered by journalist Cade Metz to be one of the three people most responsible for the advancement of deep learning during the 1990s and 2000s.[23] Among the computer scientists with an h-index of at least 100, Bengio was as of 2018 the one with the most recent citations per day, according to MILA.[24][25] As of August 2024, he has the highest Discipline H-index (D-index, a measure of the research citations a scientist has received) of any computer scientist.[26] Thanks to a 2019 article on a novel RNN architecture, Bengio has an Erdős number of 3.[27]

In October 2016, Bengio co-founded Element AI, a Montreal-based artificial intelligence incubator that turns AI research into real-world business applications.[23] The company sold its operations to ServiceNow in November 2020,[28] with Bengio remaining at ServiceNow as an advisor.[29][30]

Bengio currently serves as scientific and technical advisor for Recursion Pharmaceuticals[31] and scientific advisor for Valence Discovery.[32]

At the first AI Safety Summit in November 2023, British Prime Minister Rishi Sunak announced that Bengio would lead an international scientific report on the safety of advanced AI. The report was delivered at the AI Seoul Summit in May 2024, and covered issues such as the potential for cyber attacks and 'loss of control' scenarios.[33][34][35]

Views on AI

edit

In March 2023, following concerns raised by AI experts about the existential risk from artificial general intelligence, Bengio signed an open letter from the Future of Life Institute calling for "all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4". The letter has been signed by over 30,000 individuals, including AI researchers such as Stuart Russell and Gary Marcus.[36][37][38]

In May 2023, Bengio stated in an interview to BBC that he felt "lost" over his life's work. He raised his concern about "bad actors" getting hold of AI, especially as it becomes more sophisticated and powerful. He called for better regulation, product registration, ethical training, and more involvement from governments in tracking and auditing AI products.[39][40]

Speaking with the Financial Times in May 2023, Bengio said that he supported the monitoring of access to AI systems such as ChatGPT so that potentially illegal or dangerous uses could be tracked.[41] In July 2023, he published a piece in The Economist arguing that "the risk of catastrophe is real enough that action is needed now."[42]

Bengio co-authored a letter with Geoffrey Hinton and others in support of SB 1047, a California AI safety bill that would require companies training models which cost more than $100 million to perform risk assessments before deployment. They claimed the legislation was the "bare minimum for effective regulation of this technology."[43][44]

Yoshua Bengio being interviewed for the Dutch television series The Mind of the Universe

Awards and honours

edit

In 2017, Bengio was named an Officer of the Order of Canada.[45] The same year, he was nominated Fellow of the Royal Society of Canada and received the Marie-Victorin Quebec Prize.[46][47] Together with Geoffrey Hinton and Yann LeCun, Bengio won the 2018 Turing Award.[7]

In 2020, he was elected a Fellow of the Royal Society.[48] In 2022, he received the Princess of Asturias Award in the category "Scientific Research" with his peers Yann LeCun, Geoffrey Hinton and Demis Hassabis.[49] In 2023, Bengio was appointed Knight of the Legion of Honour, France's highest order of merit.[50]

In August 2023, he was appointed to a United Nations scientific advisory council on technological advances.[51][52]

He was recognized as a 2023 ACM Fellow.[53]

In 2024, TIME Magazine included Bengio in its yearly list of the 100 most influential people globally.[54]

Publications

edit
  • Ian Goodfellow, Yoshua Bengio and Aaron Courville: Deep Learning (Adaptive Computation and Machine Learning), MIT Press, Cambridge (USA), 2016. ISBN 978-0262035613.
  • Dzmitry Bahdanau; Kyunghyun Cho; Yoshua Bengio (2014). "Neural Machine Translation by Jointly Learning to Align and Translate". arXiv:1409.0473 [cs.CL].
  • Léon Bottou, Patrick Haffner, Paul G. Howard, Patrice Simard, Yoshua Bengio, Yann LeCun: High Quality Document Image Compression with DjVu, In: Journal of Electronic Imaging, Band 7, 1998, S. 410–425 doi:10.1117/1.482609
  • Bengio, Yoshua; Schuurmans, Dale; Lafferty, John; Williams, Chris K. I. and Culotta, Aron (eds.), Advances in Neural Information Processing Systems 22 (NIPS'22), December 7th–10th, 2009, Vancouver, BC, Neural Information Processing Systems (NIPS) Foundation, 2009
  • Y. Bengio, Dong-Hyun Lee, Jorg Bornschein, Thomas Mesnard, Zhouhan Lin: Towards Biologically Plausible Deep Learning, arXiv.org, 2016
  • Bengio contributed one chapter to Architects of Intelligence: The Truth About AI from the People Building it, Packt Publishing, 2018, ISBN 978-1-78-913151-2, by the American futurist Martin Ford.[55]

References

edit
  1. ^ a b Yoshua Bengio publications indexed by Google Scholar  
  2. ^ a b c Yoshua Bengio at the Mathematics Genealogy Project  
  3. ^ "Yoshua Bengio - A.M. Turing Award Laureate". amturing.acm.org. Archived from the original on November 27, 2020. Retrieved December 15, 2020.
  4. ^ Knight, Will (July 9, 2015). "IBM Pushes Deep Learning with a Watson Upgrade". MIT Technology Review. Retrieved July 31, 2016.
  5. ^ Yann LeCun; Yoshua Bengio; Geoffrey Hinton (May 28, 2015). "Deep learning". Nature. 521 (7553): 436–444. doi:10.1038/NATURE14539. ISSN 1476-4687. PMID 26017442. Wikidata Q28018765.
  6. ^ Bergen, Mark; Wagner, Kurt (July 15, 2015). "Welcome to the AI Conspiracy: The 'Canadian Mafia' Behind Tech's Latest Craze". Recode. Archived from the original on March 31, 2019. Retrieved July 31, 2016.
  7. ^ a b "Fathers of the Deep Learning Revolution Receive ACM A.M. Turing Award". Association for Computing Machinery. New York. March 27, 2019. Archived from the original on March 27, 2019. Retrieved March 27, 2019.
  8. ^ "'Godfathers of AI' honored with Turing Award, the Nobel Prize of computing". March 27, 2019. Archived from the original on April 4, 2020. Retrieved December 9, 2019.
  9. ^ "Godfathers of AI Win This Year's Turing Award and $1 Million". March 29, 2019. Archived from the original on March 30, 2019. Retrieved December 9, 2019.
  10. ^ "Nobel prize of tech awarded to 'godfathers of AI'". The Telegraph. March 27, 2019. Archived from the original on April 14, 2020. Retrieved December 9, 2019.
  11. ^ "The 3 'Godfathers' of AI Have Won the Prestigious $1M Turing Prize". Forbes. Archived from the original on April 14, 2020. Retrieved December 9, 2019.
  12. ^ Ray, Tiernan. "Deep learning godfathers Bengio, Hinton, and LeCun say the field can fix its flaws". ZDNet. Archived from the original on March 3, 2020. Retrieved February 15, 2020.
  13. ^ "Turing Award Winners 2019 Recognized for Neural Network Research - Bloomberg". Bloomberg News. March 27, 2019. Archived from the original on April 10, 2020. Retrieved February 15, 2020.
  14. ^ "The 100 Most Influential People of 2024". TIME. Retrieved August 28, 2024.
  15. ^ "Best Computer Science Scientists". research.com. Retrieved November 21, 2023.
  16. ^ a b c "Interview: The Bengio Brothers". Eye On AI. March 28, 2019. Archived from the original on April 10, 2021. Retrieved February 24, 2021.
  17. ^ a b "Yoshua Bengio". Profiles. Canadian Institute For Advanced Research. Archived from the original on August 15, 2016. Retrieved July 31, 2016.
  18. ^ "Apple targets Google staff to build artificial intelligence team". Financial Times (ft.com). May 3, 2021. Retrieved September 13, 2024.
  19. ^ Levy, Elias (May 8, 2019). "À la mémoire de Carlo Bengio". The Canadian Jewish News. Archived from the original on April 10, 2021. Retrieved February 24, 2021.
  20. ^ Tahiri, Lalla Nouzha (July 2017). Le théâtre juif marocain : une mémoire en exil : remémoration, représentation et transmission (Thèse ou essai doctoral accepté thesis) (in French). Montréal (Québec, Canada): Université du Québec à Montréal. Archived from the original on April 10, 2021. Retrieved April 10, 2021.
  21. ^ "Célia Moréno, une marocaine au Québec". Mazagan24 - Portail d'El Jadida (in French). November 14, 2020. Archived from the original on February 12, 2021. Retrieved February 24, 2021.
  22. ^ a b Bengio, Yoshua. "CV". Département d'informatique et de recherche opérationnelle. Université de Montréal. Archived from the original on March 6, 2018. Retrieved July 31, 2016.
  23. ^ a b Metz, Cade (October 26, 2016). "AI Pioneer Yoshua Bengio Is Launching Element.AI, a Deep-Learning Incubator". WIRED. Archived from the original on September 7, 2018. Retrieved September 7, 2018.
  24. ^ "Yoshua Bengio, the computer scientist with the most recent citations per day". MILA. September 1, 2018. Archived from the original on October 1, 2018. Retrieved October 1, 2018.
  25. ^ "Computer science researchers with the highest rate of recent citations (Google Scholar) among those with the largest h-index". University of Montreal. September 6, 2018. Archived from the original on October 13, 2018. Retrieved October 1, 2018.
  26. ^ "World's Best Computer Science Scientists: H-Index Computer Science Ranking 2023". Research.com. Retrieved May 20, 2023.
  27. ^ "Collaboration Distance - zbMATH Open". zbmath.org. Retrieved May 20, 2023.
  28. ^ "ServiceNow to Acquire AI Pioneer Element AI". Retrieved April 16, 2023.
  29. ^ "Element AI sold for $230-million as founders saw value mostly wiped out, document reveals". Archived from the original on December 19, 2020. Retrieved December 19, 2020.
  30. ^ "Element AI hands out pink slips hours after announcement of sale to U.S.-based ServiceNow". Archived from the original on December 14, 2020. Retrieved December 19, 2020.
  31. ^ "Yoshua Bengio - Recursion Pharmaceuticals". Recursion Pharmaceuticals. Archived from the original on March 27, 2019. Retrieved March 27, 2019.
  32. ^ "Yoshua Bengio Joins Valence Discovery as Scientific Advisor". Valence Discovery. Retrieved March 9, 2021.
  33. ^ Pillay, Tharin (September 5, 2024). "TIME100 AI 2024: Yoshua Bengio". TIME. Retrieved September 23, 2024.
  34. ^ Hemmadi, Murad (November 3, 2023). "Bengio backs creation of Canadian AI safety institute, will deliver landmark report in six months". The Logic. Retrieved September 23, 2024.
  35. ^ "International Scientific Report on the Safety of Advanced AI". GOV.UK. Retrieved September 23, 2024.
  36. ^ Samuel, Sigal (March 29, 2023). "AI leaders (and Elon Musk) urge all labs to press pause on powerful AI". Vox. Retrieved August 9, 2024.
  37. ^ Woollacott, Emma. "Tech Experts - And Elon Musk - Call For A 'Pause' In AI Training". Forbes. Retrieved August 9, 2024.
  38. ^ "Pause Giant AI Experiments: An Open Letter". Future of Life Institute. Retrieved August 9, 2024.
  39. ^ "One of the three 'godfathers of A.I.' feels 'lost' because of the direction the technology has taken". Fortune. Retrieved June 15, 2023.
  40. ^ "AI 'godfather' Yoshua Bengio feels 'lost' over life's work". BBC News. May 30, 2023. Retrieved June 15, 2023.
  41. ^ Murgia, Madhumita (May 18, 2023). "AI pioneer Yoshua Bengio: Governments must move fast to 'protect the public'". Financial Times. Retrieved July 12, 2023.
  42. ^ "One of the "godfathers of AI" airs his concerns". The Economist. ISSN 0013-0613. Retrieved December 22, 2023.
  43. ^ Pillay, Tharin; Booth, Harry (August 7, 2024). "Exclusive: Renowned Experts Pen Support for California's Landmark AI Safety Bill". TIME. Retrieved August 9, 2024.
  44. ^ "Letter from renowned AI experts". SB 1047 - Safe & Secure AI Innovation. Retrieved August 9, 2024.
  45. ^ "Order of Canada honorees desire a better country". The Globe and Mail. June 30, 2017. Archived from the original on April 28, 2019. Retrieved August 28, 2017.
  46. ^ "Royal Society of Canada". December 16, 2017. Archived from the original on April 12, 2020. Retrieved December 16, 2017.
  47. ^ "Prix du Quebec". December 16, 2017. Archived from the original on December 16, 2017. Retrieved December 16, 2017.
  48. ^ "Yoshua Bendigo". Royal Society. Archived from the original on October 27, 2020. Retrieved September 19, 2020.
  49. ^ IT, Developed with webControl CMS by Intermark. "Geoffrey Hinton, Yann LeCun, Yoshua Bengio and Demis Hassabis - Laureates - Princess of Asturias Awards". The Princess of Asturias Foundation. Retrieved May 20, 2023.
  50. ^ Guérard, Marc-Antoine (March 8, 2022). "Professor Yoshua Bengio appointed Knight of the Legion of Honour by France". Mila. Retrieved July 30, 2023.
  51. ^ "University of Montreal professor to join new UN technology advisory board". CJAD, Bell Media. The Canadian Press. Retrieved August 4, 2023.
  52. ^ "UN Secretary-General Creates Scientific Advisory Board for Independent Advice on Breakthroughs in Science and Technology | UN Press". press.un.org. August 3, 2023. Retrieved August 4, 2023.
  53. ^ "Yoshua Bengio". awards.acm.org. Retrieved January 26, 2024.
  54. ^ "The 100 Most Influential People of 2024". TIME. Retrieved August 28, 2024.
  55. ^ Falcon, William (November 30, 2018). "This Is The Future Of AI According To 23 World-Leading AI Experts". Forbes. Archived from the original on March 29, 2019. Retrieved March 20, 2019.