Samy Bengio

Samy Bengio
Bengio in 2021
Born1965 (age 58–59)
NationalityCanadian
Alma materUniversité de Montréal
RelativesYoshua Bengio (brother)
Scientific career
FieldsComputer science
InstitutionsApple, Google, IDIAP Research Institute, Microcell Labs, EPFL
ThesisOptimisation d'une règle d'apprentissage pour réseaux de neurones artificiels (Optimization of a learning rule for artificial neural networks) (1993)
Websitebengio.abracadoudou.com

Samy Bengio is a Canadian computer scientist, senior director of Artificial Intelligence and Machine Learning Research at Apple,[1] adjunct professor at École Polytechnique Fédérale de Lausanne,[2] and a former long-time scientist at Google[3] known for leading a large group of researchers working in machine learning including adversarial settings. Bengio left Google shortly after the company fired, Timnit Gebru, without first notifying him.[4][5] At the time, Bengio said that he had been "stunned" by what happened to Gebru.[6] He is also among the three authors who developed Torch in 2002,[7] the ancestor of PyTorch,[8] one of today's two largest machine learning frameworks.[9]

Education

[edit]

Bengio obtained his Ph.D. in Computer Science in 1993 with a thesis titled Optimization of a Parametric Learning Rule for Neural Networks from the Université de Montréal. Before that, Bengio got an M.Sc. in Computer Science in 1989 with a thesis on Integration of Traditional and Intelligence Tutoring Systems from the same university, together with a B.Sc. in Computer Science in 1986.

Scientific contributions

[edit]

According to DBLP, Samy Bengio has authored around 250 scientific papers on neural networks, machine learning, deep learning, statistics, computer vision and natural language processing.[10] The most cited[11] of these include some of the early works sparking the 2010s deep learning revolution by showing how to explore the many learned representations obtained through deep learning,[12] one of the first deep learning approaches to image captioning,[13] efforts to understand why deep learning works[14] leading to many follow-up works.[15] He also worked on the first evidence that adversarial examples can exist in the real world, i.e., one can change a physical object such that a machine learning system would be fooled[16] and one of the first works on zero-shot recognition, i.e., recognizing classes never seen during training.[17]

Professional activities

[edit]

Bengio worked at the IDIAP Research Institute and École Polytechnique Fédérale de Lausanne in Switzerland, from 1999 to 2007.[18] He was appointed adjunct professor in Computer and Communication Sciences at EPFL in 2024.[2]

He was general chair of the Conference on Neural Information Processing Systems in 2018,[19] served as program chair of the conference in 2017,[20] and is currently a board member.[21] He was also program chair of ICLR (2015–2016)[22] and sits on its board (2018–2020).[23]

Bengio is also an editor of the Journal of Machine Learning Research.[24]

Personal life

[edit]

Samy Bengio was born to two Moroccan Jews who emigrated to France and Canada. He is the brother of Turing Award winner Yoshua Bengio.[25] Both of them lived in Morocco for a year during their father's military service there.[25] His father, Carlo Bengio, was a pharmacist who wrote theatre pieces and ran a Sephardic theatrical troupe in Montreal that played Judeo-Arabic pieces.[26][27] His mother, Célia Moreno, is also an artist who played in one of the major theatre scenes of Morocco that was run by Tayeb Seddiki in the 1970s.[28]

References

[edit]
  1. ^ "Apple hires ex-Google AI scientist who resigned after colleagues' firings". Reuters. 2021-05-03. Retrieved 2021-05-21.
  2. ^ a b Evangelista, Sandy (2024-12-05). "Appointment of EPFL professors" (Press release). Lausanne, Switzerland: EPFL. Retrieved 2024-12-09.
  3. ^ "Another prominent Google scientist is leaving the company amid fallout from fired AI researcher". CNBC. 6 April 2021. Retrieved 2021-04-09.
  4. ^ Dave, Jeffrey Dastin, Paresh (2020-12-17). "Google staff demand exec step aside after ethicist's firing - document". Reuters. Retrieved 2021-06-11.{{cite news}}: CS1 maint: multiple names: authors list (link)
  5. ^ Schiffer, Zoe (2021-04-06). "Google AI manager resigns following controversial firings of two top researchers". The Verge. Retrieved 2021-06-11.
  6. ^ "Samy Bengio". www.facebook.com. Retrieved 2021-06-11.
  7. ^ Collobert, Ronan; Bengio, Samy; Marithoz, Johnny (2002). Torch: A Modular Machine Learning Software Library. CiteSeerX 10.1.1.8.9850.
  8. ^ Yegulalp, Serdar (2017-01-19). "Facebook brings GPU-powered machine learning to Python". InfoWorld. Retrieved 2021-02-23.
  9. ^ "The State of Machine Learning Frameworks in 2019". The Gradient. 2019-10-10. Retrieved 2021-02-23.
  10. ^ "dblp: Samy Bengio". dblp.org. Retrieved 2021-02-24.
  11. ^ "Samy Bengio". scholar.google.com. Retrieved 2021-02-24.
  12. ^ Erhan, Dumitru; Bengio, Yoshua; Courville, Aaron; Manzagol, Pierre-Antoine; Vincent, Pascal; Bengio, Samy (2010-03-01). "Why Does Unsupervised Pre-training Help Deep Learning?". The Journal of Machine Learning Research. 11: 625–660. ISSN 1532-4435.
  13. ^ Vinyals, Oriol; Toshev, Alexander; Bengio, Samy; Erhan, Dumitru (June 2015). "Show and tell: A neural image caption generator". 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. pp. 3156–3164. arXiv:1411.4555. doi:10.1109/cvpr.2015.7298935. ISBN 978-1-4673-6964-0. S2CID 1169492.
  14. ^ Zhang, Chiyuan; Bengio, Samy; Hardt, Moritz; Recht, Benjamin; Vinyals, Oriol (March 2021). "Understanding deep learning (still) requires rethinking generalization". Communications of the ACM. 64 (3): 107–115. doi:10.1145/3446776. ISSN 0001-0782. S2CID 231991101.
  15. ^ "Google Scholar". scholar.google.com. Retrieved 2021-02-24.
  16. ^ Kurakin, Alexey; Goodfellow, Ian J.; Bengio, Samy (2018-07-27), "Adversarial Examples in the Physical World", Artificial Intelligence Safety and Security, Boca Raton, FL: Chapman and Hall/CRC, pp. 99–112, arXiv:1607.02533, doi:10.1201/9781351251389-8, ISBN 978-1-351-25138-9, S2CID 1257772, retrieved 2021-02-24
  17. ^ Frome, Andrea; Corrado, Greg S.; Shlens, Jonathon; Bengio, Samy; Dean, Jeffrey; Ranzato, Marc'Aurelio; Mikolov, Tomas (2013-12-05). "DeViSE: a deep visual-semantic embedding model". Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2. NIPS'13. Lake Tahoe, Nevada: Curran Associates Inc.: 2121–2129.
  18. ^ "Samy Bengio: de l'IDIAP à Google" (in French). 2008-04-11. {{cite journal}}: Cite journal requires |journal= (help)
  19. ^ "2018 Organizing Committee". nips.cc. Retrieved 2021-02-23.
  20. ^ "NIPS 2017 Committees". nips.cc. Retrieved 2021-02-23.
  21. ^ "Board, Neural Information Processing Systems". nips.cc. Retrieved 2021-02-23.
  22. ^ "ICLR 2015". iclr.cc. Retrieved 2021-02-24.
  23. ^ "2020 Board". iclr.cc. Retrieved 2021-02-24.
  24. ^ "Samy Bengio | Simons Institute for the Theory of Computing". simons.berkeley.edu. 17 October 2017. Retrieved 2021-02-23.
  25. ^ a b "Interview: The Bengio Brothers". Eye On AI. 28 March 2019. Retrieved 2021-02-24.
  26. ^ Levy, Elias (2019-05-08). "À la mémoire de Carlo Bengio". The Canadian Jewish News. Retrieved 2021-02-24.
  27. ^ Tahiri, Lalla Nouzha (July 2017). Le théâtre juif marocain : une mémoire en exil : remémoration, représentation et transmission (Thèse ou essai doctoral accepté thesis) (in French). Montréal (Québec, Canada): Université du Québec à Montréal.
  28. ^ "Célia Moréno, une marocaine au Québec". Mazagan24 - Portail d'El Jadida (in French). 2020-11-14. Retrieved 2021-02-24.