SUMMARY OF JUERGEN SCHMIDHUBER'S PROFESSIONAL ACTIVITIES IN 2011

PUBLICATIONS OF 2011 (published / accepted)

(for pre-2011 and post-2011 articles, PDFs/HTMLs/overviews see
http://www.idsia.ch/~juergen/onlinepub.html)

BOOKS 2011
2. J. Schmidhuber, K. R. Thorisson, M. Looks (editors): Artificial General
Intelligence. Proceedings of the 4th International Conference, AGI 2011, Mountain
View, CA, USA, August 3-6, 2011, Lecture Notes in Computer Science, Volume 6830,
2011, Springer, DOI: 10.1007/978-3-642-22887-2.
1. J. Schmidhuber, F. Gomez, A. Graves, S. Hochreiter. Sequence Learning with
Artificial Recurrent Neural Networks. (Aiming to become the definitive textbook on
RNN.) Invited by Cambridge University Press, in preparation.

JOURNALS 2011
5. T. Glasmachers, J. Koutnik, J. Schmidhuber. Kernel Representations for Evolving
Continuous Functions. Evolutionary Intelligence Journal, accepted 2011.
4. J. Schmidhuber. Philosophers & Futurists, Catch Up! Response to The
Singularity. Journal of Consciousness Studies, 2012, in press.
3. J. Schmidhuber. Citation Bubble About to Burst? Correspondence, Nature, vol.
469, p. 34, 2011
2. V. Graziano, T. Glasmachers, T. Schaul, L. Pape, G. Cuccu, J. Leitner, J.
Schmidhuber. Artificial Curiosity for Autonomous Space Exploration. Acta Futura
4:41-51, 2011 (DOI: 10.2420/AF04.2011.41)
1. T. Rueckstiess, J. Schmidhuber. A Python Experiment Suite. The Python Papers
6(1):2, 2011

INVITED BOOK CHAPTERS 2011

4. J. Schmidhuber. The Fastest Way of Computing All Universes. In H. Zenil, ed., A
Computable Universe. World Scientific, 2012, in press.
3. J. Schmidhuber. Maximizing Fun By Creating Data With Easily Reducible
Subjective Complexity. In G. Baldassarre and M. Mirolli (eds.), Roadmap for
Intrinsically Motivated Learning. Springer, 2012, in press.
2. J. Schmidhuber. A Formal Theory of Creativity to Model the Creation of Art. In
J. McCormack (ed.), Computational Creativity. MIT Press, 2012, in press.
1. J. Schmidhuber. Randomness, Occam's Razor, AI, Creativity and Digital Physics.
In H. Zenil, ed., Randomness Through Computation. World Scientific, 2011.

CONFERENCES 2011
28. V. R. Kompella, M. Luciw, J. Schmidhuber. Incremental Slow Feature Analysis.
International Joint Conference on Artificial Intelligence (IJCAI-2011, Barcelona),
2011.
27. D. C. Ciresan, U. Meier, J. Masci, L. M. Gambardella, J. Schmidhuber. Flexible,
High Performance Convolutional Neural Networks for Image Classification.
International Joint Conference on Artificial Intelligence (IJCAI-2011, Barcelona),
2011.
26. V. R. Kompella, L. Pape, J. Masci, M. Frank and J. Schmidhuber. AutoIncSFA and
Vision-based Developmental Learning for Humanoid Robots, 11th IEEE-RAS
International Conference on Humanoid Robots (Humanoids), Bled, Slovenia, 2011.
25. J. Nagi, F. Ducatelle, G. A. Di Caro, D. Ciresan, U. Meier, A. Giusti, F. Nagi,
J. Schmidhuber, L. M. Gambardella. Max-Pooling Convolutional Neural Networks for
Vision-based Hand Gesture Recognition. IEEE International Conference on Signal and
Image Processing Applications, 2011.
24. M. Frank, A. Foerster, J. Schmidhuber. Reflexive Collision Response with
Virtual Skin. International Conference on Agents and Artificial Intelligence ICAART
2012, accepted 2011.
23. Yi Sun, F. Gomez, M. Ring, J. Schmidhuber. Incremental Basis Construction from
Temporal Difference Error. Proceedings of the 28th International Conference on
Machine Learning (ICML-11), 2011.
22. V. Graziano, J. Koutnik, J. Schmidhuber. Unsupervised Modeling of Partially
Observable Environments. 22nd European Conference on Machine Learning ECML, Athens,
2011.
21. U. Meier, D. C. Ciresan, L. M. Gambardella, J. Schmidhuber. Better Digit
Recognition with a Committee of Simple Neural Nets. 11th International Conference
on Document Analysis and Recognition (ICDAR 2011), Beijing, China, 2011.
20. D. C. Ciresan, U. Meier, L. M. Gambardella, J. Schmidhuber. Convolutional
Neural Network Committees For Handwritten Character Classification. 11th
International Conference on Document Analysis and Recognition (ICDAR 2011),
Beijing, China, 2011.
19. T. Schaul, T. Glasmachers, J. Schmidhuber. High Dimensions and Heavy Tails for
Natural Evolution Strategies. Proceedings of the Genetic and Evolutionary
Computation Conference (GECCO-2011, Dublin), 2011.
18. T. Schaul, Yi Sun, D. Wierstra, F. Gomez, J. Schmidhuber. Curiosity-Driven
Optimization. IEEE Congress on Evolutionary Computation (CEC-2011), 2011.
17. D. C. Ciresan, U. Meier, J. Masci, J. Schmidhuber. A Committee of Neural
Networks for Traffic Sign Classification. International Joint Conference on Neural
Networks (IJCNN-2011, San Francisco), 2011.
16. L. Pape, F. Gomez, M. Ring, J. Schmidhuber. Modular deep belief networks that
do not forget. International Joint Conference on Neural Networks (IJCNN-2011, San
Francisco), 2011.
15. J. Masci, D. C. Ciresan, U. Meier, J. Schmidhuber. Stacked Convolutional Auto-
Encoders for Hierarchical Feature Extraction. International Conference on
Artificial Neural Networks (ICANN-2011, Espoo, Finland), 2011.
14. M. Ring, T. Schaul, J. Schmidhuber. The Two-Dimensional Organization of
Behavior. In Proc. Joint IEEE International Conference on Development and Learning
(ICDL) and on Epigenetic Robotics (ICDL-EpiRob 2011), Frankfurt, 2011.
13. G. Cuccu, M. Luciw, J. Schmidhuber, F. Gomez. Intrinsically Motivated
Evolutionary Search for Vision-Based Reinforcement Learning. In Proc. Joint IEEE
International Conference on Development and Learning (ICDL) and on Epigenetic
Robotics (ICDL-EpiRob 2011), Frankfurt, 2011.
12. H. Ngo, M. Ring, J. Schmidhuber. Curiosity Drive based on Compression Progress
for Learning Environment Regularities. In Proc. Joint IEEE International Conference
on Development and Learning (ICDL) and on Epigenetic Robotics (ICDL-EpiRob 2011),
Frankfurt, 2011.
11. M. Luciw, V. Graziano, M. Ring, J. Schmidhuber. Artificial Curiosity with
Planning for Autonomous Visual and Perceptual Development. In Proc. Joint IEEE
International Conference on Development and Learning (ICDL) and on Epigenetic
Robotics (ICDL-EpiRob 2011), Frankfurt, 2011.
10. J. Schmidhuber, D. Ciresan, U. Meier, J. Masci, A. Graves. On Fast Deep Nets
for AGI Vision. In Proc. Fourth Conference on Artificial General Intelligence (AGI-
11), Google, Mountain View, California, 2011.
9. M. Ring, T. Schaul. Q-error as a Selection Mechanism in Modular Reinforcement-
Learning Systems. Proceedings of the International Joint Conference on Artificial
Intelligence (IJCAI-2011, Barcelona),} 2011.
8. L. Pape, A. Kok. Real-world limits to algorithmic intelligence. Fourth
Conference on Artificial General Intelligence, Mountain View, CA. Lecture Notes in
Artificial Intelligence 6830, 394-400, 2011.
7. G. Cuccu, F. Gomez, T. Glasmachers. Novelty Restarts for Evolutionary
Strategies. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC,
New Orleans), 2011.
6. G. Cuccu, F. Gomez. When Novelty is Not Enough. In Proceedings of Evostar 2011
(Turin, Italy), 2011
5. S. Yi, F. Gomez, J. Schmidhuber. Planning to Be Surprised: Optimal Bayesian
Exploration in Dynamic Environments. In Proc. Fourth Conference on Artificial
General Intelligence (AGI-11), Google, Mountain View, California, 2011.
4. T. Glasmachers, J. Schmidhuber. Optimal Direct Policy Search. In Proc. Fourth
Conference on Artificial General Intelligence (AGI-11), Google, Mountain View,
California, 2011.
3. L. Gisslen, M. Luciw, V. Graziano, J. Schmidhuber. Sequential Constant Size
Compressors and Reinforcement Learning. In Proc. Fourth Conference on Artificial
General Intelligence (AGI-11), Google, Mountain View, California, 2011. {\bf
Kurzweil Prize for Best AGI Paper 2011.}
2. T. Schaul, L. Pape, T. Glasmachers, V. Graziano J. Schmidhuber. Coherence
Progress: A Measure of Interestingness Based on Fixed Compressors. In Proc. Fourth
Conference on Artificial General Intelligence (AGI-11), Google, Mountain View,
California, 2011.
1. B. Steunebrink, J. Schmidhuber. A Family of Goedel Machine Implementations. In
Proc. Fourth Conference on Artificial General Intelligence (AGI-11), Google,
Mountain View, California, 2011.

HONORS 2011

BEST PAPERS 2011

1. 2011, Google Headquarters, Mountain View, CA: Best paper award at AGI 2011
(Kurzweil Prize, with Gisslen, Luciw, Graziano).2. The 2011 Solomonoff AGI Theory
Prize was shared by M. Ring of JS' group.

FIRST PRIZES IN INTERNATIONAL COMPETITIONS 2011 The neural networks developed in

JS' lab won several contests (with Ciresan, Meier, Masci):1. IJCNN 2011 on-site
Traffic Sign Recognition Competition (1st rank, 2 August 2011, 0.56 % error rate,
the only method better than humans, who achieved 1.16 % on average; 3rd place for
1.69 %).2. ICDAR 2011 offline Chinese handwritten character recognition
competition (1st rank in June 2011).3. Online German Traffic Sign Recognition
Contest (1st & 2nd rank; 1.02% error rate), January 2011.

FRIST RANKS IN MACHINE LEARNING BENCHMARKS 20111. MNIST handwritten digits data
set (perhaps the most famous machine learning benchmark). New record (0.27%) in
June 2011, and human-competitive performance (0.23%) in Dec 2011.2. NORB stereo
image data set, NY University, 2004. New records in 2011.3. CIFAR-10 image data
set of Univ. Toronto. New records in 2011.

SELECTED INVITED TALKS 2011

4. 1 Aug 2011: Keynote for IJCNN 2011, San Jose, California: 2nd Neural Network
ReNNaissance & Formal Theory of Fun3. 4 June 2011: World Science Festival, New
York, New York: Rebooting the Cosmos. Panel: Is the Universe the Ultimate Computer?
2. 27 June 2011: Carl v. Linde Academy, Munich: Optimal AI for all computable
universes (Bavarian TV taped this)1. 16 Jan 2011: Invited Talk for the Winter
Intelligence Conference, Future of Humanity Institute, Oxford (video available)
MORE:
22 Nov 2011 University of Pisa
20 Oct 2011 Exhibit 'Da Vinci al Macello'
9 Aug 2011 Stanford University
29 Jun 2011 Free University Amsterdam,
23 Feb 2011 Arcelor Mittal in Metz
30 Apr 2011 CapoCaccia Neuroinformatics
11 Apr 2011 Max Planck Institute Tuebingen31 Mar 2011 University Bern

TEACHING 2011
WS 2011/2012: Masters Course Intelligent Systems (Machine Learning)

SCIENTIFIC SERVICE 2011

JS reviewed scientific grant proposals and papers,
and served on the editorial boards of various journals.

EXTERNALLY FUNDED PROJECTS SINCE 2009

Value of Schmidhuber's direct external competitive funding at IDSIA
through new grants since 2009 (without funding for project partners): > US$ 6m
(not counting ongoing projects that started earlier).
Total value of corresponding new projects: many times more.
Sources: EU, SNF, CTI, Industry, others.