Interest Areas

• Soft-Computing & Computational Intelligence
• Robotics
• Reinforcement Learning
• Evolutionary Computation
• Cybernetics
• Psychology
• Brain Research
• Pattern Recognition & Computer Vision
• Graph Theory
• Discrete Math

 Assistant Professor

PhD in Computer Science and Artificial Intelligence.

"Studies on Adaptive Systems with applications in Autonomous Robots and Intelligent Agents"

 at the Artificial Intelligence Dept. (DIA).

Universidad Politécnica de Madrid

Other relevant sites:

Dr. Javier de Lope (My Advisor)

Reinforcement Learning and Artificial Intelligence

http://www.rl-community.org/

• Session Chair (INTELLIGENT CONTROL SYSTEMS AND OPTIMIZATION) at ICINCO 2007, 4th International Conference on Informatics in Control, Automation and Robotics (ICINCO), Angers, France, May 9-12, 2007.

• Local organizing committee of the FLINS 2008, 8th International FLINS Conference on Computational Intelligence in Decision and Control, Madrid, Spain, September 21-24, 2008.

• Member of the technical committee of Third Annual Reinforcement Learning Competition. a part of the 2009 International Conference on Machine Learning (ICML'09), Montreal, Canada, June 18, 2009.

• Session Co-Chair (Bioinspired applications III) at IWINAC 2009, Session Co-Chair (Bioinspired applications III) at IWINAC 2009, third "International Work-conference on the Interplay between Natural and Artificial Computation" IWINAC 2009, Santiago de Compostela, Galicia, Spain, June 22-26, 2009.

• Reviewer for the Pattern Recognition Letters Journal (PatRec). An official publication of the International Association for Pattern Recognition, Acknowledgement,  Pattern Recognition Letters(28),  pp. 2437 – 2444, 2007.     doi:10.1016/S0167-8655(07)00311-X  

• José Antonio Martin H., Matilde Santos & Javier de Lope (2010), "Orthogonal Variant Moments Features in Image Analysis" , Information Sciences., March, 2010. Vol. 180(6), pp. 846 - 860.

  [DOI] [URL]

• Andrés García García, José Antonio Martín H. & María Teresa Gutiérrez Domínguez (2010), "A Computational Model for the Formation of Equivalence Classes" , International Journal of Psychology and Psychological Therapy., March, 2010. Vol. 10(1), pp. 163-176.

  [URL]

• Jose Antonio Martin H., Javier de Lope & Dario Maravall (2009), "Adaptation, Anticipation and Rationality in natural and artificial systems: computational paradigms mimicking nature" , Natural Computing., December, 2009. Vol. 8(4), pp. 757-775.

  [DOI] [URL]

• Jose Antonio Martin H., Matilde Santos, G. Farias, N. Duro, J. Sanchez, R. Dormido, S. Dormido-Canto, J. Vega & H. Vargas (2009), "Dynamic Clustering and Modeling Approaches for Fusion Plasma Signals" , IEEE Transactions on Instrumentation and Measurement., September, 2009. Vol. 58(9), pp. 2969 - 2978.

  [DOI]

• José Antonio Martin H., Javier de Lope & Matilde Santos (2009), "A Method to Learn the Inverse Kinematics of Multi-link Robots by Evolving Neuro-Controllers" , Neurocomputing., August, 2009. Vol. 72(13-15), pp. 2806-2814.

  [DOI]

• Jose Antonio Martin H. & Javier de Lope (2009), "A Model for the Dynamic Coordination of Multiple Competing Goals" , Journal of Experimental & Theoretical Artificial Intelligence., June, 2009. Vol. 21(2), pp. 123-136.

  [DOI]

• Darío Maravall, Javier de Lope & Jose Antonio Martin H. (2009), "Hybridizing Evolutionary Computation and Reinforcement Learning for the Design of Almost Universal Controllers for Autonomous Robots" , Neurocomputing., January, 2009. Vol. 72(4-6), pp. 887-894.

  [DOI] [URL]

• S. Dormido-Canto, G. Farias, J. Vega, R. Dormido, J. Sanchez, N. Duro, M. Santos & José Antonio Martin H. (2006), "Search and retrieval of plasma wave forms: Structural pattern recognition approach" , Review of Scientific Instruments., September, 2006. Vol. 77 (10)

  [DOI] [URL]

• José Antonio Martin H. & Javier de Lope (2009), "Ex<a> : An Effective Algorithm for Continuous Actions Reinforcement Learning Problems" , In Proceedings of 35th Annual Conference of the IEEE Industrial Electronics Society (IECON 2009) . Oporto, Portugal. November 2009., pp. 2063 - 2068. IEEE.

  [DOI] [URL] [IECON 2009]

• José Antonio Martin H. & Javier de Lope Asian (2009), "Learning Autonomous Helicopter Flight with Evolutionary Reinforcement Learning" , In Computer Aided Systems Theory - EUROCAST 2009,12th International Conference, Las Palmas de Gran Canaria, Spain, February 15-20, 2009, Revised Selected Papers (EUROCAST 2009) . September 2009. Lecture Notes in Computer Science Vol. 5717, pp. 75-82. Springer Berlin / Heidelberg.

  [DOI] [URL] [EUROCAST 2009]

• José Antonio Martin H., Javier de Lope Asian & Daro Maravall (2009), "Learning to Coordinate Multi-robot Competitive Systems by Stimuli Adaptation" , In Part II, Bioinspired Applications in Artificial and Natural Computation (IWINAC 2009) . Santiago de Compostela, Spain. June 2009. Lecture Notes in Computer Science Vol. 5602, pp. 362-371. Springer.

  [DOI] [IWINAC 2009]

• José Antonio Martin H., Javier de Lope Asian & Daro Maravall (2009), "The kNN-TD Reinforcement Learning Algorithm" , In IWINAC Part I, Methods and Models in Artificial and Natural Computation (IWINAC 2009) . Santiago de Compostela, Spain. June 2009. Lecture Notes in Computer Science Vol. 5901, pp. 305-314. Springer.

  [DOI] [IWINAC 2009]

• Javier de Lope, Jose Antonio Martin H & Darío Maravall (2009), "Applying Reinforcement Learning to Modular Cooperative Robotic Systems" , Multidisciplinary Symposium on Reinforcement Learning (MSRL 2009) . Montreal, Canada. June 2009.

  [URL] [MSRL 2009]

• José Antonio Martin H. & Javier De Lope (2009), "Learning Autonomous Helicopter Flight with Evolutionary Reinforcement Learning" , In Proceedings of the 12th International Conference on Computer Aided Systems Theory EUROCAST 2009 (EUROCAST 2009) . Las Palmas de Gran Canaria, Spain. February 2009., pp. 25-26. IUCTC Universidad de Las Palmas de Gran Canaria.

  [EUROCAST 2009]

• José Antonio Martin H., Javier de Lope & Matilde Santos (2008), "Evolution of Neuro-controllers for Multi-link Robots" , In Innovations in Hybrid Intelligent Systems (HAIS 2008) . Salamanca, Spain. November 2008. Advances in Soft Computing Vol. 44, pp. 175-182. Springer Verlag.

  [DOI] [URL] [HAIS 2008]

• José Antonio Martin H, Matilde Santos, Andrés García & Javier de Lope (2008), "A Computational Model of the Equivalence Class Formation Psychological Phenomenon" , In Innovations in Hybrid Intelligent Systems (HAIS 2008) . Salamanca, Spain. November 2008. Advances in Soft Computing Vol. 44, pp. 104-111. Springer Verlag.

  [DOI] [URL] [HAIS 2008]

• Andrés García, José Antonio Martin H. & Mayte Gutiérrez (2008), "A computational model for the formation of equivalence classes" , Fourth Conference of the European Association for Behaviour Analysis (Eaba 2008) . Madrid, Spain. September 2008.

  [Eaba 2008]

• José Antonio Martin H & Matilde Santos (2008), "Application of Orthogonal Variant Moments to Computer Vision" , In Computational Intelligence In Decision And Control: Proceedings Of The 8th International Flins Conference (FLINS 2008) . Madrid, Spain. September 2008. World Scientific Proceedings Series on Computer Engineering and Information Science Vol. 1, pp. 441-446. World Scientific.

  [DOI] [URL] [FLINS 2008]

• Yolanda Sanz, Javier de Lope Asian & José Antonio Martin H. (2008), "Applying Reinforcement Learning to Multi-robot Team Coordination" , In Hybrid Artificial Intelligence Systems, Third International Workshop (HAIS 2008) . Burgos, Spain. September 2008. Lecture Notes in Computer Science Vol. 5271, pp. 625-632. Springer.

  [DOI] [URL] [HAIS 2008]

• Jose Antonio Martín H. (2008), "Approaches for the RL Competition 2008" . Helsinki, Finland. July 2008.

  [ICML - RL2008 2008]

• Javier de Lope, Juan San Martin & Jose Antonio Martin H. (2007), "Helicopter Flight Dynamics Using Soft Computing Models" , In Computer Aided Systems Theory – EUROCAST 2007, Revised Selected Papers (EUROCAST 2007) . Las Palmas de Gran Canaria, Spain. November 2007. Lecture Notes in Computer Science Vol. 4739, pp. 621-628. Springer Berlin / Heidelberg.

  [DOI] [URL] [EUROCAST 2007]

• José Antonio Martin H. & Javier de Lope (2007), "A k-NN Based Perception Scheme for Reinforcement Learning" , In Computer Aided Systems Theory – EUROCAST 2007, Revised Selected Papers (EUROCAST 2007) . Las Palmas de Gran Canaria, Spain. November 2007. Lecture Notes in Computer Science Vol. 4739, pp. 138-145. Springer Berlin / Heidelberg.

  [DOI] [URL] [EUROCAST 2007]

• Jose Antonio Martin H., Matilde Santos, G. Farias, N. Duro, J. Sanchez, R. Dormido, S. Dormido-Canto & J. Vega (2007), "Dynamic Clustering and Neuro-Fuzzy Identification for the Analysis of Fusion Plasma Signals" , In 2007 IEEE International Symposium on Intelligent Signal Processing (WISP 2007) . Alcalá de Henares, Spain. October 2007. IEEE, pp. 979-984. IEEE.

  [DOI] [WISP 2007]

• José Antonio Martin H. & Javier de Lope (2007), "Concepts and Models for the Future Generation of Emotional and Intelligent Systems" , In Bio-inspired Modeling of Cognitive Tasks (IWINAC 2007) . La Manga del Mar Menor, Spain. June 2007. Lecture Notes in Computer Science Vol. 4527, pp. 41-50. Springer.

  [DOI] [URL] [IWINAC 2007]

• Darío Maravall, Javier de Lope & Jose Antonio Martin H. (2007), "Combining the Best of the Two Worlds: Inheritance Versus Experience" , In Nature Inspired Problem-Solving Methods in Knowledge Engineering (IWINAC 2007) . La Manga del Mar Menor, Spain. June 2007. Lecture Notes in Computer Science Vol. 4528, pp. 337-346. Springer.

  [DOI] [URL] [IWINAC 2007]

• José Antonio Martin H. & Javier de Lope (2007), "A distributed reinforcement learning control architecture for multi-link robots - experimental validation" , In ICINCO-ICSO (ICINCO 2007) . Angers, France. May 2007., pp. 192-197. INSTICC Press.

  [ICINCO 2007]

• José Antonio Martin H. & Javier De Lope (2007), "A k-NN Based Perception Scheme for Reinforcement Learning" , In Computer Aided Systems Theory EUROCAST 2007 (EUROCAST 2007) . Las Palmas de Gran Canaria, Spain. February 2007., pp. 55-57. IUCTC Universidad de Las Palmas de Gran Canaria.

  [EUROCAST 2007]

• Javier de Lope, Juan San Martin & Jose Antonio Martin H. (2007), "Helicopter Flight Dynamics Using Soft Computing Models" , In Computer Aided Systems Theory EUROCAST 2007 (EUROCAST 2007) . Las Palmas de Gran Canaria, Spain. February 2007., pp. 219-220. IUCTC Universidad de Las Palmas de Gran Canaria.

  [EUROCAST 2007]

• Jose Antonio Martin H. (2006), "Hidden Edges in Graph Coloring" , In International e-conference of computer science 2006 (IeCCS 2006) . Lecture Series on Computer and Computational Science Vol. 8, pp. 167-170. VSP Brill.

  [URL] [IeCCS 2006]

• Jose Antonio Martin H. & Matilde Santos (2006), "Orthogonal Variant Moments in Computer Vision" , In International e-conference of computer science 2006 (IeCCS 2006) . Lecture Series on Computer and Computational Science Vol. 8, pp. 163-166. VSP Brill.

  [URL] [IeCCS 2006]

• José Antonio Martin H. & Javier de Lope (2006), "Dynamic goal coordination in physical agents" , In Proceedings of the 3rd International Conference on Informatics in Control, Automation and Robotic (ICINCO 2006) . Setúbal, Portugal. August 2006., pp. 154-159. INSTICC Press.

  [ICINCO 2006]

• Jose Antonio Martin H., Matilde Santos, G. Pajares, G. Farias, N. Duro, J. Sanchez, R. Dormido, S. Dormido-Canto, J. Vega, M. Ruiz, E. Barrera & S. Lopez (2006), "Approach to real-time event detection in continuous data flows based on neuro-fuzzy models" , In 16th Annual Conference on High-Temperature Plasma Diagnostics. Abstracts Book (HTPD 2006) . Williamsburg, VA. May 2006.

  [HTPD 2006]

• Jose Antonio Martin H., Teresa de Pedro, Carlos González, Ricardo García, Luís Argüelles, Jose Rivas & Javier Toraño (2005), "Fuzzy Modeling for Coal Seams A Case Study for a Hard-Coal Mine" , In Computer Aided Systems Theory EUROCAST 2005, Revised Selected Papers (EUROCAST 2005) . Las Palmas de Gran Canaria, Spain. October 2005. Lecture Notes in Computer Science Vol. 3643, pp. 33-37. Springer Berlin / Heidelberg.

  [DOI] [EUROCAST 2005]

• Jose Antonio Martín H., Carlos González, Ricardo García Rosa & de Pedro. Teresa (2005), "A fuzzy expressions processor with modifiers and hedges, conceptual design and tests" , In Proccedings of the Fourth Conference of the European Society for Fuzzy Logic and Technology (EUSFLAT 2005) and Eleventh Rencontres Francophones sur la Logique Floue et ses Applications (LFA 2005) (EUSFLAT 2005) . Barcelona, Spain. September 2005., pp. 357-362. Universidad Polytecnica de Catalunya.

  [URL] [EUSFLAT 2005]

• Jose Antonio Martin H. (2005), "Search space modulation in genetic algorithms: evolving the search space by sinusoidal transformations" , In Proceedings of the 2005 conference on Genetic and evolutionary computation (GECCO 2005) . Washington D.C., USA. June 2005., pp. 1559-1560. ACM.

  [DOI] [URL] [GECCO 2005]

• Jose Antonio Martin H. (2005), "Physical Traveling Salesperson Problem for GECCO 2005" , Physical Traveling Salesperson Problem (PTSP 2005) . Washington D.C. USA. June 2005.

  [URL] [PTSP 2005]

• Jose Antonio Martin H., Teresa de Pedro, Carlos González, Ricardo García, Luís Argüelles, Jose Rivas & Javier Toraño (2005), "Fuzzy Modeling for Coal Seams A Case Study for a Hard-Coal Mine" , In Cast and Tools for Robotics, Vehicular and Communication Systems, EUROCAST 2005 (EUROCAST 2005) . Las Palmas de Gran Canaria, Spain. February 2005., pp. 13-14. IUCTC Universidad de Las Palmas de Gran Canaria.

  [EUROCAST 2005]

• Jose Antonio Martin H. & Javier Alonso Ruiz (2004), "Formalización de maniobras en robots con múltiples grados de libertad como sistemas multiagente" , In Procedings of the IX Jornadas de Ingeniería del Software y Bases de Datos JISBD, DESMA. (DESMA 2004) . Malaga, España. November 2004. Vol. 1, pp. 38-47.

  [URL] [DESMA 2004]