Marek Grzes

is a postdoctoral research fellow in the School of Computer Science at the University of Waterloo where he works on a MITACS funded project in which decision theory and probabilistic reasoning are applied to building chatbots for electronic commerce and entertainment industry.

Marek Grzes


Telephone: +1 519 888 4567 ext 33023
Fax: +1 519 885 1208
Office: DC 3528
Address:
School of Computer Science
University of Waterloo
200 University Avenue West
Waterloo, Ontario
N2L 3G1 Canada

Email: mgrzes at cs.uwaterloo.ca



Quick links

Research Projects

Professional Activities

Chair

PC Member

Reviewer

Edited volumes

  1. Peter Vrancx, Matt Knudson and Marek Grzes (Eds.): Adaptive and Learning Agents, LNAI, Vol. 7113, Springer, 2012.
  2. Peter Vrancx, Matt Knudson and Marek Grzes (Eds.): Proceedings of AAMAS 2011 Workshop on Adaptive and Learning Agents (ALA 2011), Taipei, Taiwan, 2011 (pdf)
  3. Marek Grzes and Matthew E. Taylor (Eds.): Proceedings of AAMAS 2010 Workshop on Adaptive and Learning Agents (ALA 2010), Toronto, Canada, 2010 (pdf)

Refereed Publications

  1. Marek Grzes and Pascal Poupart: POMDP Planning and Execution in an Augmented Space. Proceedings of the International Conference on Autonomous Agents and Multiagent Systems (AAMAS). Paris, France, 2014. (to appear)
    [pdf] [bibtex]
  2. Marcin Czajkowski, Marek Grzes, and Marek Kretowski: Multi-test Decision Tree and its Application to Microarray Data Classification. Artificial Intelligence in Medicine (AIIM). Elsevier, 2014. (to appear)
    [doi] [bibtex]
  3. Marek Grzes, Jesse Hoey, Shehroz Khan, Alex Mihailidis, Stephen Czarnuch, Dan Jackson and Andrew Monk: Relational Approach to Knowledge Engineering for POMDP-based Assistance Systems as a Translation of a Psychological Model. International Journal of Approximate Reasoning (IJAR). Special Issue of Applications of Bayesian Networks. Vol. 55(1), Part 1, pages 36-58, Elsevier, 2014.
    [pdf] [doi] [software] [bibtex]
  4. Marek Grzes, Pascal Poupart and Jesse Hoey: Controller Compilation and Compression for Resource Constrained Applications. Proceedings of International Conference on Algorithmic Decision Theory (ADT). Brussels, Belgium, 2013.
    [pdf] [slides] [bibtex]
  5. Marek Grzes, Pascal Poupart and Jesse Hoey: Isomorph-free Branch and Bound Search for Finite State Controllers. Proceedings of International Joint Conference on Artificial Intelligence (IJCAI). Beijing, China, 2013.
    [pdf] [poster] [bibtex]
  6. Marek Grzes and Jesse Hoey: On the Convergence of Techniques that Improve Value Iteration. Proceedings of International Joint Conference on Neural Networks (IJCNN). Dallas, USA, 2013.
    [pdf] [poster] [bibtex]
  7. Jesse Hoey, Xiao Yang, Marek Grzes, Rene Navarro and Jesus Favela. Modeling and Learning for LaCasa, the Location And Context-Aware Safety Assistant. In NIPS 2012 Workshop on Machine Learning Approaches to Mobile Context Awareness. Lake Tahoe, NV, 2012.
  8. Marek Grzes and Jesse Hoey: Analysis of Methods for solving MDPs. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems (AAMAS). Valencia, Spain, 2012. (pdf)
  9. Michael G. Melonis, Alex Mihailidis, Ryan Keyfitz, Marek Grzes, Jesse Hoey, and Cathy Bodine: Empowering Adults With a Cognitive Disability Through Inclusion of Non-Linear Context Aware Prompting Technology (N-CAPS). In Proceedings of the RESNA Annual Conference. Baltimore, USA, 2012. (pdf)
  10. Marcin Czajkowski, Marek Grzes, and Marek Kretowski. Multi-Test Decision Trees for Gene Expression Data Analysis. In Proceedings of the International Joint Conference on Security and Intelligent Information Systems. Warsaw, Poland, Springer, LNCS, 7053: 154-167, 2011. (url)
  11. Veronika Koltunova, Jesse Hoey, and Marek Grzes. Goal-Oriented Sensor Selection for Intelligent Phones (GOSSIP). In Proceedings of the UbiComp International Workshop on Situation, Activity and Goal Awareness. Beijing, China, ACM, 2011. (url)
  12. Marek Grzes, Jesse Hoey, Shehroz Khan, Alex Mihailidis, Stephen Czarnuch, Dan Jackson and Andrew Monk: Relational Approach to Knowledge Engineering for POMDP-based Assistance Systems with Encoding of a Psychological Model. In Proceedings of the ICAPS 2011 Workshop on Knowledge Engineering for Planning and Scheduling (KEPS), Freiburg, Germany, 2011. (pdf).
  13. Sam Devlin, Daniel Kudenko, and Marek Grzes. An empirical study of potential-based reward shaping and advice in complex, multi-agent systems. Advances in Complex Systems, 14(2): 251-278, 2011. (url)
  14. Jesse Hoey and Marek Grzes: Distributed control of situated assistance in large domains with many tasks. In Proceedings of International Conference on Automated Planning and Scheduling (ICAPS), Freiburg, Germany, 2011.
  15. Marek Grzes and Jesse Hoey: Efficient planning in R-max. In Proceedings of the 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Taipei, Taiwan, 2011.
  16. Sam Devlin, Marek Grzes, and Daniel Kudenko: Multi-agent, potential-based reward shaping for robocup keepaway. In Proceedings of the 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Taipei, Taiwan, 2011.
  17. Marek Grzes and Daniel Kudenko: Reward shaping and mixed resolution function approximation. In Developments in Intelligent Agent Technologies and Multi-Agent Systems: Concepts and Applications. IGI Press, 2011.
  18. Sam Devlin, Marek Grzes, and Daniel Kudenko: Multi-agent Reinforcement Learning with Reward Shaping for KeepAway Takers. In Proceedings of AAMAS 2010 Workshop on Adaptive and Learning Agents (ALA 2010), Toronto, Canada, 2010.
  19. Marek Grzes and Daniel Kudenko: PAC-MDP learning with knowledge-based admissible models. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Toronto, Canada, 2010, ACM Press.
    [slides] [poster]
  20. Marek Grzes and Daniel Kudenko: Online learning of shaping rewards in reinforcement learning. Neural Networks, 23(4): 541-550, 2010.
  21. Marek Grzes and Daniel Kudenko: Theoretical and empirical analysis of reward shaping in reinforcement learning. In Proceesings of International Conference on Machine Learning and Applications, Miami, USA, 2009. IEEE Computer Society.
  22. Marek Grzes and Daniel Kudenko: Learning shaping rewards in model-based reinforcement learning. In Proceedings of AAMAS 2009 Workshop on Adaptive Learning Agents (ALA 2009), Budapest, Hungary, 2009.
  23. Marek Grzes and Daniel Kudenko: Reinforcement learning with reward shaping and mixed resolution function approximation. International Journal of Agent Technologies and Systems (IJATS), 1(2):36-54, 2009.
  24. Sam Devlin, Marek Grzes, and Daniel Kudenko: Reinforcement learning in robocup keepaway with partial observability. In Proceedings of the IEEE/WIC/ACM International Conferences on Intelligent Agent Technology (IAT 2009), Milan, Italy, 2009. IEEE Computer Society.
  25. Marek Grzes and Daniel Kudenko: Improving optimistic exploration in model-free reinforcement learning. In Proceeding of the International Conference on Adaptive and Natural Computing Algorithms (ICANNGA'09), volume 5495 of LNCS, Kuopio, Finland, 2009. Springer.
  26. Marek Grzes, Daniel Kudenko: Plan-based reward shaping for reinforcement learning. In: Proceedings of the 4th IEEE International Conference on Intelligent Systems (IS 2008), IEEE, vol. 2:22-29, Varna, Bulgaria, 2008. (url)
  27. Marek Grzes, Daniel Kudenko: Robustness Analysis of SARSA(lambda): Different Models of Reward and Initialisation. In: Proceedings of the 13th International Conference on Artificial Intelligence: Methodology, Systems, Applications (AIMSA 2008), Springer LNAI, vol. 5253:144-156, Varna, Bulgaria, 2008. (url)
  28. Marek Grzes, Daniel Kudenko: Multigrid reinforcement learning with reward shaping. In: Proceedings of the 18th International Conference on Artificial Neural Networks (ICANN 2008), Springer LNCS, vol. 5163:357-366, Prague, Czech Republic, 2008. (url)
  29. Marek Grzes, Daniel Kudenko: An Empirical Analysis of the Impact of Prioritised Sweeping on the DynaQ's Performance. In: Proceedings of the 9th International Conference on Artificial Intelligence and Soft Computing (ICAISC 2008), Springer LNCS, vol. 5097:1041-1051, Zakopane, Poland, 2008. (url)
  30. Marek Grzes, Daniel Kudenko: Learning potential for reward shaping in reinforcement learning with tile coding. In Proceedings of the AAMAS'08 Workshop on Adaptive and Learning Agents and Multi-Agent Systems (ALAMAS-ALAg 2008), pages 17-23, Estoril, Portugal, 2008.
  31. Marek Grzes, Daniel Kudenko: Plan-based reward shaping for reinforcement learning. In Proceedings of the AAMAS'08 Workshop on Adaptive and Learning Agents and Multi-Agent Systems (ALAMAS-ALAg 2008), pages 9-16, Estoril, Portugal, 2008.
  32. Marek Kretowski, Marek Grzes: Global Induction of Decision Trees. Encyclopedia of Data Warehousing and Mining - 2nd Edition, Idea Group Inc., 2008.
  33. Marek Kretowski, Marek Grzes: Evolutionary Induction of Mixed Decision Trees. In Wang, J. (Ed.), Data Warehousing and Mining: Concepts, Methodologies, Tools, and Applications, Idea Group Inc., 2008.
  34. Marek Kretowski, Marek Grzes: Evolutionary Induction of Mixed Decision Trees. International Journal of Data Warehousing and Mining, vol. 3(4): 68-82, 2007. (url)
  35. Marek Grzes, Marek Kretowski: Decision Tree Approach to Microarray Data Analysis. Biocybernetics and Biomedical Engineering, vol. 27(3): 29-42, 2007.
  36. Marek Kretowski, Marek Grzes: Evolutionary Induction of Decision Trees for Misclassification Cost Minimization. In: Proceedings of 8th International Conference on Adaptive and Natural Computing Algorithms (ICANNGA 2007), Warsaw, Poland, Springer LNCS, vol. 4431:1-10, 2007.
  37. Marek Kretowski, Marek Grzes: Evolutionary Induction of Cost-Sensitive Decision Trees. In: Proceedings of 16th International Symposium on Methodologies for Intelligent Systems (ISMIS 2006), Bari, Italy, Springer LNAI, vol. 4203:121-126, 2006.
  38. Marek Kretowski, Marek Grzes: Mixed Decision Trees: An Evolutionary Approach. In: Proceedings of 8th International Conference on Data Warehousing and Knowledge Discovery (DaWaK 2006), Krakow, Poland, Springer LNCS, vol. 4081:260-269, 2006.
  39. Marek Kretowski, Marek Grzes: Evolutionary Learning of Linear Trees with Embedded Feature Selection. In: Proceedings of 8th International Conference on Artificial Intelligence and Soft Computing (ICAISC 06), Zakopane, Poland, Springer LNCS, vol. 4029:400-409, 2006.
  40. Marek Grzes, Marek Kretowski: Decision tree approach to microarray data analysis. In: Proceedings of 6th International Seminar on Statistics and Clinical Practice. Lecture Notes in The ICB Seminar, vol. 70:105-111, 2005.
  41. Marek Kretowski, Marek Grzes: Global learning of decision trees by an evolutionary algorithm. In: Information Processing and Security Systems. Springer, pages 401-410, 2005.
    [pdf] [bibtex] [software]
  42. Marek Kretowski, Marek Grzes: Global Induction of Oblique Decision Trees: An Evolutionary Approach. In: Intelligent Information Processing and Web Mining. Proceedings of Intelligent Information Systems (IIS 2005), Springer, pages 309-319, 2005.
    [pdf] [bibtex] [software]
  43. Marek Kretowski, Marek Grzes: An evolutionary algorithm for global induction of decision trees. ACS-CISIM 04, pages 63-70, Elk, Poland, 2004.

Other Publications

  1. Daniel Kudenko and Marek Grzes: Knowledge-based reinforcement learning for data mining. In Proceedings of the AAMAS workshop on Agents and Data Mining Interaction, volume 5680 of LNCS, Budapest, Hungary, 2009. Springer-Verlag.

Dissertations


Software


Misc


Related and Useful Links



Academic Genealogy

This tree was created by Haym Hirsh and its original version can be found here.

Last modified Thursday, 03rd April, 2014 10:06am

statystyka