Ing. Marko Ruman

Education 

Present Jun 2018 Ph.D. - Mathematical Engineering State Doctoral Exam with honors Faculty of Nuclear Sciences and Physical Engineering, Czech Technical University, Prague, Czech Republic 

Jun 2018 Sep 2016 MSc. - Mathematical Engineering GPA: 3.97 Magna cum laude Faculty of Nuclear Sciences and Physical Engineering, Czech Technical University, Prague, Czech Republic Aug 

2016 Sep 2013 BSc. - Mathematical Engineering GPA: 3.55 Magna cum laude Faculty of Nuclear Sciences and Physical Engineering, Czech Technical University, Prague, Czech Republic 

Work Experience 

Present Jul 2015 Research Assistant - Institute of Information Theory and Automation, Czech Academy of Sciences 

ˆ Co-authored 7 papers on reinforcement learning, learning of dynamic stochastic environments and modelling human decision making as Markov decision processes 

ˆ Presented own research at conferences NIPS, ICANN and ICCAIRO 

ˆ Developed a Python library implementing the researched universally approximating model of dynamic environments called Mixture Ratios 

ˆ Recently developed a novel method for knowledge transfer in deep reinforcement learning 

ˆ Participated as a team member of two international and four Czech research projects 

ˆ Served as a member of the Organising Committee of COST 2019 GAMENET Conference Research interests 

ˆ Knowledge transfer in deep reinforcement learning ˆ Bayesian learning of dynamic stochastic environments 

ˆ Markov decision processes 

Jan 2020 Apr 2018 Co-Founder - Optimifica 

ˆ Developed a custom ML model for predicting customers’ interest in specific products used by retail companies 

ˆ Achieved 40% success rate when recommending 5 products for a new basket for retail companies with low-frequency customer base (2-3 visits per year on average) 

ˆ Increased margin of retail companies by 5% by utilising micro-targeted product recommendations produced by the custom ML model Apr 2018 Oct 2004 ML and web development - Freelancer 

ˆ Coded my first website when I was 12, worked on many machine learning and web development projects since then