Multi-Objective Deep Reinforcement Learning with Lexicographic Task-priority constraints
In this post I summarize our recent paper and advocate for less reward engineering in favor of constrained RL.
Blog (sorted by categories)
Machine Learning
Easy Language Learning with ChatGPT and Python
This post describes how to use ChatGPT with python for easy language (or anything else) learning.
Fun with Graph Neural Networks
Analysis of Graph Neural Networks by comparison to Multilayer Perceptrons on a simple graph-classification task.
Neural activity animated visualization
Animated visualization of neural activity in different neural networks, made with Python.
Soft Actor Critic: Deep Reinforcement Learning for Robotics?
This post addresses real life feasibility of deep Reinforcement Learning algorithms and how the Soft Actor Critic algorithm relates to the problem.
Convolutional features for visual scale estimation
My bachelor Thesis: Scale estimation for online Visual Object Tracking based on convolutional features.
Python
Fun with Cellular Automata
Some information regarding the animation playing as the banner on my website's landing page.
Neural activity animated visualization
Animated visualization of neural activity in different neural networks, made with Python.
Soft Actor Critic: Deep Reinforcement Learning for Robotics?
This post addresses real life feasibility of deep Reinforcement Learning algorithms and how the Soft Actor Critic algorithm relates to the problem.
Decorate-Sort-Undecorate: List Sorting in Python
Understand the 'Decorate-Sort-Undecorate' idiom for advanced sorting in python.
Automatically Backup any Postgres Database Table into a GoogleDrive
Learn how you can backup any Postgress database table into a GoogleDrive folder using two small scripts and the crontab.
Linux
Hokuyo UST-10LX with ROS Setup
In this post I describe how to set up and configure a Raspberry Pi 3 to collect laser data from the Hokuyo UST-10LX sensor via ROS.
Docker + ROS: How to listen to ROS nodes in External Docker Containers
Learn how to configure Docker for comminucation with ROS.
Automatically Backup any Postgres Database Table into a GoogleDrive
Learn how you can backup any Postgress database table into a GoogleDrive folder using two small scripts and the crontab.
Robotics
Autonomous Navigation with Pepper Robots
We extended the Pepper robot with additional sensors and implemented the powerful ROS navigation stack to achieve autonomous navigation with Pepper.
WoZ4U: An Open Source Interface for the Pepper robot
Study visit at the Intelligent Robotics group in Umeå, Sweden: A comprehensive interface for Softbanks Pepper robot.
Virtual Reality
Multimanual Interaction on a 3D Fitt’s Law Task
Using an Oculus Rift alongside a Leap Motion, we investigated interaction techniques for virtual hands.