Multi-Objective Deep Reinforcement Learning with Lexicographic Task-priority constraints
In this post I summarize our recent paper and advocate for less reward engineering in favor of constrained RL.
Blog (sorted by years)
Sort by categories or tags
2023
Easy Language Learning with ChatGPT and Python
This post describes how to use ChatGPT with python for easy language (or anything else) learning.
Fun with Cellular Automata
Some information regarding the animation playing as the banner on my website's landing page.
Fun with Graph Neural Networks
Analysis of Graph Neural Networks by comparison to Multilayer Perceptrons on a simple graph-classification task.
2022
Autonomous Navigation with Pepper Robots
We extended the Pepper robot with additional sensors and implemented the powerful ROS navigation stack to achieve autonomous navigation with Pepper.
2021
Hokuyo UST-10LX with ROS Setup
In this post I describe how to set up and configure a Raspberry Pi 3 to collect laser data from the Hokuyo UST-10LX sensor via ROS.
Neural activity animated visualization
Animated visualization of neural activity in different neural networks, made with Python.
2020
WoZ4U: An Open Source Interface for the Pepper robot
Study visit at the Intelligent Robotics group in Umeå, Sweden: A comprehensive interface for Softbanks Pepper robot.
Soft Actor Critic: Deep Reinforcement Learning for Robotics?
This post addresses real life feasibility of deep Reinforcement Learning algorithms and how the Soft Actor Critic algorithm relates to the problem.
Docker + ROS: How to listen to ROS nodes in External Docker Containers
Learn how to configure Docker for comminucation with ROS.
2019
Decorate-Sort-Undecorate: List Sorting in Python
Understand the 'Decorate-Sort-Undecorate' idiom for advanced sorting in python.
Automatically Backup any Postgres Database Table into a GoogleDrive
Learn how you can backup any Postgress database table into a GoogleDrive folder using two small scripts and the crontab.
Convolutional features for visual scale estimation
My bachelor Thesis: Scale estimation for online Visual Object Tracking based on convolutional features.
2018
Multimanual Interaction on a 3D Fitt’s Law Task
Using an Oculus Rift alongside a Leap Motion, we investigated interaction techniques for virtual hands.