Q-Learning FrozenLake Performance Analysis
Budget / SalaryHourly project
TypeFreelance project
LocationRemote
Posted1 hour ago
Task #2: We will set the is_slippery to False and True and compare the performance. You are required to generate a random 6x6 valid grid with a 20% probability that a tile is hole. You will also initialize the environment. The agent should be initialized at the grid (0,0) and the goal should be at (5,5). You want to move the agent from the start to the goal.
2.1. Describe the following elements in this environment using your own words:
• Observations
• Action Space
• Reward
• The environment’s information dictionary
• Episode
2.2. Implement an agent based on Q-learning for training the agent to move from the start to the
end. Describe how you deployed the agent, how you initialized the parameters, how the Qlearning
is trained using the data. You must present the process of training the agent, explaining
the experimental settings, and discussing your results. Using figures and diagrams
shows the average amount of rewards over episodes over time. For this task, you need to
compare the performance differences when is_slippery is set to True and False.
Your work needs to show that you have described those concepts in 2.1 indicating that you
have excellent understanding of those concepts. You need to achieve excellent results in 2.2.
The learning process using Q-learning needs to be fully described, showing that you have deep
understanding of Q-learning. Results need to be shown using Figures and/or diagrams with
justifications. You also need to implement the experiments with two settings in is_slippery
and achieved excellent results.
I will be sharing coding notebooks for referencing/modifications.
Need to submit jupyter notebook and word-limited report.
Using AI is not permitted for both code and report (in code, you can refer to the notebooks I’ll share specifying the modifications you make on them or other open sources like libraries websites or official documentations)
2.1. Describe the following elements in this environment using your own words:
• Observations
• Action Space
• Reward
• The environment’s information dictionary
• Episode
2.2. Implement an agent based on Q-learning for training the agent to move from the start to the
end. Describe how you deployed the agent, how you initialized the parameters, how the Qlearning
is trained using the data. You must present the process of training the agent, explaining
the experimental settings, and discussing your results. Using figures and diagrams
shows the average amount of rewards over episodes over time. For this task, you need to
compare the performance differences when is_slippery is set to True and False.
Your work needs to show that you have described those concepts in 2.1 indicating that you
have excellent understanding of those concepts. You need to achieve excellent results in 2.2.
The learning process using Q-learning needs to be fully described, showing that you have deep
understanding of Q-learning. Results need to be shown using Figures and/or diagrams with
justifications. You also need to implement the experiments with two settings in is_slippery
and achieved excellent results.
I will be sharing coding notebooks for referencing/modifications.
Need to submit jupyter notebook and word-limited report.
Using AI is not permitted for both code and report (in code, you can refer to the notebooks I’ll share specifying the modifications you make on them or other open sources like libraries websites or official documentations)
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.