Lab 8: Robot Tournament Part 2

Pre-lab

  1. Check for current bugs here and make sure they are fixed before proceeding with the training
  2. Get together with your group and complete the following:
    • Discuss and choose a strategy you want your robot to use to play the game
    • Implement the strategy you chose in your script (the one renamed to your robot’s name from the last lab)
      • Add rewards for your robot as needed when implementing your strategy
    • Once the strategy is implemented, train your robot to obtain your first model
      • It is recommended that you train your robot for a while so meaningful behavior is established and can be evaluated
  3. Submit the following for the pre-lab:
    • A brief description of the strategy your group chose and how it was implemented (e.g. additional helpers you wrote, where rewards are added, etc.)
    • The model you obtained from the training
    • How long it takes to train the model
    • Briefly evaluate the model you obtained. What does the robot seem to be doing well? What seems to be lacking? How can its performance be improved, strategy and implementation-wise?

 

Lab

  • Your TA will address your questions from post-lab 7
  • TA Demo: training settings
    1. Behavioural cloning
    2. Generative adversarial imitation learning (GAIL)
  • TA Demo: modifying your robot appearance (by editing/adding prefabs)
  • In your groups:
    1. Adjust training settings: add behavioural cloning and/or GAIL and test out the training
      • Once you’re done: show your TA and explain what you did with the settings
    2. Tweak your strategy/implementation based on your analysis of your first model
    3. Modify your robot’s appearance and home base (by adjusting home base material)
    4. Show your TA your progress on one of 2 or 3

 

Postlab

  1. What changes were made to strategy/implementation? Give a brief justification for your changes.
  2. What training settings did you apply? Briefly explain what the settings does.