Customizing AWS DeepRacer Action Space
?
3 likes?772 views
The document discusses customizing the action space for AWS DeepRacer. It describes how the action space is defined in the console and via a JSON file, and how it is used during training to analyze the model's steering actions. The document provides tips on changing the action space, such as moving steering angles, dropping unused actions, or merging actions. It advises to make only small changes when cloning models and to allow time for the new model to adapt.
Customizing AWS DeepRacer Action Space
- 2. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Customizing AWS DeepRacer Action Space Kire Galev AWS DeepRacer Expert Boot Camp Computer Vision Developer
- 3. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Action Space in Console A W S D e e p R a c e r E x p e r t B o o t C a m p ? Works fine ? Easy to use ? Once defined can¡¯t be changed ? Stays same after cloning (transfer learning)
- 4. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Action Space .json file location A W S D e e p R a c e r E x p e r t B o o t C a m p Console: S 3 : / / a ws - d e e p r a c e r - a 2 5 4 4 9 7 8 - 4 0 e 3 - b 2 a 1 - c 2 7 9 - 9 9 3 0 4 a d b d 8 1 6 / m o d e l - m e t a d a t a / M o d e l - n a m e / m o d e l _ m e t a d a t a . j s o n Local training: m o d e l _ m e t a d a t a . j s o n i n c u s t o m _ f i l e s f o l d e r
- 5. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. How is used my Action Space A W S D e e p R a c e r E x p e r t B o o t C a m p Histograms for : ? Episod e ? Iteratio n ? W hole trainin g
- 6. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. How is used my Action Space A W S D e e p R a c e r E x p e r t B o o t C a m p Polar coordinates view View from cars perspective
- 7. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Where is a specific action used on the track A W S D e e p R a c e r E x p e r t B o o t C a m p
- 8. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. A W S D e e p R a c e r E x p e r t B o o t C a m p Where is a specific action used on the track
- 9. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. What to change in Action Space A W S D e e p R a c e r E x p e r t B o o t C a m p ? M o v e s t e e r i n g a n g l e l e f t / r i g h t ? I n c r e a s e / D e c r e a s e s p e e d ? D r o p l e s s u s e d a c t i o n s ? M e r g e 2 o r m o r e a c t i o n s i n o n e
- 10. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Action Space based on track analysis A W S D e e p R a c e r E x p e r t B o o t C a m p
- 11. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Action Space based on track analysis A W S D e e p R a c e r E x p e r t B o o t C a m p
- 12. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. ChangingAction Space when cloning model A W S D e e p R a c e r E x p e r t B o o t C a m p ? Number of actions must stay same ? Don¡¯t make drastic changes (max: 5%) ? Wait some time for model ¡°adaptation¡±
- 13. ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Questions & Open Discussion join.deepracing.io
- 14. Please complete the session survey in the mobile app. ! ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 15. Thank you! ? 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. /kire-galev @kgalev kire_g join.deepracing.io Kire Galev