Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
Flatland
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Package Registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
elrichgro
Flatland
Commits
fa54bee7
Commit
fa54bee7
authored
5 years ago
by
Erik Nygren
Browse files
Options
Downloads
Patches
Plain Diff
Added simple training_example.py with random Agent
parent
87e672f8
No related branches found
Branches containing commit
No related tags found
Tags containing commit
No related merge requests found
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
examples/training_example.py
+80
-0
80 additions, 0 deletions
examples/training_example.py
with
80 additions
and
0 deletions
examples/training_example.py
0 → 100644
+
80
−
0
View file @
fa54bee7
from
flatland.envs.generators
import
complex_rail_generator
from
flatland.envs.rail_env
import
RailEnv
import
numpy
as
np
from
flatland.utils.rendertools
import
RenderTool
np
.
random
.
seed
(
1
)
# Use the complex_rail_generator to generate feasible network configurations with corresponding tasks
# Training on simple small tasks is the best way to get familiar with the environment
#
env
=
RailEnv
(
width
=
15
,
height
=
15
,
rail_generator
=
complex_rail_generator
(
nr_start_goal
=
10
,
nr_extra
=
10
,
min_dist
=
10
,
max_dist
=
99999
,
seed
=
0
),
number_of_agents
=
5
)
# Import your own Agent or use RLlib to train agents on Flatland
# As an example we use a random agent here
class
RandomAgent
:
def
__init__
(
self
,
state_size
,
action_size
):
self
.
state_size
=
state_size
self
.
action_size
=
action_size
def
act
(
self
,
state
):
"""
:param state: input is the observation of the agent
:return: returns an action
"""
return
np
.
random
.
choice
(
np
.
arange
(
self
.
action_size
))
def
step
(
self
,
memories
):
"""
Step function to improve agent by adjusting policy given the observations
:param memories: SARS Tuple to be
:return:
"""
return
def
save
(
self
):
# Store the current policy
return
# Load the agent with the parameters corresponding to the environment and observation_builder
agent
=
RandomAgent
(
env
.
get_observation_size
(),
env
.
get_action_size
())
n_trials
=
1000
# Empty dictionary for all agent action
action_dict
=
dict
()
for
trials
in
range
(
1
,
n_trials
+
1
):
# Reset environment and get initial observations for all agents
obs
=
env
.
reset
()
# Here you can also further enhance the provided observation by means of normalization
# See training navigation example in the baseline repository
score
=
0
# Run episode
for
step
in
range
(
100
):
# Chose an action for each agent in the environment
for
a
in
range
(
env
.
get_num_agents
()):
action
=
agent
.
act
(
obs
[
a
])
action_dict
.
update
({
a
:
action
})
# Environment step which returns the observations for all agents, their corresponding
# reward and whether their are done
next_obs
,
all_rewards
,
done
,
_
=
env
.
step
(
action_dict
)
# Update replay buffer and train agent
agent
.
step
(
obs
[
a
],
action_dict
[
a
],
all_rewards
[
a
],
next_obs
[
a
],
done
[
a
])
score
+=
all_rewards
[
a
]
obs
=
next_obs
.
copy
()
if
done
[
'
__all__
'
]:
break
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment