Go back to figure-eight

Overview

**NEW JOB WITH NEW CLASSES**

In this job you will be presented with images taken at street level. The images are pictures of the street, its buildings, cars, traffic lights, pedestrians, etc... The task is to segment the images by regions of interest using the pixel labeling tool.

Steps

  1. Use the tool the colour the images according to the ontology.

    Do this task by layers in the image: start with the objects that are at the back of the image and then define the objects that are at the front. For instance, if the image shows a tree in besides a building, define the building first as if the tree was not there then define the tree.
  2. Classify each of the regions into one and only one of the classes in the ontology given.

Rules & Tips

Segments of the images can be classified in any of the aforementioned categories. Most of the categories are self explanatory, but we here present some clarifying remarks:

Classify each of the regions into one and only one of the categories within this table:

Class Index

#

Description

Class

Image

1

All visible areas of the sky

Sky

2

Trees, forest

Trees, nature

3

Trees, forest

Terrain, grass

4

Trees, forest

Water

Detailed Mark-Up Instructions

#

Class

Description

1. Sky
All visible areas of the sky
 MARK
 DO NOT MARK
Over exposed areas of the sky
#4682b4

Label sky with the sky colour

Label sky with the sky colour

DO NOT MARK Label over-exposed areas of the sky
2
2. Trees
Trees, forest
 MARK
#478e33

Label trees, forest with the tree colour

Label trees, forest with the tree colour
3. Terrain & Grass
Flat terrain, not drivable, low level bushes and vegetation
 MARK
#95f598

Label terrain and grass with the terrain and grass colour

Label terrain and grass with the terrain and grass colour
4. Water


Rivers, lakes, streams, pools
 MARK
#0076ff

Label any bodies of water, with the water colour

Label any bodies of water, with the water colour
5. Road Surface
All drivable road surfaces
 MARK
#804080

Label drivable road surfaces with the road surface colour

Label drivable road surfaces with the road surface colour
6. Double Yellow Lines
Two yellow lines running along the road edge
 MARK
#746cc1

Label double yellow lines with the double yellow line colour

Label double yellow lines with the double yellow line colour
7. Pedestrian Crossing
Zebra crossing consisting of a row of white rectangles from one side of the road to the other
 MARK
#96b5ca

Label pedestrian crossings with the pedestrian crossing colour

Label pedestrian crossings with the pedestrian crossing colour
8. Speed Bump
Traffic calming device that use vertical deflection to slow motor-vehicle traffic in order to improve safety conditions.
 MARK
#9bdd2e

Label speed bumps with the speed bump colour

Label speed bumps with the speed bump colour
9. Yellow Box Markings
Single yellow lines which cross each other forming a box
 MARK
#bdbdbd

Label yellow box markings with the yellow box marking colour

Label yellow box markings with the yellow box marking colour
10. White Bar Markings
Single white line with a cross bar at the end
 MARK
#b7e2cd

Label white bar markings with the white bar marking colour

Label white bar markings with the white bar marking colour
11. Arrows and Lane Destination
Arrows and markings directly on the road surface at road junctions
 MARK
#f4a933

Label arrows and lane destinations with the arrows and lane destination colour

Label arrows and lane destinations with the arrows and lane destination colour
12. Bus Lane
Lane on main road carriageway with signage and road surface may be coloured red
 MARK
#ffffff

Label bus lanes with the bus lane colour

Label bus lanes with the bus lane colour
13. Road Markings
All road markings - excluding the following
 MARK
 DO NOT MARK
Double yellow lines, which should be marked in their corresponding class colour.
 DO NOT MARK
Arrows and Lane Destination, which should be marked in their corresponding class colour.
 DO NOT MARK
Bus Lanes, which should be marked in their corresponding class colour.
 DO NOT MARK
Yellow Bar markings, which should be marked in their corresponding class colour.
 DO NOT MARK
White Bar markings, which should be marked in their corresponding class colour.
#fdf98b

Label road markings with the road marking colour

Label road markings with the road marking colour

DO NOT MARK Double yellow lines

DO NOT MARK Arrows and Lane Destination

DO NOT MARK Bus Lanes

DO NOT MARK Yellow Bar markings

DO NOT MARK White Bar markings
14. Manhole & Hatch
Opening in the road to access sewer systems.
 MARK
#595392

Label manholes and hatches with the manhole and hatch colour

Label manholes and hatches with the manhole and hatch colour
15. Pavement Surface
Not drivable flat surface excluding grass
 MARK
 DO NOT MARK
Grass, which should be marked in their corresponding class colour.
#e65ae6

Label pavement surfaces with the pavement colour

DO NOT MARK Grass

Label pavement surfaces with the pavement colour
16. Curb
Stone stripe separating drivable surface from a pedestrian walk or traffic flow in other direction. The curb is always HIGHER than the drivable surface
 MARK
#6cbac1

Label curbs with the curb colour

Label curbs with the curb colour
17. Drop Curb
Stone stripe connecting pedestrian walk with the drivable surface at the same level transitioning from the CURB.
 MARK
#746cc1

Label drop curbs with the drop curb colour

Label drop curbs with the drop curb colour
18. Fence
Freestanding structure with holes that separate outdoor areas
 MARK
#f3d234

Label fences with the  fence colour

Label fences with the  fence colour
19. Guard Rail
Metal structure mounted on the side of the road (with holding bars)
 MARK
#d4a89e

Label guard rails with the guard rail colour

Label guard rails with the guard rail colour
20. Street Lamp
Device for illuminating the road, various sizes and styles.
 MARK
 DO NOT MARK
The vertical pole supporting the street lamp. These should be marked in their corresponding class colour.
#ea5133

Label street light with the street light colour
Label vertical pole with the pole colour

Label street light with the street light colour
Label vertical pole with the pole colour

Label street light with the street light colour
Label vertical pole with the pole colour
21. Traffic lights
Traffic lights
 MARK
 DO NOT MARK
The vertical pole or cables supporting the traffic lights. These should be marked in their corresponding class colour.
#ad49cd

Label traffic light with the traffic light colour
Label vertical pole with the pole colour

Label traffic light with the traffic light colour
Label pole arm with the pole arm colour

DO NOT MARK poles as traffic lights.
22. Bus Stop
Bus stop signage.
 MARK
 DO NOT MARK
Bus stop pole. Poles should be marked in their corresponding class colour.
#6a2e8d

Label bus stop signage with the bus stop signage colour
Label vertical pole with the pole colour

Label bus stop signage with the bus stop signage colour
Label vertical pole with the pole colour

DO NOT MARK the bus stop pole . Only mark the actual bus stop signage.
23. Road Signs
Front of road signs
 MARK
 DO NOT MARK
Back of the road sign. The back should be marked as object
 DO NOT MARK
Vertical poles or pole arms. These should be marked in their corresponding class colour.
#c7c924

Label street sign with the street sign colour
Label vertical pole with the pole colour

Label street sign with the street sign colour
Label vertical pole with the pole colour

DO NOT MARK back of a road signs as a road sign. This must be labelled as an object

DO NOT MARK road signs as street signs
24. Street Signs
Low signs showing the name of a street.
 MARK
 DO NOT MARK
Road Signs. Road Signs are NOT street signs and should be marked in their corresponding class colour.
#5199b8

Label street sign with the street sign colour

Label street sign with the street sign colour

DO NOT MARK the street sign poles. Only mark the actual sign.

DO NOT MARK road signs as street signs
25. Speed Camera
Yellow object (box). Please mark both front and rear of the box.
 MARK
 DO NOT MARK
Mark as a pole. Speed cameras are NOT poles and should be marked in their corresponding class colour.
#fdf731

Label speed camera with the speed camera colour

Label speed camera with the speed camera colour

DO NOT MARK the speed camera as a pole.

DO NOT MARK the speed camera pole as a speed camera. Only mark the box as a speed camera.
26
26. Telegraph Pole
Tall wooden pole usually with several wires extending from the top.
 MARK
 DO NOT MARK
Wires. Wires do not require marking.
#f08e33

Label Telegraph Pole with the Telegraph Pole colour

Label Telegraph Pole with the Telegraph Pole colour

DO NOT MARK the telegraph pole wires. Only mark the actual pole.
27. Post
Short post
 MARK
#f19f9f

Label short posts with the post colour

Label short posts with the post colour
28. Belisha Beacons
Black and white post with Yellow ball at the top
 MARK
 DO NOT MARK
Mark as a pole. Belisha Beacons are NOT poles and should be marked in their corresponding class colour.
#c7c924

Label Belisha Beacon with the Belisha Beacon colour

Label Belisha Beacon with the Belisha Beacon colour

DO NOT MARK the Belisha Beacon as a pole.
29. Poles
Stand-alone poles, or poles supporting street lamps, traffic lights, traffic signs etc.
 MARK
 DO NOT MARK
Lamps, signs and other objects mounted on top of a pole. They are labelled by a different colour. corresponding to its class.
 DO NOT MARK
Belisha beacons (see #6)     Telegraph posts (see #9) 
#2b9bcd

Label pole with the pole colour
Label lamp with the street lamp colour

Label pole with the pole colour
Label bus sign with the bus sign colour

Label both poles
Label road signs on the poles with the road sign colour

DO NOT MARK Belisha beacons as poles

DO NOT MARK Telegraph poles as poles
30. Pole Arm
Horizontal tube on the top of the pole that supports street lamps or traffic lights.
 MARK
 DO NOT MARK
The vertical pole supporting the horizontal arm. These should be marked in their corresponding class colour.
 DO NOT MARK
Street lamps or traffic lights. These should be marked in their corresponding class colour.
#bd7855

Label pole arm with the pole arm colour
Label traffic light with the traffic light colour
Label vertical pole with the pole colour

Label pole arm with the pole arm colour
Label street lamp with the street lamp colour
Label vertical pole with the pole colour

DO NOT MARK other objects as pole arm.
31. Shelter
Shelter structure
 MARK
 DO NOT MARK
Bus Signage. Bus Signage should be marked in their corresponding class colour.
#8d8d8d

Label bus shelter with the bus shelter colour

Label bus shelter with the bus shelter colour

DO NOT MARK bus shelter with bus stop signage colour
32. Postbox
Post boxes are red and black pillars
 MARK
#7bf5bb

Label postbox with the postbox colour

Label postbox with the postbox colour
33. Telephone cabinets
Grey or green telephone cabinet usually found at the roadside
 MARK
#a96b21

Label telephone cabinets with the telephone cabinet colour

Label telephone cabinets with the telephone cabinet colour
34. Portable Road Furniture
Cones, plastic fences, plastic barriers etc. Any road objects that can be moved
 MARK
 DO NOT MARK
Poles, signs or any permanent road object
#c03128

Label portable road furniture with the portable road furniture colour

Label portable road furniture with the portable road furniture colour

DO NOT MARK permanent road objects like poles or signs.
35. Transport
Car, lorry, van, tram, bus etc
 MARK
 DO NOT MARK
Bicycle / motorbike, which should be marked in their corresponding class colour.
#0e258e

Label any cars, vans, trams, etc, with the transport colour

Label any cars, vans, trams, etc, with the transport colour

DO NOT MARK Bicycles or Motorbikes
36. Bicycle / Motorbike


Two (or three) - wheeled transport
 MARK
 DO NOT MARK
Any other transport types, which should be marked in their corresponding class colour.
#771c20

Label any bicycle or motorbike, with the bicycle/motorbike colour

Label any bicycle or motorbike, with the bicycle/motorbike colour

DO NOT MARK Cars or Vans, etc
37. License Plate


Readable license plates
 MARK
#70effb

Label any vehicle license plates, with the license plate colour

Label any vehicle license plates, with the license plate colour
38. Object
Fallback category for unmovable objects or constructions
 MARK
 MARK
Backs of road signs
 DO NOT MARK
Front of road signs as objects. They must be marked as roadsigns
#999

Label any unmovable objects or constructions, that dont already have a class with the object colour

Label any unmovable objects or constructions, that dont already have a class with the object colour

DO NOT MARK fronts of road signs as objects
39 . Building & Constructions
Buildings, bridges, walls, tunnels
 MARK
#464646

Label building & constructions with the building & constructions colour

Label building & constructions with the building & constructions colour
40
40 .Person


Walking, standing, sitting humans
 MARK
#dd3c3c

Label any humans, with the person colour

Label any humans, with the person colour
41. Animals


Animals that move on the ground
 MARK
#ca96c6

Label any animals, with the animal colour

Label any animals, with the animal colour
42. Ego-Car


Parts of the ego-car (hood, roof) and mapping equipment (rails, antennae)
 MARK
#547f74

Label any parts of the ego car , with the ego-car colour

Label any parts of the ego car , with the ego-car colour

Unlabelled
Unclear, invisible or questionable objects
 MARK
#000000

Label any unclear or invisible items, with the unlabelled colour

Label any unclear or invisible items, with the unlabelled colour

Links

For traffic signs lists, check:

UK - https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/519129/know-your-traffic-signs.pdf

Common Errors

Please Watch Out For These In Future Iterations

Curb that is higher than road surface is a curb, not drop-curb
You MUST label roads signs as 23. Road Signs NOT as 24. Street Signs

"Grass" or "loan" labels only flat horizontal surfaces, including soft shoulder of the road. Hills, rocks, bushes and grass on slopes should be labelled as a 'nature'


Guard Rail is a specific heavy-metal road furniture
Label handrail as fences
Label zebra crossroad as a whole- manhole on the right side of the road labeled as 'object', not 'manhole'

Examples