Update README.md
Browse files
README.md
CHANGED
|
@@ -8,4 +8,19 @@ tags:
|
|
| 8 |
- adas
|
| 9 |
- semantic-segmentation
|
| 10 |
- obstacle-detection
|
| 11 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
- adas
|
| 9 |
- semantic-segmentation
|
| 10 |
- obstacle-detection
|
| 11 |
+
---
|
| 12 |
+
## SceneSeg
|
| 13 |
+
Self-driving cars are usually trained to detect specific object types, such as cars, pedestrians, buses, etc.
|
| 14 |
+
Such approaches are prone to failure cases when a self-driving car encounters an unusual object that it hasn't seen before,
|
| 15 |
+
e.g. a rickshaw, or if a self-driving car encounters a strange presentation of a known object, e.g. a cyclist that has fallen over.
|
| 16 |
+
In these scenarios, self-driving cars are unable to detect these critical objects leading to dangerous driving outcomes.
|
| 17 |
+
To address this, we have developed SceneSeg, a neural network that is able to segment all important foreground objects,
|
| 18 |
+
irrespective of what that object is. SceneSeg is able to implicitly learn the visual features of foreground objects such as cars,
|
| 19 |
+
buses, vans, pedestrians, cyclists, animals, rickshaws, trucks and other similar objects, even though it has not been explicitly
|
| 20 |
+
trained to detect these object types. SceneSeg is also able to detect objects that are outside of its training data, such as tyres
|
| 21 |
+
rolling down a highway, or a loose trailer. SceneSeg can also detect objects in unusual presentations that it hasn't seen during training.
|
| 22 |
+
SceneSeg performs robustly across challenging weather and lighting conditions, including during heavy rain, snow and low light driving.
|
| 23 |
+
SceneSeg performs out of the box on roads across the world without any parameter tuning. SceneSeg provides self-driving cars with a core
|
| 24 |
+
safety layer, helping to address 'long-tail' edge cases which plauge object-level detectors.
|
| 25 |
+
|
| 26 |
+
<img src="https://github.com/autowarefoundation/autoware_vision_pilot/blob/main/Media/SceneSeg_GIF_Rain.gif">
|