Pit Grid Instructions

General Image Annotation

Summary of Task

• Simple bounding boxes around equipment which appears in images extracted from videos
• The videos are from a stationary point but can pan, tilt, and zoom
• The labels of most interest to us are by far the rarest and will need special attention
• Setting will be from multiple different pits at different angles, in different environmental conditions

Contents
● Labels & Attributes Table
● Annotation Rules
● Labels & Attributes Description/Examples
● Common Errors

Labels & Attributes Table

Labels Occurrence

sump Every frame

grid Nearly every frame

guns Every frame

dragline_bucket Around 40% of frames

person Very rare

sump_flange Very rare

Annotation Rules

Label Workflow

sump - The sump is the thick, iron pipe bent in a 90 degree angle,
submerged in a pool of liquid generally in the bottom left
quadrant of the frame

- To annotate the sump start the top left corner of the

bounding box between the two mounting points on the top,
horizontal portion of the pipe.

- These mounting points are metal protrusions with a hole

punched through each of them, they will sometimes have
cables mounted to them

- Place the bottom right corner of the bounding box so that all
 of the pipe past the mounting points is captured inside the box

- IMPORTANT the bottom line of the bounding box should be

EXACTLY where the pipe begins to be submerged in the liquid

grid - The grid is the area which is made up of a horizontal bar and
many smaller vertical bars

- Not all grids will look exactly identical but will be very similar

- The grid visible may range from completely submerged to

completely exposed

- To annotate the grid place the left top of the bounding box at
the furthest left point of the grid which is visible above the
water

- Capture the horizontal top bar of the grid fully and place the
bottom right point of the bounding box where the grid begins
to disappear below the water

- Part of the grid may be hidden by water flowing over top of it,
in this case do not annotate any area where the top horizontal
bar is not visible, this may result in multiple bounding boxes for
grid in a single image which is acceptable to us

guns - The guns are the two rotating metal water cannons which are
usually to the right of the screen, they will usually be spraying
water but can also be turned off

- Sometimes one of the water guns can be out of frame in this

case you will annotate the single gun visible

- We want to capture the water stream as well as the guns but

we do not want to annotate over the grid

- To annotate the guns use a single bounding box for both guns,
no matter if there are 1 or 2 water guns visible a single
bounding box will be used for both

- The bottom right of the bounding box will start to the right of
the furthest gun visible to the right where the gun meets the
platform it is mounted on

- The box will capture all of the water guns in the frame as well
as the entire water stream

- IMPORTANT even if the water stream continues past the grid

do not extend the guns bounding box past where the grid starts

dragline_bucket - The dragline bucket is a moving piece of equipment which will

generally appear in the top half of the frame, it is a bucket
hanging by crane like cables

- The dragline bucket will be viewed from many different angles

as it moves throughout the frame

- To annotate the dragline bucket, capture the horizontal cross

 bar which is attached to the cables above the bucket and
capture all of the bucket visible

- At times the bucket may be partially visible, annotate any part

of the bucket which would normally fall into the bounding box
which are visible in frame

person - Rarely a person will enter the frame, usually at the top of the
frame and very small

-If any part of a person is in the frame annotate them

sump_flange - Sump flange is a very rare label but also the most important, it
will need special attention

- Sump flange is part of the sump but needs to be annotated in

addition to the sump annotation

- The sump flange is at the end of the vertical section of the

sump

- The sump flange starts where a wide circular flat section can
be seen ringing around vertical pipe of the sump far down the
pipe

- The sump flange can also start where a cup like apparatus can
be seen mounted to the side of the vertical pipe of the sump far
down the pipe

- The sump flange continues down until the end of the sump
where there is no more pipe

- To annotate the sump flange place a single bounding box over

any visible portion of the sump flange, this will also be covered
by the sump bounding box but needs to be a separate
annotation
Labels & Attributes Description/Examples

Labels/Attributes Description Example

Sump - A good annotation starts

between the mounting eye holes
and ends at the water surface
and the right most part of the
pipe which is visible above the
water, the box should have the
entire pipe with in it

- In this case both the sump and

the sump flange are visible and
the bounding boxes will overlap
 - This is a poor annotation as the
box does not contain the entire
pipe

- This is a poor annotation as the

box does not end where the
water line is at the bottom of the
pipe

grid - A good annotation starts at the

top edge of the of the horizontal
bar at the left most of the grid
and ends where the opening to
grid stops and where the water
begins

- This is a poor annotation as the

box extends too far past where
the grid ends and is too far down
past where the water reaches the
grid
- This is a poor annotation as the
box does not capture all of the
grid

- A good annotation starts at the

top edge of the of the horizontal
bar at the left most of the grid
and ends where the opening to
grid stops and where the water
begins

- This is a poor annotation as the

box does not capture all of the
grid

- This is a poor annotation as the

box extends too far past where
the grid ends
guns - A good annotation captures both
guns and both water streams
ending before the grid begins

- This is a poor annotation as the

box extends past the grid and
does not capture all of the top
water stream

- This is a poor annotation as the

box does not capture either of
the water streams
dragline_bucket

- A good annotation captures the

entire of the visible bucket and
the top horizontal bar above if it
is visible

- This is a poor annotation as the

box does not capture the entire
visible bucket or the top
horizontal bar

- This is a poor annotation as the

box is too large and captures
unnecessary mounting points
Person

- If a person is found in the frame

draw a box as tight as possible
around the entire body
sump_flange

- The sump flange can start with a

cylindrical cup mounted to the
right of the vertical pipe far
down, if this cylinder is visible the
annotation should start from the
top of the cylinder and end where
the water starts

- A good annotation starts at the

flange and ends at either where
the water starts or where the
pipe completely ends,
terminating with a cone made up
of trapezoids
- This is a poor annotation as the
box does not capture the entire
sump flange area

- This is a poor annotation as the

box starts above the sump flange
and extends past the end of the
pipe or start of the water
- This is a poor annotation as the
box starts above the sump flange
- This is a poor annotation as the
box does not capture all of the
visible sump flange
Common Errors

Edge Case How to Handle It Example

Grid completely Do not annotate any of the grid

obscured

Grid partially Annotate the part of the grid

obscured which is visible

It is possible for this to split the

1 grid bounding box into 2