Confidential 3501132: Appen - Person/Object Segmentation
Confidential 3501132: Appen - Person/Object Segmentation
2 l
Objective: To draw pixel-level masks for person & object and mark classifications for each subject based on how they are
13 tia
positioned in the image. Each class should be instanced; that means, each instance of each of these classes should have their
own mask, even if boundaries of two instances are touching.
IMPORTANT NOTE:
Subject(s) faces will be blurred out of the image, but please proceed with annotations if any other rejection clauses are
not shown.
01 n
Consistency:
e Every person present in a frame must contain a mask and a separate mask if they are holding an object. If
visible, please annotate accordingly. If not visible, please leave the mask empty (add it in the UI matching
the instance of the person you're annotating but don't draw any mask).
To maintain consistency, especially with images with multiple people and objects, please classify the PERSON
annotations from LEFT to RIGHT.
For the OBJECT class, where 1 PERSON could be associated with multiple OBJECT instances, please annotate from
LEFT to RIGHT (like instructed for the PERSON class), irrespective of who is holding the object.
35 id
Summary:
1. Person (EACH PERSON IN THE OBJECT SHOULD HAVE THEIR OWN MASK)
nf
2. Annotation Instructions
RULES
Quality
Co
Please make sure that masks are in the confinement of the individual
Occlusion
In general, only annotate portions of classes that are visible; we are not to estimate boundaries when portions of
classes are occluded.
Hats can be included in the mask of the person as long as they are not oversized or significant in size.
Glasses should be annotated over
Annotate over necklaces and other jewelry
Reflections
Please ignore reflections
CLASS DEFINITIONS
Person
Overall mask of a subject in a frame
For frames with multiple people, please classify as Person1, Person2, etc. so each person(s) has their own unique
mask.
Object held by Person
Create a detailed mask over any object which is hold/used/played by the person.
The object size should be relative small or medium respect to the person.
Holdable: Camera, Cup, Bottle, Toy
Pets: Dog, Cat, Rabbit, Hamster
Instrument: Guitar, Violin.
Fashion Items: Bag
Not to draw the mask.
2 l
Relative Large: Desk.
Examples:
13 tia
01 ne
35 id
nf
Co
Visual Examples
Description: Focus on the visible part. For the “person” segmentation, the segmentation only includes the visible region.
2 l
13 tia
Description: If the person holds more than an object, please label them as the different classes, such as object-00, object-01.
The ordering here does not matter.
Rejections
WHEN TO REJECT IMAGES:
REJECTED EXAMPLES:
2 l
13 tia
01 ne
35 id
nf
Co
“Blurred area significantly prevents me from drawing high quality mask along important boundary”
Co
nf
35 id
01 ne
13 tia
2 l
Collages
Co
nf
35 id
01 ne
13 tia
2 l
2 l
13 tia
01 n
Extreme Blur (The person in the left side)
e
35 id
nf
Co
Animated Object
Co
nf
35 id
01 ne
13 tia
2 l
Artificial Overlay
2 l
13 tia
01 ne
35 id
nf
Co
Person in a photo
Co
nf
35 id
01 ne
13 tia
2 l
2 l
13 tia
01 ne
35 id
nf
If excluding an object will make the mask very complex, you can include the object as part of the body (wire netting is
Co
BLURRY PEOPLE
Please annotate the images where people are slightly blurry (the three examples below should be annotated). Only reject the
images if people are extremely blurry, so much that you cannot annotate them.
2 l
BOUNDARIES OF BLURRY PARTS
For the boundaries, include just the solid parts and exclude blurry parts (the parts that are slightly transparent where the
13 tia
background can be seen). See the hands in the example.
01 ne
HALO TOOLS/TIPS:
35 id
nf
Co
Co
nf
35 id
01 ne
13 tia
2 l
Co
nf
35 id
01 ne
13 tia
2 l
Co
nf
35 id
01 ne
13 tia
2 l
Co
nf
35 id
01 ne
13 tia
2 l