Welcome to Populii and the Ratings Project!

This is your go to onboarding guide to ensure you’ve got all you need to be successful
on this project.

Project Objectives:
The ratings project opens up an opportunity for freelancers to explore the world of
machine learning, contributing to its continuous improvement.

The primary objective of the task at hand is to review output in the form of text or
images, evaluating its adherence to the defined guidelines, and provide a judgment
based on that evaluation following the required format. The tasks assigned to you will
be available in the native language specified by you upon signing up.

Eligibility:
In order to be eligible for this project, you must agree to the Populii terms and conditions
as well as the NDA.
With regards to language and country of residence:
● You must select a language on your profile that is native to the country of
residence.
● You are only allowed to have up to two languages that you are native in.
● Tasks will be allocated to your account and work availability notifications will
be shared on your Populii ID.

Qualifications:
In order to work on the Ratings Project:
● You must meet the eligibility criteria above.
● You must pass the assessment for the project on Populii.
● You must have gone through all the knowledge base training materials
(https://sites.google.com/populii.ai/cs-training-repository/home).
● You must maintain a standard of 85% quality and average handling time
(AHT) less than or equals to 10 minutes
If your quality and AHT fall below the standard thresholds required, you may become
ineligible to participate.
 Quality Threshold Trigger warning before Trigger warning after Final step
training & Suspension training
from Project

75% - 84.99% 1 1 Permanent removal from

the project
<75% 0 0 Permanent removal from
the project

AHT Threshold* Trigger warning before Trigger warning after Final step
training & Suspension training
from Project

10-12min 2 1 Permanent removal from

the project
>12min 1 1 Permanent removal from
the project
≤10min Green zone N/A N/A N/A

*Note: AHT thresholds will vary based on the task so please adhere to the notification of
the task for that information.

Project Flow:
For the Ratings Project, here is how the flow will work.
First and foremost, start by verifying that your profile is updated with the correct
payment information and your preferred language is selected. Then the subsequent
actions that need to be undertaken are as follows:
1. Submit your application for the gig:
After you sign up for Populii, navigate to “Available Gigs” and click “Apply”.
2. Next move “My Gigs” and select “Gigs Applied”.
3. Take the assessment available for completion.
4. Next navigate to our “Knowledge Bank” and select “Videos” and “Ratings”.
5. Watch the three training videos. Then navigate to “Documents”.
6. These are the training documents and the order to take:
a. Ratings - Safety Guidelines
b. Ratings - Factuality Guidelines
c. Ratings - Creativity Guidelines Training doc
d. CS Guideline - Factuality Cocoa
e. CS Guideline - Overall Quality SxS
 7. Once you’ve passed the assessment and reviewed the training materials, you
will receive an email from the Populii team with a Populii email ID and
credentials. You’ll use this for working on the project. Your Populii email ID
should arrive within 48 hours (about 2 days) of passing the assessment.
Note: Your Populii email ID should only be used for Populii projects. Accounts
not logged into within 60 days (about 2 months) will be automatically expired.
8. After receiving your Populii email ID, you’ll be added to a worker pool based
on your native language. When the work is available in your language, you’ll
be notified via email with instructions on how to attend to the work.
9. Once the work is completed, the reviewer will assess the submission and
update quality scores.
10. Payments earned from the project will be added to your profile on populii and
earnings will be available by the last Wednesday of every month for
withdrawals.

Task Details:
The Ratings Project tasks take place on the customer platform. Once you receive your
Populii ID and are added to a worker pool, you will be able to log in to do work. Tasks in
your language will be emailed to you upon availability with instructions.
With regards to tasks, please note:
● Tasks are completed following a first-come, first-served approach. The tasks
in your language are also being sent to many others. If you get a task
availability email but see no tasks upon logging in, that means they have all
be picked up. You may see a popup that says: “No Worker Pool” or “Invalid
Worker Pool”
● If you are not receiving emails with tasks, that means there is currently no
volume in your language.
● If you see an error on the customer platform that states you are not part of a
worker pool, this could mean you are not meeting the quality threshold.
Contact the support team at Populii to confirm.

Judging Criteria:
Quality
In order to work on the Ratings Project, you must maintain a quality rating of 85% or
higher. All the tasks completed by you will be evaluated for quality by a dedicated team
of reviewers specialized in the target language you will be working in.
Average Handling Time (AHT)*
AHT is the amount of time spent on the completion of each task, with the target varying
depending on the type of task you are assigned. Your submissions are not only judged
on quality but also on AHT. Depending on the expected time vs the actual time spent
doing the task will affect your payment.
When you start working on the tool, you will see a timer counting down how long you
spend on each task. When the timer reaches 0, the current task will be skipped and the
next one will appear, however, that should not happen, and that is not the indicator of
how long you should be spending on each task. The expected AHT (Average Handling
Time) is 5-15 minutes depending on the type of task being completed, so please keep
an eye on that.

Note: AHT thresholds will vary based on the task so please adhere to the notification of
the task for that information.

Payment:
Each task is eligible for a specific rate and payments are calculated based on many
variables. Payments for this project will be set up and paid by Populii through our
payment providers. You will be paid on the last Wednesday of every month.

Payment Calculations
FAQs
What happens if I see a message on Datacompute that says:“No Worker Pool” or
“Invalid Worker Pool”?
The platform works on a first come first serve mechanism. if the work is picked up by
the other community members and when all the work exhausted, the error will appear
which means that there are no tasks currently available

Am I allowed to have more than one language?

Worker pool is assigned to eligible users who have only 2 languages updated on their
profile as per our policy.

How can I see the feedback on the review from my work?

We are working on creating a more transparent atmosphere for you to review feedback.
What happens if my pay is different than I thought it’d be?
The actual payout rate depends on the quality and the average handling time of the
tasks.

Why would I get an account suspension or be banned from tasks?

If your quality/AHT is not meeting the set target despite the opportunities provided. This
will lead to a temporary suspension of your profile. The Populii support team will reach
you with updated training and assessments, so you can get back to work once those
are completed.

What should I do if I want to stop working on Data Compute/go on a break?

No action needed, just close the Data Compute tab. Attention here, If a rating was
completed and wasn’t submitted, the time spent on that prompt won’t be included in the
Analytics.

Any and all questions should be addressed to [email protected].

Please also join our private Ratings Project Reddit community.