Assist Remove Quiz
Assist Remove Quiz
best effort.
(Please consult the Spec doc as you take the quiz)
Select all the qualities you should look for when uploading an image. Select all
that apply.
Correct!
Images should be clear, with a high resolution, should be less than 1MB in
size, should not contain the prompt itself within the image, and should be
able to be related to a coding problem.
When should you run the generated code to make sure it executes?
When it is sufficiently
Never complicated that it is hard
to check by hand
Always
Correct!
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 1/17
09/12/2024, 09:21 Outlier
Always run the code to make sure that it works. Even if you find other errors
just by looking at the response, you still need to test the code to see if you
Assist Removefind
Certany more errors.
True False
Correct!
Do not write prompts to do something that you yourself are unable to do. You
should be able to write the perfect answer to the prompts that you write.
Response:
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 2/17
09/12/2024, 09:21 Outlier
Yes No
Correct!
Some of the node values are incorrect. Even though the model still
understands some elements from the picture, this is a valid Image
Understanding Failure because the model response gets something wrong
about the image
Yes No
Not quite!
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 3/17
09/12/2024, 09:21 Outlier
Check for logical errors / if the code compiles
Response:
The factorial function will be recursively called 6 times when n = 5 since the
base case n < 1 is not reached until n = 0. The following recursive calls will be
made when factorial(5) is executed:
1. factorial(5)
2. factorial(4)
3. factorial(3)
4. factorial(2)
5. factorial(1)
6. factorial(0)
Image-Independent
Image Understanding
Reasoning
Not quite!
Check every detail of the image! :)
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 4/17
09/12/2024, 09:21 Outlier
AssistConsider
Remove Cert the following prompt:
Prompt: This image shows an implementation of Quick Sort. Write code in
Python that implements a Quick Sort algorithm.
Correct!
This is a bad prompt because the model can answer the prompt without
needing the image. Even though the prompt is related to the image, the
image is not required in order to answer the prompt.
linked list. There are individual nodes consisting of two parts: the data (blue
section) and the address (green section) pointing to the next node. Include a
sequence of nodes containing data values (e.g., 10, 20, 30, and 40) connected
via arrows, with the final node indicating the end of the list using a cross or null
marker.
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 5/17
09/12/2024, 09:21 Outlier
Correct!
This is a bad prompt because the model does not need to rely on the image
in order to answer the prompt. The prompt contains all of the information
needed by the model to provide an accurate answer.
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 6/17
09/12/2024, 09:21 Outlier
searches for that string within the tree that was created, and returns true if the
string is found and false if it is not found.
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 7/17
09/12/2024, 09:21 Outlier
Correct!
This is a good prompt because it is related to code, relies on the image,
specifies the coding language, and is easily verifiable.
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 8/17
09/12/2024, 09:21 Outlier
structure. Then, write a Python program that creates a tree data structure.
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 9/17
09/12/2024, 09:21 Outlier
Response:
Assist Remove Cert
After examining the prompt and response from above, does the response
contain an Image Understanding failure?
Yes No
Correct!
No, there is no image understanding failure. The model successfully analyzed
the image to determine that the height of the tree was 4.
After examining the prompt and response from above, does the response
contain an Image Independent Reasoning failure?
Yes No
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 10/17
09/12/2024, 09:21 Outlier
Not quite!
Assist RemoveConsider
Cert what exactly the prompt is asking for - did the response fulfill that
request?
Response:
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 11/17
09/12/2024, 09:21 Outlier
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 12/17
09/12/2024, 09:21 Outlier
After examining the prompt and response from above, does the response
contain an Image Understanding failure?
Yes No
Correct!
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 13/17
09/12/2024, 09:21 Outlier
Yes, there is an Image Understanding failure. The model incorrectly states
that Key Task 1 and Key Task 2 have three children each, when they actually
Assist Removeonly
Certhave two. A few other values are also incorrect.
explain if there are any issues which would prevent the code from working as
expected.
Response:
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 14/17
09/12/2024, 09:21 Outlier
After examining the prompt and response from above, does the response
contain an Image Understanding failure?
Yes No
Correct!
The model successfully analyzed the image and found the error with the print
statement.
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 15/17
09/12/2024, 09:21 Outlier
Response:
After examining the prompt and response from above, does the response
contain an Image Understanding failure?
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 16/17
09/12/2024, 09:21 Outlier
Assist Remove
Yes Cert No
Not quite!
Yes No
https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 17/17