0% found this document useful (0 votes)
53 views17 pages

Assist Remove Quiz

The document outlines a Course Screening Quiz that requires a passing grade of 14 out of 17 questions. It includes questions about image qualities for coding prompts, the necessity of running generated code, and the evaluation of prompts based on their reliance on images. The quiz emphasizes understanding image-related reasoning issues and the importance of clear, high-quality prompts in coding tasks.

Uploaded by

harshvardhan7274
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
53 views17 pages

Assist Remove Quiz

The document outlines a Course Screening Quiz that requires a passing grade of 14 out of 17 questions. It includes questions about image qualities for coding prompts, the necessity of running generated code, and the evaluation of prompts based on their reliance on images. The quiz emphasizes understanding image-related reasoning issues and the importance of clear, high-quality prompts in coding tasks.

Uploaded by

harshvardhan7274
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 17

09/12/2024, 09:21 Outlier

Assist Remove Cert AV

Course Screening Quiz

Passing grade: 14 out of 17 questions (88.2%)


You must pass this quiz in order to work on this project, so please give your

best effort.
(Please consult the Spec doc as you take the quiz)

Select all the qualities you should look for when uploading an image. Select all
that apply.

Clear, high resolution


Images larger than 1MB
images

Contains the prompt in That incorporates coding


the image ideas

Correct!
Images should be clear, with a high resolution, should be less than 1MB in
size, should not contain the prompt itself within the image, and should be
able to be related to a coding problem.

When should you run the generated code to make sure it executes?

When it is sufficiently
Never complicated that it is hard
to check by hand

Always

Correct!

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 1/17
09/12/2024, 09:21 Outlier
Always run the code to make sure that it works. Even if you find other errors
just by looking at the response, you still need to test the code to see if you
Assist Removefind
Certany more errors.

It is okay to ask the model to solve a problem you do not completely


understand because “the model will do it for you”.

True False

Correct!
Do not write prompts to do something that you yourself are unable to do. You
should be able to write the perfect answer to the prompts that you write.

Consider the following prompt/image/response

Prompt: Implement this tree data structure in Python.

Response:

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 2/17
09/12/2024, 09:21 Outlier

Assist Remove Cert

Is there an “image understanding” issue with this response?

Yes No

Correct!
Some of the node values are incorrect. Even though the model still
understands some elements from the picture, this is a valid Image
Understanding Failure because the model response gets something wrong
about the image

Is there an “Image Independent Reasoning” issue with this response:

Yes No

Not quite!

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 3/17
09/12/2024, 09:21 Outlier
Check for logical errors / if the code compiles

Assist Remove Cert

Consider the following image/prompt/response:

Prompt: How many times will factorial be recursively called when n = 5 ?

Response:
The factorial function will be recursively called 6 times when n = 5 since the

base case n < 1 is not reached until n = 0. The following recursive calls will be
made when factorial(5) is executed:

1. factorial(5)

2. factorial(4)
3. factorial(3)

4. factorial(2)

5. factorial(1)
6. factorial(0)

What type of error is shown in this response?

Image-Independent
Image Understanding
Reasoning

There is no error here

Not quite!
Check every detail of the image! :)

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 4/17
09/12/2024, 09:21 Outlier

AssistConsider
Remove Cert the following prompt:
Prompt: This image shows an implementation of Quick Sort. Write code in
Python that implements a Quick Sort algorithm.

Based on the project requirements, is the above prompt a good prompt, or a


bad prompt?

Good Prompt Bad Prompt

Correct!
This is a bad prompt because the model can answer the prompt without
needing the image. Even though the prompt is related to the image, the
image is not required in order to answer the prompt.

Consider the following prompt:


Prompt: Write a Python program that implements this structure of a singly

linked list. There are individual nodes consisting of two parts: the data (blue

section) and the address (green section) pointing to the next node. Include a
sequence of nodes containing data values (e.g., 10, 20, 30, and 40) connected

via arrows, with the final node indicating the end of the list using a cross or null

marker.

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 5/17
09/12/2024, 09:21 Outlier

Assist Remove Cert

Based on the project requirements, is the above prompt a good prompt, or a


bad prompt?

Good Prompt Bad Prompt

Correct!
This is a bad prompt because the model does not need to rely on the image
in order to answer the prompt. The prompt contains all of the information
needed by the model to provide an accurate answer.

Consider the following prompt:


Prompt: This image shows the implementation of a sorting algorithm. Tell me
what this sorting algorithm is called, and then write code that implements the
sorting algorithm from the image, and show a usage example using the values
from the image.

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 6/17
09/12/2024, 09:21 Outlier

Assist Remove Cert

Based on the project requirements, is the above prompt a good prompt, or a


bad prompt?

Good Prompt Bad Prompt

Consider the following prompt:


Prompt: Create a tree in JavaScript that contains the data shown in this image.
The nodes of the tree should copy exactly the structure and value of the nodes
shown in the image. Then, write a JavaScript function that takes in a string,

searches for that string within the tree that was created, and returns true if the
string is found and false if it is not found.

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 7/17
09/12/2024, 09:21 Outlier

Assist Remove Cert

Based on the project requirements, is the above prompt a good prompt, or a


bad prompt?

Good Prompt Bad Prompt

Correct!
This is a good prompt because it is related to code, relies on the image,
specifies the coding language, and is easily verifiable.

Consider the following prompt:


Prompt: Describe the relationship between the clusters found in this chart and
discuss possible conclusions that can be drawn from the data distribution.

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 8/17
09/12/2024, 09:21 Outlier

Assist Remove Cert

Based on the project requirements, is the above prompt a good prompt, or a


bad prompt?

Good Prompt Bad Prompt

Analyze the following prompt and response:


Prompt: For the diagram in the image, find the height of the tree data

structure. Then, write a Python program that creates a tree data structure.

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 9/17
09/12/2024, 09:21 Outlier

Response:
Assist Remove Cert

After examining the prompt and response from above, does the response
contain an Image Understanding failure?

Yes No

Correct!
No, there is no image understanding failure. The model successfully analyzed
the image to determine that the height of the tree was 4.

After examining the prompt and response from above, does the response
contain an Image Independent Reasoning failure?

Yes No

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 10/17
09/12/2024, 09:21 Outlier

Not quite!
Assist RemoveConsider
Cert what exactly the prompt is asking for - did the response fulfill that
request?

Analyze the following prompt and response:


Prompt:

Response:

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 11/17
09/12/2024, 09:21 Outlier

Assist Remove Cert

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 12/17
09/12/2024, 09:21 Outlier

Assist Remove Cert

After examining the prompt and response from above, does the response
contain an Image Understanding failure?

Yes No

Correct!

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 13/17
09/12/2024, 09:21 Outlier
Yes, there is an Image Understanding failure. The model incorrectly states
that Key Task 1 and Key Task 2 have three children each, when they actually
Assist Removeonly
Certhave two. A few other values are also incorrect.

Analyze the following prompt and response:


Prompt: Given the following image of a block of python code, identify and

explain if there are any issues which would prevent the code from working as

expected.

Response:

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 14/17
09/12/2024, 09:21 Outlier

Assist Remove Cert

After examining the prompt and response from above, does the response
contain an Image Understanding failure?

Yes No

Correct!
The model successfully analyzed the image and found the error with the print
statement.

Analyze the following prompt and response:


Prompt: Can you replicate this bar chart in python?

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 15/17
09/12/2024, 09:21 Outlier

Assist Remove Cert

Response:

After examining the prompt and response from above, does the response
contain an Image Understanding failure?

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 16/17
09/12/2024, 09:21 Outlier

Assist Remove
Yes Cert No

Not quite!

Is this a good justification for Image Understanding dimension? Justification:


"The code provided includes some of the elements depicted in the image, but
certain details are not entirely accurate or fully aligned with the image."

Yes No

https://app.outlier.ai/en/expert/course?id=6723e7433ad12e600c328a4a 17/17

You might also like