COMP4660-8420 Assignment2
COMP4660-8420 Assignment2
Context
This assignment extends the previous one in a way that is up to you; there should be some
connection to the previous assignment, but remember, don’t get too stressed. You should take
into account the marking outcomes from Assignment 1, and any peer review comments you may
get, to improve the text as appropriate to the new assignment.
So, what do you do? You can either extend you current paper using a deep learning approach OR
an evolutionary algorithms approach.
Examples: if you extend the current with an evolutionary algorithm, you could adjust the
parameters of your neural network or pruning or input processing or all the weights or …
Similarly, you could use a CNN on the larger version of the data set (not all datasets have this) and
then apply the same pruning or … to the fully connected layers at the end.
1. A report (about 4-6 pages of text content with a MAXIMUM of 10 pages, including
references, diagrams, graphs and tables). Remember to keep your report clear and
concise. I say that the text content should be about 4-6 pages to signal that we will not
be counting lines, but if it is 10 pages long and it is all diagrams then it is very clear
that there is too little text. Conversely, if it is 10 pages long and there is just one
diagram then there is too much text, but 6 pages with one diagram is ne, and so on.
Submission Method
Please submit your assignment via the OpenReview conference management system. Your
submission will be a second version of your previous paper as far as OpenReview is concerned –
I will re-open the site about a week before the assignment is due. Something like this is common
in conferences, when your paper is accepted you then modify based on review comments
(markers and peer reviewers in this case) and then submit a nal version (often called a “camera-
ready” version).
Objectives
The purpose for this assignment is for you to:
• Develop a good understanding of deep learning or evolutionary algorithms, and enhance your
skills in implementing them in PyTorch / Python.
• Enhance your approach to investigating and solving a real-world data set / problem.
fi
fi
fi
ffi
fi
fi
ff
fi
fl
fi
• Develop improved understanding of reporting investigations in a conference paper.
• Some experience in using Google scholar to nd citing/cited papers.
Task Description
1. devise a classi cation or regression problem to investigate using the data set;
2. implement in PyTorch / Python to solve the problem and implement a method to
determine the performance of the technique(s) you used;
3. implement a technique from the literature (paper selected as for assignment 1) and
determine its bene t or lack of bene t (to keep it simple, we expect you to simply
extend the work you did in assignment 1 simply using DL/EA, rather than doing a
brand new assignment);
4. compare your results with results published in the dataset paper reporting results on
the data set you chose (dataset paper as chosen for assignment 1); and
5. write a report on your work.
Data set
Either continue with your existing dataset Your report should indicate which dataset you used,
what modi cations you made to the encodings if you needed to do so, and cite the technique
paper you chose. Other academic papers can generally be found by using Google scholar.
Google scholar will have links to one or more paper repositories. You can get access if you do this
from ANU campus as the library subscribes to most of the large document repositories. Some
papers are in multiple repositories so if you cannot nd a free copy then ask your tutor for advice.
From o campus, if you log into the ANU Virtual Proxy server then usually you can access the
same electronic resources. You should also mention in your report any di erent topologies and
analyses used in your experimentation.
Design of a Problem
Detail in your report what you want to model in the data set and explain what the inputs
and outputs you will use to develop the neural network model.
Implementation
Choose an appropriate measure to report the results produced by your extended technique
and compare to your results using neural networks. You can use the measure used in the
research papers that have the results of their predictions on the data set you have used and
would like to compare your results with. Remember to cite the papers in your report.
Report
The report must be in the style of an academic paper and must conform to the Lecture Notes
in Computer Science conference paper proceedings format, but with the margins changed to
2 cm and header/footer to 1 cm. The template for the report can be downloaded from Wattle
by clicking the link named “AssignmentReportTemplate-LNCS-O ce2007.zip” and needs
the margins to be modi ed. Use the Springer citation style
Your report should have a meaningful title, which indicates what you have done.
"COMP8420 Assignment" is not a meaningful title. Your title and content should NOT
mention the course: we are modelling the assignment so that you are making a conference
paper submission. Your u number should be showing in your email address, and only there.
Your a liation would be “School of Computing, Australian National University, Canberra
Australia".