1
PSY337
Advanced Research Design and Analysis
Unit Outline
2
Unit Code: PSY337
Unit Title: Advanced Research Design and Analysis
Year 2022
Semester Two
Sector Higher Education
School/Discipline Psychology
Credit Points 10
Equivalent Units PSY347
Pre-requisites Must have passed 1 units
in {Psy247, Psy248}
Assumed Knowledge PSY150 or PSY140, PSY151 or
PSY141, and PSY101
Charles Darwin University acknowledges and pays respect to Elders both past and
present of the Larrakia people where the main Darwin campus is located, along with
our campuses on lands of the Arrernte of Alice Springs, the Jawoyn, Wardaman and
Dagomon of Katherine, the Waramungu of Tennant Creek, and our interstate
campuses on lands of the Gadigal People of the Eora Nation of Sydney and the Kulin
Nation of Melbourne.
CDU also acknowledges its footprint is on the lands of many nations of Aboriginal
custodians including the Kungarakan people of Batchelor and Adelaide River, Yolngu of
northeast Arnhemland, and the Tiwi people.
Aboriginal and Torres Strait Islander students are warned that CDU study materials may unavoidably contain
images of persons now deceased.
Unit Description
This unit is designed to further develop research skills including; understanding of sampling
techniques, knowledge and application of appropriate analytical tools, writing of research
reports in APA style, and an understanding of scale development and measurement. It is
intended that at the end of this course students will be able to decide on the analyses
relevant to test particular research hypotheses, interpret some of the main inferential
statistics used in psychological research and be competent in the use of statistical software
for these purposes.
Participation
Accomplishing the unit outcomes requires that you devote approximately 10–12 hours a week in total
to engaging with the unit material. This time will be spent:
• participating in the lectures and tutorials
• completing the required textbook readings
• identifying and reading required journal articles for seminars and to supplement in-class
learning
In your first week for this unit, you will attend a three-hour class on Friday afternoon (2-5pm; please
make every effort to attend this first class). For each week after that, you will watch an online lecture
and attend a workshop on Friday afternoon (2-4pm) in-person [if on campus] or online [if external].
The pre-recorded lectures will be made available Friday afternoons on the week before the workshop.
Computers will be available for those students on campus during the Friday afternoon workshops and
all external students will require access to their own computer during this time (a mobile phone is not
sufficient).
Internal lectures & tutorials
• Day and time: Friday 2-5PM
• Location: CAS.Orange 1.3.14
3
External lectures & tutorials
You can join the internal tutorials (details above) via the collaborate classroom in Learnline. If you are
in another time zone than Darwin/NT, you will need work out the lecture times in your time zone.
If for any reason the tutorial times do not work for you, you can watch or listen to the recordings at a
later time (recordings typically become available within 3 hours of the end of the session).
To stay on track and accomplish the assessment tasks, we highly recommend that you access
Learnline at least once a week.
For queries related to the content, the assessments, technology or anything else related to the unit,
please post these in the Discussion Boards (e.g., under Learning Materials-Week 1-Week 1 questions).
For personal/confidential content, please contact me directly via email (robert.heirene@cdu.edu.au).
I aim to respond to emails within 24 hours (excluding weekends) and so please do feel free to send
me a reminder email if you do not hear from me in this time frame.
Unit Overview
The unit will be managed by a Unit Coordinator who will guide you through most of the
material and will handle any administrative requirements. Guest lecturers may be invited to
address specialist areas.
All essential information is contained in this Unit Outline.
This unit is designed to engage and guide your thinking but to do this YOU must be engaged
– what you will get out this unit is determined by the amount of effort you put in. Set aside
the time to address the materials properly and treat it as the commitment that it is. It is
expected that you will spend ten hours a week engaged with this unit through readings,
lectures, tutorials and written work.
Students are also expected to hold to the Student Code of Conduct which upholds respect,
inclusion, ethics and integrity, excellence and accountability as key values.
Class timetable details may be found via the CDU Portal – Timetables.
4
Learning Outcomes
The unit learning outcomes include:
1. Explain the principles of experimental design within the framework of ethical
considerations.
2. Articulate and describe the basic principles of scale development.
3. Determine, use and interpret the statistical methodology most suitable for specific
designs with a firm understanding of the assumptions required for utilization.
4. Apply the analysis best suited to the research hypothesis.
5. Analyse and critically interpret research data from the social sciences.
Teaching Period Coordinator
Dr Robert Heirene
Email: robert.heirene@cdu.edu.au
Phone: 088946 7453
Office: Blue 1.32
Campus: Casuarina
Office hours by appointment only.
About the College of Health & Human Sciences
The College of Health & Human Sciences brings together scholars and students who are
passionate about tackling real-world issues and opportunities.
Located in Australia’s Top End, our programs report enviable graduate employment rates,
indeed some of the highest in Australia. Whatever your aspirations, our engaging and
dedicated academic and research staff will help you broaden and expand your horizons and
realise your ambitions.
Courses span biomedical and clinical sciences, health science, pharmacy, sport and exercise,
psychology, and social work. We also provide structured progression onto other
professional training, such as medicine and physiotherapy. We offer practical workintegrated learning opportunities within the Northern Territory, across Australia and around
the world, with an abundance of research opportunities.
Connect with us on Facebook.
5
RESOURCES
Prescribed Texts
– Navarro, D. J., & Foxcroft, D. R. (2022). learning statistics with jamovi: a tutorial for
psychology students and other beginners. (Version 0.75).
https://dx.doi.org/10.24384/hgc3-7p15
This is a free online text that anybody can access.
Recommended Texts
Your coordinator will provide you with additional reccomended texts throughout the
semester that will accompany and supplement the lecture and seminar materials.
Liaison Librarian
Liaison Librarians are your link to effective use of library resources. We work with students
and staff to help find, evaluate and reference the most reliable and relevant resources for
research and teaching. Contact your librarian for individual assistance or register for a
workshop. Explore the Subject LibGuides or visit the Drop In Room at Casuarina during
semester, 10am-1pm, weekdays (Red 8.1.7).
6
About Learnline
Learnline is CDU’s online learning environment, encompassing the learning management
system Blackboard, streaming media services and other learning technologies.
At CDU, most HE Units and many VET units are delivered online so you can:
• Access unit content easily
• Engage with your lecturer and fellow students through collaborative tools
• Submit assessments and access grades and feedback
• Stay connected on the go with mobile apps
Important specific technologies within Learnline that your unit may refer to include:
Turnitin Text-Matching software
Incorporated into assessment submission points, Turnitin compares submitted assignments
against a database of academic papers and online resources to identify areas of overlap
between the submitted assignment and existing works. A Turnitin originality report provides
detailed information about the matches found between a student’s submitted paper and
existing sources. Both instructors and students can use the report to review assignment
submissions for originality and create opportunities to identify how to properly attribute
sources and/or paraphrase effectively.
Blackboard Collaborate
Blackboard Collaborate is web-based video conferencing software which allows for the
sharing of presentations together with video and audio that may be used in a lecture,
tutorial or a collaborative format. Conveniently, Collaborate Presentations may be recorded
and retrieved. CDU currently runs two versions of Collaborate with Classic requiring a
launcher and Ultra opening directly in the browser. Closely read any provided information to
correctly join a session.
Kaltura
Kaltura is a video platform that allows for the uploading, publishing, sharing and editing of
video and audio files. Kaltura also facilitiates collaborative learning experiences for staff
and students through in-video quizzes, screen recordings and other interactive learning
experiences.
Plagiarism and Academic Honesty
Plagiarism is representing someone else’s ideas and work as your own. Plagiarism includes
not only copying verbatim, but also rephrasing the ideas of another without properly
acknowledging the source. As work is prepared and submitted to meet course
requirements, whether a draft or a final version of a paper or project, take care to
distinguish personal ideas and language from information derived from sources. Sources
include published primary and secondary materials, electronic media, and information and
opinions gained directly from other people.
Students are also expected to hold to the Student Code of Conduct which upholds respect,
inclusion, ethics and integrity, excellence and accountability as key values.
7
Writing Standards
Citations and references should adhere to the American Psychological Association (APA)
Formatting and Style Guide 7
th edition.
This referencing style shows how to lay out citations and references as well as formats for
general types of documents you may need to employ during your study, such as reports,
Information on the APA style guide may be found at the relevant CDU LibGuide or at the
APA Style book or blog.
Technology Requirements
This is an online course. Students will use a computer to communicate, to access online
multimedia (audio, video, Flash), and to create multimedia. Consistent Internet access and a
computer with the ability to record and broadcast sound via a built-in or external mic or a
headset will be required.
Online tests should be attempted via a desktop computer with a physical connection to the
internet rather than using wifi.
The latest versions of Google Chrome and Mozilla Firefox are the only supported internet
browsers. Microsoft Internet Explorer, Microsoft Edge and Apple Safari are known to have
display issues in Learnline or its component parts.
System requirements for Learnline and related systems vcan be found here.
8
LEARNING SCHEDULE
For easy conversion to calendar weeks, see the HE Year/Semester Week conversion
document on the CDU Portal – Timetables.
Room locations and times for internally scheduled classes may also be found online at CDU
Portal – Timetables.
Week # (date
beginning) Topic Sub-Topics
Assessments
Due
(date; time)
Week 1
(22/08/2022)
Introduction to the unit and relevant
software
Basic statistical concepts review,
software (SPSS, jamovi),
Week 2
(29/08/2022) Multiple regression
Regression basics and recap;
statistical assumptions; running the
test
Week 3
(05/09/2022) One-way ANOVA ANOVA basics and recap; statistical
assumptions; running the tests
Week 4
(12/09/2022) Factorial ANOVA
ANOVA designs (between, repeated
and mixed); statistical assumptions;
running the tests
Week 5
(19/09/2022) Chi-square & logistic regression
Chi-square test & logistic
regression;purpose of these tests;
statistical assumptions; running the
tests

Week 6
(26/09/2022) [No class] [No class]
Online test 1 (28/09/2022
at 12pm to 30/09/2022 at
12pm)
Week 7
(10/10/2022)
Seminar on data analysis and write-up
assessment.
Week 8
(17/10/2022) Questionnaire design Development, reliability, and validity
of questionnaires
Week 9
(24/10/2022) Alternatives to NHST
Problems with null-hypothesis
statistical tests; effect sizes and
confidence intervals; Bayesian
statistics
Week 10
(31/10/2022) Power analysis Sample size determination for
common statistical tests
Data analysis
& write-up
(02/11/2022;
by 12pm)
Week 11
(07/11/2022)
Transparency & reproducibility in
scientific research
Issues with replication and
reproduction in the social sciences;
scientific reform; importance of
replication studies
Week 12
(14/11/2022) [No class] [No class]
Online test 2
(16/11/2022 at 12pm to
18/11/2022 at 12pm)
Week 13
(21/11/2022) Revision Week
Week 14
(28/11/2022) Centrally organised examination period
9
ASSESSMENT
This unit has the following assessment items:
DESCRIPTION/FOCUS VALUE
RELATES TO
LEARNING
OUTCOMES
1. Online test 1 25% 1, 2, 3, & 4
2. Data analysis & write-up 50% 3, 4, & 5
3. Online test 2 25% 1, 2, 3, & 4
Further details may be found on the unit Learnline site.
Students are reminded that the capture and presentation of assessment items for sale,
trade or other circulation, either within the university or with outside bodies, represents a
significant act of academic misconduct under the university’s Academic and Scientific
Misconduct and Fraud and Corruption Control policies and may leave students open to
penalties laid out therein.
General information concerning CDU end of semester examinations may be found here:
https://cdu.edu.au/student-central/examinations
Application For Extension Of Due Date Of Assignment
Submission Procedure
In the College of Health and Human Sciences (CHHS), an Extension Panel reviews all student
extension requests. To request an extension please review the following:
1. Complete the Extension Application Form (provided on Learnline) and submit to the
unit coordinator (by email) Please note this this application must be received by
your unit coordinator in the CHHS a minimum of three business days before the due
date of the assessment item to which the request relates. Your application must be
accompanied by appropriate supporting documentation and will not be processed
without it.
2. The unit coordinator will forward your extension request to the Extension Panel for
review.
3. The Extension Panel will review the extension request and supporting evidence and
decide if an extension will be granted and for how long the extension will be for.
They will return this decision to the unit coordinator.
4. The unit coordinator will return the Extension Panel’s decision to the student to
advise of and extension being granted or not.
10
Assessment 1
DESCRIPTION/FOCUS Online test 1
VALUE 25%
RELATED UNIT
OUTCOMES 1, 2, 3, & 4
DUE DATE Opens 28/09/2022 at 12pm and closes 30/09/2022 at 12pm
LENGTH The test will last for 45 minutes
TASK
Answer 25 multiple choice questions (MCQs) based on lecture and
seminar material covered between weeks 1 and 5.
PREPARATION
Weeks 1-5 lecture and seminar materials and readings provided (see
page 12 & 13 of this document).
PRESENTATION N/A
ASSESSMENT CRITERIA 1 mark per correct answer
Assessment 2
DESCRIPTION/FOCUS Data analysis & write-up
VALUE 50%
RELATED UNIT
OUTCOMES 3, 4, & 5
DUE DATE 02/11/2022, by 12:00
LENGTH 1,500 words max. There is no minimum word count.
TASK
On October 26 at 12:00pm (Darwin time) you will be presented with a
description of 10 studies and a data set for each study. For each study,
you will need to decide on and run the appropriate statistical analyses
in jamovi/SPSS and report the results in writing. The statistical analyses
you will need to use will be covered in weeks 2 to 8.
You will have 1 week to complete this assessment.
PREPARATION Weeks 1-8 lecture and seminar materials and readings provided (see
page 12 & 13 of this document).
PRESENTATION APA standards (7th)
ASSESSMENT CRITERIA See page 14 of this document
Assessment 3
DESCRIPTION/FOCUS Online test 2
VALUE 25%
RELATED UNIT
OUTCOMES 1, 2, 3, & 4
11
DUE DATE Opens 16/11/2022 at 12pm and closes 18/11/2022 at 12pm
LENGTH The test will last for 45 minutes
TASK
Answer 25 multiple choice questions (MCQs) based on lecture and
seminar material covered between weeks 7 and 11.
PREPARATION
Weeks 7-11 lecture and seminar materials and readings provided (see
page 12 & 13 of this document).
PRESENTATION N/A
ASSESSMENT CRITERIA 1 mark per correct answer
Disability Support
Charles Darwin University is committed to providing an accessible, supportive, safe and
inclusive learning environment for all students. If you require an academic accommodation
due to a disability, let your lecturer know as soon as possible. Students who need academic
accommodations based on the impact of a disability will be encouraged to contact the
Equity Services office if they have not done so already. The Equity Services office is on the
Casuarina campus and can be reached at (08) 8946 6288 or equity@cdu.edu.au.
Online Support
24 hour a day technical support for Learnline and Online Classroom (powered by Blackboard
Collaborate)
Phone: 1800 984 057
Computer Account Support
Support for student account and logging in issues, including email accounts
Phone: (08) 8946 6600
LogIT: logit.cdu.edu.au
Enrolment Support
Inherent Requirements: Please familiarise yourself with the inherent requirements necessary for
studying psychology https://www.cdu.edu.au/inherent-requirements/psychology
Student Central provides a ‘one-stop’ service for queries regarding admissions, enrolments,
progression, fees and more.
Phone: 1800 061 963
Email: student.central@cdu.edu.au
For queries about unit content always contact your lecturer in the first instance.
12
Required reading for each week
Note: all “chapters” mentioned refer to the prescribed text:
– Navarro, D. J., & Foxcroft, D. R. (2022). learning statistics with jamovi: a tutorial for psychology
students and other beginners. (Version 0.75). https://dx.doi.org/10.24384/hgc3-7p15
Week # Topic Required reading
Week 1 Introduction to the
unit and relevant
software
– Chapter 1: Why do we learn statistics?
– Chapter 2: A brief introduction to research design
Week 2
Multiple regression
– Chapter 12: Correlation and linear regression
Week 3
One-way ANOVA
– Chapter 13: Comparing several means (one-way ANOVA)
Week 4
Factorial ANOVA
– Chapter 14: Factorial ANOVA
Week 5 Chi-square & logistic
regression
– Chapter 10: Categorical data analysis
Week 6
[No class]
None
Week 7 Seminar on data
analysis and write-up
assessment.
Please read the following paper:
– Drost, Ellen. (2011). Validity and Reliability in Social Science Research.
Education Research and Perspectives. 38. 105-124.
Week 8
Questionnaire design
– Chapter 15: Factor analysis
Week 9
Alternatives to NHST
Please read the following chapter AND paper:
– Chapter 16: Bayesian statistics
– Cumming, G. (2014). The New Statistics: Why and How. Psychological
Science, 25(1), 7–29. https://doi.org/10.1177/0956797613504966
Week 10
Power analysis
Please read the following paper:
– Todd Abraham, W., & Russel, D. W. Statistical Power Analysis in
Psychological Research. Social and Personality Psychology
Compass 2/1 (2008): 283–301, 10.1111/j.1751-
9004.2007.00052.x
Week 11
Transparency &
reproducibility in
scientific research
Please read the following papers:
– Aarts, Alexander & Anderson, Joanna & Anderson, Christopher
& Attridge, Peter & Attwood, Angela & Axt, Jordan & Babel,
Molly & Bahník, Štěpán & Baranski, Erica & Barnett-Cowan,
Michael & Bartmess, Elizabeth & Beer, Jennifer & Bell, Raoul &
Bentley, Heather & Beyan, Leah & Binion, Grace & Borsboom,
Denny & Bosch, Annick & Bosco, Frank & Penuliar, Mike.
(2015). Estimating the reproducibility of psychological science.
Science. 349. 10.1126/science.aac4716.
– Munafò, Marcus & Nosek, Brian & Bishop, Dorothy & Button,
Katherine & Chambers, Christopher & Percie du Sert, Nathalie
& Simonsohn, Uri & Wagenmakers, Eric-Jan & Ware, Jennifer &
Ioannidis, John. (2017). A manifesto for reproducible science.
Nature Human Behaviour. 1. 0021. 10.1038/s41562-016-0021.
Week 12
[No class]
None
13
As this is a third-year, advanced unit, a certain amount of knowledge is assumed of students. As
such, while the following section of the textbook is not recommended for any specific week, I highly
recommend you read it at the beginning of (or before) semester:
– Part IV “Statistical Theory” (Chapters 7, 8, & 9)
Assessment Criteria

Assessment 2: Data analysis and write-up

In this assessment, you will be presented with the description of 10 fictitious research studies and
related data sets (in Excel). Your task is to 1) identify the correct statistical analyses; 2) run the
correct analyses in jamovi or SPSS (your choice); 3) correctly report the outputs/results in writing
(based on APA 7th or this unit’s workbook). There is a maximum total word count of 1500 (note this is
not a target but a limit). Note that you are required to save and store (but not submit) the
SPSS/jamovi outputs. All the statistical analyses will be covered between weeks 2 and 8.
This task is worth 40% of the total marks for this unit. You have 7 days to complete this assessment
(for dates, please see page 10 of this document).
For each study/data set, you can achieve a maximum score of 10 points, for an overall total score of
100, if you were to do everything correctly. The statistical techniques covered between week 2 and
10 include 15 different tests (week 4 to week 10), several approaches to check for normality (week
3), and reliability/validity (week 2).
Because each statistical test is reported in a slightly different way and because you will be
tested on multiple statistical tests/approaches to normality testing/reliability validity (and you
will only be provided with the description of the 10 fictitious research studies one week prior to the
deadline for submission), the manner by which marks are assigned on each research study/data set
is going to vary slightly depending on the complexity of the statistical analyses.
In general, however, the table below provides a breakdown of how marks are given, for a single
fictitious research study, based on 1), 2) and 3).
Selecting the
most appropriate
statistical
test for analysis
Identifying and
reporting the IV,
DV, and [if relevant]
the number of
levels per IV for the
study
Reporting the main
results of the
statistical
test(s) and
assumption tests if
relevant.
Correctly interpreting
the statistical test
outcomes and [if
relevant] reporting the
follow-up/post
hoc tests
0 or 3 0 or 1 0-2 0-4
14
Higher Education (HE) Grading Schema
As per the CDU Grading Policy, Higher Education assessment items are graded as per the
table below.
NOTATION GRADE AND EXPLANATION VALUE
HD High Distinction
Demonstrates imagination, originality or flair, based on
proficiency in all aspects of the unit; work is interesting or
surprisingly exciting, challenging, well read or scholarly.
85 – 100%
D Distinction
Demonstrates awareness and understanding of deeper
andless obvious aspects of the unit, such as ability to
identify and debate critical issues or problems, ability to
solve nonroutine problems, ability to adapt and apply
ideas to new situations, and ability to evaluate new ideas.
75 – < 85% C Credit Demonstrates ability to use and apply fundamental concepts and skills of the unit going beyond mere replication of content knowledge or skill to show understanding of key ideas, awareness of their relevance, some use of analytical skills, and some originality or insight. 65 - < 75% P Pass Satisfies all of the basic learning requirements of the unit, such as knowledge of fundamental concepts and performance of basic skills; demonstrates satisfactory, adequate, competent, or capable achievement. 50 - < 65% PU Pass Ungraded Indicates that the unit is assessed only a basis of pass or fail and that the student’s work has achieved a pass level. PC Pass Conceded A PC grade may be awarded by the College Assessment Review in lieu of a composite mark in the range 45 to <50% when, in the view of the College Assessment Review Panel and taking into consideration the student’s overall academic performance, the student falls short of satisfying all basic requirements for a Pass but can be granted concession for the deficiencies. F Fail Fails to satisfy the requirements of the unit. < 50% FNS Fail Not Submitted Fails to satisfy the requirements of the unit. Did not complete 50% or more of the assessment 0