You are not currently logged in. Please create an account or log in to view the full course.
Validity
- About
- Transcript
- Cite
Research Methods – Good Scientific Practice
In this course, Dr Ashok Jansari (Goldsmiths, University of London) explores how researchers report good (or sometimes not good) science. In the first lecture, we think about the three main forms of validity: face, concurrent, and ecological. In the second lecture, we think about the three main forms of reliability: test-retest, inter-rater, and internal. In the third lecture, we think about features of science and how the empirical method can promote good scientific practice. Next, we think about theory construction and the process that a good researcher will follow to work from their initial idea towards their finished theory. In the fifth and final lecture, we think about scientific reporting and the five key sections of a report which adheres to the American Psychological Association (APA) standard.
Validity
In this lecture, we think about validity, focusing in particular on: (i) whether a study is measuring what it explicitly says it is measuring, known as face validity; (ii) whether a study’s results align somewhat with existing results in the same field, known as concurrent validity; (iii) whether the results of an experiment can be applied to the real world, known as ecological validity; (iv) which areas of psychology suffer particularly with ecological validity.
I'm Dr African.
00:00:06Sorry, and I'm a cognitive neuropsychologist at Goldsmiths University of London.
00:00:08What that means is that I try to study how our mental functions such as memory and
00:00:12face recognition work by studying people who've got brain
00:00:19damage and you've got disruption in those systems.
00:00:22So, for example,
00:00:25I study people with memory disorders to understand how our memory works.
00:00:26And I study people with a rare disorder called presto magnesia,
00:00:30whereby they can't recognise faces
00:00:35to try to understand how you and I recognise faces.
00:00:37Now what we're going to do is to look at the issue of validity.
00:00:40No validity, as it says on the tin,
00:00:44is to do with how appropriate or realistic or valid your results are now.
00:00:47Ultimately, when we do any form of experimentation,
00:00:54we're trying to explore a particular issue such as, um,
00:00:58is bullying brought on by watching violent video games or something like that?
00:01:02There's a question there
00:01:09and our experiment.
00:01:11However we work it out or design, it is going to be to answer this particular question
00:01:12Now. The issue of validity is, are we actually doing that correctly?
00:01:19Our our results going to be valid and do they represent
00:01:24the type of thing that we want to look at?
00:01:28So the first type of validity is face validity.
00:01:31Face validity is effectively what it says on its face or it's tin.
00:01:34Is that what it's looking at?
00:01:40So if we do a study on, say, the influence of violent video games on bullying,
00:01:42the results that we get are they actually representing that particular issue?
00:01:50Or have we ended up doing an odd study where, in fact, were, um,
00:01:56looking at poverty or the impact of poverty on people's behaviour?
00:02:01So face validity is basically about Does it actually
00:02:05measure the thing that it's saying it does?
00:02:10So if I'm doing a study on memory,
00:02:12is the type of test that I'm doing to do with memory,
00:02:16or am I actually somehow measuring people's I Q.
00:02:19By mistake.
00:02:23So the point here is that for face validity,
00:02:24it needs to measure what it says it's Measuring.
00:02:28Another form of validity is concurrent validity.
00:02:33So how does this particular study or test
00:02:37relate to other tests that currently measured the same thing?
00:02:43So using the memory example again,
00:02:48if I was developing a new test of short term memory.
00:02:50For example,
00:02:54if it's got concurrent validity,
00:02:56it means that the results from my study relate
00:02:58to other concurrent tests of short term memory.
00:03:02So what you want to do is to make sure
00:03:06that you are measuring what you're say you're measuring,
00:03:09which is the face validity,
00:03:12and that it relates at some level to the other
00:03:13tests in the similar in the same or similar field.
00:03:17So you want to have rough equivalence so
00:03:21that you're not measuring something completely different.
00:03:23Another really important type of validity is known as ecological validity
00:03:27and ecological validity is something that's become
00:03:33really quite important in psychology because ultimately,
00:03:35what ecological validity is about?
00:03:40Is that what we're measuring as experimenters in
00:03:42a laboratory or in a classroom setting?
00:03:47Does it actually relate to the outside world?
00:03:51Now, for example, I'm as blind as a bat
00:03:55my eyes that is so bad that if I didn't have my contact lenses on,
00:03:57I wouldn't be able to see anything.
00:04:02So when I go to an optician,
00:04:04optician gets me to look at a chart of letters on green or red
00:04:06background and asked me whether it's clearer
00:04:11on the red background or green background.
00:04:14Now I don't go around the outside world
00:04:17looking at things on red and green background.
00:04:19But importantly,
00:04:21the diagnosis that they give the result of my eye test
00:04:24and what they help me with in terms of
00:04:28glasses or contact lenses has got ecological validity,
00:04:31because with my contact lenses right now, I can see things quite clearly.
00:04:34So there is ecological validity to the type of testing that the opposition is doing
00:04:39in terms of my real world behaviour.
00:04:44With some aspects of psychology, there is good ecological validity.
00:04:47So, for example, some tests of memory,
00:04:51short term and long term generally they do
00:04:54measure what's happening in the outside world.
00:04:57For example, there are other areas,
00:05:00such as how the front of the brain measure the front of the brain,
00:05:03controls human behaviour and allows us to plan, make decisions, be creative
00:05:06that really lack ecological validity.
00:05:13So, for example,
00:05:16there are famous patients who've had tumours removed from the front
00:05:17of their brains who have got major problems in everyday life.
00:05:21And some of you may have come across a
00:05:26case called Phineas Gauge who had a bizarre accident in
00:05:28the States in the 1800 where a poll flew through
00:05:33his face and caused a lot of brain damage,
00:05:37and he ended up with frontal lobe brain damage.
00:05:39Now we have patients like Phineas Gauge who have damaged in the same area of
00:05:42the brain caused by brain surgery who can't do things in the outside world,
00:05:47such as make decisions about where to go this afternoon or financially,
00:05:53what to choose between five different options.
00:05:57And yet they pass all of the standard test of frontal lobe functioning.
00:05:59So what we have there is a lack of ecological validity.
00:06:04We know that the patient in the outside world has got major problems,
00:06:08but the test currently are saying that there's nothing wrong with them,
00:06:13and that's a lack of ecological validity.
00:06:17So overall validity is about the fact that we want our results
00:06:20to bear some semblance
00:06:26to what is actually happening in the outside world.
00:06:28Otherwise, there's no point in doing this research,
00:06:31and there are all sorts of consequences of
00:06:34not having a valid result because, for example,
00:06:37you might end up with a theory that's completely wrong or
00:06:40were still in clinical cases like the patients with brain damage.
00:06:44You might end up saying to them,
00:06:48There's nothing wrong with you even though
00:06:50there's something really wrong with them.
00:06:51Civility is an extremely important thing,
00:06:53and we have to make sure that our studies are experimentation
00:06:56and our results have good validity within them.
00:07:02The next thing we're going to look at is reliability.
00:07:07
Cite this Lecture
APA style
Jansari, A. (2022, March 07). Research Methods – Good Scientific Practice - Validity [Video]. MASSOLIT. https://massolit.io/courses/research-methods-good-scientific-practice/theory-construction
MLA style
Jansari, A. "Research Methods – Good Scientific Practice – Validity." MASSOLIT, uploaded by MASSOLIT, 07 Mar 2022, https://massolit.io/courses/research-methods-good-scientific-practice/theory-construction