Flash Flash Revolution: Community Forums

Flash Flash Revolution: Community Forums (http://www.flashflashrevolution.com/vbz/index.php)
-   Critical Thinking (http://www.flashflashrevolution.com/vbz/forumdisplay.php?f=33)
-   -   Are you insecure about your intelligence? (http://www.flashflashrevolution.com/vbz/showthread.php?t=119274)

Cavernio 06-18-2011 10:07 AM

Re: Are you insecure about your intelligence?
 
Quote:

Originally Posted by 3Bey (Post 3488785)
yes but the facility you had to gain them come from intelligence.

Which would make kids far more intelligent than any adult could ever be, yet I don't think most people define intelligence that way.

Cavernio 06-18-2011 10:57 AM

Re: Are you insecure about your intelligence?
 
Reliability to re-taking a test? Well, if they never learned the right answer in the first place, or how to get it, of course it's going to be similar.


I would say that I have to read those studies so I can pick them apart mercilessly (as I tend to do with any study I bother to read.) Have you ever 'trained' someone for psychometric tests? I have. Most people didn't give a shit about how well they did, (they were in it to boost their grade for their psyc class,) most people tried to get in and out of the study as fast as possible since it took like 2 friggin hours. Not that every study does this, but unless you have clear motivation for someone to learn something, I'm going to say training doesn't cut it. Especially since about the maximum motivation you could give someone would be to, say, pay them money for getting a higher score, once the study is done, they have no reason to retain the skills they had learned.

I personally think motivation is a huge factor in performance for, well, anything. And that includes intelligence testing, and most of the things you say it correlates with, can all be confounded by one's motivation to succeed. If we could figure out good measures of motivation, I strongly suspect the strength of all the general measures that we say point to intelligence would be weakened. However, I also don't think we have a good measure for motivation, and I think most people would agree to that. (But why should measuring motivation be any harder than measuring any other general idea of a person, like intelligence?)

I remember studies saying that the best predictor of college performance was the amount of sleep someone got, better than SAT's or highschool grades and IQ. You also point this out yourself, that the ability to perform well on tests, in general, correlates with itself quite nicely.

The army retains a bunch of old data from old IQ tests that were clearly based a lot on culture and language, which have since had them torn to shreds by many a researcher. Makes sense that people who score high on those perform well in the army, doesn't mean that it's actually measuring intelligence though.

Regardless of everything else though, the very fact that intelligence testing is not close to 100% in predicting anything, just shows how poor we are at measuring it.
I'm not saying that intelligence isn't important. You can either look at something and say 'it predicts it this well' or look at it and say 'this much variation is left up to other things.'

The essence of G is to try and be what you say it is. That does not mean it succeeds.

I don't think we can really do a debate like this justice without reams of scientific articles about the subject though.

Reach 06-18-2011 12:40 PM

Re: Are you insecure about your intelligence?
 
Quote:

I don't think we can really do a debate like this justice without reams of scientific articles about the subject though.
Well, I posted an article with numerous citations in it. Much of what I talked about is cited in the paper.

http://www.udel.edu/educ/gottfredson...hygmatters.pdf

Obviously there are databases of research on this topic, but most of the points I'm trying to make here are covered there.

Quote:

I personally think motivation is a huge factor in performance for, well, anything.
Of course. Some people are not motivated to try to do well on IQ tests, but that's why a professional assessment of your ability should be taken before ever making wide reaching claims about what you can and cannot do. Psychologists are trained to recognize non compliance, especially from youngsters, and that can obviously invalidate scores.

Quote:

I remember studies saying that the best predictor of college performance was the amount of sleep someone got, better than SAT's or highschool grades and IQ. You also point this out yourself, that the ability to perform well on tests, in general, correlates with itself quite nicely.
I don't see how that could correlate at all, since people sleep different amounts naturally. Obviously getting a good nights sleep is important though; it's well documented that taking an IQ test, for example, when exhausted can decrease your score (though, it appears to have no effect in certain individuals).

With respect to tests; tests can test anything. The crux of g is that I can literally test you on ANY mental task in ANY format and it will have some correlation with your overall IQ.

Quote:

The army retains a bunch of old data from old IQ tests that were clearly based a lot on culture and language, which have since had them torn to shreds by many a researcher. Makes sense that people who score high on those perform well in the army, doesn't mean that it's actually measuring intelligence though.
Not all sections of the test are based on language. Some of them are spatial and have shown little to no cultural bias. They're also heavily correlated with performance on language tests.

Maybe language tests aren't measuring 'intelligence' as you define it, but whatever they are measuring is a good predictor of your ability to learn and perform any number of tasks. If this isn't intelligence, than what is?


Quote:

Regardless of everything else though, the very fact that intelligence testing is not close to 100% in predicting anything, just shows how poor we are at measuring it.
How so? No statistical test is ever going to predict anything 100% accurately. Not only is that mathematically impossible within a population, but it isn't the goal of psychometrics.

Cavernio 06-18-2011 10:24 PM

Re: Are you insecure about your intelligence?
 
You brushed off what I am beginning to see as the most important point I was making.

I wasn't talking merely about motivation and outright non-compliance on tests.

People say that g represents some sort of general intelligence. But it seems to me that it could represent some sort of general motivation among people of good enough intelligence to understand the nature of a test. Someone motivated tries harder at various things like school, their job, and other academic or psychometric tests...all of which supposedly represent intelligence.

g clearly cannot represent some sort of general intelligence anyways, because of the vastness of beings that can have some intelligence who cannot take any sort of test; animals, severly retarded humans, people who have never had any sort of education (well only some tests for those peopl.)

As to the amount of sleep relating to school grades, I will say that I never read any article about it, but I distinctly remember being told that by my first year psychology professors (in more than one class.) Secondly, just because you point out variables in why something doesn't correlate perfectly, doesn't mean that it a relationship doesn't exist. I'm actually kinda surprised you just didn't say something like intelligent people probably sleep more.

"Maybe language tests aren't measuring 'intelligence' as you define it, but whatever they are measuring is a good predictor of your ability to learn and perform any number of tasks. If this isn't intelligence, than what is? "

I'm going to pretend your last sentence is "If this isn't intelligence, than what is it?", because I can say it's motivation.

Lets be real here, if shonin has taught us anything, its that if I work hard, I can accomplish greatness!

My, well, disillusion, at psychometrics is not just in regards to intelligence testing, it's more generalized than that. However, measures of intelligence, and the very fact that people have thought up of the idea of g, means that people think very highly of it.

Zageron 06-18-2011 11:26 PM

Re: Are you insecure about your intelligence?
 
I'm finding the the questions on TRI52 that go like this > to be extremely difficult. The rest are simple, but these ones are stumping me.

Edit: Correction, nearly the entire second half of the test is extremely difficult. I'm nearly at 50, I wonder what I'll get... :s

Edit 2: O wtf the more you do right the farther it lets you go? This test could take forever. ;_;

Artic_counter 06-18-2011 11:53 PM

Re: Are you insecure about your intelligence?
 
I'm neither secure nor insecure. I mostly don't give a shit about it. Even though it wasn't always the case.

I've went through both phase. I've once been extremely secure about my intellect at one point because I was literary the best at everything I did (read childhood) but I've also been insecure when I realized that a lot of people were capable of reaching up to my talents with hard work. Especially in math. Which I now consider to be a passionate hobby I'm really interested into compared to something I used to determine how "intelligent" I was.

Nowadays, I just appreciate the fact that I'm a little bit gifted and I do not strive to increase my intellect for the sake of increasing my intellect. I will actually care about it only if I need to work hard on it in order to have fun with my life and achieve whatever goals that I want to pursue. Which is something I find to be a lot healthier.

Of course, that doesn't change the fact that I really enjoy learning things and that I'm curious as hell lol.

Zageron 06-19-2011 01:44 AM

Re: Are you insecure about your intelligence?
 
Well I ended up with 134. Some of those questions just stopped me in my tracks. Specifically the > ones. :(

Would really like to know how they are done eventually.

Cavernio 06-20-2011 07:59 AM

Re: Are you insecure about your intelligence?
 
K, thought about something beside motivation or intelligence g could be measuring: concentration.

Makes the most sense to me actually. It is very heavily tied into the concept of intelligence too, in that I think intelligence, by necessity, requires concentration. Children would still break this mold though, they seem to learn without having to try. Some learn faster because they do try.

Another thing to add to the list in regards to how tests fail to measure intelligence would be computers. Usually not thought of as highly intelligent, but they could ace some of those tests.

Reincarnate 06-20-2011 08:52 AM

Re: Are you insecure about your intelligence?
 
g is most certainly *not* mere concentration

XCV 06-20-2011 01:22 PM

Re: Are you insecure about your intelligence?
 
Quote:

Originally Posted by Cavernio (Post 3489838)
Children would still break this mold though, they seem to learn without having to try

This is very true. I didn't have to take notes or study for a test until I started taking AP classes two months ago. I just retained everything, either that or I already knew it.

Then again, my IQ is somewhere in the 150s, but that probably doesn't play a part.

Cavernio 06-20-2011 01:57 PM

Re: Are you insecure about your intelligence?
 
Quote:

Originally Posted by Reincarnate (Post 3489847)
g is most certainly *not* mere concentration

It is certainly not mere intelligence either.

Reincarnate 06-20-2011 02:02 PM

Re: Are you insecure about your intelligence?
 
It's general cognitive ability

Cavernio 06-21-2011 01:42 PM

Re: Are you insecure about your intelligence?
 
That's the same thing, and its still just theory, and you're not even bothering to argue why anything I mentioned is invalid, which is important because if what I said is valid, the theory that g measures general cognitive ability is a bunch of BS. At the very least, if we could somehow validly factor in motivation and concentration into g's measurements, if my hypothesis is true, the strength of g would be reduced. The strongest case would be for g to become an utterly useless measure of general cognitive ability.

I mean, think about an example of it. For instance, why would you ever consider something like reaction time to be a representation of general cognitive ability? The fact that it would ever be included in a measure of g seems to be that it loads nicely into it. And the fact that it does makes people think 'oh, reaction time is a good measure of general cognitive ability', using circular reasoning to validate it instead of thinking, 'oh, that's odd, why would something as simple and unintelligent as reaction time be loading into a measure of general cognitive ability?'

That's the funny thing with, well, any measures of validity for any psychometric test; its generally a giant circular path that is set up to validate itself. Measures of validity can only be known to truly be valid if they show that the test isn't valid.

Reincarnate 06-21-2011 01:49 PM

Re: Are you insecure about your intelligence?
 
Because intelligence and concentration are completely different things. It doesn't matter how "hard" an average intellect concentrates on some difficult problem. If they can't solve it, they can't solve it. It's just something you need to account for in assessing how a question was answered. If a high-g person doesn't concentrate at all and bombs a bunch of questions he would have gotten right had he focused, that doesn't mean he's low g. It means his results are invalid.

It's like trying to argue that a 120 MPH-capable car isn't actually fast because you test drive it and never take it above 60 MPH. It's a test error that simply needs correction for the sake of measuring the capability of the thing you're trying to test.

You can call it whatever you want -- I mean any set of positively-correlated variables will necessarily have a factor that explains most of the variance when you perform component analysis. It just so happens that when it comes to intelligence metrics, we slap "g" to the high-variance-explaining element. That element gives a statistical predictive power. If you know something about g, you can estimate what results you'll get on a variety of other metrics.

So like it or not, there are statistical strengths when it comes to g, so I've always found little sense in the "does g exist?" argument. It can predict and correlate to many things, and so in this sense -- yes, it exists. There are simple tests (elementary cognitive tests) that strongly correlate with g, so again, if you know something about the ECT performance, you'll know something about g, and in turn you'll know something about how you'd perform at a great deal of other tasks. A lot of this data is well-supported.

Reincarnate 06-21-2011 02:13 PM

Re: Are you insecure about your intelligence?
 
"I mean, think about an example of it. For instance, why would you ever consider something like reaction time to be a representation of general cognitive ability?"

Because less reaction time on a simple cognitive test means you spent less time thinking about it.

From the wiki:

Elementary cognitive tasks (ECTs) also correlate strongly with g. ECTs are, as the name suggests, simple tasks that apparently require very little intelligence, but still correlate strongly with more exhaustive intelligence tests. Determining whether a light is red or blue and determining whether there are four or five squares drawn on a computer screen are two examples of ECTs. The answers to such questions are usually provided by quickly pressing buttons. Often, in addition to buttons for the two options provided, a third button is held down from the start of the test. When the stimulus is given to the subject, he removes his hand from the starting button to the button of the correct answer. This allows the examiner to determine how much time was spent thinking about the answer to the question (reaction time, usually measured in small fractions of second), and how much time was spent on physical hand movement to the correct button (movement time). Reaction time correlates strongly with g, while movement time correlates less strongly.[10] ECT testing has allowed quantitative examination of hypotheses concerning test bias, subject motivation, and group differences. By virtue of their simplicity, ECTs provide a link between classical IQ testing and biological inquiries such as fMRI studies.

Cavernio 06-21-2011 03:49 PM

Re: Are you insecure about your intelligence?
 
K, so I agree largely with what you've said, which is largely a point I've been trying to make. Yes, if a smart person fails because they can't concentrate for whatever reason, it invalidates the measure. How often to do you think someone performs at full potential all the time though? How can you say that g measures general cognitive ability when you say yourself that there are things can cause g to not be measures of general cognitive ability?

Of course g exists, I don't think I ever said it didn't. I think I started with saying **** g, not g doesn't exist. But to say that g measures general cognitive ability, that's the issue I have. If I've said otherwise I'm taking it back.

Until we correct for things like motivation and concentration for measurements of intelligence, I simply can't say that g measures intelligence.

As to ECT's correlating to g, or even being used as a factor in a formula for g, that's all fine, but what you've quoted, in my eyes, doesn't really change anything I've said. It's neat that they thought of comparing reaction time and movement time, and how we could potentially try to figure out if a person was motivated by performing an fMRI while they're doing the tasks, the paragraph is specifically vague about ECT's. It never says that once measuring controls for things like motivation, and then factoring them out of, say that the results are still correlated to g, much less strongly correlated.

Reincarnate 06-21-2011 04:10 PM

Re: Are you insecure about your intelligence?
 
There are always sources of error in any experiment you perform -- not just a g calculation. It doesn't detract from the nature of what you're testing after you take conflicting variables into account.

Why do you have a problem with g being a measure of general cognitive ability when it's defined as a large variance-explaining entity resultant from a variegated set of cognitive tasks?

You think intelligence needs to factor in motivation and concentration? I don't think that's a very good definition. Intelligence is the ability to quickly gather new information and perform complex tasks. There are certainly sources of error that may conflict with the data-gathering or the performance processes, but that doesn't mean the actual intelligence factor is any less valid. It doesn't make sense to say "Well, I scored low on this test because I didn't really try." Okay, so try. Besides, with so many people and so many trials, g has predictive power and you can be sure that not everyone "was having an off day" when testing. Plenty of people try, and plenty may not perform at capacity. Even so, we see predictive power in g. Things like motivation and concentration are just noise that get filtered out as you increase N. For tough questions, for instance, even if you give someone as much time as they want to solve a problem, if they can't figure it out, they can't figure it out.

Again, it's like saying "Well, to predict the top speed of this car by the type of engine+wheels present, we need to take into account the grogginess levels of the driver and his willingness to accelerate to maximum speed." Those factors don't have any bearing on the actual speed potential of the car, and so it doesn't make sense to say "Until we account for grogginess and willingness, we can't say the type of engine+wheels measures the capable speeds of the car."

Besides, if I am groggy and feeling like poop when taking a highly g-loaded test, I'm going to feel groggy and poopy when performing any other task g is supposed to predict, too. If you get marked with a g level of a particular threshold, that means you're scoring at a level that has been the result of multiple trials in the population such that concentration and motivation have already been shelled out through high N alone. In other words, if you're performing tests and feeling groggy in doing so, obviously you would expect your value to not be indicative of your potential. The solution to that is to actually try.

But if you're not motivated/concentrated when you're testing, that doesn't mean you're not intelligent. It doesn't mean you're necessarily intelligent, either. But you're not testing yourself properly if you're not taking it seriously.

Reach 06-22-2011 09:44 AM

Re: Are you insecure about your intelligence?
 
Quote:

Originally Posted by Zageron (Post 3489438)
Well I ended up with 134. Some of those questions just stopped me in my tracks. Specifically the > ones. :(

Would really like to know how they are done eventually.

134 is a very good score. It would qualify you for mensa and puts you above 99% of the population in general reasoning.

There are usually a couple of ways to solve each of the questions, but many of the > ones with the boxes with 4 squares are solved by solving the remainder in each lane and combining them into one and canceling out/combining where logically necessary.

Some of them are more complicated though. The test is much harder than IQtest.dk, because it's designed to measure much higher IQs accurately. IQtest.dk is simply not designed to measure IQs over 130 (it runs into serious ceiling effect, or inability to make statistically significant differentiation between people of different ability).


Quote:

Until we correct for things like motivation and concentration for measurements of intelligence, I simply can't say that g measures intelligence.
I'm not convinced this is a valid argument.


You could also say, for example, that until we correct for things like motivation and concentration for measurements of running speed, I simply can't say that a sprinting event on a track measures running speed.

It doesn't make any sense. Of course we accept that some major correlate of running speed, i.e. a sprinting event, measures how fast you can run. We also accept that some people run faster than others. We don't even need to think about it. We also intuitively know that your speed in a sprinting event is highly correlated with your speed in other events, and your 'general' fitness, or 'g'Fit (which in turn, is a wide reaching predictor of your running speed in any event!).

What then, is the big deal with it comes to IQ tests? It's the exact same thing...


Quote:

For tough questions, for instance, even if you give someone as much time as they want to solve a problem, if they can't figure it out, they can't figure it out.
This is essentially the essence of high range tests like the Titan test, and as much as I'm not convinced it beats or even matches standard psychometric measures of intelligence in terms of validity, it does have very high correlation with standard IQ tests...

It's just backed up too much by data. Beyond a point, studies have shown there is a near zero correlation between time spent and score on extremely high difficulty questions, because a person of insufficient intellect will *never* solve it given even an indefinite amount of time (or they will solve it incorrectly).

This is a huge punch to the nuts for the 'concentration' hypothesis, since I would hypothesize that if concentration and motivation were serious factors to consider when measuring intelligence, dumber people would be able to solve hard questions correctly given enough time and there would be a strong correlation between time spent and score on difficult tests.

It also makes sense intuitively. Take someone with MR for example; we never expect them to start doing higher level maths, even if they were very motivated and tried their hardest. They simply don't have the capacity to do so. Likewise, why expect someone of average intelligence to be able to perform way above their level if they simply concentrate harder and are more motivated? They too, do not have the capacity.

(For the record, I do think concentration and motivation matter, just not nearly as much as Cavernio does).

(Also, anecdotally, when attempting the Titan test, I found I could either solve the question relatively quickly or was hopelessly lost indefinitely, fumbling around in the dark taking stabs at probably incorrect solutions).

Reincarnate 06-22-2011 10:31 AM

Re: Are you insecure about your intelligence?
 
I feel like most of the bashing against intelligence metrics are done out of emotional appeal.

Reincarnate 06-22-2011 11:04 AM

Re: Are you insecure about your intelligence?
 
just took iqtest.dk again -- got "over 145" again (slightly unfair since I took this test in the past already), but here are the answers in screenshot form if anyone is curious. Question 39 is lmfao so much harder than the rest to figure out (there's one super-obvious fact that is actually useless, and only once you find the next relevant observation does the final step unravel to the answer). 34 is also tough (imo).


All times are GMT -5. The time now is 11:12 PM.

Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.
Copyright FlashFlashRevolution