<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: &#8220;we can all bring out experts..&#8221;</title>
	<atom:link href="http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/feed/" rel="self" type="application/rss+xml" />
	<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/</link>
	<description>Conversation, politics and stray insights</description>
	<lastBuildDate>Sun, 12 Feb 2012 15:56:05 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
	<item>
		<title>By: willis</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-272212</link>
		<dc:creator>willis</dc:creator>
		<pubDate>Sat, 01 Nov 2008 17:57:41 +0000</pubDate>
		<guid isPermaLink="false">#comment-272212</guid>
		<description>Why do the funding arrangements matter? Non sequitur again.

You can insult and bluster all you want. You can claim that the whole world is agin&#039; you. Actually it would appear that the whole education world is against you.

No wonder you feel so defensive and angry.

You do some digging for a change. Find some solid academic research which backs up the 11+. Go on.

What is AQE&#039;s position. Or did you fall out with them as well. 

Are you Stephen Elliot in disguise?</description>
		<content:encoded><![CDATA[<p>Why do the funding arrangements matter? Non sequitur again.</p>
<p>You can insult and bluster all you want. You can claim that the whole world is agin&#8217; you. Actually it would appear that the whole education world is against you.</p>
<p>No wonder you feel so defensive and angry.</p>
<p>You do some digging for a change. Find some solid academic research which backs up the 11+. Go on.</p>
<p>What is AQE&#8217;s position. Or did you fall out with them as well. </p>
<p>Are you Stephen Elliot in disguise?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Essentialist</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-272175</link>
		<dc:creator>Essentialist</dc:creator>
		<pubDate>Sat, 01 Nov 2008 14:52:58 +0000</pubDate>
		<guid isPermaLink="false">#comment-272175</guid>
		<description>Willis,
Your persistent simplistic ignoring evidence of the real problems of the 11-plus are staggering. 
If you had read to the end of John Gardner&#039;s Testing the Test you would have come across the technical section. The culprits are identified here.
 
....&quot;Openness

Many of the difficulties associated with the technical aspects of the Transfer Test have not come to light because access to the necessary information is prohibited.

 This study highlights the importance of openness in high stakes tests such as the Transfer Test. Modern validity inquiry - which interprets all validity as construct-referenced - includes a consideration of the social consequences of testing. Given that significant adverse consequences for individuals can arise from interpreting the grade sequence C2, C1, B2, B1 as a perfect hierarchy, those responsible for designing and administering the Transfer Test have a clear responsibility to admit to the Test’s frailties. This report represents a call for greater openness and accountability in respect of a test which can have a profound effect on a child’s future.

Clearly, no test is perfect and the Transfer Test’s designers may feel, with some justification, that in order to eliminate misclassifications, they face the impossible task of reducing the standard error of measure to zero. Nevertheless this report calls for information on the Transfer Test and its weaknesses to be conveyed clearly to the public.

Standards for Test Administration

... the British examination bodies have always avoided
the publication of data bearing on the technical fidelity of their assessment instruments.  The silence on Transfer Test information in Northern Ireland rings loud when contrasted with the approach taken in just three of the AERA Standards:

Standard 1.1 (on Validity)

A rationale should be presented for each recommended interpretation and use of test scores,
together with a comprehensive summary of the evidence and theory bearing on the intended
use or interpretation.

Standard 1.2 (on Validity)

The test developer should set forth clearly how test scores are intended to be interpreted and
used. The population(s) for which a test is appropriate should be clearly delimited, and the
construct that the test is intending to assess should be clearly described.

Standard 2.1 (on Reliability and Errors of Measurement)

For each total score, sub-score or combination of scores that is to be interpreted, estimates of
relevant reliabilities and standard errors of measurement or test information functions should
be reported.

The Transfer Test is a high stakes test and Northern Ireland pupils deserve the protection of
technical fidelity standards which apply to children elsewhere in the world. This report
demonstrates that the grading has potential for significant misclassification; the
inference that a pupil with a grade B1, for example, has more ‘ability’ than a pupil graded B2
simply cannot be validated.

While testing agencies  can be held to
account for the validity and reliability of their instruments, one could be forgiven the
impression that British testing agencies are accountable only for their question setting and
marking. Parents who dispute their child’s Transfer Test grade have recourse to a re-mark 
Parents with more fundamental concerns have no recourse except perhaps to the law.
However, the secrecy that surrounds the Transfer Test leaves the courts with few options
other than to assume that there is a one-to-one correspondence between the Test score and the
child’s ‘ability’.

 Adoption of the Standards would quickly disabuse the courts of this viewand would give test developers, administrators and candidates alike access to powerful evidence if the need arises for them to argue their case.&quot;....

Spelled out for you Willis in black and white. The Department of Education and CCEA  were identified in 2000 as the responsible parties for validity and reliability for the 11-plus. Their solution to the problem? Create an anti- 11-plus hysteria permitting them to end the use of the instrument entirely. Problem solved. Notice how the 11-plus has been used continuously since 2000 without reference to the responsibilities of DENI or CCEA. John Gardner (the computer academic) allowed the criticisms of the 11-plus to be used by anti-selection radicals but stayed silent on the role of CCEA and DENI. In fact he continued to profit from their contract work and was made Head of the School of Education.

Now Willis if I need to go over this slowly for you I can. BTW did you ever find out about the funding arrangements for the Testing the Test project?

Keep digging. It&#039;s not the test stupid!</description>
		<content:encoded><![CDATA[<p>Willis,<br />
Your persistent simplistic ignoring evidence of the real problems of the 11-plus are staggering.<br />
If you had read to the end of John Gardner&#8217;s Testing the Test you would have come across the technical section. The culprits are identified here.</p>
<p>&#8230;.&#8221;Openness</p>
<p>Many of the difficulties associated with the technical aspects of the Transfer Test have not come to light because access to the necessary information is prohibited.</p>
<p> This study highlights the importance of openness in high stakes tests such as the Transfer Test. Modern validity inquiry &#8211; which interprets all validity as construct-referenced &#8211; includes a consideration of the social consequences of testing. Given that significant adverse consequences for individuals can arise from interpreting the grade sequence C2, C1, B2, B1 as a perfect hierarchy, those responsible for designing and administering the Transfer Test have a clear responsibility to admit to the Test’s frailties. This report represents a call for greater openness and accountability in respect of a test which can have a profound effect on a child’s future.</p>
<p>Clearly, no test is perfect and the Transfer Test’s designers may feel, with some justification, that in order to eliminate misclassifications, they face the impossible task of reducing the standard error of measure to zero. Nevertheless this report calls for information on the Transfer Test and its weaknesses to be conveyed clearly to the public.</p>
<p>Standards for Test Administration</p>
<p>&#8230; the British examination bodies have always avoided<br />
the publication of data bearing on the technical fidelity of their assessment instruments.  The silence on Transfer Test information in Northern Ireland rings loud when contrasted with the approach taken in just three of the AERA Standards:</p>
<p>Standard 1.1 (on Validity)</p>
<p>A rationale should be presented for each recommended interpretation and use of test scores,<br />
together with a comprehensive summary of the evidence and theory bearing on the intended<br />
use or interpretation.</p>
<p>Standard 1.2 (on Validity)</p>
<p>The test developer should set forth clearly how test scores are intended to be interpreted and<br />
used. The population(s) for which a test is appropriate should be clearly delimited, and the<br />
construct that the test is intending to assess should be clearly described.</p>
<p>Standard 2.1 (on Reliability and Errors of Measurement)</p>
<p>For each total score, sub-score or combination of scores that is to be interpreted, estimates of<br />
relevant reliabilities and standard errors of measurement or test information functions should<br />
be reported.</p>
<p>The Transfer Test is a high stakes test and Northern Ireland pupils deserve the protection of<br />
technical fidelity standards which apply to children elsewhere in the world. This report<br />
demonstrates that the grading has potential for significant misclassification; the<br />
inference that a pupil with a grade B1, for example, has more ‘ability’ than a pupil graded B2<br />
simply cannot be validated.</p>
<p>While testing agencies  can be held to<br />
account for the validity and reliability of their instruments, one could be forgiven the<br />
impression that British testing agencies are accountable only for their question setting and<br />
marking. Parents who dispute their child’s Transfer Test grade have recourse to a re-mark<br />
Parents with more fundamental concerns have no recourse except perhaps to the law.<br />
However, the secrecy that surrounds the Transfer Test leaves the courts with few options<br />
other than to assume that there is a one-to-one correspondence between the Test score and the<br />
child’s ‘ability’.</p>
<p> Adoption of the Standards would quickly disabuse the courts of this viewand would give test developers, administrators and candidates alike access to powerful evidence if the need arises for them to argue their case.&#8221;&#8230;.</p>
<p>Spelled out for you Willis in black and white. The Department of Education and CCEA  were identified in 2000 as the responsible parties for validity and reliability for the 11-plus. Their solution to the problem? Create an anti- 11-plus hysteria permitting them to end the use of the instrument entirely. Problem solved. Notice how the 11-plus has been used continuously since 2000 without reference to the responsibilities of DENI or CCEA. John Gardner (the computer academic) allowed the criticisms of the 11-plus to be used by anti-selection radicals but stayed silent on the role of CCEA and DENI. In fact he continued to profit from their contract work and was made Head of the School of Education.</p>
<p>Now Willis if I need to go over this slowly for you I can. BTW did you ever find out about the funding arrangements for the Testing the Test project?</p>
<p>Keep digging. It&#8217;s not the test stupid!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: willis</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-271950</link>
		<dc:creator>willis</dc:creator>
		<pubDate>Fri, 31 Oct 2008 20:30:36 +0000</pubDate>
		<guid isPermaLink="false">#comment-271950</guid>
		<description>The problem with any discussion of &quot;Testing the Test&quot; is your non sequiturs. You asked me to debate &quot;Testing the test&quot; and offered up the quote

&quot;Indeed perhaps you should get a copy of Testing the Test from QUB (2000) and read up on the 11-plus transfer test. (written by one of its critics with his fingerprints currently all over the revised curriculum assessment arrangements)&quot;

This gave me some hope that you actually wanted to have a rational debate. Unfortunately you had simply found yet another piece of research which judged the 11+ a poor piece of work. 

I could hardly disagree.

Tell you what. Find a research document which defends the 11+ (The University of Buckingham is your best bet) then we can discuss something you agree with.

Sending me research reports which back my arguments up, while very kind, does not make you look very good.

BTW insulting an academic because his background is in Computers is not going to wash with me. Especially on a blog.</description>
		<content:encoded><![CDATA[<p>The problem with any discussion of &#8220;Testing the Test&#8221; is your non sequiturs. You asked me to debate &#8220;Testing the test&#8221; and offered up the quote</p>
<p>&#8220;Indeed perhaps you should get a copy of Testing the Test from QUB (2000) and read up on the 11-plus transfer test. (written by one of its critics with his fingerprints currently all over the revised curriculum assessment arrangements)&#8221;</p>
<p>This gave me some hope that you actually wanted to have a rational debate. Unfortunately you had simply found yet another piece of research which judged the 11+ a poor piece of work. </p>
<p>I could hardly disagree.</p>
<p>Tell you what. Find a research document which defends the 11+ (The University of Buckingham is your best bet) then we can discuss something you agree with.</p>
<p>Sending me research reports which back my arguments up, while very kind, does not make you look very good.</p>
<p>BTW insulting an academic because his background is in Computers is not going to wash with me. Especially on a blog.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Essentialist</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-271633</link>
		<dc:creator>Essentialist</dc:creator>
		<pubDate>Fri, 31 Oct 2008 02:16:48 +0000</pubDate>
		<guid isPermaLink="false">#comment-271633</guid>
		<description>That&#039;s another 11-plus question you&#039;ve come up with.
Pity you haven&#039;t been willing/able to discuss the issues of Testing the Test which I pointed you to. Go round in as many circles as you like Willis - like a hamster on a wheel.</description>
		<content:encoded><![CDATA[<p>That&#8217;s another 11-plus question you&#8217;ve come up with.<br />
Pity you haven&#8217;t been willing/able to discuss the issues of Testing the Test which I pointed you to. Go round in as many circles as you like Willis &#8211; like a hamster on a wheel.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: willis</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-271568</link>
		<dc:creator>willis</dc:creator>
		<pubDate>Thu, 30 Oct 2008 22:32:50 +0000</pubDate>
		<guid isPermaLink="false">#comment-271568</guid>
		<description>Is this an endless circle? I have. I did.

Of course I&#039;m not slow. I know that 42/0.7 = 60. Which is a lot more than you have managed.</description>
		<content:encoded><![CDATA[<p>Is this an endless circle? I have. I did.</p>
<p>Of course I&#8217;m not slow. I know that 42/0.7 = 60. Which is a lot more than you have managed.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Essentialist</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-271559</link>
		<dc:creator>Essentialist</dc:creator>
		<pubDate>Thu, 30 Oct 2008 22:12:33 +0000</pubDate>
		<guid isPermaLink="false">#comment-271559</guid>
		<description>Are you just slow?  The culprits for the attack on the 11-plus as a valid and reliable instrument are the very people who are legally responsible for its use. Get rid of the 11-plus and you impose comprehensives while at the same time erasing your failures. Would you care to suggest a different method of differentiated education?</description>
		<content:encoded><![CDATA[<p>Are you just slow?  The culprits for the attack on the 11-plus as a valid and reliable instrument are the very people who are legally responsible for its use. Get rid of the 11-plus and you impose comprehensives while at the same time erasing your failures. Would you care to suggest a different method of differentiated education?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: willis</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-271548</link>
		<dc:creator>willis</dc:creator>
		<pubDate>Thu, 30 Oct 2008 21:38:37 +0000</pubDate>
		<guid isPermaLink="false">#comment-271548</guid>
		<description>And your point is?</description>
		<content:encoded><![CDATA[<p>And your point is?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Essentialist</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-271468</link>
		<dc:creator>Essentialist</dc:creator>
		<pubDate>Thu, 30 Oct 2008 18:32:20 +0000</pubDate>
		<guid isPermaLink="false">#comment-271468</guid>
		<description>Now you are on my ground Willis.

Check out the background of John Gardner of QUB School of Education. What is his area of expertise? A clue .....computers and IT

Now ask &quot;Who funded this research?&quot;

Then ask &quot;Why was there only one reference to Testing the Test in the DENI funded  Gallagher and Smith research into the selective system of education in Northern Ireland?&quot;

 After all opponents of academic selection railed against the 11-plus endlessly; they still do.

Why did the DENI or CCEA not publish or apply for a licence to publish the work? 

It shouldn&#039;t take long Willis for even you to figure out that all is not as it seems.


Take the following:

 &quot;The ‘easiness’ of the Test is a serious design flaw as children would have been awarded a 
D grade with 70% of the available marks. It is difficult to justify how a perceived ‘fail’grade, a D, can be awarded to children who have done so well&quot;

Note Gardner and Cowan&#039;s citation of Please (1971) in Testing the Test.

Please identified the problem with measurement and reporting of same and suggested a way of recording it. What did Gardner do except ignore this practical problem.

John Gardner is one of the key individuals who &quot;sold&quot; CCEA the cop out of Assessment for Learning&quot; to cover up the problems of the DENI/CCEA/NFER adulterated Transfer Test.

Testing the Test was published in 2000. Eight years later the same 11-plus test is still used. No improvements, alterations, or adjustments. The DENI solution? End the 11-plus. Bury the problem.

So having authored such a statement John Gardner did what? He promoted a form of description of attainment in schools which ignores assessment of learning and replaces it with assessment for learning.

A step backwards into the abyss. The descent into chaos hasn&#039;t stopped yet but many of the architects of this disaster have retired or been promoted.

So where&#039;s the replacement for the 11-plus? Or where are the lawsuits against the &quot;immoral&quot; test for academic selection?

 You can&#039;t have it both ways.</description>
		<content:encoded><![CDATA[<p>Now you are on my ground Willis.</p>
<p>Check out the background of John Gardner of QUB School of Education. What is his area of expertise? A clue &#8230;..computers and IT</p>
<p>Now ask &#8220;Who funded this research?&#8221;</p>
<p>Then ask &#8220;Why was there only one reference to Testing the Test in the DENI funded  Gallagher and Smith research into the selective system of education in Northern Ireland?&#8221;</p>
<p> After all opponents of academic selection railed against the 11-plus endlessly; they still do.</p>
<p>Why did the DENI or CCEA not publish or apply for a licence to publish the work? </p>
<p>It shouldn&#8217;t take long Willis for even you to figure out that all is not as it seems.</p>
<p>Take the following:</p>
<p> &#8220;The ‘easiness’ of the Test is a serious design flaw as children would have been awarded a<br />
D grade with 70% of the available marks. It is difficult to justify how a perceived ‘fail’grade, a D, can be awarded to children who have done so well&#8221;</p>
<p>Note Gardner and Cowan&#8217;s citation of Please (1971) in Testing the Test.</p>
<p>Please identified the problem with measurement and reporting of same and suggested a way of recording it. What did Gardner do except ignore this practical problem.</p>
<p>John Gardner is one of the key individuals who &#8220;sold&#8221; CCEA the cop out of Assessment for Learning&#8221; to cover up the problems of the DENI/CCEA/NFER adulterated Transfer Test.</p>
<p>Testing the Test was published in 2000. Eight years later the same 11-plus test is still used. No improvements, alterations, or adjustments. The DENI solution? End the 11-plus. Bury the problem.</p>
<p>So having authored such a statement John Gardner did what? He promoted a form of description of attainment in schools which ignores assessment of learning and replaces it with assessment for learning.</p>
<p>A step backwards into the abyss. The descent into chaos hasn&#8217;t stopped yet but many of the architects of this disaster have retired or been promoted.</p>
<p>So where&#8217;s the replacement for the 11-plus? Or where are the lawsuits against the &#8220;immoral&#8221; test for academic selection?</p>
<p> You can&#8217;t have it both ways.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: willis</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-271354</link>
		<dc:creator>willis</dc:creator>
		<pubDate>Thu, 30 Oct 2008 15:15:09 +0000</pubDate>
		<guid isPermaLink="false">#comment-271354</guid>
		<description>Found it.

http://gtcni.openrepository.com/gtcni/bitstream/2428/6312/1/Testing the Test.pdf

KEY FINDINGS
Based on the 1998/1999 Test papers and the large samples used in this study:
· The Test does not measure a singular attribute of the candidate; it measures three:
mathematics, English and science. In the same manner that it would normally not be good
practice to add the marks from GCSE mathematics, English and science tests, their
addition in the Transfer Procedure Test is questionable.
· Since the Test does not measure a singular attribute of candidates, it cannot be used as a
proxy for any particular attribute, for example children’s ability or their potential to
benefit from a grammar school education. The common perception that it does provide
some such measure cannot be substantiated by the research.
· The Tests would be perceived as ‘easy’ by many pupils since more than 65% of them
answered over 70% of the questions correctly.
· The ‘easiness’ of the Test is a serious design flaw as children would have been awarded a
D grade with 70% of the available marks. It is difficult to justify how a perceived ‘fail’
grade, a D, can be awarded to children who have done so well.
· With such an ‘easy’ test format, it is very likely that the children will know or will at least
have a sense of how well they did. The consequences for their self-confidence, of being
awarded a D for such high scores, has not been assessed in this study but must be
considered a serious issue.
8
· There is evidence that the science section of the Test contributes significantly to the
‘easiness’. The average science score for the three tests studied was 19 out of 23 i.e. 83%
correct compared to 70% for the mathematics and English sections.
· The lower weighting and relatively high average score in science can lead to disadvantage
for those who have relatively low scores in the science sections. Despite having the same
overall Test score to begin with, candidates with low science scores may end up with
lower final scores (after age adjustment, standardization and weighting) than candidates
who score relatively more in mathematics and/or English.
· The three tests were found to be highly reliable, averaging 0.90 against a maximum
possible of 1.00. However, examination of the Standard Error of Measurement for the
combined sample for Test1 and Test 2 indicates that a child’s true score2, with 95%
confidence, will lie somewhere between 10 marks above or below their Test score.
· The Test works effectively to identify 12% of the candidates as secure A grade candidates
(scaling up to 2,053 children in the total cohort) and 18% as secure D grade candidates
(3,099 children). Its capacity to allocate grades accurately to children whose scores lie
between the score ranges of these groups is highly questionable.
· The boundaries between the six Test grades (A, B1, B2, C1, C2 and D) cover only 18
marks out of a total of 150. Within the 95% confidence range (10 marks above or below
the Test score) the Test therefore has the potential to misclassify pupils by up to three
grades above or below their given grade.
· For example, 23% of the candidates (scaling up to 4,487 children in the total cohort) have
A grade scores up to 10 marks above the score at the A/B1 boundary. Their true grade
could be an A or depending on how close they are to the boundary, it could be any grade
down to a C1. Similarly 12% of the candidates (2,148 children) have D grade scores up to
10 marks below the score at the C2/D boundary. Their true grade could be a D or
depending on how close they are to the boundary, it could be C2 or a C1. Finally, 33% of
the candidates (5,818 children) have scores between and including the A and D grade
boundaries. Grades in the middle of the range, e.g. C1, could be any grade up to A or
down to D.
· No consistent pattern of significant differences was found in the mean scores of the
groups of candidates from the different education and library board areas.
· The mean scores of the preparatory school candidates were significantly higher than any
of the other groups characterized by their school management types. There was no
significant difference between the mean scores of the groups of candidates from the two
main primary school sectors: controlled and Catholic maintained.
· The mean score of candidates from schools with high free school meal (FSM)
entitlements (51%+) was significantly lower than the mean scores of groups from the
other lower FSM entitlement (&lt;10, 11-30 and 31-50%). The mean score of the group of
candidates in schools with &lt;10% FSM entitlement was also found to be significantly
higher than those of other categories for Test 1 and Test 2.

There is more but I would max out the page.</description>
		<content:encoded><![CDATA[<p>Found it.</p>
<p><a href="http://gtcni.openrepository.com/gtcni/bitstream/2428/6312/1/Testing" rel="nofollow">http://gtcni.openrepository.com/gtcni/bitstream/2428/6312/1/Testing</a> the Test.pdf</p>
<p>KEY FINDINGS<br />
Based on the 1998/1999 Test papers and the large samples used in this study:<br />
· The Test does not measure a singular attribute of the candidate; it measures three:<br />
mathematics, English and science. In the same manner that it would normally not be good<br />
practice to add the marks from GCSE mathematics, English and science tests, their<br />
addition in the Transfer Procedure Test is questionable.<br />
· Since the Test does not measure a singular attribute of candidates, it cannot be used as a<br />
proxy for any particular attribute, for example children’s ability or their potential to<br />
benefit from a grammar school education. The common perception that it does provide<br />
some such measure cannot be substantiated by the research.<br />
· The Tests would be perceived as ‘easy’ by many pupils since more than 65% of them<br />
answered over 70% of the questions correctly.<br />
· The ‘easiness’ of the Test is a serious design flaw as children would have been awarded a<br />
D grade with 70% of the available marks. It is difficult to justify how a perceived ‘fail’<br />
grade, a D, can be awarded to children who have done so well.<br />
· With such an ‘easy’ test format, it is very likely that the children will know or will at least<br />
have a sense of how well they did. The consequences for their self-confidence, of being<br />
awarded a D for such high scores, has not been assessed in this study but must be<br />
considered a serious issue.<br />
8<br />
· There is evidence that the science section of the Test contributes significantly to the<br />
‘easiness’. The average science score for the three tests studied was 19 out of 23 i.e. 83%<br />
correct compared to 70% for the mathematics and English sections.<br />
· The lower weighting and relatively high average score in science can lead to disadvantage<br />
for those who have relatively low scores in the science sections. Despite having the same<br />
overall Test score to begin with, candidates with low science scores may end up with<br />
lower final scores (after age adjustment, standardization and weighting) than candidates<br />
who score relatively more in mathematics and/or English.<br />
· The three tests were found to be highly reliable, averaging 0.90 against a maximum<br />
possible of 1.00. However, examination of the Standard Error of Measurement for the<br />
combined sample for Test1 and Test 2 indicates that a child’s true score2, with 95%<br />
confidence, will lie somewhere between 10 marks above or below their Test score.<br />
· The Test works effectively to identify 12% of the candidates as secure A grade candidates<br />
(scaling up to 2,053 children in the total cohort) and 18% as secure D grade candidates<br />
(3,099 children). Its capacity to allocate grades accurately to children whose scores lie<br />
between the score ranges of these groups is highly questionable.<br />
· The boundaries between the six Test grades (A, B1, B2, C1, C2 and D) cover only 18<br />
marks out of a total of 150. Within the 95% confidence range (10 marks above or below<br />
the Test score) the Test therefore has the potential to misclassify pupils by up to three<br />
grades above or below their given grade.<br />
· For example, 23% of the candidates (scaling up to 4,487 children in the total cohort) have<br />
A grade scores up to 10 marks above the score at the A/B1 boundary. Their true grade<br />
could be an A or depending on how close they are to the boundary, it could be any grade<br />
down to a C1. Similarly 12% of the candidates (2,148 children) have D grade scores up to<br />
10 marks below the score at the C2/D boundary. Their true grade could be a D or<br />
depending on how close they are to the boundary, it could be C2 or a C1. Finally, 33% of<br />
the candidates (5,818 children) have scores between and including the A and D grade<br />
boundaries. Grades in the middle of the range, e.g. C1, could be any grade up to A or<br />
down to D.<br />
· No consistent pattern of significant differences was found in the mean scores of the<br />
groups of candidates from the different education and library board areas.<br />
· The mean scores of the preparatory school candidates were significantly higher than any<br />
of the other groups characterized by their school management types. There was no<br />
significant difference between the mean scores of the groups of candidates from the two<br />
main primary school sectors: controlled and Catholic maintained.<br />
· The mean score of candidates from schools with high free school meal (FSM)<br />
entitlements (51%+) was significantly lower than the mean scores of groups from the<br />
other lower FSM entitlement (&lt;10, 11-30 and 31-50%). The mean score of the group of<br />
candidates in schools with &lt;10% FSM entitlement was also found to be significantly<br />
higher than those of other categories for Test 1 and Test 2.</p>
<p>There is more but I would max out the page.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: willis</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-271316</link>
		<dc:creator>willis</dc:creator>
		<pubDate>Thu, 30 Oct 2008 11:58:41 +0000</pubDate>
		<guid isPermaLink="false">#comment-271316</guid>
		<description>Thank You

Your answer proves all my points.

&quot;The “grammar effect” adds a significant positive difference to attainment outcomes.&quot;

Even to grade &#039;D&#039;s!

So who gets to choose which Ds get through?

If you think &quot;Testing the test&quot; is so devastating to my arguments send me a link to the whole thing.

I&#039;m liking what I see so far.</description>
		<content:encoded><![CDATA[<p>Thank You</p>
<p>Your answer proves all my points.</p>
<p>&#8220;The “grammar effect” adds a significant positive difference to attainment outcomes.&#8221;</p>
<p>Even to grade &#8216;D&#8217;s!</p>
<p>So who gets to choose which Ds get through?</p>
<p>If you think &#8220;Testing the test&#8221; is so devastating to my arguments send me a link to the whole thing.</p>
<p>I&#8217;m liking what I see so far.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Essentialist</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-271314</link>
		<dc:creator>Essentialist</dc:creator>
		<pubDate>Thu, 30 Oct 2008 11:09:28 +0000</pubDate>
		<guid isPermaLink="false">#comment-271314</guid>
		<description>Have you got hold of Testing the Test yet Willis?

42% of pupils attend grammars because the quotients are applied to the entire cohort not just those taking the 11-plus. If this rule were changed then there wouldn&#039;t be the same degree of nonsense of some B, C and D grades getting a grammar school education while others do not. The &quot;grammar effect&quot; adds a significant positive difference to attainment outcomes.

Open enrolment plays a part also and no school has volunteered to reduce intake. 

DENI and CCEA are responsible for these rules; hence the justified criticism of the educationalists.</description>
		<content:encoded><![CDATA[<p>Have you got hold of Testing the Test yet Willis?</p>
<p>42% of pupils attend grammars because the quotients are applied to the entire cohort not just those taking the 11-plus. If this rule were changed then there wouldn&#8217;t be the same degree of nonsense of some B, C and D grades getting a grammar school education while others do not. The &#8220;grammar effect&#8221; adds a significant positive difference to attainment outcomes.</p>
<p>Open enrolment plays a part also and no school has volunteered to reduce intake. </p>
<p>DENI and CCEA are responsible for these rules; hence the justified criticism of the educationalists.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: willis</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-271158</link>
		<dc:creator>willis</dc:creator>
		<pubDate>Wed, 29 Oct 2008 21:31:49 +0000</pubDate>
		<guid isPermaLink="false">#comment-271158</guid>
		<description>As to my disposition for good honest toil you need have no fears.

Ok let me try again. If 30% do not seek a place at a Grammar School and 42% overall get a place at a Grammar School then 60% of those who sit the 11+ get a place at a Grammar School.

Yes or No?

Actually that would make a good 11+ question.

Would you pass?

Or Pass in the Mastermind sense?</description>
		<content:encoded><![CDATA[<p>As to my disposition for good honest toil you need have no fears.</p>
<p>Ok let me try again. If 30% do not seek a place at a Grammar School and 42% overall get a place at a Grammar School then 60% of those who sit the 11+ get a place at a Grammar School.</p>
<p>Yes or No?</p>
<p>Actually that would make a good 11+ question.</p>
<p>Would you pass?</p>
<p>Or Pass in the Mastermind sense?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Essentialist</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-271101</link>
		<dc:creator>Essentialist</dc:creator>
		<pubDate>Wed, 29 Oct 2008 19:22:06 +0000</pubDate>
		<guid isPermaLink="false">#comment-271101</guid>
		<description>So what is an A Grade in the 11-plus Willis? Where is the rank order information? Is a pupil who scores highly on the 11-plus and gets an A the same as another who also gets an A but scored closer to the B1 grade boundary? 

&quot;30% of pupils do not take the exam&quot; would be a reference to those who do not wish to seek a place at a grammar school. Once again Willis you attempt to mislead but cannot escape the relentless evidence stacked against your poor argument. 

Perhaps you will also eat some humble pie over your statement &quot;I said “ensured”. As far as I know only a A grade (Top 25%) “ensures” you a Grammar School place.&quot;

Place a call to the BELB or look up the admissions/applications figures for Grosvenor Grammar School in Belfast and retract yet another mistaken statement.

Indeed perhaps you should get a copy of Testing the Test from QUB (2000) and read up on the 11-plus transfer test. (written by one of its critics with his fingerprints currently all over the revised curriculum aqssessment arrangements)

Laff? Mock? Willis it&#039;s time you started doing some homework. Do you have the disposition?</description>
		<content:encoded><![CDATA[<p>So what is an A Grade in the 11-plus Willis? Where is the rank order information? Is a pupil who scores highly on the 11-plus and gets an A the same as another who also gets an A but scored closer to the B1 grade boundary? </p>
<p>&#8220;30% of pupils do not take the exam&#8221; would be a reference to those who do not wish to seek a place at a grammar school. Once again Willis you attempt to mislead but cannot escape the relentless evidence stacked against your poor argument. </p>
<p>Perhaps you will also eat some humble pie over your statement &#8220;I said “ensured”. As far as I know only a A grade (Top 25%) “ensures” you a Grammar School place.&#8221;</p>
<p>Place a call to the BELB or look up the admissions/applications figures for Grosvenor Grammar School in Belfast and retract yet another mistaken statement.</p>
<p>Indeed perhaps you should get a copy of Testing the Test from QUB (2000) and read up on the 11-plus transfer test. (written by one of its critics with his fingerprints currently all over the revised curriculum aqssessment arrangements)</p>
<p>Laff? Mock? Willis it&#8217;s time you started doing some homework. Do you have the disposition?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: willis</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-270989</link>
		<dc:creator>willis</dc:creator>
		<pubDate>Wed, 29 Oct 2008 14:53:33 +0000</pubDate>
		<guid isPermaLink="false">#comment-270989</guid>
		<description>The 11+ ensures that for 25-30% of children.

Now with 42% of post-primary pupils attending grammars in Northern Ireland please identify in what way the 12-17% you ignore are failed through grammars? 

I said &quot;ensured&quot;. As far as I know only a A grade (Top 25%) &quot;ensures&quot; you a Grammar School place. 

http://www.deni.gov.uk/index/85-schools/6-admission-and-choice/6-transfer-procedure.htm

30% of pupils do not take the exam so that 42% of pupils attending Grammar Schools becomes 60% of those taking the examination. 

What was that percentage you mocked?</description>
		<content:encoded><![CDATA[<p>The 11+ ensures that for 25-30% of children.</p>
<p>Now with 42% of post-primary pupils attending grammars in Northern Ireland please identify in what way the 12-17% you ignore are failed through grammars? </p>
<p>I said &#8220;ensured&#8221;. As far as I know only a A grade (Top 25%) &#8220;ensures&#8221; you a Grammar School place. </p>
<p><a href="http://www.deni.gov.uk/index/85-schools/6-admission-and-choice/6-transfer-procedure.htm" rel="nofollow">http://www.deni.gov.uk/index/85-schools/6-admission-and-choice/6-transfer-procedure.htm</a></p>
<p>30% of pupils do not take the exam so that 42% of pupils attending Grammar Schools becomes 60% of those taking the examination. </p>
<p>What was that percentage you mocked?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Essentialist</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-270962</link>
		<dc:creator>Essentialist</dc:creator>
		<pubDate>Wed, 29 Oct 2008 11:21:49 +0000</pubDate>
		<guid isPermaLink="false">#comment-270962</guid>
		<description>Parental interest in education is not some sort of career move or publicly funded hobby. It stems from innate interest in the welfare of ones children and naturally extends beyond.

 Willis surely you must see the irony of admission preference given to the children of teachers and governors? It is undeniably unmerited. Your comment on self-interest speaks for itself.

You claim &quot;The only issue for parents is a decent education for their children. 

The 11+ ensures that for 25-30% of children.&quot; 

Now with 42% of post-primary pupils attending grammars in Northern Ireland please identify in what way  the 12-17% you ignore are failed through grammars?

I have not made comment on secondary schools since they are a natural complement to grammars. As with grammars some will be good, bad and indifferent. I only rail against so-called &quot;comprehensives&quot; that rely on academic selection to artificially create the impression of all ability intakes. Interestingly all are Catholic or Integrated.

Perhaps you should direct your energy on to them.

On &quot;educationalists&quot; the difference between them and parents is that the parents are not taxpayer funded failures.</description>
		<content:encoded><![CDATA[<p>Parental interest in education is not some sort of career move or publicly funded hobby. It stems from innate interest in the welfare of ones children and naturally extends beyond.</p>
<p> Willis surely you must see the irony of admission preference given to the children of teachers and governors? It is undeniably unmerited. Your comment on self-interest speaks for itself.</p>
<p>You claim &#8220;The only issue for parents is a decent education for their children. </p>
<p>The 11+ ensures that for 25-30% of children.&#8221; </p>
<p>Now with 42% of post-primary pupils attending grammars in Northern Ireland please identify in what way  the 12-17% you ignore are failed through grammars?</p>
<p>I have not made comment on secondary schools since they are a natural complement to grammars. As with grammars some will be good, bad and indifferent. I only rail against so-called &#8220;comprehensives&#8221; that rely on academic selection to artificially create the impression of all ability intakes. Interestingly all are Catholic or Integrated.</p>
<p>Perhaps you should direct your energy on to them.</p>
<p>On &#8220;educationalists&#8221; the difference between them and parents is that the parents are not taxpayer funded failures.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: willis</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-270928</link>
		<dc:creator>willis</dc:creator>
		<pubDate>Wed, 29 Oct 2008 02:35:13 +0000</pubDate>
		<guid isPermaLink="false">#comment-270928</guid>
		<description>I appreciate that as a parent you take a interest, but for how long? 10-15 years max until the kids are sorted. Your much mocked Educationalists have to take an interest for a lot longer.

&quot;The only issue for parents is the legal regulated provision of a trusted, objective test used for the post-primary transfer of pupils at age 11&quot;

Get a grip. 

The only issue for parents is a decent education for their children. 

The 11+ ensures that for 25-30% of children. 

Either you think that the other 70-75% still get a decent education in which case a Comprehensive system isn&#039;t so big a worry or you don&#039;t really care about them as long as your kids are ok. If you are honest enough to say you don&#039;t care then fair play to you but don&#039;t expect to get on your high moral horse to &quot;Educationalists&quot;

What hacks me off is people who think that High schools do a great job but just for &quot;other people&#039;s children&quot;</description>
		<content:encoded><![CDATA[<p>I appreciate that as a parent you take a interest, but for how long? 10-15 years max until the kids are sorted. Your much mocked Educationalists have to take an interest for a lot longer.</p>
<p>&#8220;The only issue for parents is the legal regulated provision of a trusted, objective test used for the post-primary transfer of pupils at age 11&#8243;</p>
<p>Get a grip. </p>
<p>The only issue for parents is a decent education for their children. </p>
<p>The 11+ ensures that for 25-30% of children. </p>
<p>Either you think that the other 70-75% still get a decent education in which case a Comprehensive system isn&#8217;t so big a worry or you don&#8217;t really care about them as long as your kids are ok. If you are honest enough to say you don&#8217;t care then fair play to you but don&#8217;t expect to get on your high moral horse to &#8220;Educationalists&#8221;</p>
<p>What hacks me off is people who think that High schools do a great job but just for &#8220;other people&#8217;s children&#8221;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Essentialist</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-270919</link>
		<dc:creator>Essentialist</dc:creator>
		<pubDate>Wed, 29 Oct 2008 01:51:25 +0000</pubDate>
		<guid isPermaLink="false">#comment-270919</guid>
		<description>Willis.

You are but one of the many lunatics in the &quot;educationalist&quot; asylum. The only issue for parents is the legal regulated provision of a trusted, objective test used for the post-primary transfer of pupils at age 11 The politicans are bankrupt of ideas - I provided the link to demonstrate same. Your eternal gratitude is welcome however you must realise that only genuine parental choice can save the education system from total chaos</description>
		<content:encoded><![CDATA[<p>Willis.</p>
<p>You are but one of the many lunatics in the &#8220;educationalist&#8221; asylum. The only issue for parents is the legal regulated provision of a trusted, objective test used for the post-primary transfer of pupils at age 11 The politicans are bankrupt of ideas &#8211; I provided the link to demonstrate same. Your eternal gratitude is welcome however you must realise that only genuine parental choice can save the education system from total chaos</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: willis</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-270878</link>
		<dc:creator>willis</dc:creator>
		<pubDate>Tue, 28 Oct 2008 22:35:12 +0000</pubDate>
		<guid isPermaLink="false">#comment-270878</guid>
		<description>Thank You Thank You

What a link.

On the issue of increased grammar schools enrolments resulting in ‘sink’ secondary schools, the UUP proposed that this would be addressed by such schools becoming specialist schools with a high emphasis for example on pastoral care.

And you think I am a looney-tune!</description>
		<content:encoded><![CDATA[<p>Thank You Thank You</p>
<p>What a link.</p>
<p>On the issue of increased grammar schools enrolments resulting in ‘sink’ secondary schools, the UUP proposed that this would be addressed by such schools becoming specialist schools with a high emphasis for example on pastoral care.</p>
<p>And you think I am a looney-tune!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Essentialist</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-270820</link>
		<dc:creator>Essentialist</dc:creator>
		<pubDate>Tue, 28 Oct 2008 18:12:05 +0000</pubDate>
		<guid isPermaLink="false">#comment-270820</guid>
		<description>Willis,

No mention of rolling out the Dickson Plan when it mattered. Perhaps you should cancel plans to move to Canada and find a nice affordable place in Craigavon to run your campaign..

See http://www.niassembly.gov.uk/education/2007mandate/responses/note.htm

&quot;A DUP representative on 27 June raised the issue of how we make the transition to the various types of school, e.g. grammar, secondary, specialist schools etc., with the children’s interest at the centre, rather than the various sectors wishing to maintain their particular ethos.

The individual sectors have been allowed to be the focus in education and the big decision now is that area-based planning should create total equality in education in the interests of the child. Only then would you get a natural resolution of the transfer issue.

Another DUP representative added that currently there is not sufficient protections in place for the controlled sectors. (more to come on this from the Essentialist)

The discussion moved on that segregation in our schools costs millions and we need to compromise – yet the various sectors are moving on with rationalisations within their sectors, e.g. CCMS.&quot;.................

Have you ever read such nonsense? The 1`1-plus  is alive and well. No need to move position when the crusaders provide just heat rather than light in their campaign to steal the ground and to to slay the Dragon. 

Seems to me as if the DUP are sliding towards compromise/ conceding. Not a wise move with the Assembly poised precariously. I wonder if they have adopted Sinn Fein&#039;s equality of outcome/result ideology in order to stay close to the trappings of power while the rest of us feel the harsh bite of reality?

Area Based Planning decided by ESA&#039;s Gavin Boyd and his &quot;expert&quot; goons. Don&#039;t think so friend.</description>
		<content:encoded><![CDATA[<p>Willis,</p>
<p>No mention of rolling out the Dickson Plan when it mattered. Perhaps you should cancel plans to move to Canada and find a nice affordable place in Craigavon to run your campaign..</p>
<p>See <a href="http://www.niassembly.gov.uk/education/2007mandate/responses/note.htm" rel="nofollow">http://www.niassembly.gov.uk/education/2007mandate/responses/note.htm</a></p>
<p>&#8220;A DUP representative on 27 June raised the issue of how we make the transition to the various types of school, e.g. grammar, secondary, specialist schools etc., with the children’s interest at the centre, rather than the various sectors wishing to maintain their particular ethos.</p>
<p>The individual sectors have been allowed to be the focus in education and the big decision now is that area-based planning should create total equality in education in the interests of the child. Only then would you get a natural resolution of the transfer issue.</p>
<p>Another DUP representative added that currently there is not sufficient protections in place for the controlled sectors. (more to come on this from the Essentialist)</p>
<p>The discussion moved on that segregation in our schools costs millions and we need to compromise – yet the various sectors are moving on with rationalisations within their sectors, e.g. CCMS.&#8221;&#8230;&#8230;&#8230;&#8230;&#8230;..</p>
<p>Have you ever read such nonsense? The 1`1-plus  is alive and well. No need to move position when the crusaders provide just heat rather than light in their campaign to steal the ground and to to slay the Dragon. </p>
<p>Seems to me as if the DUP are sliding towards compromise/ conceding. Not a wise move with the Assembly poised precariously. I wonder if they have adopted Sinn Fein&#8217;s equality of outcome/result ideology in order to stay close to the trappings of power while the rest of us feel the harsh bite of reality?</p>
<p>Area Based Planning decided by ESA&#8217;s Gavin Boyd and his &#8220;expert&#8221; goons. Don&#8217;t think so friend.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: willis</title>
		<link>http://sluggerotoole.com/2008/10/24/we-can-all-bring-out-experts/comment-page-2/#comment-270736</link>
		<dc:creator>willis</dc:creator>
		<pubDate>Tue, 28 Oct 2008 12:22:08 +0000</pubDate>
		<guid isPermaLink="false">#comment-270736</guid>
		<description>On the issue of DUP endorsement of the Dickson Plan.

http://www.niassembly.gov.uk/io/noday.htm

Dickson Plan for Education

That this Assembly agrees that the Craigavon based Dickson Plan for Education has served the people of Craigavon well; and calls on the Minister of Education to ensure it is preserved in any future arrangements for post-primary transfer.

[Mr S Moutray]
[Mr D Simpson]
[16 September 2008] 

That is both the DUPUpper Bann MLAs

David Simpson is the sort of politician for whom even the most potty-mouthed atavist might feel respect.</description>
		<content:encoded><![CDATA[<p>On the issue of DUP endorsement of the Dickson Plan.</p>
<p><a href="http://www.niassembly.gov.uk/io/noday.htm" rel="nofollow">http://www.niassembly.gov.uk/io/noday.htm</a></p>
<p>Dickson Plan for Education</p>
<p>That this Assembly agrees that the Craigavon based Dickson Plan for Education has served the people of Craigavon well; and calls on the Minister of Education to ensure it is preserved in any future arrangements for post-primary transfer.</p>
<p>[Mr S Moutray]<br />
[Mr D Simpson]<br />
[16 September 2008] </p>
<p>That is both the DUPUpper Bann MLAs</p>
<p>David Simpson is the sort of politician for whom even the most potty-mouthed atavist might feel respect.</p>
]]></content:encoded>
	</item>
</channel>
</rss>

<!-- Performance optimized by W3 Total Cache. Learn more: http://www.w3-edge.com/wordpress-plugins/

Page Caching using disk: enhanced (Requested URI is rejected)
Object Caching 594/598 objects using memcached

Served from: sluggerotoole.com @ 2012-02-12 15:56:58 -->
