tag:blogger.com,1999:blog-3038828360589919480.post6459689573106919922..comments2023-10-12T05:22:07.181-04:00Comments on The Prichard Blog!: Student data and the $650 million stimulus [Link Update]SPWestonhttp://www.blogger.com/profile/08602329486466534720noreply@blogger.comBlogger6125tag:blogger.com,1999:blog-3038828360589919480.post-63141255469509735482009-04-04T12:26:00.000-04:002009-04-04T12:26:00.000-04:00Richard,I meant people with psychometric credentia...Richard,<BR/><BR/>I meant people with psychometric credentials. I can't find any sign that the ACT test developers think that CPE is using the test in an appropriate way.SPWestonhttps://www.blogger.com/profile/08602329486466534720noreply@blogger.comtag:blogger.com,1999:blog-3038828360589919480.post-4829598035995871912009-04-04T10:01:00.000-04:002009-04-04T10:01:00.000-04:00Susan,The ACT is considered sufficiently accurate ...Susan,<BR/><BR/>The ACT is considered sufficiently accurate by our Council on Postsecondary Education that they use it to determine which students will need remedial courses in college. ACT also plays a factor in KEES scholarship awards. Those are high stakes uses, in my opinion. <BR/><BR/>The ACT is certainly far from perfect, but it is a good enough predictor that our legislature and our postsecondary folks are both comfortable enough with the test to use it in those ways.<BR/><BR/>Other tests are often used for identification and placement into special programs for students with learning disabilities. That, I would also submit, is a high stakes use.<BR/><BR/>In very sharp contrast, the CATS was never designed to generate individual student scores. In fact, the CATS’ matrixed testing design precludes validity at the individual student level. That is another point that NTAPAA raised in their letter, which I mentioned in an earlier comment.Richard Inneshttp://www.bluegrasspolicy-blog.blogspot.comnoreply@blogger.comtag:blogger.com,1999:blog-3038828360589919480.post-74043957178875317512009-04-03T17:48:00.000-04:002009-04-03T17:48:00.000-04:00Richard,Can you give an example of a test that is ...Richard,<BR/><BR/>Can you give an example of a test that is considered valid and reliable for high stakes decisions about individual students:<BR/><BR/>(a) by its own makers?<BR/>(b) by others with the relevant credentials?<BR/><BR/>My experience is that test developers are very careful to insist that the data from their tests will not not sufficient basis for high stakes decisions about individuals and to push hard for multiple other data sources to be considered.SPWestonhttps://www.blogger.com/profile/08602329486466534720noreply@blogger.comtag:blogger.com,1999:blog-3038828360589919480.post-29664600071714164592009-04-03T17:42:00.000-04:002009-04-03T17:42:00.000-04:00Susan,No Child Left Behind didn’t require data to ...Susan,<BR/><BR/>No Child Left Behind didn’t require data to be valid and reliable for individual students, just for student subgroups. And, in Kentucky, with our huge NCLB “N Number” loophole, that subgroup was pretty large.<BR/><BR/>It’s questionable that the KCCT even met the NCLB requirement, but in any event, NCLB never drilled down to individual students. If it had, Kentucky would have failed, as even the NTAPAA admitted the KCCT wasn’t valid and reliable for high stakes decisions for individual students.<BR/><BR/>I have that letter in PDF if anyone would like to see it. It will soon be available through the freedomkentucky.org Wiki site.Richard Inneshttp://www.bluegrasspolicy-blog.blogspot.comnoreply@blogger.comtag:blogger.com,1999:blog-3038828360589919480.post-53684797825572065962009-04-03T15:47:00.000-04:002009-04-03T15:47:00.000-04:00I'm mysteriously unable to fix the survey link! A...I'm mysteriously unable to fix the survey link! Above, the update has the whole ugly url and more detail on where to look in the application document.<BR/><BR/>Both the KCCT as administered from 2003 to 2006 and as revised and administered in 2007 and 2008 met the NCLB requirement that state assessments that must "be used for purposes for which such assessments are valid and reliable, and be consistent with relevant, nationally recognized professional and technical standards."[20 USC 6311(b)(3)(C)(iii)]<BR/><BR/>The augmented-NRT that Kentucky used from 2003 to 2006 never received that approvalSPWestonhttps://www.blogger.com/profile/08602329486466534720noreply@blogger.comtag:blogger.com,1999:blog-3038828360589919480.post-59844362330741336712009-04-03T13:05:00.000-04:002009-04-03T13:05:00.000-04:00Susan,I would argue, with good evidence, that Kent...Susan,<BR/><BR/>I would argue, with good evidence, that Kentucky did not meet the “Student-level test data” item, either, because the Kentucky Core Content Tests were not valid and reliable for individual students and we had no test in the program that was for elementary schools – until Senate Bill 1 came along. It’s looking more and more like a good thing that this bill was passed.<BR/><BR/>I can’t find where you got your information that US Ed says Kentucky meets 9 of the 10 requirements.<BR/><BR/>The link to the “data quality survey” is broken. <BR/><BR/>The “application for stabilization funds” link took me to a huge set of options, which at first glance didn’t seem to offer any state-level determinations of the type you discuss, but maybe there is something well-buried in that huge set of links. Can you provide a little more explicit detail?Richard Inneshttp://www.bluegrassblog.orgnoreply@blogger.com